Reduced runtime for radosbench to 600

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #823 from ceph/wip-dir-rstats

add test for norstats functionality

Merge pull request #776 from ceph/wip-sharded-scan

tasks/cephfs: test sharded cephfs-data-scan

Merge pull request #789 from ceph/wip-14146

tasks/cephfs: check status asok output while in reconnect

Merge pull request #787 from ceph/wip-13903

Wip 13903 tests

cephfs/test_full: add some gratuitous debugging

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-14365' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/805

Merge pull request #820 from ceph/wip-rados-yaml

Wip rados yaml

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>

rados/upgrade: add '%' to combine rados.yaml with other yamls

Signed-off-by: Samuel Just <sjust@redhat.com>

rados/: remove unnecessary rados.yaml entries

Signed-off-by: Samuel Just <sjust@redhat.com>

Whitelisted 'soft lockup' and 'detected stalls on CPUs'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 367bd5b49c1584b8132fb312be3af83486001fa9)

tasks/cephfs: add TestConfigCommands

Get some coverage on the otherwise rarely touched
injectargs and `config set` interfaces.

Fixes: #14365
Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: run ceph-fuse in foreground

Previously was running this in background, which prevented
checking for nonzero exit codes.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: optionally check result of fuse proc on umount

For cases where the client process successfully unmounts,
but then crashes before finishing.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: make FuseMount.admin_socket public

For tests that specifically want to exercise an
asok operation (the test is responsible for
verifying that its mount object really is a
FuseMount and not a KernelMount)

Signed-off-by: John Spray <john.spray@redhat.com>

Merge remote-tracking branch 'gh/jewel'

Changed centos version to 7.2

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 3f4a5caeb2f1fffc302be69d3ef06fff3566fe7e)

Changed centos version to 7.2

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 3f4a5caeb2f1fffc302be69d3ef06fff3566fe7e)

Made disk size in openstack 40GB, so osd won't run out of space

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 9e28d21adc7d891a9ad3426170f147164b2778ae)

Adde + in the openstack.yaml dir
Fixes failures in #14635

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit d4fd02e9d804d5d5379fc8150ad63d412a9b5d3b)

Merge pull request #813 from ceph/wip-whitelist-jewel

Whitelisted "wrongly marked me down" for the tiering tests

Whitelisted "wrongly marked me down" for the tiering tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #807 from ceph/wip-config

suites/rados: test random queue options

add test for norstats functionality

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Whitelisted "soft lockup"
to avoid failures on slow nodes like in #14618

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 9724dee9d9d2921062d86bbb8fac17c554e7984c)

Merge pull request #810 from ceph/wip-schedule_rados-master

Made rados runs in ovh call vps.yaml

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Made rados runs in ovh call vps.yaml

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Initial draft for infernalis stable upgrade tests
Fixed indentation
Replace ‘description’ with ’meta’
Incorporated Josh's comments
Moved all overrides to the top

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit f9e2851d47d3a2b5910a9d87bb6577ee63546d5e)

suites/rados: test random queue options

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/cephfs: test sharded cephfs-data-scan

Signed-off-by: John Spray <john.spray@redhat.com>

Added point-to-point suite
Added parallel suite
Added stree-split suite
Added stress-split-erasure-code suite
Added stress-split-erasure-code-x96-64 suite

Signed-off-by: yuriw <yuri.weinstein@gmail.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit e7732cce73af2fed55a957b5529db93e3ff3ea5a)

Added point-to-point suite
Added parallel suite
Added stree-split suite
Added stress-split-erasure-code suite
Added stress-split-erasure-code-x96-64 suite

Signed-off-by: yuriw <yuri.weinstein@gmail.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit e7732cce73af2fed55a957b5529db93e3ff3ea5a)

Merge pull request #797 from ceph/wip-fusestore

rados/objecststore/fusestore.yaml: run ceph-objectstore-tool fuse test

Merge remote-tracking branch 'gh/jewel'

Merge pull request #801 from ceph/jewel-14395

suites/fs: cephfs_journal_tool: wait for health after restart

Merge branch 'greg-fs-testing'

Merge branch 'jewel-14395' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/801

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #767 from ceph/wip-14048

tasks: add TestSessionMap.test_[mount|tell]_conn_close

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #680 from ceph/wip-manila

Add testing for CephFSVolumeClient

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #798 from ceph/jewel-14254

tasks/cephfs: test for race between cap flush and clientreplay

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/jewel'

Merge pull request #678 from ceph/wip-fs-snaptests

suites/fs: enable all snapshost test scripts

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

suites/fs: fix ceph.restart syntax

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-14195' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/791

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-full-msg' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/786

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-global-config' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/784

Conflicts:
tasks/cephfs/vstart_runner.py
Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-14048' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/767

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-manila' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/680

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/jewel-14254' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/798

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #803 from ceph/wip-rbd-nbd-jewel

rbd: rbd-nbd can only run on Ubuntu
librbd: journal replay should honor inter-event dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rbd: rbd-nbd can only run on Ubuntu

NBD support is not available in RHEL/CentOS 7

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #802 from ceph/wip-whitelist-jewel

Whitelisted 'wrongly marked me down'

Reviewed-by: Samuel Just <sjust@redhat.com>

Whitelisted 'wrongly marked me down'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

suites/fs: cephfs_journal_tool: wait for health after restart

Fixes: #14395
Signed-off-by: Yan, Zheng <zyan@redhat.com>

tasks/cephfs: test for race between cap flush and clientreplay

Signed-off-by: Yan, Zheng <zyan@redhat.com>

tasks/cephfs: override max_pgs_per_osd in TestVolumeClient

Because volume client cues its PG counts from the
mon pg warn max per osd setting, the teuthology template's
ultra-high 10000 setting causes problems.  Force it down
to the usual sensible default for this test.

Also update vstart_runner to populate ctx.daemons so that the test
can restart daemons the same way on vstart as in full blown teuthology.

For branch wip-manila

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: pg_num check in volume_client test

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix raising from RemoteProcess.wait()

...in the case where we call wait() on an already-finished
process.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix vstart's LocalDaemon.proc

This class is meant to quack like a DaemonState,
so it needs to expose a .proc attribute.  This
was breaking TestDamageTable.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix wait in test_volume_client

Signed-off-by: John Spray <john.spray@redhat.com>

suites: add an extra client to fs/recovery

The volumeclient test wants 3, and the rest of the tests
can just ignore it.

Signed-off-by: John Spray <john.spray@redhat.com>

suites: add yaml for TestVolumeClient

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add test_volume_client

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix fuse killing in vstart

The "ps au" output was truncating lines which could cause
processes to get missed in some cases, like where there
is a long --client-mountpoint argument.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: write_n_mb optionally background

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: reset IDs of mounts between tests

because volumeclient test twiddles the IDs to
match the auth identities it creates.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: clear extra auth ids on test start

Because new volumeclient tests will be creating IDs
instead of modifying the default ones.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add test case auth_list helper

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #743 from ceph/wip-root-metadata

tasks/cephfs: add TestSessionMap.test_session_reject

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #611 from ceph/wip-libcephfs-acl

suites/fs: test ceph-fuse with libcephfs permission check

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

rados/objecststore/fusestore.yaml: run ceph-objectstore-tool fuse test

Signed-off-by: Sage Weil <sage@redhat.com>

Fixed symblink for os configs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 0915747895b20b856a173d58f515af6b03381406)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
Conflicts:
distros/supported/centos_7.2.yaml

Merge pull request #796 from ceph/wip-fix-sumblink-distros

Fixed symblink for os configs

Fixed symblink for os configs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #754 from ceph/wip_add_centos71_master

Removed CentOS 7.1 and added CentOS 7.2 instead

Change supported ditros to use latest CentOS 7.2

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

tasks: add TestSessionMap.test_[mount|tell]_conn_close

To check that teardown is happening correctly when
sending commands to an MDS.

Fixes: #14048
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #794 from ceph/wip-rbd-valgrind-jewel

suites/rbd: avoid redundant helgrind tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

suites/rbd: avoid redundant helgrind tests

Allow rbd_fsx to accept an override for which valgrind tool to use.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #793 from ceph/wip-centos-71-72

suites/teuthology: Add CentOS 7.1 and 7.2

Merge pull request #792 from ceph/wip_fix_h-x_jewel_3

Added ditros to f-h-x-offline, tiering, v0-94-4-stop tests

suites/teuthology: Add CentOS 7.1 and 7.2

Signed-off-by: Zack Cerza <zack@redhat.com>

Added ditros to f-h-x-offline, tiering, v0-94-4-stop tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

suites: turn up debug for TestFull

Because these tests exercise subtle interactions
in the Client->ObjectCacher->Objecter stack,
enable the verbose logging for the lower layers
too.

Signed-off-by: John Spray <john.spray@redhat.com>

suites: debug on client 0/1 instead of all

...because otherwise every CLI invokation spits
out a client.admin verbose log, and it's annoying.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #790 from ceph/wip_fix_h-x_jewel_2

Removed point-to-point-x test, will need to add jewel specific later

Removed point-to-point-x test, will need to add jewel specoific later
http://tracker.ceph.com/issues/14339

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

tasks/cephfs: check status asok output while in reconnect

Mostly checking the output from the status asok is awkward
because you need to get the system stuck in a particular
state to do so.  However, we already have a test here
that sticks the system in reconnect, so here's some
very light test coverage for that asok.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add TestStrays.test_dir_deletion

test_ops_throttle was catching misbehaviour when
deleting lots of files in a directory, but
we should have a non-throttle test for that case
so that it's clearer what's gone wrong.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: better message from test_full_fsync

When it gives an error from the unexpected place,
say so.

Signed-off-by: John Spray <john.spray@redhat.com>

suites/fs: update log whitelist for test_session_reject

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: generate mount paths on the fly

...because new tests that modify the client ID will
get confused about whether they're mounted or not, otherwise.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: support mount_path in Mount subclasses

For e.g. volumeclient guests that want to mount
a subpath.

Signed-off-by: John Spray <john.spray@redhat.com>

Revert "pg: add test cases for pg list_missing on EC pool"

This reverts commit 6fb44db9cbc91754bfab4c4312ba806febf65274.

Merge pull request #785 from ceph/wip-14257

tasks/cephfs: fix wait_for_state timing

tasks/cephfs: fix wait_for_state timing

Return actual elapsed wallclock time instead of
the number of times we polled.

Fixes: #14257
Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: update vstart_runner for teuthology change

Previously teuthology read test path from ctx.teuthology_config,
now it reads it from the global teuthology.config.config object.

This was breaking test_journal_migration because it uses tasks/workunit,
when run with vstart_runner.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #780 from ceph/jewel-14196

tasks/cephfs: fix race in test_damage

Merge remote-tracking branch 'origin/jewel'

Merge remote-tracking branch 'origin/jewel-14196'