Merge pull request #864 from ceph/wip-15012-jewel

Removed branch: firefly from 4-after.yaml

Removed branch: firefly from 4-after.yaml

Fixes #15012

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #812 from ceph/jewel-10436

suites/fs: enable all snapshost test scripts

Reduced runtime for radosbench to 600

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit a72bba29103cd287131eb7b56953c417649fed5d)

rados/upgrade: add '%' to combine rados.yaml with other yamls

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit a13d9e89a8fb280ef1538104e2f4f9c77d288501)

rados/: remove unnecessary rados.yaml entries

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit ebea8ade8ec0aa41058fabed5ac7796ee60b20a7)

Merge branch 'jewel' of https://github.com/ceph/ceph-qa-suite into jewel

Merge pull request #819 from ceph/wip-whitelist-jewel

Whitelisted 'soft lockup' and 'detected stalls on CPUs'

Whitelisted 'soft lockup' and 'detected stalls on CPUs'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge remote-tracking branch 'gh/jewel'

Changed centos version to 7.2

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 3f4a5caeb2f1fffc302be69d3ef06fff3566fe7e)

Changed centos version to 7.2

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 3f4a5caeb2f1fffc302be69d3ef06fff3566fe7e)

Made disk size in openstack 40GB, so osd won't run out of space

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 9e28d21adc7d891a9ad3426170f147164b2778ae)

Adde + in the openstack.yaml dir
Fixes failures in #14635

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit d4fd02e9d804d5d5379fc8150ad63d412a9b5d3b)

Merge branch 'jewel' of https://github.com/ceph/ceph-qa-suite into jewel

Merge pull request #813 from ceph/wip-whitelist-jewel

Whitelisted "wrongly marked me down" for the tiering tests

Whitelisted "wrongly marked me down" for the tiering tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #807 from ceph/wip-config

suites/rados: test random queue options

suites/fs: enable all snapshost test scripts

Signed-off-by: Yan, Zheng <zyan@redhat.com>

Whitelisted "soft lockup"
to avoid failures on slow nodes like in #14618

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 9724dee9d9d2921062d86bbb8fac17c554e7984c)

Merge pull request #810 from ceph/wip-schedule_rados-master

Made rados runs in ovh call vps.yaml

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Made rados runs in ovh call vps.yaml

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Initial draft for infernalis stable upgrade tests
Fixed indentation
Replace ‘description’ with ’meta’
Incorporated Josh's comments
Moved all overrides to the top

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit f9e2851d47d3a2b5910a9d87bb6577ee63546d5e)

suites/rados: test random queue options

Signed-off-by: Sage Weil <sage@redhat.com>

Added point-to-point suite
Added parallel suite
Added stree-split suite
Added stress-split-erasure-code suite
Added stress-split-erasure-code-x96-64 suite

Signed-off-by: yuriw <yuri.weinstein@gmail.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit e7732cce73af2fed55a957b5529db93e3ff3ea5a)

Added point-to-point suite
Added parallel suite
Added stree-split suite
Added stress-split-erasure-code suite
Added stress-split-erasure-code-x96-64 suite

Signed-off-by: yuriw <yuri.weinstein@gmail.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit e7732cce73af2fed55a957b5529db93e3ff3ea5a)

Merge pull request #797 from ceph/wip-fusestore

rados/objecststore/fusestore.yaml: run ceph-objectstore-tool fuse test

Merge remote-tracking branch 'gh/jewel'

Merge pull request #801 from ceph/jewel-14395

suites/fs: cephfs_journal_tool: wait for health after restart

Merge branch 'greg-fs-testing'

Merge branch 'jewel-14395' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/801

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #767 from ceph/wip-14048

tasks: add TestSessionMap.test_[mount|tell]_conn_close

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #680 from ceph/wip-manila

Add testing for CephFSVolumeClient

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #798 from ceph/jewel-14254

tasks/cephfs: test for race between cap flush and clientreplay

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/jewel'

Merge pull request #678 from ceph/wip-fs-snaptests

suites/fs: enable all snapshost test scripts

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

suites/fs: fix ceph.restart syntax

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-14195' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/791

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-full-msg' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/786

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-global-config' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/784

Conflicts:
tasks/cephfs/vstart_runner.py
Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-14048' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/767

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-manila' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/680

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/jewel-14254' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/798

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #803 from ceph/wip-rbd-nbd-jewel

rbd: rbd-nbd can only run on Ubuntu
librbd: journal replay should honor inter-event dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rbd: rbd-nbd can only run on Ubuntu

NBD support is not available in RHEL/CentOS 7

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #802 from ceph/wip-whitelist-jewel

Whitelisted 'wrongly marked me down'

Reviewed-by: Samuel Just <sjust@redhat.com>

Whitelisted 'wrongly marked me down'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

suites/fs: cephfs_journal_tool: wait for health after restart

Fixes: #14395
Signed-off-by: Yan, Zheng <zyan@redhat.com>

tasks/cephfs: test for race between cap flush and clientreplay

Signed-off-by: Yan, Zheng <zyan@redhat.com>

tasks/cephfs: override max_pgs_per_osd in TestVolumeClient

Because volume client cues its PG counts from the
mon pg warn max per osd setting, the teuthology template's
ultra-high 10000 setting causes problems.  Force it down
to the usual sensible default for this test.

Also update vstart_runner to populate ctx.daemons so that the test
can restart daemons the same way on vstart as in full blown teuthology.

For branch wip-manila

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: pg_num check in volume_client test

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix raising from RemoteProcess.wait()

...in the case where we call wait() on an already-finished
process.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix vstart's LocalDaemon.proc

This class is meant to quack like a DaemonState,
so it needs to expose a .proc attribute.  This
was breaking TestDamageTable.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix wait in test_volume_client

Signed-off-by: John Spray <john.spray@redhat.com>

suites: add an extra client to fs/recovery

The volumeclient test wants 3, and the rest of the tests
can just ignore it.

Signed-off-by: John Spray <john.spray@redhat.com>

suites: add yaml for TestVolumeClient

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add test_volume_client

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fix fuse killing in vstart

The "ps au" output was truncating lines which could cause
processes to get missed in some cases, like where there
is a long --client-mountpoint argument.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: write_n_mb optionally background

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: reset IDs of mounts between tests

because volumeclient test twiddles the IDs to
match the auth identities it creates.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: clear extra auth ids on test start

Because new volumeclient tests will be creating IDs
instead of modifying the default ones.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add test case auth_list helper

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #743 from ceph/wip-root-metadata

tasks/cephfs: add TestSessionMap.test_session_reject

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #611 from ceph/wip-libcephfs-acl

suites/fs: test ceph-fuse with libcephfs permission check

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

rados/objecststore/fusestore.yaml: run ceph-objectstore-tool fuse test

Signed-off-by: Sage Weil <sage@redhat.com>

Fixed symblink for os configs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 0915747895b20b856a173d58f515af6b03381406)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
Conflicts:
distros/supported/centos_7.2.yaml

Merge pull request #796 from ceph/wip-fix-sumblink-distros

Fixed symblink for os configs

Fixed symblink for os configs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #754 from ceph/wip_add_centos71_master

Removed CentOS 7.1 and added CentOS 7.2 instead

Change supported ditros to use latest CentOS 7.2

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

tasks: add TestSessionMap.test_[mount|tell]_conn_close

To check that teardown is happening correctly when
sending commands to an MDS.

Fixes: #14048
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #794 from ceph/wip-rbd-valgrind-jewel

suites/rbd: avoid redundant helgrind tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

suites/rbd: avoid redundant helgrind tests

Allow rbd_fsx to accept an override for which valgrind tool to use.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #793 from ceph/wip-centos-71-72

suites/teuthology: Add CentOS 7.1 and 7.2

Merge pull request #792 from ceph/wip_fix_h-x_jewel_3

Added ditros to f-h-x-offline, tiering, v0-94-4-stop tests

suites/teuthology: Add CentOS 7.1 and 7.2

Signed-off-by: Zack Cerza <zack@redhat.com>

Added ditros to f-h-x-offline, tiering, v0-94-4-stop tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

suites: turn up debug for TestFull

Because these tests exercise subtle interactions
in the Client->ObjectCacher->Objecter stack,
enable the verbose logging for the lower layers
too.

Signed-off-by: John Spray <john.spray@redhat.com>

suites: debug on client 0/1 instead of all

...because otherwise every CLI invokation spits
out a client.admin verbose log, and it's annoying.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #790 from ceph/wip_fix_h-x_jewel_2

Removed point-to-point-x test, will need to add jewel specific later

Removed point-to-point-x test, will need to add jewel specoific later
http://tracker.ceph.com/issues/14339

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

tasks/cephfs: better message from test_full_fsync

When it gives an error from the unexpected place,
say so.

Signed-off-by: John Spray <john.spray@redhat.com>

suites/fs: update log whitelist for test_session_reject

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: generate mount paths on the fly

...because new tests that modify the client ID will
get confused about whether they're mounted or not, otherwise.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: support mount_path in Mount subclasses

For e.g. volumeclient guests that want to mount
a subpath.

Signed-off-by: John Spray <john.spray@redhat.com>

Revert "pg: add test cases for pg list_missing on EC pool"

This reverts commit 6fb44db9cbc91754bfab4c4312ba806febf65274.

Merge pull request #785 from ceph/wip-14257

tasks/cephfs: fix wait_for_state timing

tasks/cephfs: fix wait_for_state timing

Return actual elapsed wallclock time instead of
the number of times we polled.

Fixes: #14257
Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: update vstart_runner for teuthology change

Previously teuthology read test path from ctx.teuthology_config,
now it reads it from the global teuthology.config.config object.

This was breaking test_journal_migration because it uses tasks/workunit,
when run with vstart_runner.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #780 from ceph/jewel-14196

tasks/cephfs: fix race in test_damage

Merge remote-tracking branch 'origin/jewel'

Merge remote-tracking branch 'origin/jewel-14196'

Merge remote-tracking branch 'origin/wip-13583'

tasks/cephfs: fix wait in assert_cluster_log

I had the monc tick interval wrong.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fixes to FuseMount

This was getting stressed in new ways by
TestSessionMap.test_session_reject, which
has a mount that fails initially.

Two changes here:
 * Raise CommandFailedError instead of RuntimeError when
   a mount fails (i.e. catch process termination instead
   of timing out on /sys/ population)
 * Generalise error handling on umount, so that we only
   raise the exception on an umount failure if the mount
   appears to really not be unmounted.  There is some
   EINVAL corner case that was getting triggered by the test.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add TestSessionMap.test_session_reject

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add assert_cluster_log

For capturing the cluster log and asserting
that we see a particular expected message.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: add run_ceph_w to CephManager

Analogous to raw_cluster_command, but instead
of calling blocking CLI command we're invoking
the -w mode.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: new hooks for auth keys and config

Used when configuring clients with dynamically
generated auth keys, and pointing them at mount paths.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #775 from ceph/wip-stat-error

repair_test: Add whitelist item for new stat error message