Merge pull request #1233 from ceph/wip-17759

Added short pg log entries to rgw test

Reviewed-by: Samuel Just <sjust@redhat.com>

Added short pg log entries to rgw test

This change aims to test rgw with messenger failure injection
and very short logs.

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>

objectstore/bluestore: disable bluefs env mirror

We can't atomically append to two env backends, which means
that we can see size mismatches when we inject failures.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1232 from ceph/wip-blackhole

tasks: use new generic objectstore_blackhole option

tasks: use new generic objectstore_blackhole option

Signed-off-by: Sage Weil <sage@redhat.com>

rados/objectstore/objectstore: suppress core dumps

Some of these tests to fork and assertion tests that leave
core behind, and that is normal.  Disable core dumps.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1086 from jcsp/wip-ceph-mgr

Create ceph-mgr tests

Reviewed-by: Kefu Chai <kchai@redhat.com>

tasks: update cephfs_test_runner for mgr

Signed-off-by: John Spray <john.spray@redhat.com>

packages: install ceph-mgr

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: update to run ceph-mgr daemons

Signed-off-by: John Spray <john.spray@redhat.com>

suites: create mgr yaml

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: create ceph-mgr tests

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: refactor test case class

A more generic CephTestCase and CephCluster, for
writeing non-cephfs test cases.

This avoids overloading one class with the functionality
needed by lots of different subsystems.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #1219 from ceph/wip-cephfs-scan-links

tasks/cephfs: add TestDataScan.test_scan_links

Reviewed-by: John Spray <john.spray@redhat.com>

tasks/cephfs: fixup test_backtrace_repair

The branches got mixed up and the merged one wasn't
the same one that was tested.  This is the one that
works!

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #1220 from ceph/wip-10235

Remove obsolete calamari code

Merge pull request #1145 from michaelsevilla/mantle

mds: add tests for mantle (programmable balancer)

Reviewed-by: John Spray <john.spray@redhat.com>

Remove obsolete calamari code

It's dead, Jim.

Fixes: http://tracker.ceph.com/issues/10235
Signed-off-by: Dan Mick <dan.mick@redhat.com>

tasks/cephfs: add TestDataScan.test_scan_links

Signed-off-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #1218 from jcsp/wip-backtrace-repair

tasks/cephfs: add TestForwardScrub.test_backtrace_repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

tasks/cephfs: add TestForwardScrub.test_backtrace_repair

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #1216 from ceph/wip-pg-files

tasks/cephfs: add TestDataScan.test_pg_files

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #1217 from ceph/wip-17558

mon-seesaw: add mon-seesaw test and mon_seesaw task

Reviewed-by: Sam Just <sjust@redhat.com>

mon-seesaw: add mon-seesaw test and mon_seesaw task

mon_seesaw task replaces a monitor with a newly reployed one, in a
single-mon test including this task OSDs will not be able to connect
to cluster if the tracker#17558 is not fixed on the monitor side.

http://tracker.ceph.com/issues/17558
Signed-off-by: Kefu Chai <kchai@redhat.com>

tasks/cephfs: add TestDataScan.test_pg_files

Fixes: http://tracker.ceph.com/issues/17249
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #1213 from jcsp/wip-generate-caps

tasks/ceph: move generate_caps from teuthology

Merge pull request #1202 from ajarr/wip-check-volume-size

test_volume_client: check volume size

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #1166 from ajarr/wip-17216

tasks/cephfs : test recovery of partial auth update

Reviewed-by: John Spray <john.spray@redhat.com>

tasks/ceph: move generate_caps from teuthology

This was only used in this task, and it is much too
ceph-specific to belong in teuthology.

Fixes: http://tracker.ceph.com/issues/17614
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #1212 from ceph/wip-osd-recovery

rados/singleton/all/osd-recovery*: disable fast fail

rados/singleton/all/osd-recovery*: disable fast fail

This test relies on being able to kill two OSDs before
they detect the failures on their own.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1210 from ceph/wip-add-jewel-x

Added jewel-x-singleton

Added jewel-x-singleton

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #1209 from ceph/wip-rados-upgrade

rados/upgrade: remove hammer-x-singleton

rados/upgrade: remove hammer-x-singleton

Upgrades must stop at jewel now.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1208 from ceph/wip-rgw-min-size

rados: move rgw_snaps from thrash to basic

rados: move rgw_snaps from thrash to basic

rgw does not tolerate min_size=2 + size=2 thrashing (slow
rados ops).

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1207 from ceph/wip-kraken

more kraken upgrade fixes

Merge pull request #1200 from ceph/wip-rebuild-mondb

tasks/rebuild_mondb.py: fill up the caps in the keyring

upgrade/jewel-x: fix require_kraken_osds flag

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/jewel-x: drop 'failed to encode' crc mismatch whitelist

We should no longer trigger these warnings now that we
build the OSDMap based on require_*_osds flags.

Signed-off-by: Sage Weil <sage@redhat.com>

rados: fix require_kraken_osds flag

Signed-off-by: Sage Weil <sage@redhat.com>

rados/singleton-nomsgr: drop 16113 and 13234

A stop at jewel is required, and these are pre-jewel bugs.

Signed-off-by: Sage Weil <sage@redhat.com>

rados: infernalis -> kraken is not supported; stop at jewel

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1206 from ceph/wip-thrash-min-size-2

rados: move readwrite test out of thrash matrix

rados: move readwrite test out of thrash matrix

The thrash matrix includes min_size = 2 and size = 2.  This
is fine and good, except that the inevitable slow rados ops
that generates make readwrite.yaml issue timeouts and
fail.  Since the workload isn't meant to tolerate slow
requests, move it into the basic/ group.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1204 from ceph/wip-jd-testing

suites/upgrade: additional point-to-point Jewel upgrade workaround

Merge pull request #1205 from ceph/wip-kraken

upgrade: set kraken osd flag on upgrade

Reviewed-by: Kefu Chai <kchai@redhat.com>

upgrade/jewel-x: set kraken flag when osds finish

Signed-off-by: Sage Weil <sage@redhat.com>

rados/singleton-nomsgr: set require_*_osds in upgrade tests

Signed-off-by: Sage Weil <sage@redhat.com>

test_volume_client: remove superfluous arguments

Signed-off-by: Ramana Raja <rraja@redhat.com>

test_volume_client: check volume size

Check that the total size shown by the df output of a mounted volume
is same as the volume size and the quota set on the volume.

Signed-off-by: Ramana Raja <rraja@redhat.com>

suites/upgrade: additional point-to-point Jewel upgrade workaround

Upgrade happens in parallel with cls_rbd test run which can result in
a false-positive test failure.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tasks/rebuild_mondb.py: fill up the caps in the keyring

we will fail 'ceph-monstore-tool' command if the caps is empty so user
won't assign a key without any caps when rebuilding the monstore.

Signed-off-by: Kefu Chai <kchai@redhat.com>

releases/kraken.yaml: set require_kraken_osds

Signed-off-by: Sage Weil <sage@redhat.com>

releases/jewel: set require_jewel_osds

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1187 from ceph/wip-getuid

fs: enable ceph-fuse permission checking for all pjd suites

Merge pull request #1196 from ceph/wip-dump-stuck

tasks/dump_stuck: fix failure

/home/teuthworker/archive/sage-dump-stuck/457624

Merge pull request #1189 from ceph/wip-zafman-fixes

Fixes for rados suite test caused failures and improvements

Reviewed-by: Samuel Just <sjust@redhat.com>

tasks/dump_suck: mark down osds one at a time

This forces them to be unclean, *then* stale.  This ensures
that after they are both down they are both *always* unclean,
whereas previously it would be possible for them to be only
stale and not unclean.

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/dump_stuck: fix unclean count

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/dump_stuck: more verbose

Signed-off-by: Sage Weil <sage@redhat.com>

multibench: Fixed so I can use this standalone

Signed-off-by: David Zafman <dzafman@redhat.com>

ceph_manager: do_pg_scrub() don't resubmit a request for 2 minutes

Add 6 minute fatal timeout
Warn when repair is being resubmitted because it causes races

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #1194 from ceph/wip-17416

suites/rbd: increase timeout for rbd-mirror stress test

suites/rbd: increase timeout for rbd-mirror stress test

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mds: add tests for mantle (programmable balancer)
- rebased to add block rados pull test

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>

fs: enable ceph-fuse permission checking for all pjd suites

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #1193 from ceph/wip-16016

suites: update log whitelist for scrub msg

Merge pull request #1184 from ceph/rgw-lifecycle-testing

rgw - Add config for testing lifecycle expiration

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

suites: update log whitelist for scrub msg

Fixes: http://tracker.ceph.com/issues/16016
Signed-off-by: John Spray <john.spray@redhat.com>

Merge remote-tracking branch 'upstream/pull/1176/head'

* upstream/pull/1176/head:
  tasks/cephfs: add default paths to vstart_runner

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

tasks/cephfs: add default paths to vstart_runner

So that for folks with sources in typical locations
(or typical on my workstation at least!) invoking
vstart_runner is less of a mouthful.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #1188 from ceph/revert-1128-wip-16805

Revert "ceph_manager: lower mon_reweight_min_bytes_per_osd to 10"

Reviewed-by: Samuel Just <sjust@redhat.com>

Revert "ceph_manager: lower mon_reweight_min_bytes_per_osd to 10"

Merge pull request #1185 from jcsp/wip-dirfrags-2

tasks/ceph: enable dirfrags in cephfs

Merge pull request #1186 from ceph/wip-ubuntu-java

suites/fs: pin java test to ubuntu

tasks/ceph: enable dirfrags in cephfs

Otherwise places we set mds_bal_frag have
no effect.

Signed-off-by: John Spray <john.spray@redhat.com>

suites/fs: remove duplicated frag_enable.yaml

...so that all these point back to basic/dirfrag

Signed-off-by: John Spray <john.spray@redhat.com>

rgw - Add config for testing lifecycle expiration

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #1177 from ceph/wip-librbd-disable-helgrind

suites/rbd: remove helgrind test cases

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #1180 from ceph/wip-bluestore-code

misc fixes to test bluestore, but not actual tests in the suite (yet)

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

tasks/ceph_manager: add bdev_inject_crash_probability support

Only do the failure injection 50% of the time; otherwise, just
kill as usual.

Signed-off-by: Sage Weil <sage@redhat.com>
# Conflicts:
# tasks/ceph_manager.py

inject bdev failures when killing osd on bluestore

Signed-off-by: Sage Weil <sage@redhat.com>

objectstore/bluestore: bluefs env mirror

Catch bugs in bluefs or rocksdb env layer.

Signed-off-by: Sage Weil <sage@redhat.com>

objectstore/bluestore.yaml: debug rocksdb

Signed-off-by: Sage Weil <sage@redhat.com>

objectstore: add filestore and bluestore stubs

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/ceph_manager: respect bdev_inject_crash in kill_osd()

Note that this will only work with bluestore osds.

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/thrashosds: fix powercycle, bdev_inject_crash

The CephManager.kill_osd expects these in its config, not
Thrasher's.

Signed-off-by: Sage Weil <sage@redhat.com>

rados/basic/tasks/repair_test: enable bluestore error injection

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1179 from ceph/wip-16688-master

Removed 11429 config

Reviewed-by: Samuel Just <sjust@redhat.com>

Removed 11429 config

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #1178 from ceph/wip-smoke-krbd-iozone

smoke: mask out unsupported image features for krbd iozone test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

smoke: mask out unsupported image features for krbd iozone test

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #1127 from ryneli/master

suites/rados: add test case for rockdb's envlibrados

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

suites/rbd: remove helgrind test cases

Helgrind cannot properly handle Ceph's use of std::mutex --
resulting in numerous false positives and potential assertion
failures.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1169 from ceph/wip-kefu-17179

tasks: add rebuild_mondb

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #1136 from ceph/wip-16129

 rgw: add sleep to let the sync agent init

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #978 from ceph/wip-ec-fast-read

test fast ec read

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #1171 from dachary/wip-16506-ceph-coverage

upgrade: ceph-test is needed for ceph-coverage

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>