Fixed missing ceph task

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rados/singleton-nomsgr/all/alloc-hint: enable xfs extsize for test

This is off by default; enable it for this test.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 02a6c917eca6237118163ecd49ed7ca56bda275b)

Merge pull request #63 from ceph/wip-rgw-firefly

only test rgw on new firefly releases to avoid old bug

upgrade/firefly: only test rgw on newer firefly releases

This avoids #8311 by not testing rgw when the blank pool bug was present.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #58 from ceph/wip_add_v0.80.3

Added v0.80.3 to the mix

Removed whitelist lines since it's not needed for version v0.80.3

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added v0.80.3 to the mix

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'wip_stable_upgrade2' into firefly

upgrade/firefly: don't use overrides

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: ignore mon scrub errors from early firefly versions

See #8815

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: do intermediate s3tests on original test set

The later s3-tests fail on early firefly point releases.

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: upgrade to firefly, not dumpling

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: ignore crush tunables on upgrade

..then adjust them

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: fix final steps

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: upgrade mds after osd

Signed-off-by: Sage Weil <sage@redhat.com>

suites/upgrade/firefly: test rgw at the end

...and do all final tests for all runs

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: consolidate into a single collection

Signed-off-by: Sage Weil <sage@inktank.com>

Added upgrade tests - stable

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rgw: update idle_timeout for rgw_s3tests_multiregion.yaml

Fixes: #8194
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

rados: add ec and rep lost_unfound_delete tests

Signed-off-by: Samuel Just <sam.just@inktank.com>

rados/singleton/all/cephtool: whitelist scrub vs split vs agent issue

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: bump up timeout for misc.yaml

This keeps timing out after 3h.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #26 from ceph/wip-rbd-cache

test rbd with cache pool

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

rbd/thrash: factor out install + ceph

Signed-off-by: Sage Weil <sage@inktank.com>

rbd: do most tests with a (small) cache pool in front

Signed-off-by: Sage Weil <sage@inktank.com>

rbd/basic: factor out install + ceph

Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash: whitelist 'must scrub before tier agent can activate'

Signed-off-by: Sage Weil <sage@inktank.com>

rados: include objectstore tests

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #25 from ceph/wip-fastdumpemp-wusui

Reduce runs in the dumpling-emperor upgrade suite.

big: test xfs + btrfs

Note that previously we were specifying neither, so the OSDs were running
off of /.

Signed-off-by: Sage Weil <sage@inktank.com>

Reduce runs in the dumpling-emperor upgrade suite.

Add + to 2-workload, 4-workload and 6-final-workload
suites.  Reduce 5-upgrade-sequence to only run two
tests and make sure upgrades to emperor occur in each
sequence.  Fix swift.yaml to not include rgw: clause
(this is already done by s3tests.yaml).

Fixes: #8051
Signed-off-by: Warren Usui <warren.usui@inktank.com>

changed idle_timeout to 300

Merge pull request #24 from ceph/wip-7922

rados/singleton-nomsgr: add multi-backfill reservation rejection test

rados/thrash: rejection backfill reservations sometimes while thrashing

rados/singleton-nomsgr: add multi-backfill reservation rejection test

This triggers #7922.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #23 from ceph/wip-7771-wusui

FIxed dumpling - emperor upgrade suites

upgrade/dumpling-x: run dumpling version of s3tests

Signed-off-by: Sage Weil <sage@inktank.com>

FIxed dumpling - emperor upgrade suites

Reformatted many of the yaml files.
Fixed duplication of workunit definitions.
Do not do install.upgrade on clients.
Included branch: definition in final workload files.

Signed-off-by: Warren Usui <warren.usui@inktank.com>

upgrade/dumpling-emperor-x: do not warn about tunables

We do the same for dumpling-x.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-emperor-x: ignore 'scrub mismatch' from mon

The encoded full osdmaps can differ due to a series of issues that were
fixed well after emperor.  We also whitelist this for dumpling-x.

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: test ceph-fuse and kclient

Add client as a variable on the basic collection.  Move the other stuff
(libcephfs plus a weird restart test) to libcephfs collection.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #21 from ceph/wip-thrash-affinity

krbd, kcephfs: trash osd primary-affinity

Merge pull request #22 from ceph/wip-fuse-permission

multimds: fuse_default_permissions = 0 for kernel build test

multimds: fuse_default_permissions = 0 for kernel build test

This can reduce the test time becuase it avoids sending getattr
request whenever the kernel checks inode permission.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>

krbd, kcephfs: trash osd primary-affinity

libceph.ko support is in testing and should be in 3.15.  This commit
effectively reverts commit 66ffaa65657b ("kcephfs, krbd: do not thrash
primary-affinity").

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

rados/monthrash: shorten mon pings so that freezing triggers reconnects

This exercises (tho it doesn't necessarily verify) the mon ping reconnect
code when the thrasher freezes the mons.

See #7888.

Signed-off-by: Sage Weil <sage@inktank.com>

rgw_pool_type: remove accidentally added empty file

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-x/parallel: restart after cuttlefish->dumpling upgrade

Fixes: #7824
Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash/workloads: make cache-agent-big use an ec base pool

Signed-off-by: Samuel Just <sam.just@inktank.com>

rgw: add erasure coded data pool variant

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

rgw: set max-entries to 10 for data sync test

This way it tests the agent generating more than max-intries writes to
a bucket.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-x/stress-split: set fastcgi idle timeout to 2 min

30 seconds isn't enough when combined with osd thrashing.

Fixes: #7702
Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x/parallel: test cuttlefish->dumpling starting point

Maybe this will trigger #7519.  And anyway, it's good coverage.

Signed-off-by: Sage Weil <sage@inktank.com>

distros: add rhel 6.4

Signed-off-by: Sage Weil <sage@inktank.com>

distros: add wheezy

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #20 from ceph/wip-distros

symlink all distros facets to a common set of 'supported' targets

distros: add 14.04 to supported list

Signed-off-by: Sage Weil <sage@inktank.com>

distros: test rhel/centos 6.5 instead of 6.4

symlink all distros facets to a common set of 'supported' targets

This makes it easier to maintain the supported/tested targets.

Signed-off-by: Sage Weil <sage@inktank.com>

knfs: make it a list

Signed-off-by: Sage Weil <sage@inktank.com>

knfs: async export

Signed-off-by: Sage Weil <sage@inktank.com>

rados/monthrash: add pool create/delete tests

This is sufficient to trigger #7736 when combined with mon thrashing and
mon msg delay injection.

Signed-off-by: Sage Weil <sage@inktank.com>

nkfs: 6h timeout of kernel build

Yes, NFS reexport is slow.  But at the moment appears to be reliable.

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: fix misc -> fs/misc paths

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x/stress-split: tolerate legacy crush tunables

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #19 from ceph/wip-print

added print task
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

added print task

upgrade/dumpling-x: more mon scrub whitelist

There are two log messages; whitelist them both

Signed-off-by: Sage Weil <sage@inktank.com>

knfs: test v3 and v4

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #18 from ceph/wip-knfs-fsstress

knfs: add fsstress and kernel build

knfs: add fsstress and kernel build

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>

knfs: restructure a bit

Separate cluster buildup from tasks.

Signed-off-by: Sage Weil <sage@inktank.com>

nfs -> knfs

Signed-off-by: Sage Weil <sage@inktank.com>

workunits/misc -> fs/misc

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: whitelist mon scrub mismatch

A mixed dumpling/firefly cluster will have each mon independently encode
the full map.  Firefly now puts feature bits in the Incremental so that
we encode the "right" way, but dumpling doesn't have that capability
yet, and we don't plan to backport it.

Fixes: #7704
Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: upgrade final client node for final test

This means the final workloads are running firefly code.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: full librados tests after full upgrade

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: new (separate) suite for multi-mds tests

Eventually we can merge this into the fs suite, but for now it is useful
to segregate the test cases.

Start with a dup of basic and verify sections; add others later.

Signed-off-by: Sage Weil <sage@inktank.com>

Revert "fs/basic: multimds"

This reverts commit aea501beb744dd6f6ec2b60678cefc7fae6761b0.

Let's put this in a separate subdir for now.  It won't pass on firefly because
the libcephfs changes aren't there.

Merge remote-tracking branch 'gh/firefly'

upgrade/dumpling-x/stress-split: use dumpling workunits

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #16 from ceph/wip-hint-tests

rados/singleton-nomsgr: add allocation hint test

Reviewed-by: Sage Weil <sage@inktank.com>

Merge pull request #17 from ceph/wip-final_load_fix

fixed final_load problem

fixed final_load problem

upgrade/dumpling-x: upgrade mon before osd

The MDS needs to see the TMAP2OMAP feature bit in the osdmap.  THe mons
have to encode the feature bits passed by the new osds in order for that
to happen.  Ergo, upgrade mons first.

This is only important for the MDS and for users who want to use erasure
coded pools or tiering without restarting the osds *again* after the mons
get upgraded.

Fixes: #7679
Signed-off-by: Sage Weil <sage@inktank.com>

rgw: add data sync test

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

rgw: use different keys for different system users

Only one of these was being used before, due to a bug in
teuthology. This is fixed, and trying to create a second user with the
same access key fails.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-x: fix order

Make it match the filename.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: do not thrash primary-affinity

We can't do it on a mixed cluster

Signed-off-by: Sage Weil <sage@inktank.com>

stress-split: use dumpling version of rbd.py tests

The firefly version has a test that depends on new behavior.

Fixes: #7643
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

fs/basic: multimds

Signed-off-by: Sage Weil <sage@inktank.com>

rados/singleton-nomsgr: add allocation hint test

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

Remove the mds-mon-osd upgrade sequence

It wasn't actually supported.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't warn on legacy crush tunables

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

upgrade: fix typo in subsection name

It's referred to as workload, not workunit, by the parallel task earlier.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade: fix indentation for final-workload

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Revert "The parallel task expects dicts here..."

This reverts commit 79e348320f3695d085693b7ce0c538a9dfdd182b.

The parallel task expects dicts here...

We should fix that at some point.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

get test-upgrade-firefly.sh from the dumpling branch

it doesn't exist elsewhere

Revert "Update rados_api_tests.yaml"

This needs to reference dumpling now.

This reverts commit 8e88922581f80000784072e381867f0b5448cd7f.