smoke: specify fs on each run

Signed-off-by: Sage Weil <sage@inktank.com>

smoke-tests -> smoke

Signed-off-by: Sage Weil <sage@redhat.com>

smoke: remove old smoke suite

Signed-off-by: Sage Weil <sage@redhat.com>

Revert "rados: Fix cache_flush, cache_try_flush, cache_evict and add hit_set_list"

cache_evict is kinda broken at the moment due to snapdir nonsense.  I'm reverting this
test for now until it's fixed so it doesn't obscure the test results.

Bug: 8629
This reverts commit 3dae48c7cd9e72af47bc76840df652c1570d7502.

enable kernel debugging on kclient fsx runs

Signed-off-by: Greg Farnum <greg@inktank.com>

Merge pull request #41 from ceph/wip-rados-op-fixes

rados: Fix cache_flush, cache_try_flush, cache_evict and add hit_set_lis...

creating smoke-tests suite to include basic tests from all modules

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

rados: Fix cache_flush, cache_try_flush, cache_evict and add hit_set_list

Signed-off-by: David Zafman <david.zafman@inktank.com>

Merge pull request #40 from ceph/wip-runxfstests

wip-runxfstests

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #38 from ceph/wip-krbd-fsx

krbd: add librbd_fsx -K job

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

krbd: add librbd_fsx -K job

Our fsx fork has recently gained a support for the krbd mode - add it
to the test suite.  Disable discard ops and randomized striping, both
of which aren't ready yet.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

krbd: catch up with run_xfstests.sh changes

In the current xfstests, tests cannot be listed in ranges.  Because of
this, and because our distribution of tests between our three clients
was pretty uneven, I've changed this job to run the whole auto group
(with some tests excluded by run_xfstests_krbd.sh) in random order on
two clients in parallel.  It takes longer to run, but it also spares
a test box and can potentially create a better test workload.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

Merge pull request #39 from ceph/wip-multimds-syntax

multimds: fix fuse_default_permissions syntax

multimds: fix fuse_default_permissions syntax

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #37 from ceph/wip-heartbeat

osd_heartbeat_grace from 20 -> 40 when running valgrind

osd_heartbeat_grace from 20 -> 40 when running valgrind

This will mask occasional 'wrongly marked me down' errors when valgrind
is running (it makes things generally slow).

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #36 from ceph/wip-objectstore

fix objecstore test

Merge pull request #35 from ceph/wip-add-v0.67.9

Added dumpling v0.67.9 version, removed older versions v0.67.2, v0.67.4,...

Added dumpling v0.67.9 version, removed older versions v0.67.2, v0.67.4, v0.67.8
This will reduce number of tests to run, some  may failed on old versions, see http://tracker.ceph.com/issues/8409

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rados/singleton-nomsgr/all/objectstore: skip ceph cluster setup

Not necessary; we just need it installed.

Signed-off-by: Sage Weil <sage@inktank.com>

rados/singleton-nomsgr/all/objectstore: clean up

ceph_test_objectstore scribbles in $CWD.  Keep it inside $TESTDIR and
clean up when we are done.

Fixes: #8395
Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #34 from ceph/wip-fuse

fuse_defautl_permissions = 0;

Reviewed-by: Greg Farnum <greg@inktank.com>

multimds: fuse_default_permissions = 0

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: factor install+ceph tasks out of other collections

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #31 from ceph/wip-fuse-permission

marginal/multimds: fuse_default_permissions = 0 for ceph-fuse

Merge pull request #32 from ceph/wip-8284

Reviewed-by: Samuel Just <sam.just@inktank.com>

Merge pull request #33 from ceph/wip-8297-wusui

2-workload testrgw needs to be sequential.

2-workload testrgw needs to be sequential.

Fixes: 8297
Signed-off-by: Warren Usui <warren.usui@inktank.com>

rados/thrash: Add pool_snaps variants

Fixes: #8284
Signed-off-by: David Zafman <david.zafman@inktank.com>

marginal/multimds: fuse_default_permissions = 0 for ceph-fuse

This can reduce the test time becuase it avoids sending getattr
request whenever the kernel checks inode permission.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>

cache-snaps.yaml: set target_max_objects to test snap flush/evict

Signed-off-by: Samuel Just <sam.just@inktank.com>

Merge pull request #30 from ceph/wip-8263

Wip 8263

rados/thrash: Fix workload of cache-agent-big

Create a log of objects and operate on some of them
(Initial object creation counts against total operations specified)
Add limit to 20 minutes

Fixes: 8263
Signed-off-by: David Zafman <david.zafman@inktank.com>

rgw: test with ec + cache pool

Signed-off-by: Sage Weil <sage@inktank.com>

Fix syntax of erasure coded pool creation

Signed-off-by: David Zafman <david.zafman@inktank.com>

Merge pull request #28 from ceph/wip_add_0688_release

added new correctd tag 67.8

added new correctd tag 67.8

Merge pull request #27 from ceph/wip_add_0688_release

added latest dumpling tag v0.68.8

added latest dumpling tag v0.68.8

rgw: update idle_timeout for rgw_s3tests_multiregion.yaml

Fixes: #8194
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

rados: add ec and rep lost_unfound_delete tests

Signed-off-by: Samuel Just <sam.just@inktank.com>

rados/singleton/all/cephtool: whitelist scrub vs split vs agent issue

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: bump up timeout for misc.yaml

This keeps timing out after 3h.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #26 from ceph/wip-rbd-cache

test rbd with cache pool

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

rbd/thrash: factor out install + ceph

Signed-off-by: Sage Weil <sage@inktank.com>

rbd: do most tests with a (small) cache pool in front

Signed-off-by: Sage Weil <sage@inktank.com>

rbd/basic: factor out install + ceph

Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash: whitelist 'must scrub before tier agent can activate'

Signed-off-by: Sage Weil <sage@inktank.com>

rados: include objectstore tests

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #25 from ceph/wip-fastdumpemp-wusui

Reduce runs in the dumpling-emperor upgrade suite.

big: test xfs + btrfs

Note that previously we were specifying neither, so the OSDs were running
off of /.

Signed-off-by: Sage Weil <sage@inktank.com>

Reduce runs in the dumpling-emperor upgrade suite.

Add + to 2-workload, 4-workload and 6-final-workload
suites.  Reduce 5-upgrade-sequence to only run two
tests and make sure upgrades to emperor occur in each
sequence.  Fix swift.yaml to not include rgw: clause
(this is already done by s3tests.yaml).

Fixes: #8051
Signed-off-by: Warren Usui <warren.usui@inktank.com>

changed idle_timeout to 300

Merge pull request #24 from ceph/wip-7922

rados/singleton-nomsgr: add multi-backfill reservation rejection test

rados/thrash: rejection backfill reservations sometimes while thrashing

rados/singleton-nomsgr: add multi-backfill reservation rejection test

This triggers #7922.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #23 from ceph/wip-7771-wusui

FIxed dumpling - emperor upgrade suites

upgrade/dumpling-x: run dumpling version of s3tests

Signed-off-by: Sage Weil <sage@inktank.com>

FIxed dumpling - emperor upgrade suites

Reformatted many of the yaml files.
Fixed duplication of workunit definitions.
Do not do install.upgrade on clients.
Included branch: definition in final workload files.

Signed-off-by: Warren Usui <warren.usui@inktank.com>

upgrade/dumpling-emperor-x: do not warn about tunables

We do the same for dumpling-x.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-emperor-x: ignore 'scrub mismatch' from mon

The encoded full osdmaps can differ due to a series of issues that were
fixed well after emperor.  We also whitelist this for dumpling-x.

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: test ceph-fuse and kclient

Add client as a variable on the basic collection.  Move the other stuff
(libcephfs plus a weird restart test) to libcephfs collection.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #21 from ceph/wip-thrash-affinity

krbd, kcephfs: trash osd primary-affinity

Merge pull request #22 from ceph/wip-fuse-permission

multimds: fuse_default_permissions = 0 for kernel build test

multimds: fuse_default_permissions = 0 for kernel build test

This can reduce the test time becuase it avoids sending getattr
request whenever the kernel checks inode permission.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>

krbd, kcephfs: trash osd primary-affinity

libceph.ko support is in testing and should be in 3.15.  This commit
effectively reverts commit 66ffaa65657b ("kcephfs, krbd: do not thrash
primary-affinity").

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

rados/monthrash: shorten mon pings so that freezing triggers reconnects

This exercises (tho it doesn't necessarily verify) the mon ping reconnect
code when the thrasher freezes the mons.

See #7888.

Signed-off-by: Sage Weil <sage@inktank.com>

rgw_pool_type: remove accidentally added empty file

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-x/parallel: restart after cuttlefish->dumpling upgrade

Fixes: #7824
Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash/workloads: make cache-agent-big use an ec base pool

Signed-off-by: Samuel Just <sam.just@inktank.com>

rgw: add erasure coded data pool variant

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

rgw: set max-entries to 10 for data sync test

This way it tests the agent generating more than max-intries writes to
a bucket.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-x/stress-split: set fastcgi idle timeout to 2 min

30 seconds isn't enough when combined with osd thrashing.

Fixes: #7702
Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x/parallel: test cuttlefish->dumpling starting point

Maybe this will trigger #7519.  And anyway, it's good coverage.

Signed-off-by: Sage Weil <sage@inktank.com>

distros: add rhel 6.4

Signed-off-by: Sage Weil <sage@inktank.com>

distros: add wheezy

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #20 from ceph/wip-distros

symlink all distros facets to a common set of 'supported' targets

distros: add 14.04 to supported list

Signed-off-by: Sage Weil <sage@inktank.com>

distros: test rhel/centos 6.5 instead of 6.4

symlink all distros facets to a common set of 'supported' targets

This makes it easier to maintain the supported/tested targets.

Signed-off-by: Sage Weil <sage@inktank.com>

knfs: make it a list

Signed-off-by: Sage Weil <sage@inktank.com>

knfs: async export

Signed-off-by: Sage Weil <sage@inktank.com>

rados/monthrash: add pool create/delete tests

This is sufficient to trigger #7736 when combined with mon thrashing and
mon msg delay injection.

Signed-off-by: Sage Weil <sage@inktank.com>

nkfs: 6h timeout of kernel build

Yes, NFS reexport is slow.  But at the moment appears to be reliable.

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: fix misc -> fs/misc paths

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x/stress-split: tolerate legacy crush tunables

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #19 from ceph/wip-print

added print task
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

added print task

upgrade/dumpling-x: more mon scrub whitelist

There are two log messages; whitelist them both

Signed-off-by: Sage Weil <sage@inktank.com>

knfs: test v3 and v4

Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #18 from ceph/wip-knfs-fsstress

knfs: add fsstress and kernel build

knfs: add fsstress and kernel build

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>

knfs: restructure a bit

Separate cluster buildup from tasks.

Signed-off-by: Sage Weil <sage@inktank.com>

nfs -> knfs

Signed-off-by: Sage Weil <sage@inktank.com>

workunits/misc -> fs/misc

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: whitelist mon scrub mismatch

A mixed dumpling/firefly cluster will have each mon independently encode
the full map.  Firefly now puts feature bits in the Incremental so that
we encode the "right" way, but dumpling doesn't have that capability
yet, and we don't plan to backport it.

Fixes: #7704
Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: upgrade final client node for final test

This means the final workloads are running firefly code.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: full librados tests after full upgrade

Signed-off-by: Sage Weil <sage@inktank.com>

multimds: new (separate) suite for multi-mds tests

Eventually we can merge this into the fs suite, but for now it is useful
to segregate the test cases.

Start with a dup of basic and verify sections; add others later.

Signed-off-by: Sage Weil <sage@inktank.com>

Revert "fs/basic: multimds"

This reverts commit aea501beb744dd6f6ec2b60678cefc7fae6761b0.

Let's put this in a separate subdir for now.  It won't pass on firefly because
the libcephfs changes aren't there.