fixed final_load problem

upgrade/dumpling-x: upgrade mon before osd

The MDS needs to see the TMAP2OMAP feature bit in the osdmap.  THe mons
have to encode the feature bits passed by the new osds in order for that
to happen.  Ergo, upgrade mons first.

This is only important for the MDS and for users who want to use erasure
coded pools or tiering without restarting the osds *again* after the mons
get upgraded.

Fixes: #7679
Signed-off-by: Sage Weil <sage@inktank.com>

rgw: add data sync test

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

rgw: use different keys for different system users

Only one of these was being used before, due to a bug in
teuthology. This is fixed, and trying to create a second user with the
same access key fails.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-x: fix order

Make it match the filename.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: do not thrash primary-affinity

We can't do it on a mixed cluster

Signed-off-by: Sage Weil <sage@inktank.com>

stress-split: use dumpling version of rbd.py tests

The firefly version has a test that depends on new behavior.

Fixes: #7643
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

fs/basic: multimds

Signed-off-by: Sage Weil <sage@inktank.com>

Remove the mds-mon-osd upgrade sequence

It wasn't actually supported.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't warn on legacy crush tunables

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

upgrade: fix typo in subsection name

It's referred to as workload, not workunit, by the parallel task earlier.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade: fix indentation for final-workload

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Revert "The parallel task expects dicts here..."

This reverts commit 79e348320f3695d085693b7ce0c538a9dfdd182b.

The parallel task expects dicts here...

We should fix that at some point.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

get test-upgrade-firefly.sh from the dumpling branch

it doesn't exist elsewhere

Revert "Update rados_api_tests.yaml"

This needs to reference dumpling now.

This reverts commit 8e88922581f80000784072e381867f0b5448cd7f.

upgrade/dumpling-x: more indentation

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: fix indentation

Signed-off-by: Sage Weil <sage@inktank.com>

Merge remote-tracking branch 'gh/firefly'

Merge pull request #14 from ceph/wip-final-workload-wusui

Fix parallel workunit issues.

Fix parallel workunit issues.

Fixed the spacing of workunits inside 2-workload and 4-final-workland
files.  Removed parallel final-workload reference from dumpling.yaml.

Fixes: 7633
Signed-off-by: Warren Usui <warren.usui@inktank.com>

upgrade/dumpling-x: skip rados api tests that fail against firefly OSDs

Fixes: #7584
Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #9 from ceph/wip-upgrade-dumpling

upgrade/dumpling: two fixes

Merge pull request #13 from ceph/wip-upgrade

a few upgrade fixes

upgrade/dumpling-x/parallel: do all final workloads

Run all of the final workloads in succession instead of in separate tests.
Since we are not concerned about timing in this case, only that the
cluster is functioning at the end, this cuts down our test matrix by a
factor of 4.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling-x: do not upgrade client host

If we are running against a mixed cluster for the duration of the upgrade,
we need to make sure we are running the *old* client tests against the
cluster.  Do not upgrade client.0.

Fixes: #7574
Signed-off-by: Sage Weil <sage@inktank.com>

Merge pull request #12 from ceph/wip-final-workload-wusui

Fix dumpling-x upgrade suite.

Fix dumpling-x upgrade suite.

final-workload references were added (replacing second task
reference)

Fixes: 7606
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Removed branch ref to fix http://tracker.ceph.com/issues/7584

Update rados_api_tests.yaml

Removed branch ref to fix http://tracker.ceph.com/issues/7584

Merge pull request #11 from ceph/wip-7581

increase verbosity for OSDs for ceph-deploy tests

increase verbosity for OSDs for ceph-deploy tests

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

Merge pull request #10 from ceph/wip-7485

suites/fs/basic: add mds_creation_retry

Barely-
Reviewed-by: Greg Farnum <greg@inktank.com>

suites/fs/basic: add mds_creation_retry

This invokes the new mds_creation_failure task from
teuthology, ahead of mounting the FS and running the
trivial_sync workload.  It is a regression test
for #7485.

Fixes: #7485
Signed-off-by: John Spray <john.spray@inktank.com>

Add missing fedora yamls.

Running a git add first would have been helpfull...

Run ceph-deploy on fedora19 not old fedora18.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Add missing fedora yamls.

Running a git add first would have been helpfull...

Run ceph-deploy on fedora19 not old fedora18.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge remote-tracking branch 'gh/firefly'

upgrade/dumpling: add recent dumpling point releases

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/dumpling: upgrade to latest dumpling, not emperor

Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash/workloads: enable copy_from for the ec workloads

Signed-off-by: Samuel Just <sam.just@inktank.com>

Merge pull request #8 from ceph/yuriw

Added new dumpling-emperor-x upgrade suite

removed leftover dirs again

removed one upgrade-sequence step and re-named the rest of steps

removed unfinished stress-split suite from

removed obsolete suite from upgrades dir and added dumpling-emperor-x parallel suite

Merge branch 'master' of github.com:ceph/ceph-qa-suite into yuriw

Merge pull request #7 from ceph/wip-upgrade

upgrade: dumpling-next -> dumpling-x

upgrade: dumpling-next -> dumpling-x

Make the final upgrade step unspecified so that it can be specified at
schedule time.  This let us test dumpling -> firefly, dumpling->emperor, or
whatever else we want.

Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash: add ec-radosbench workload

Signed-off-by: Samuel Just <sam.just@inktank.com>

rados/thrash: add ec workloads

Adds ec workloads for snaps, small objects, read-write.

copy-from is not yet enabled.

Signed-off-by: Samuel Just <sam.just@inktank.com>

rados/thrash: test rados against cache pool with agents

Run rados model against a pool with target_max_objects set so that the
tiering agent is working against us.

Signed-off-by: Sage Weil <sage@inktank.com>

iozone: kill empty suite

Signed-off-by: Sage Weil <sage@inktank.com>

kcephfs, krbd: do not thrash primary-affinity

Kenrel doesn't yet support it.  See #7455

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade: reorg

Signed-off-by: Sage Weil <sage@inktank.com>

fixed yam typos

added distros

added parallel dumping-emperor-next upgrade tests

don't use notcmalloc flavor for valgrind

We now have the suppressions to avoid this.  Yay!

Signed-off-by: Sage Weil <sage@inktank.com>

Fix broken symlinks.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge pull request #6 from ceph/wip-set-inline

fs: Fix bad "mds set inline_data" syntax

fs: Fix bad "mds set inline_data" syntax

Signed-off-by: John Spray <john.spray@inktank.com>

rgw task for multipart upload script

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

s/rgw_user_quota.pl/rgw_user_quota.yaml

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

task for rgw user quota testing

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

created upgrades:dumpling-next suite to test parallel upgrades
and partial upgrades.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

s/rgw_tests.sh/s3_bucket_quota.pl

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

increase mon verbosity for all ceph-deploy tasks

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

increase mon verbosity in logs

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

fs/basic: test with inline data

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

correct user name

removed roles from task file

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

rados/thrash: add cache + snaps workload

Signed-off-by: Sage Weil <sage@inktank.com>

added roles for bucket quota tests

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added roles to rest yaml

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

modified rgw suite for bucket quota tests

Signed-off-by: tamil <tamil@tamil-VirtualBox.(none)>

suite for rest

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

add another host so that replicas meet the minimum required

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

add missing/required OSDs to the rest of ceph-deploy tasks

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
(cherry picked from commit 2e721f0d7c5f344168d70959bb1478a0f3393718)

upgrade/parallel/stress-split: api tests needs to run on dumpling host

Even tho we run the dumpilng branch test.sh, the installed
ceph_test_rados_api_* are still emperor.  Add another role/host so that
this doesn't happen.

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/parallel/stress-split: use dumpling tests against mixed d+e

Signed-off-by: Sage Weil <sage@inktank.com>

rados: add rados tool test

For now this just tests listomapvals, but it may be expanded in the
future.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/parallel/stress-split: fix test

Upgrade the second host before restarting the final monitor.

Run the dumpling api tests, since we still have half the osds running
dumpling.

Signed-off-by: Sage Weil <sage@inktank.com>

rename upgrade/upgrade-* -> upgrade/*

Signed-off-by: Sage Weil <sage@inktank.com>

upgrade/upgrade-parallel: don't test copy-from on dumpling

It wasn't there yet

Signed-off-by: Sage Weil <sage@inktank.com>

rados/trash: add cache workload

Signed-off-by: Sage Weil <sage@inktank.com>

rados/thrash: add small objects ceph_test_rados workload

With small objects we can generate many more ops more quickly and stress
the cluster a bit differently.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'wip-dzfix'

Increase timeout by 50% in thrashers/mapgap.yaml

Seen in /a/teuthology-2013-12-17_23:00:03-rados-next-distro-basic-plana/7188

Signed-off-by: David Zafman <david.zafman@inktank.com>

moved samba suite a level up [suites/fs/samba to suites/samba]

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

task to test rgw bucket quota

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

bump the OSDs to three per mon/host

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
(cherry picked from commit 8e543213bdafbec557c1bf5c962d87e49d6271ab)

Merge pull request #2 from ceph/wip-6947

use 3 OSDs in fs tests

use 3 OSDs in fs tests

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

restructured upgrade suites to be under one folder called upgrade.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>