s/giant/firefly when setting the crush tunables

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

s/giant/firefly

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

removing upgrade suites that are no longer required

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge remote-tracking branch 'origin/giant' into wip-merge

Conflicts:
erasure-code/ec-rados-default.yaml
tasks/mds_client_limits.py
tasks/mds_client_recovery.py
tasks/mds_journal_migration.py

remove dumpling-firefly-giant as dumpling-firefly-x covers this test

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

fixed firefly-x and dumpling-firefly-x

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

upgrade/dumpling-giant-x: remove

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/cuttlefish, emperor, old: remove

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #156 from ceph/wip-9609-wusui

Fix workunit branches.

Fix workunit branches.

FIxes: 9606
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Merge pull request #155 from ceph/wip-9341

tasks/mds_client_recovery: client trim its cache on reconnect

Reviewed-by: John Spray <john.spray@redhat.com>

tasks/mds_client_recovery: client trim its cache on reconnect

make sure CephFS client trim its cache before reconnect to the MDS.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

suites: enable mds_client_limits test

Requires same cluster etc as 'recovery', though
we could now do with better name than that.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: wait for mds active before mounting clients

To make the logs clearer when trying to work out
if/when something went wrong, rather than always
having client logs start with some failures.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: rename FuseMount.get_client_id to get_global_id

'client_id' was ambiguous because in other places it
meant the '0' in client.0, whereas here it means
the runtime-generated global ID of the client.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: add mds_client_limits

New CephFS tests for the behaviour of the system while
enforcing its resource limits.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: generalise CephFSTestCase

Some of this stuff could be even more general for embedding
unittest-style suites, but for the moment let's keep the cephfs
stuff in a walled garden.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: generalize config writing for Filesystem

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #154 from ceph/wip_fix_multi_version

Fixing branch assumptions

Fixing branch assumptions

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #153 from ceph/wip-9511-wusui

Use the correct versions of existing tests

Use the correct versions of existing tests

The test-upgrade-firefly.sh script is used from the dumpling suite

Fixes: 9511
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Merge pull request #152 from dachary/wip-9608-ec-default-parallel-giant

ec-rados-default is not fit for dumpling parallel upgrade

ec-rados-default is not fit for dumpling parallel upgrade

Because it may race with the upgrade and end up being unable to perform.

http://tracker.ceph.com/issues/9608 Fixes: #9608

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
(cherry picked from commit b77ef02bc5ca623d2c5577c2caafcf3720ddd2ec)

Merge branch 'master' of github.com:ceph/ceph-qa-suite

Merge pull request #151 from dachary/wip-9608-ec-default-parallel

ec-rados-default is not fit for dumpling parallel upgrade

ec-rados-default is not fit for dumpling parallel upgrade

Because it may race with the upgrade and end up being unable to perform.

http://tracker.ceph.com/issues/9608 Fixes: #9608

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

added multi-version for giant-clients vs firefly-servers

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added upgrade suite for dumpling-firefly-giant

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
(cherry picked from commit c7603c0b7871477110946d2d47ea67dda1b7a9bf)

Conflicts:

suites/upgrade/firefly-giant-x/parallel/5-upgrade-sequence/upgrade-by-daemon.yaml
suites/upgrade/firefly-giant-x/parallel/5-upgrade-sequence/upgrade-by-type.yaml

smoke: fix pjd debug conf syntax

Needs the section there or else ceph.py barfs at runtime

Signed-off-by: Sage Weil <sage@redhat.com>

tasks: wait for active after mds restart

May have been causing spurious failures on
trying to read session state after MDS restart (
session list isn't populated until recovery is
complete)

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #147 from dachary/wip-ec-feature-plugin-v2-giant

erasure-code: assert that firefly-x/stress-split cannot load lrc

erasure-code: assert that firefly-x/stress-split cannot load lrc

Because it would crash existing plugins.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
(cherry picked from commit d6f02d604840b448158a1470b6bb1f6d0550e97f)

added upgrade suite for dumpling-firefly-giant

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #135 from ceph/wip_9398

First draft of firefly-giant-x suite

adjusting crush tunables when running a mixed version of mons and osds. bug 8765

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added workload tag

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #142 from ceph/wip-9284

Tests for #9284, FUSE client capability handling

Reviewed-by: Greg Farnum <greg@inktank.com>

Merge pull request #146 from dachary/wip-9298-rgw-ec-starvation-giant

rgw: increase the number of OSDs for erasure coded pools

rgw: increase the number of OSDs for erasure coded pools

So that there never is less than 4 osd which is the minimum when trying
erasure coded workloads that only work with 4 osd.

http://tracker.ceph.com/issues/9298 Fixes: #9298

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

included an option to ceph_objectstore_tool, whenever we have keyvaluestore_backend as a configurable parameter

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #128 from dachary/wip-ec-feature-plugin-v2

erasure-code: CEPH_FEATURE_ERASURE_CODE_PLUGINS_V2 integration tests

Merge pull request #145 from dachary/wip-erasure-code-workloads

erasure-code: fix bugous ec-rados-default.yaml in some suites

erasure-code: fix bugous ec-rados-default.yaml in some suites

The ec-rados-default.yaml was linked to suites as if it was a task
although it is a workload intended for parallel upgrade tests.

The ec-rados-plugin=jerasure-k=2-m=1.yaml task is defined and used
instead, where relevant.

http://tracker.ceph.com/issues/9549 Fixes: #9549

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

fixed indentation in the yaml

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

suites: enable mds_client_limits test

Requires same cluster etc as 'recovery', though
we could now do with better name than that.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: wait for mds active before mounting clients

To make the logs clearer when trying to work out
if/when something went wrong, rather than always
having client logs start with some failures.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: rename FuseMount.get_client_id to get_global_id

'client_id' was ambiguous because in other places it
meant the '0' in client.0, whereas here it means
the runtime-generated global ID of the client.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: add mds_client_limits

New CephFS tests for the behaviour of the system while
enforcing its resource limits.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: generalise CephFSTestCase

Some of this stuff could be even more general for embedding
unittest-style suites, but for the moment let's keep the cephfs
stuff in a walled garden.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: generalize config writing for Filesystem

Signed-off-by: John Spray <john.spray@redhat.com>

Update giant.yaml

fixed typos(cherry picked from commit 1f950d2bf4dd76d671ab1c85a87a5f1175305635)

Update giant.yaml(cherry picked from commit 90b6eec23fad6b3af1305de9c59a4759e076ebd3)

Update giant.yaml

Added comments(cherry picked from commit 3dd1314c6fa70fefc4ea8c65c33bac1ad3ba267a)

Create dumpling-giant-x stress-split upgrade suite

Fixes: 9357
Signed-off-by: Warren Usui <warren.usui@inktank.com>
(cherry picked from commit c729372aaae82b8fb0a31a42f24d96924078282f)

Update giant.yaml(cherry picked from commit 35b3f4617c54dcb9705ca31489e2348bdb0e18b5)

dumpling-giant-x: use giant version of workunits

The firefly version of test_librbd_python at least does
not work on giant.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
(cherry picked from commit 8755466c4b7c2402e3265ecb04a8300a4d0c146f)

Merge pull request #143 from ceph/wip-migration-test

tasks: more substantial IO for journal migration

Reviewed-by: Greg Farnum <greg@inktank.com>

suites: turn on debugging for smoke cfuse pjd test

Signed-off-by: Greg Farnum <greg@inktank.com>

Update giant.yaml

fixed typos

Update giant.yaml

Update giant.yaml

Added comments

Merge remote-tracking branch 'origin/giant'

tasks: escaping '*' when deleting files

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: more substantial IO for journal migration

...so that there will at least be multiple segments
in the log during the rewrite.

Also make the test stricter by checking that
cephfs-journal-tool can happily read the resulting
journal.

Signed-off-by: John Spray <john.spray@redhat.com>

s/tasks/workload
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #141 from ceph/wip-9423

Fix #9423 - race in mds_client_recovery

Merge pull request #140 from ceph/wip-9177

suites/fs: update to latest mdtest

suites/fs: update to latest mdtest

They appear to have (accidentally?) fixed whatever
was crashing.

Fixes: #9177
Signed-off-by: John Spray <john.spray@redhat.com>

tasks: fix race in test_stale_caps

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: typo in mds_client_recovery

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: handle failure cleanly in test_stale_caps

Previously would fail because the cap waiter
completed too soon, without noticing that the
reason it completed quickly was because it failed.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #137 from ceph/wip-9461

Removed cuttlefish part foxes #9461

Removed cuttlefish part foxes #9461

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rgw: set debug rgw=20

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

First draft of firefly-giant-x suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added RHEL7 to matrix.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

erasure-code: CEPH_FEATURE_ERASURE_CODE_PLUGINS_V2 integration tests

http://tracker.ceph.com/issues/9343 Refs: #9343

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

erasure-code: assert that firefly-x/stress-split cannot load lrc

Because it would crash existing plugins.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Merge pull request #132 from ceph/revert-131-wip-9357-wusui

Revert "Use same upgrade-test as firefly."

Revert "Use same upgrade-test as firefly."

Merge pull request #131 from ceph/wip-9357-wusui

Use same upgrade-test as firefly.

Use same upgrade-test as firefly.
The changes for firefly upgrade tests apply to giant as well.

Merge pull request #130 from ceph/wip-9220

tasks: add watch_notify_same_primary

Reviewed-by: Sage Weil <sage@redhat.com>

tasks: add watch_notify_same_primary

Reproduces: #9220
Signed-off-by: Samuel Just <sam.just@inktank.com>

Merge pull request #116 from dachary/wip-9298-rgw-ec-starvation

rgw: increase the number of OSDs for erasure coded pools

Merge pull request #122 from ceph/wip-9357-wusui

Create dumpling-giant-x stress-split upgrade suite

Create dumpling-giant-x stress-split upgrade suite

Fixes: 9357
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Update giant.yaml

dumpling-giant-x: use giant version of workunits

The firefly version of test_librbd_python at least does
not work on giant.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #119 from ceph/wip_9352

Wip 9352

Merge pull request #118 from dachary/wip-more-osds

add osds to firefly-x upgrade suite

Updated README

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

First draft for a new suite dumpling-giant-x

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

added a test to use single disk for both data and journal.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added dmcrypt and separate_journal_disk options

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #112 from ceph/wip-8231-forreview

Wip 8231 forreview

Reviewed-by: Samuel Just <sam.just@inktank.com>

tasks: fix mount race in mds_client_recovery

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #117 from dachary/wip-erasure-code-workloads

erasure-code: do not schedule isa workloads just yet

add osds to firefly-x upgrade suite

so that the lrc plugin has enough to work with

Signed-off-by: Loic Dachary <loic-201408@dachary.org>