upgrade/cuttlefish, emperor, old: remove

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #156 from ceph/wip-9609-wusui

Fix workunit branches.

Fix workunit branches.

FIxes: 9606
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Merge pull request #155 from ceph/wip-9341

tasks/mds_client_recovery: client trim its cache on reconnect

Reviewed-by: John Spray <john.spray@redhat.com>

tasks/mds_client_recovery: client trim its cache on reconnect

make sure CephFS client trim its cache before reconnect to the MDS.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

suites: enable mds_client_limits test

Requires same cluster etc as 'recovery', though
we could now do with better name than that.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: wait for mds active before mounting clients

To make the logs clearer when trying to work out
if/when something went wrong, rather than always
having client logs start with some failures.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: rename FuseMount.get_client_id to get_global_id

'client_id' was ambiguous because in other places it
meant the '0' in client.0, whereas here it means
the runtime-generated global ID of the client.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: add mds_client_limits

New CephFS tests for the behaviour of the system while
enforcing its resource limits.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: generalise CephFSTestCase

Some of this stuff could be even more general for embedding
unittest-style suites, but for the moment let's keep the cephfs
stuff in a walled garden.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: generalize config writing for Filesystem

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #154 from ceph/wip_fix_multi_version

Fixing branch assumptions

Fixing branch assumptions

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #153 from ceph/wip-9511-wusui

Use the correct versions of existing tests

Use the correct versions of existing tests

The test-upgrade-firefly.sh script is used from the dumpling suite

Fixes: 9511
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

Merge pull request #151 from dachary/wip-9608-ec-default-parallel

ec-rados-default is not fit for dumpling parallel upgrade

ec-rados-default is not fit for dumpling parallel upgrade

Because it may race with the upgrade and end up being unable to perform.

http://tracker.ceph.com/issues/9608 Fixes: #9608

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

added multi-version for giant-clients vs firefly-servers

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added upgrade suite for dumpling-firefly-giant

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #135 from ceph/wip_9398

First draft of firefly-giant-x suite

adjusting crush tunables when running a mixed version of mons and osds. bug 8765

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

included an option to ceph_objectstore_tool, whenever we have keyvaluestore_backend as a configurable parameter

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #128 from dachary/wip-ec-feature-plugin-v2

erasure-code: CEPH_FEATURE_ERASURE_CODE_PLUGINS_V2 integration tests

Merge pull request #145 from dachary/wip-erasure-code-workloads

erasure-code: fix bugous ec-rados-default.yaml in some suites

erasure-code: fix bugous ec-rados-default.yaml in some suites

The ec-rados-default.yaml was linked to suites as if it was a task
although it is a workload intended for parallel upgrade tests.

The ec-rados-plugin=jerasure-k=2-m=1.yaml task is defined and used
instead, where relevant.

http://tracker.ceph.com/issues/9549 Fixes: #9549

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

fixed indentation in the yaml

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Update giant.yaml

fixed typos

Update giant.yaml

Update giant.yaml

Added comments

Merge remote-tracking branch 'origin/giant'

tasks: escaping '*' when deleting files

Signed-off-by: John Spray <john.spray@redhat.com>

s/tasks/workload
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #141 from ceph/wip-9423

Fix #9423 - race in mds_client_recovery

Merge pull request #140 from ceph/wip-9177

suites/fs: update to latest mdtest

suites/fs: update to latest mdtest

They appear to have (accidentally?) fixed whatever
was crashing.

Fixes: #9177
Signed-off-by: John Spray <john.spray@redhat.com>

tasks: fix race in test_stale_caps

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: typo in mds_client_recovery

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: handle failure cleanly in test_stale_caps

Previously would fail because the cap waiter
completed too soon, without noticing that the
reason it completed quickly was because it failed.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #137 from ceph/wip-9461

Removed cuttlefish part foxes #9461

Removed cuttlefish part foxes #9461

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rgw: set debug rgw=20

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

First draft of firefly-giant-x suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added RHEL7 to matrix.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

erasure-code: CEPH_FEATURE_ERASURE_CODE_PLUGINS_V2 integration tests

http://tracker.ceph.com/issues/9343 Refs: #9343

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

erasure-code: assert that firefly-x/stress-split cannot load lrc

Because it would crash existing plugins.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Merge pull request #132 from ceph/revert-131-wip-9357-wusui

Revert "Use same upgrade-test as firefly."

Revert "Use same upgrade-test as firefly."

Merge pull request #131 from ceph/wip-9357-wusui

Use same upgrade-test as firefly.

Use same upgrade-test as firefly.
The changes for firefly upgrade tests apply to giant as well.

Merge pull request #130 from ceph/wip-9220

tasks: add watch_notify_same_primary

Reviewed-by: Sage Weil <sage@redhat.com>

tasks: add watch_notify_same_primary

Reproduces: #9220
Signed-off-by: Samuel Just <sam.just@inktank.com>

Merge pull request #116 from dachary/wip-9298-rgw-ec-starvation

rgw: increase the number of OSDs for erasure coded pools

Merge pull request #122 from ceph/wip-9357-wusui

Create dumpling-giant-x stress-split upgrade suite

Create dumpling-giant-x stress-split upgrade suite

Fixes: 9357
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Update giant.yaml

dumpling-giant-x: use giant version of workunits

The firefly version of test_librbd_python at least does
not work on giant.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #119 from ceph/wip_9352

Wip 9352

Merge pull request #118 from dachary/wip-more-osds

add osds to firefly-x upgrade suite

Updated README

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

First draft for a new suite dumpling-giant-x

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

added a test to use single disk for both data and journal.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added dmcrypt and separate_journal_disk options

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #112 from ceph/wip-8231-forreview

Wip 8231 forreview

Reviewed-by: Samuel Just <sam.just@inktank.com>

tasks: fix mount race in mds_client_recovery

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #117 from dachary/wip-erasure-code-workloads

erasure-code: do not schedule isa workloads just yet

add osds to firefly-x upgrade suite

so that the lrc plugin has enough to work with

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

erasure-code: do not schedule isa workloads just yet

they should be selectively activated, depending the isa plugin availability

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

ceph_manager: Add test code to use export/import to move a pg

Check for more than 1 osd down and randomize on chance_move_pg (100%)
For now only export from older down osd to newly down osd to avoid missing map

Signed-off-by: David Zafman <david.zafman@inktank.com>

ceph_manager: Implement export/import when thrasher kills an osd

Use list-pgs to avoid races by seeing actual pgs present

Signed-off-by: David Zafman <david.zafman@inktank.com>

ceph_objectstore_tool: Add task for testing of tool of the same name

Based on ceph/src/test/ceph_objectstore_tool.py but only does
replicated pool testing and doesn't test argument validation.

Signed-off-by: David Zafman <david.zafman@inktank.com>

rgw: increase the number of OSDs for erasure coded pools

So that there never is less than 4 osd which is the minimum when trying
erasure coded workloads that only work with 4 osd.

http://tracker.ceph.com/issues/9298 Fixes: #9298

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Merge pull request #115 from dachary/wip-erasure-code-workloads

erasure-code: do not schedule lrc workloads just yet

erasure-code: do not schedule lrc workloads just yet

testing after renaming is in progress

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Merge pull request #114 from dachary/wip-erasure-code-workloads

DNM: erasure-code: add various erasure-code workloads

erasure-code: add to suites/upgrade/*-x final workloads

And replace the ec-readwrite.yaml custom workloads with links to the
workloads found in the erasure-code directory.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

erasure-code: add various erasure-code workloads

The erasure-code directory is populated with files describing rados
workloads suitable to test the default erasure code plugins. They are
linked to the rados suite. The pre-existing rados workloads from the
rados suite are replaced with those. Two workloads only differed by the
fact that one of them had less operations than the other. The more
complete set of operations is kept and used for all workloads to
maximize coverage.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Merge pull request #113 from ceph/ceph-deploy-dmcrypt

Added dmcrypt option and ability to choose same or different disk for ce...

added config_options to enable adding ceph config file entries to ceph-deploy task

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Added dmcrypt option and ability to choose same or different disk for ceph journal

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #101 from ceph/wip-7810

Wip 7810

Merge pull request #111 from ceph/wip-fix-stress_split

Moved mon.c to the first host with mon.a and mon.b to address the issue

Moved mon.c to the first host with mon.a and mon.b to address the issue
Sage found:
"... supposed to have half dumpling, half x osds. but the steps that upgrade and restart the mons upgrade the packages on the second host (which should remain dumpling w/ osd 3,4,5)"

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #110 from ceph/wip-fix-stress_split

Moved mon.c to teh first host with mon.a and mon.b to address the issue ...

Moved mon.c to teh first host with mon.a and mon.b to address teh issue Sage found
"... supposed to have half dumpling, half x osds.  but the steps that upgrade and restart the mons upgrade the packages on the second host (which should remain dumpling w/ osd 3,4,5)"

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #109 from ceph/wip_fix_firefly-x

Added sequential: clause, so test stop thrashing the mon after it runs t...

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added sequential: clause, so test stop thrashing the mon after it runs that one workload

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #105 from ceph/wip-boto

tasks/s3tests: push boto config with idle_timeout setting

Merge pull request #106 from ceph/wip-9091-wusui

mplement ceph.created_pool

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #107 from dachary/wip-9209-ec-workload

erasure-code: add jerasure k=3 m=1 workload

erasure-code: add jerasure k=3 m=1 workload

It validates that http://tracker.ceph.com/issues/9209 is fixed.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

thrashosds: increase osd revive timeout (75s -> 150s)

This is needed when running valgrind.

Signed-off-by: Sage Weil <sage@redhat.com>

mplement ceph.created_pool

ceph.created_pool allows the user (via yaml lines) to add pools
that the ceph_manager knows about.

Fixes: 9091
Signed-off-by: Warren Usui <warren.usui@inktank.com>

set boto timeout, too, for s3tests

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/s3tests: push boto config with idle_timeout setting

Signed-off-by: Sage Weil <sage@redhat.com>

suites/fs: add cephfs_journal_tool test

Fixes: #4886
Signed-off-by: John Spray <john.spray@redhat.com>

gitignore: ignore vim temp files

Signed-off-by: John Spray <john.spray@redhat.com>

suites/fs: add client recovery

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/mds_client_recovery: use existing clients

This will enable using .yaml changes to switch this
guy over to use kcephfs client once the teuthology
code around it supports all the same hooks as I've added
for fuse.

Signed-off-by: John Spray <john.spray@redhat.com>