Use qemu-kvm in the qemu task for rpm based systems.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #299 from ceph/wip-10538

Add v0.80.8 to firefly stable suites (issue 10538)

Added "force-branch: firefly-original" to make sure we run on good s3tests branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typos

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added new v0.80.8 to
/newer
singleton/version
singleton/version-x
Added more logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #297 from ceph/wip-10525

Changed to "osd map max advance: 1000"

Added warning "osd_map_max_advance" to the whitelist to aviod fail on it

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Changed to "osd map max advance: 1000"

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #295 from ceph/wip-10525

Changed to "osd map max advance: 1000"

Changed to "osd map max advance: 1000"

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #294 from ceph/wip-10525

Replaced step for v0.80.6 with v0.80.7

Replaced step for v0.80.6 with v0.80.7

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #292 from ceph/wip-10525

Fixes http://tracker.ceph.com/issues/10525

Fixes http://tracker.ceph.com/issues/10525

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #289 from ceph/wip-10525

Fixes http://tracker.ceph.com/issues/10525

Fixes http://tracker.ceph.com/issues/10525

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge remote-tracking branch 'gh/wip-slow-backend-firefly' into firefly

drop tiobench tests

The tiobench software has been abandoned upstream for years. Fedora and
Debian are no longer shipping the tiobench package, so we've had to
carry the package ourselves in the Ceph project, and we're trying to
slim down our dependencies where it makes sense to do so.

Nuke the tiobench tests.

http://tracker.ceph.com/issues/10152 Refs: #10152

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
(cherry picked from commit 8a317125fc542667e57c66017db6e80a3edc24f2)

Conflicts:
suites/kcephfs/cephfs/tasks/kclient_workunit_suites_tiobench.yaml

tasks/s3tests: add slow backend configurable

Adding this so that we can modify the clients' conf file as needed with slow backend.
This can be achieved by:

overrides:
  s3tests:
    slow_backend: true

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 61409179dfdd6969c624dd741813291332644003)

rgw: mark ec related rgw suites as slow backend

We want to avoid tests that time out due to a too slow backend.

Reviwed-by: Josh Durgin <josh.durgin@inktank.com>
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Inherit teuthology's log level

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 31ff241f5a74d455d6e61f02065f2df43d3fa978)

Merge pull request #267 from ceph/wip-firelfy-yuriw

Removed import_export tests to fix #10176

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Removed import_export tests to fix #10176

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

radosgw-admin: wait before trimming usage

Fixes: #9892
Need to wait through the usage interval before trimming usage, otherwise we might not
remove all pending usage info.

Backport: dumpling, firefly, giant

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit dd09ecbfab8a659f3faaf879a52849caab5e8e8e)
(cherry picked from commit 47d56d779eb145f5bca1e8e1efdeec8be92b6579)

Merge pull request #255 from ceph/revert-251-wip-10178-firefly

Revert "fix mon restart in firefly upgrade tests"

Revert "fix mon restart in firefly upgrade tests"

Merge pull request #253 from ceph/wip-firelfy-yuriw

Removed import_export tests to fix #10176

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Removed import_export tests to fix #10176

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #251 from ceph/wip-10178-firefly

fix mon restart in firefly upgrade tests

upgrade/firefly: do not wait for clean when restarting mons

This may fail is the quorum features to not match.

Fixes: #10178
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #242 from ceph/wip-10057-firefly

ms die on skipped message = false for all krbd, kclient tasks

ms die on skipped message = false for all krbd, kclient tasks

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 219b72b6fdd5a020f266b3675fb149cce6cbac8e)

fs/basic/tasks/cfuse_workunit_misc: timeout at 6h

The multiple_rsync can take a while.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c58af9f26b63bd1df0c43706e5eda58953454eab)

fs/multiclient: force mpi tests onto trusty

This will ensure we have a matching version of MPI.

Signed-off-by: Sage Weil <sage@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 0a88b34ba350b9eb057a735fe8082ebf03762327)

Merge pull request #231 from ceph/wip-firelfy-yuriw

Reverted to have upgrade-osd-mon-mds sequence for newer tests of firefly...

Added [client.0] for ceph-fuse, fixes looping issue for firefly upgrade suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Reverted to have upgrade-osd-mon-mds sequence for newer tests of firefly stable suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #229 from ceph/wip-firelfy-yuriw

Removed sequence upgrading osd before mon as invalid, fixes http://tracker.ceph.com/issues/7679

Removed sequence upgrading osd before mon as invalid, fixes http://tracker.ceph.com/issues/7679

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #224 from ceph/wip-9710

Wip 9710

Removed second rgw task as we need only one when combibed (+) workloads s3tests abd swift

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added "+"to all workloads to reduce amount of jobs

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #220 from ceph/wip-9419

Changed load to rados/load-gen-big.sh

Changed load to rados/load-gen-big.sh

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #219 from ceph/wip-9419

Wip 9419

Removed msd from upgrade sequence, as it's not correct for dumpling-to-firefly upgrade steps and removed cls line

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Restored restart order

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Changed rados workload to test-upgrade-firefly.sh on dumplimg branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Testing

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #218 from ceph/wip-9419

Restart osd only added

Fixed restart

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Modified restart to have mon.a, mon.b, mon.c, osd.0, osd.1

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Restart osd only added

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #217 from ceph/wip-9419

Cleaned up tests structure

Put mds after ods in restart

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #209 from ceph/wip-9866

upgrade client node before finish

Cleaned up tests structure

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

upgrade/firefly: upgrade client host before doing final workloads

This triggered an error on older because s3tests triggers a but in the
original radosgw, but we may as well do it for the newer/ ones too.

Fixes: #9866
Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: don't thash primary affinity with dumpling clients

Fixes: #9865
Signed-off-by: Sage Weil <sage@redhat.com>

tasks/thrashosds: support overrides

e.g.,

overrides:
  thrashosds:
    thrash_primary_affinity: false
...
tasks:
- install:
- ceph:
- thrashosds:
- workunit:
...

Needed for #9865

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7e41c93ed894823cdc53a0eed214edd86a00fbdc)

Smarter s3tests branch selection

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
(cherry picked from commit 1b8d31986a5a8bc4cd9fea90eb680db3ca1866c8)

s/ceph_test_rados/rados_loadgen_big workload
fixes: #9610

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #203 from ceph/wip-9419

Fixed dir structure problem

fixed issue:9288 in firefly:older suite - avoid upgrading clients
in paralllel to the workloads

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

fixing issue with bug:9288 - do not upgrade clients when workload is
running in parallel

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Fixed rgw task, added logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip-9419

Fixed dir structure problem

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #198 from ceph/wip-9419

Added a case to test #9419 as part of nightlies runs (task #9568)

Fixed sytax errors, removed "sequential" clause per Tamil's comments.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

added new test to upgrade client first and also added rbd workload
to run in parallel to upgrades in firefly/older and firefly/newer suites

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Now indeed added rgw workload

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed double 'tasks' incorrect lines, added rados and rgw workloads

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added a case to test #9419 as part of nightlies runs
(task #9568)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

removed a test that was upgrading client when workload was in progress.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

apache: switch to use the apache worker mpm

Fixes: #9169
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit c3b53c326558dd3dd435c9e3fdbc07d8c15f4e68)

apache: change template to load mpm worker module

in apache 2.4

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 35c9cae84c7964ad96381c7455c40e43dd6b4a8d)

Merge pull request #210 from ceph/wip-9419

Fixed dirs strucrture

Fixed dirs strucrture

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

dont run rbd tests parallel to upgrades

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge branch 'firefly' of github.com:ceph/ceph-qa-suite into firefly

Merge pull request #186 from ceph/wip_9758

Wip 9758 (version to version upgrades firefly)

Fixed dirs structure and distros

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed hardcodeded  v0.80.7 and replaced with firefly branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typos

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Adding new tests, so we have two upgrade paths now:

In all-x/versions-steps-x.yaml
v0.80.4 -> v0.80.5 -> v0.80.6 -> v0.80.7 -> -x (branch to be tested)

and
in all/versions-steps.yaml
v0.80.4 -> v0.80.5 -> v0.80.6 -> firefly (v0.80.7 latest)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed last step to 'firefly', in order to keep *only* released versions in ths test.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed extra workload tag from workload3

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Better logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Changed test-upgrade-firefly.sh to test.sh - no need to use it for this test

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation more ...

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation more

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added v0.80.7, incorporated more comments, increased amount of worloads, added more prints.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Incorporated all Tamil's comments, nut #4 (branch "firefly-original" for s3tests)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Replaced parallel with sequential.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip_9758

added ceph task

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

optimizing upgrade tests

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>