Control the nfs service correctly on rpm-based systems

This fixes issue #11020

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 2e4d884fdaabbeca67b519537a80166d3cc99fa3)

Fixes #11013, use time.sleep instead of manager.sleep which isn't there.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 811c02e3922c4ae29c09bb5f7b48840d0eced951)

workunit: include /usr/sbin in the PATH for all commands

Fixes: #10600
Backport: hammer, giant, firefly, dumpling

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 0e53f5f38b0cb06a6f4989e622a279c8ba9104eb)

Merge pull request #355 from dachary/wip-cram-firefly

all tests must end with .t

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

pull fsstress.sh tests from the firelfy branch

Signed-off-by: Loic Dachary <loic@dachary.org>

all tests must end with .t

The hb=firelfy cannot end the URL because of this constraint.

Signed-off-by: Loic Dachary <loic@dachary.org>

rbd: fix typo in url

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #351 from dachary/wip-cram-firefly

pull cram tests from the firelfy branch

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #352 from dachary/wip-qemu-firefly

Use an NFS mount instead of virtio-9p in the qemu task

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Use an NFS mount instead of virtio-9p in the qemu task

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 93f2bea3530a523c7b2ac0575033697cea893f2d)

pull cram tests from the firelfy branch

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #348 from ceph/wip-10954-firefly

linter fixes for firefly

fix path for tox.ini to work on ceph-qa-suite only

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused import from ceph task

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused variable assignment

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9df27f7a1040dae69ef65122d13d1640cb1b6a66)

initial tox.ini to run flake8

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7108b699fda247ce12cbeaea9dd0a32843775c27)

ignore tox hidden dir

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 4068f73ade68e36c1e7653733eacf2b1288cd753)

fs: move into the ceph-fuse mount before doing a test

Fixes: #10465
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 8a5f76d10bc8bf0358f5215ac2aadfb210691507)

Add labels to a couple common task failures

The labels will help us quickly determine what the command was trying to
accomplish in log output.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit a965d6ca142c12c74124f73c9ef874df85e07e3d)

Conflicts:
tasks/workunit.py

extra_packages: stop trying to install libcephfs stuff

These package names all differ across distros, and they're included in
teuthology's install task anyway.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 977a221f9226cf479c9d2c1fbdd1d8df13bbce44)

tiobench: remove more of it which was somehow skipped

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

do not try and install libcephfs-java via extra_packages

It's been added to the default install task, because the
package name varies across distros.

Fixes: #10510
Signed-off-by: Greg Farnum <greg@gregs42.com>
(cherry picked from commit 30e5f3d93192a6bf2428ea4f8d793e2a087a5353)

samba: run only on ubuntu until #10627 is resolved

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 1dcff968a4fc359086723e8a3cb941051297f14a)

Use qemu-kvm in the qemu task for rpm based systems.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #299 from ceph/wip-10538

Add v0.80.8 to firefly stable suites (issue 10538)

Added "force-branch: firefly-original" to make sure we run on good s3tests branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typos

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added new v0.80.8 to
/newer
singleton/version
singleton/version-x
Added more logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #297 from ceph/wip-10525

Changed to "osd map max advance: 1000"

Added warning "osd_map_max_advance" to the whitelist to aviod fail on it

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Changed to "osd map max advance: 1000"

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #295 from ceph/wip-10525

Changed to "osd map max advance: 1000"

Changed to "osd map max advance: 1000"

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #294 from ceph/wip-10525

Replaced step for v0.80.6 with v0.80.7

Replaced step for v0.80.6 with v0.80.7

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #292 from ceph/wip-10525

Fixes http://tracker.ceph.com/issues/10525

Fixes http://tracker.ceph.com/issues/10525

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #289 from ceph/wip-10525

Fixes http://tracker.ceph.com/issues/10525

Fixes http://tracker.ceph.com/issues/10525

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge remote-tracking branch 'gh/wip-slow-backend-firefly' into firefly

drop tiobench tests

The tiobench software has been abandoned upstream for years. Fedora and
Debian are no longer shipping the tiobench package, so we've had to
carry the package ourselves in the Ceph project, and we're trying to
slim down our dependencies where it makes sense to do so.

Nuke the tiobench tests.

http://tracker.ceph.com/issues/10152 Refs: #10152

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
(cherry picked from commit 8a317125fc542667e57c66017db6e80a3edc24f2)

Conflicts:
suites/kcephfs/cephfs/tasks/kclient_workunit_suites_tiobench.yaml

tasks/s3tests: add slow backend configurable

Adding this so that we can modify the clients' conf file as needed with slow backend.
This can be achieved by:

overrides:
  s3tests:
    slow_backend: true

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 61409179dfdd6969c624dd741813291332644003)

rgw: mark ec related rgw suites as slow backend

We want to avoid tests that time out due to a too slow backend.

Reviwed-by: Josh Durgin <josh.durgin@inktank.com>
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Inherit teuthology's log level

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 31ff241f5a74d455d6e61f02065f2df43d3fa978)

Merge pull request #267 from ceph/wip-firelfy-yuriw

Removed import_export tests to fix #10176

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Removed import_export tests to fix #10176

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

radosgw-admin: wait before trimming usage

Fixes: #9892
Need to wait through the usage interval before trimming usage, otherwise we might not
remove all pending usage info.

Backport: dumpling, firefly, giant

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit dd09ecbfab8a659f3faaf879a52849caab5e8e8e)
(cherry picked from commit 47d56d779eb145f5bca1e8e1efdeec8be92b6579)

Merge pull request #255 from ceph/revert-251-wip-10178-firefly

Revert "fix mon restart in firefly upgrade tests"

Revert "fix mon restart in firefly upgrade tests"

Merge pull request #253 from ceph/wip-firelfy-yuriw

Removed import_export tests to fix #10176

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Removed import_export tests to fix #10176

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #251 from ceph/wip-10178-firefly

fix mon restart in firefly upgrade tests

upgrade/firefly: do not wait for clean when restarting mons

This may fail is the quorum features to not match.

Fixes: #10178
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #242 from ceph/wip-10057-firefly

ms die on skipped message = false for all krbd, kclient tasks

ms die on skipped message = false for all krbd, kclient tasks

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 219b72b6fdd5a020f266b3675fb149cce6cbac8e)

fs/basic/tasks/cfuse_workunit_misc: timeout at 6h

The multiple_rsync can take a while.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c58af9f26b63bd1df0c43706e5eda58953454eab)

fs/multiclient: force mpi tests onto trusty

This will ensure we have a matching version of MPI.

Signed-off-by: Sage Weil <sage@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 0a88b34ba350b9eb057a735fe8082ebf03762327)

Merge pull request #231 from ceph/wip-firelfy-yuriw

Reverted to have upgrade-osd-mon-mds sequence for newer tests of firefly...

Added [client.0] for ceph-fuse, fixes looping issue for firefly upgrade suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Reverted to have upgrade-osd-mon-mds sequence for newer tests of firefly stable suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #229 from ceph/wip-firelfy-yuriw

Removed sequence upgrading osd before mon as invalid, fixes http://tracker.ceph.com/issues/7679

Removed sequence upgrading osd before mon as invalid, fixes http://tracker.ceph.com/issues/7679

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #224 from ceph/wip-9710

Wip 9710

Removed second rgw task as we need only one when combibed (+) workloads s3tests abd swift

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added "+"to all workloads to reduce amount of jobs

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #220 from ceph/wip-9419

Changed load to rados/load-gen-big.sh

Changed load to rados/load-gen-big.sh

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #219 from ceph/wip-9419

Wip 9419

Removed msd from upgrade sequence, as it's not correct for dumpling-to-firefly upgrade steps and removed cls line

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Restored restart order

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Changed rados workload to test-upgrade-firefly.sh on dumplimg branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Testing

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #218 from ceph/wip-9419

Restart osd only added

Fixed restart

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Modified restart to have mon.a, mon.b, mon.c, osd.0, osd.1

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Restart osd only added

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #217 from ceph/wip-9419

Cleaned up tests structure

Put mds after ods in restart

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #209 from ceph/wip-9866

upgrade client node before finish

Cleaned up tests structure

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

upgrade/firefly: upgrade client host before doing final workloads

This triggered an error on older because s3tests triggers a but in the
original radosgw, but we may as well do it for the newer/ ones too.

Fixes: #9866
Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/firefly: don't thash primary affinity with dumpling clients

Fixes: #9865
Signed-off-by: Sage Weil <sage@redhat.com>

tasks/thrashosds: support overrides

e.g.,

overrides:
  thrashosds:
    thrash_primary_affinity: false
...
tasks:
- install:
- ceph:
- thrashosds:
- workunit:
...

Needed for #9865

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7e41c93ed894823cdc53a0eed214edd86a00fbdc)

Smarter s3tests branch selection

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
(cherry picked from commit 1b8d31986a5a8bc4cd9fea90eb680db3ca1866c8)

s/ceph_test_rados/rados_loadgen_big workload
fixes: #9610

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #203 from ceph/wip-9419

Fixed dir structure problem

fixed issue:9288 in firefly:older suite - avoid upgrading clients
in paralllel to the workloads

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

fixing issue with bug:9288 - do not upgrade clients when workload is
running in parallel

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Fixed rgw task, added logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip-9419

Fixed dir structure problem

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #198 from ceph/wip-9419

Added a case to test #9419 as part of nightlies runs (task #9568)

Fixed sytax errors, removed "sequential" clause per Tamil's comments.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

added new test to upgrade client first and also added rbd workload
to run in parallel to upgrades in firefly/older and firefly/newer suites

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Now indeed added rgw workload

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed double 'tasks' incorrect lines, added rados and rgw workloads

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added a case to test #9419 as part of nightlies runs
(task #9568)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

removed a test that was upgrading client when workload was in progress.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

apache: switch to use the apache worker mpm

Fixes: #9169
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit c3b53c326558dd3dd435c9e3fdbc07d8c15f4e68)