Testing

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed restart

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Modified restart to have mon.a, mon.b, mon.c, osd.0, osd.1

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Restart osd only added

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Put mds after ods in restart

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Cleaned up tests structure

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

removed a test that was upgrading client when workload was in progress.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

apache: switch to use the apache worker mpm

Fixes: #9169
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit c3b53c326558dd3dd435c9e3fdbc07d8c15f4e68)

apache: change template to load mpm worker module

in apache 2.4

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 35c9cae84c7964ad96381c7455c40e43dd6b4a8d)

Merge pull request #210 from ceph/wip-9419

Fixed dirs strucrture

Fixed dirs strucrture

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

upgrade/firefly: don't thash primary affinity with dumpling clients

Fixes: #9865
Signed-off-by: Sage Weil <sage@redhat.com>

tasks/thrashosds: support overrides

e.g.,

overrides:
  thrashosds:
    thrash_primary_affinity: false
...
tasks:
- install:
- ceph:
- thrashosds:
- workunit:
...

Needed for #9865

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7e41c93ed894823cdc53a0eed214edd86a00fbdc)

Smarter s3tests branch selection

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
(cherry picked from commit 1b8d31986a5a8bc4cd9fea90eb680db3ca1866c8)

s/ceph_test_rados/rados_loadgen_big workload
fixes: #9610

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #203 from ceph/wip-9419

Fixed dir structure problem

fixed issue:9288 in firefly:older suite - avoid upgrading clients
in paralllel to the workloads

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

fixing issue with bug:9288 - do not upgrade clients when workload is
running in parallel

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Fixed rgw task, added logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip-9419

Fixed dir structure problem

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #198 from ceph/wip-9419

Added a case to test #9419 as part of nightlies runs (task #9568)

Fixed sytax errors, removed "sequential" clause per Tamil's comments.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

added new test to upgrade client first and also added rbd workload
to run in parallel to upgrades in firefly/older and firefly/newer suites

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Now indeed added rgw workload

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed double 'tasks' incorrect lines, added rados and rgw workloads

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added a case to test #9419 as part of nightlies runs
(task #9568)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

dont run rbd tests parallel to upgrades

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge branch 'firefly' of github.com:ceph/ceph-qa-suite into firefly

Merge pull request #186 from ceph/wip_9758

Wip 9758 (version to version upgrades firefly)

Fixed dirs structure and distros

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed hardcodeded  v0.80.7 and replaced with firefly branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typos

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Adding new tests, so we have two upgrade paths now:

In all-x/versions-steps-x.yaml
v0.80.4 -> v0.80.5 -> v0.80.6 -> v0.80.7 -> -x (branch to be tested)

and
in all/versions-steps.yaml
v0.80.4 -> v0.80.5 -> v0.80.6 -> firefly (v0.80.7 latest)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed last step to 'firefly', in order to keep *only* released versions in ths test.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed extra workload tag from workload3

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Better logging

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Changed test-upgrade-firefly.sh to test.sh - no need to use it for this test

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation more ...

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation more

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added v0.80.7, incorporated more comments, increased amount of worloads, added more prints.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Incorporated all Tamil's comments, nut #4 (branch "firefly-original" for s3tests)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Replaced parallel with sequential.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip_9758

added ceph task

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

optimizing upgrade tests

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

fixed syntax

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

optimizing upgrade tests

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #194 from ceph/wip-9769

Wip 9769

Fixes #9769, the upgrade sequence upgrades osds first and then the mds at the end

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip-9769

upgrade/firefly: put client on separate node

Fixes #9769, added overrides for legacy crush tunables

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Switched claint's nodes

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Prep PR to address "mon warn on legacy crush tunables: false" issue

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Put clients on different nodes to avoid conflict running with import_export.sh

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixing

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixes #9769, added overrides for legacy crush tunables

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

client.0 and client.1 on separate nodes and added upgrade step for client.1

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added one more workload and one more step upgarde to teh current firefly branch, e.g. v0.80.7

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added mon.a and mon.b tp upgrade

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Moved install.upgrades under upgrade-sequence, sequential block

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge branch 'firefly' of https://github.com/ceph/ceph-qa-suite into wip_9758

Merge pull request #185 from ceph/wip_fix_latest

Moved latest_dumpling_release.yaml to teh oler dir

Moved latest_dumpling_release.yaml to teh oler dir

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed workload by adding parallel clause

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed yaml

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

First draft for version-a to version-b suite

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #173 from ceph/wip_9709

Wip 9709

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Add latest dumpling point release to the mix

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #161 from ceph/wip_add_firefly_version

Added version v0.80.6

Added version v0.80.6

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rados/singleton-nomsgr/all/objectstore: clean up

ceph_test_objectstore scribbles in $CWD.  Keep it inside $TESTDIR and
clean up when we are done.

Fixes: #8395
Signed-off-by: Sage Weil <sage@inktank.com>
(cherry picked from commit 5be30f0d9bba46684ecf37310a6d09ae4f0ac528)

suites/fs: update to latest mdtest

They appear to have (accidentally?) fixed whatever
was crashing.

Fixes: #9177
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit bda325b33b036ac110bbc65f62019aa76d05ae3b)

ceph_manager: reset timeout if we are making progress in wait_for_recovery

Signed-off-by: Samuel Just <sam.just@inktank.com>
(cherry picked from commit 8d9d724b7f2f6c2984b0ee58a5a91f79820719f2)

thrashers/mapgap.yaml: ignore osd_map_cache_size warning

Signed-off-by: Samuel Just <sam.just@inktank.com>
(cherry picked from commit 77670aeadf9f2f43db5858ad096016353ce578bb)

rados/singleton/all/thrash_cache_writeback_forward_none: thrash cache pool drain

Enable/disable cache pool against a running workload.

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
(cherry picked from commit f8282df84d5ce760653ff1d3a9d8ea4e1391fba0)

set boto timeout, too, for s3tests

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9e5397237857d9015ac8c9e908f0cbeb1777576d)

Conflicts:

machine_types/vps.yaml

tasks/s3tests: push boto config with idle_timeout setting

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9d466aa110e293cb88c1f61cc7391d59b64b553b)

thrashosds: increase osd revive timeout (75s -> 150s)

This is needed when running valgrind.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 12a391ea011a772dbcc720b825f7b8dd8ecbf702)

use 'mon create-initial' always

But don't error if it fails, as this would mean that the monitors
are just taking longer to form quorum. Go and try the next block which will
wait up to 15 minutes for a successful gatherkeys to happen (that only works
if monitors have formed quorum).

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
(cherry picked from commit 70a1f18adfdf673b983cc7f5f2c78abb899001c7)

ignore errors on informational service status

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
(cherry picked from commit 5b946e1a6df8b7f80001f5176435eb36b12711e3)

use the right syntax for RHEL/CentOS distros to check for ceph status

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
(cherry picked from commit 4b15d0118ec000fe1e947131a62ef9990b23e9f4)

rgw: httpd instead of httpd.worker

httpd exists on rhel 6.5 too ...

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f7b32bcc318c4a700628d87826080a043f89a22c)

rgw: need alll of mod unixd, version, authz

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6392758f1bf503c3bbb2b3ad2f2ee9e6f79d6841)

tasks/rgw: include mod_authz

As per http://www.webhostingtalk.com/showthread.php?t=1173594

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 27b7eceeae1e48d0ad8dd820c3b84442bfffa406)

tasks/rgw: get mpm_event frmo mods-available, not mods-enabled

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2aae91929f720c54f406b7612631d82b27c98fe6)

Add extra conf for Apache 2.4

Inside a conditional to affect only 2.4, set User, Group, and the
module config to load mpm_event.  This is normally done with the
default configuration files, but since this abbreviated conf bypasses
those, we must set them here.

Signed-off-by: Dan Mick <dan.mick@inktank.com>
(cherry picked from commit 9de5bd1d2302907c59594eb4df8b4d954d5e8e94)

Merge pull request #97 from dachary/firefly

rgw.yaml: keep the client.0 key even if empty (firefly)

rgw.yaml: keep the client.0 key even if empty

Because rgw.py iterates over it to run the rgw server. If it is removed
the rgw servers are not run and all fails.

Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 5cfcb76860302386375ca0cf1c7a960ef6659a75)

Merge pull request #93 from ceph/wip-9126-firefly

rgw: s/idle_timeout/default_idle_timeout/

rgw: s/idle_timeout/default_idle_timeout/

Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from da00662191e9ec173be50b551253f4460f369f9da)

rgw: add default_idle_timeout to allow override

Globally overriding the rgw idle_timeout is not possible because it it
needs to be done on a per client.0, client.1, etc. basis. Add the
default_idle_timeout key to the rgw config : it defaults to the
previously hardcoded default (30) and can be changed via the override.

The existing tasks that were previously overriding the idle_timeout on a
per client basis are changed to use the default_idle_timeout instead for
consistency and to allow a global override.

Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 54a7298cdd8d40aaf79615a1f580b66f83e48419)

Conflicts:
machine_types/vps.yaml
suites/smoke/verify/tasks/rgw_s3tests.yaml

ceph_manager: longer osd restart timeout

We bumped this on master and dumpling already

Signed-off-by: Sage Weil <sage@redhat.com>

Use Remote.user

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use teuthology's DaemonGroup

It has timeout support.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use newer orchestra API

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>