Add centos/rhel7 to distros 'all' folder.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge pull request #99 from ceph/wip-hadoop

reorg hadoop tests

Reviewed-by: Greg Farnum <greg@inktank.com>

suites/hadoop: update workunit names

These were renamed/reorged.

Signed-off-by: Sage Weil <sage@redhat.com>

rgw: httpd instead of httpd.worker

httpd exists on rhel 6.5 too ...

Signed-off-by: Sage Weil <sage@redhat.com>

rgw: need alll of mod unixd, version, authz

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/rgw: include mod_authz

As per http://www.webhostingtalk.com/showthread.php?t=1173594

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/rgw: get mpm_event frmo mods-available, not mods-enabled

Signed-off-by: Sage Weil <sage@redhat.com>

Add extra conf for Apache 2.4

Inside a conditional to affect only 2.4, set User, Group, and the
module config to load mpm_event.  This is normally done with the
default configuration files, but since this abbreviated conf bypasses
those, we must set them here.

Signed-off-by: Dan Mick <dan.mick@inktank.com>

Merge pull request #96 from dachary/wip-8988-default-idle-timeout

rgw.yaml: keep the client.0 key even if empty

Merge pull request #89 from dachary/wip-9027-create-unique-pool

initialize ctx.manager in ceph.py

Reviewed-by: Sage Weil <sage@redhat.com>

rgw.yaml: keep the client.0 key even if empty

Because rgw.py iterates over it to run the rgw server. If it is removed
the rgw servers are not run and all fails.

Signed-off-by: Loic Dachary <loic@dachary.org>

replace locally instantiated CephManager

Use the ctx.manager instance created by ceph.py instead

Signed-off-by: Loic Dachary <loic@dachary.org>

initialize ctx.manager in ceph.py

instead of rados.py because ceph.py is only run once where rados.py
could be run multiple time, leading to race conditions

http://tracker.ceph.com/issues/9027 Fixes: #9027

Signed-off-by: Loic Dachary <loic@dachary.org>

move functions from ceph to ceph_manager

mount_osd_data and make_admin_daemon_dir are only used by
ceph_manager.py although they are defined in ceph.py

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #90 from dachary/wip-8988-default-idle-timeout

rgw: s/idle_timeout/default_idle_timeout/

Reviewed-by: John Spray <john.spray@redhat.com>

rgw: s/idle_timeout/default_idle_timeout/

Signed-off-by: Loic Dachary <loic@dachary.org>

rest-api tests: enable debugging

Hoping to catch #9058

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #86 from dachary/wip-9027-create-unique-pool

rados.py: avoid CephManager creation race

Merge pull request #87 from dachary/wip-8988-default-idle-timeout

rgw: add default_idle_timeout to allow override

rgw: add default_idle_timeout to allow override

Globally overriding the rgw idle_timeout is not possible because it it
needs to be done on a per client.0, client.1, etc. basis. Add the
default_idle_timeout key to the rgw config : it defaults to the
previously hardcoded default (30) and can be changed via the override.

The existing tasks that were previously overriding the idle_timeout on a
per client basis are changed to use the default_idle_timeout instead for
consistency and to allow a global override.

Signed-off-by: Loic Dachary <loic@dachary.org>

rados.py: avoid CephManager creation race

gevent may hold the rados.py thread when it has an opportunity. The

   if not hasattr(ctx, 'manager'):

must therefore be immediately before the manager creation it is supposed
to protect. If any of the functions called as a side effect of

   first_mon = teuthology.get_first_mon(ctx, config)
   (mon,) = ctx.cluster.only(first_mon).remotes.iterkeys()

give gevent an opportunity to hold the thread, it creates a race
condition.

The other possibility would be use a ctx lock to protect the code, but
this solution seem simpler.

http://tracker.ceph.com/issues/9027 Fixes: #9027

Signed-off-by: Loic Dachary <loic@dachary.org>

s/apache2/apache

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #100 from ceph/wip-9154

use the right syntax for RHEL/CentOS distros to check for ceph status

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #98 from ceph/rgw_civetweb

bug 8927: include frontend:civetweb for rgw tests

use the right syntax for RHEL/CentOS distros to check for ceph status

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

Merge pull request #85 from dachary/wip-rgw-idle-timeout

overrides: rgw must not be nested in ceph

overrides: rgw must not be nested in ceph

Signed-off-by: Loic Dachary <loic@dachary.org>

s/apache/apache2

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Added a facet to test both apache and civetweb as frontend for rgw

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge pull request #83 from ceph/wip_add_manual_override2

Added idle_timeout: to fix time-outs problems for some tests

bug 8927: enable civetweb testing for rgw

Fixed syntax

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added idle_timeout: to fix time-outs problems for some tests

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #81 from ceph/wip_add_manual_override

Added overrides for vps time outs

Added overrides for vps time outs

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Update module references

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge branch 'teuth_master' into tasks_master

Import teuthology tasks (master branch)

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Removed upgrade/dumpling from master branch as it should be only in dumpling branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #75 from ceph/wip-readforward

include readforward cache mode in cache mode cycling test

Reviewed-by: Samuel Just <sam.just@inktank.com>

Merge pull request #306 from ceph/wip-9024

ignore errors if 'ps aux' fails

ignore errors if 'ps aux' fails

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

rados/singleton: make cache mode cycling include readforward mode

 forward -> off -> writeback -> readforward -> ...

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #305 from ceph/wip-8640

implement `--version` and improve `setup.py`

create a --version flag for teuthology

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

pull the version and description in setup.py

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

add an initial version to teuthology

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

Tweak usage statement

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #304 from ceph/wip-fix-build-matrix

suite: fix build_matrix when non-yaml present in % dir

suite: fix build_matrix when non-yaml present in % dir

First, if we get a non-yaml file, return an empty list.

Second, if we are in a % mode, exclude an empty raw result from the
combination.  Otherwise, we get no resulting jobs.

Signed-off-by: Sage Weil <sage@redhat.com>

adding multi-version suite to test compatibility of clients running newer
version of ceph against servers running older version.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

Merge pull request #76 from ceph/wip_tune2_upgrade-firefly

Added ec-readwrite.yaml to the mix to enable erasure code coverage

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Added ec-readwrite.yaml to the mix to enable erasure code coverage

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #303 from ceph/wip-8930

Tasks are failing since using "data" pool no longer part of default install

Reviewed-by: Sage Weil <sage@redhat.com>

Tasks are failing since using "data" pool no longer part of default install

Create a pool specifically for each task

Fixes: 8930
Signed-off-by: David Zafman <david.zafman@inktank.com>

Expand '~' in ssh key paths

... since paramiko doesn't bother to do this

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

Merge pull request #301 from ceph/wip-nuke-vpm

nuke: allow nuking vpm hosts

kcephfs/thrash: add standby mds

Signed-off-by: Sage Weil <sage@redhat.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

ceph_manager: increase osd revival timeout from 75 -> 150 seconds

Saw this fail on a firefly run just bc of valgrind slowness.  Make the
timeout higher!

Signed-off-by: Sage Weil <sage@redhat.com>

valgrind: ignore ec plugin factory leaks

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #300 from ceph/wip-mpi-vers

task/mpi: Explicit check for version mismatch

Merge pull request #302 from ceph/wip-8850

tell us if you are really not running any more

add another call to use "ps aux"

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

tell us if you are really not running any more

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

nuke: allow nuking vpm hosts

Skip the console check, though.

Signed-off-by: Sage Weil <sage@redhat.com>

kcephfs: thrash mds too

And shorten names.

Signed-off-by: Sage Weil <sage@redhat.com>

task/mpi: Explicit check for version mismatch

Instead of proceeding to have mpiexec fail or hang,
do an up-front check that the MPI version is the same
on all of the nodes in the test.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #53 from ceph/wip-leaks

use notcmalloc to fix leak checking

Merge pull request #67 from ceph/wip_fix_emperor-x

Fixed -x in the suite, this fixed http://tracker.ceph.com/issues/8862

Fixed -x in the suite, this fixed http://tracker.ceph.com/issues/8862

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fix package_version_for_hash() call

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #62 from ceph/wip-standbyreplay

suites/fs: add a standbyreplay configuration

task/mds_journal_migration: fix cleanup

Previously this was remounting in the background
which meant that if a workunit was executed immediately
afterwards it could put files in the mount dir before
the FS was mounted, causing the mount to fail.

Signed-off-by: John Spray <john.spray@redhat.com>

suites/fs: add a standbyreplay configuration

A place for any tests which should be run with
standbyreplay MDSs in play.  Initially just
the mds_journal_migration task, to cover
the #8811 case.

Signed-off-by: John Spray <john.spray@redhat.com>

Update README

Update README

dumpling-firefly-x: document structure of suite

Hopefully this makes it easier to digest and maintain
than reading yaml fragments.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
Signed-off-by: Yuri Weintstein <yuri.weinstein@inktank.com>

task/workunit: add sudo to dir delete

This failure to delete used to be hidden in
a catch-all exception handler that was
removed in 396dc073.

This was causing failures in kcephfs suite
like:
Command failed on plana96 with status 1: 'rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0'

Signed-off-by: John Spray <john.spray@redhat.com>

rados/singleton/all/rest-api: add mds.a

The test expects an MDS.

Signed-off-by: Sage Weil <sage@inktank.com>

added a new test for rgw_readwrite with front end as civetweb instead of apache

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added a new test for rgw_readwrite with front end as civetweb instead of apache

Merge pull request #66 from ceph/wip_tune_upgrade-firefly

Changed upgrade order and re-enabled rados/tests.sh

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Changed upgrade order and re-enabled rados/tests.sh

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #296 from ceph/wip-standby-mds

Wip standby mds

task/osd_recovery: use rbd instead of metadata pool

Signed-off-by: Sage Weil <sage@redhat.com>

task/osd_backfill: use 'rbd' instead of 'data' pool

Signed-off-by: Sage Weil <sage@redhat.com>

task/workunit: general tidy

* PEP8-ize whitespace
* specialize a catch-all except:
* don't alias 'misc' to 'teuthology'

Signed-off-by: John Spray <john.spray@redhat.com>

task/workunit: clean up dir deletion

This was always trying to remove the mountpoint,
and then swallowing the exception and printing
it to the log.

Instead:
 * Ensure it's only trying to delete mnt if it created it
 * Don't swallow those exceptions: if deleting the dirs
   fails then something has gone wrong and it should bubble
   up.

Signed-off-by: John Spray <john.spray@redhat.com>

task/cephfs: generalise Filesystem for multi-MDS

This enables tasks like mds_journal_migration to be
run in an environment with standby-replay MDSs present.

Signed-off-by: John Spray <john.spray@redhat.com>

rados/verify: increase api tests timeout

This has been timing out for weeks to months (hard to say since before that
we were consistently hitting an OSD crash on shutdown).  The runs I've looked
at are making progress and seem fine ... just slow because of valgrind and
because of thrashing.

Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>

use notcmalloc builder for valgrind leak checking

This reverts 453d72b294af6d3db1ae7a212ba9b43209d69f26.  It turns out that
tcmalloc defeats the leak checking in valgrind.

Signed-off-by: Sage Weil <sage@inktank.com>

Remove oddly-placed, broken import

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Rename CephState to DaemonGroup and move to orchestra

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move DaemonState to teuthology.orchestra

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

clusters/fixed-3-cephfs.yaml: put client.0 on separate node, remove client.1

Only one job needs 2 clients; put them on separate hosts.  They should not
be colocated with the OSDs!

Signed-off-by: Sage Weil <sage@redhat.com>

rados/objectstore: move objectstore related tests from singleton-nomsgr

Just so they're in a nice convenient bunch.

Signed-off-by: Sage Weil <sage@redhat.com>

added debug messages for radosbench.yaml

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>