Merge pull request #83 from ceph/wip_add_manual_override2

Added idle_timeout: to fix time-outs problems for some tests

Fixed syntax

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added idle_timeout: to fix time-outs problems for some tests

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #81 from ceph/wip_add_manual_override

Added overrides for vps time outs

Added overrides for vps time outs

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Update module references

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge branch 'teuth_master' into tasks_master

Import teuthology tasks (master branch)

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Removed upgrade/dumpling from master branch as it should be only in dumpling branch

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #75 from ceph/wip-readforward

include readforward cache mode in cache mode cycling test

Reviewed-by: Samuel Just <sam.just@inktank.com>

Merge pull request #306 from ceph/wip-9024

ignore errors if 'ps aux' fails

ignore errors if 'ps aux' fails

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

rados/singleton: make cache mode cycling include readforward mode

 forward -> off -> writeback -> readforward -> ...

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #305 from ceph/wip-8640

implement `--version` and improve `setup.py`

create a --version flag for teuthology

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

pull the version and description in setup.py

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

add an initial version to teuthology

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

Tweak usage statement

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #304 from ceph/wip-fix-build-matrix

suite: fix build_matrix when non-yaml present in % dir

suite: fix build_matrix when non-yaml present in % dir

First, if we get a non-yaml file, return an empty list.

Second, if we are in a % mode, exclude an empty raw result from the
combination.  Otherwise, we get no resulting jobs.

Signed-off-by: Sage Weil <sage@redhat.com>

adding multi-version suite to test compatibility of clients running newer
version of ceph against servers running older version.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

Merge pull request #76 from ceph/wip_tune2_upgrade-firefly

Added ec-readwrite.yaml to the mix to enable erasure code coverage

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Added ec-readwrite.yaml to the mix to enable erasure code coverage

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #303 from ceph/wip-8930

Tasks are failing since using "data" pool no longer part of default install

Reviewed-by: Sage Weil <sage@redhat.com>

Tasks are failing since using "data" pool no longer part of default install

Create a pool specifically for each task

Fixes: 8930
Signed-off-by: David Zafman <david.zafman@inktank.com>

Expand '~' in ssh key paths

... since paramiko doesn't bother to do this

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

Merge pull request #301 from ceph/wip-nuke-vpm

nuke: allow nuking vpm hosts

kcephfs/thrash: add standby mds

Signed-off-by: Sage Weil <sage@redhat.com>

Merge branch 'master' of github.com:ceph/ceph-qa-suite

ceph_manager: increase osd revival timeout from 75 -> 150 seconds

Saw this fail on a firefly run just bc of valgrind slowness.  Make the
timeout higher!

Signed-off-by: Sage Weil <sage@redhat.com>

valgrind: ignore ec plugin factory leaks

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #300 from ceph/wip-mpi-vers

task/mpi: Explicit check for version mismatch

Merge pull request #302 from ceph/wip-8850

tell us if you are really not running any more

add another call to use "ps aux"

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

tell us if you are really not running any more

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>

nuke: allow nuking vpm hosts

Skip the console check, though.

Signed-off-by: Sage Weil <sage@redhat.com>

kcephfs: thrash mds too

And shorten names.

Signed-off-by: Sage Weil <sage@redhat.com>

task/mpi: Explicit check for version mismatch

Instead of proceeding to have mpiexec fail or hang,
do an up-front check that the MPI version is the same
on all of the nodes in the test.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #53 from ceph/wip-leaks

use notcmalloc to fix leak checking

Merge pull request #67 from ceph/wip_fix_emperor-x

Fixed -x in the suite, this fixed http://tracker.ceph.com/issues/8862

Fixed -x in the suite, this fixed http://tracker.ceph.com/issues/8862

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fix package_version_for_hash() call

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #62 from ceph/wip-standbyreplay

suites/fs: add a standbyreplay configuration

task/mds_journal_migration: fix cleanup

Previously this was remounting in the background
which meant that if a workunit was executed immediately
afterwards it could put files in the mount dir before
the FS was mounted, causing the mount to fail.

Signed-off-by: John Spray <john.spray@redhat.com>

suites/fs: add a standbyreplay configuration

A place for any tests which should be run with
standbyreplay MDSs in play.  Initially just
the mds_journal_migration task, to cover
the #8811 case.

Signed-off-by: John Spray <john.spray@redhat.com>

Update README

Update README

dumpling-firefly-x: document structure of suite

Hopefully this makes it easier to digest and maintain
than reading yaml fragments.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
Signed-off-by: Yuri Weintstein <yuri.weinstein@inktank.com>

task/workunit: add sudo to dir delete

This failure to delete used to be hidden in
a catch-all exception handler that was
removed in 396dc073.

This was causing failures in kcephfs suite
like:
Command failed on plana96 with status 1: 'rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0'

Signed-off-by: John Spray <john.spray@redhat.com>

rados/singleton/all/rest-api: add mds.a

The test expects an MDS.

Signed-off-by: Sage Weil <sage@inktank.com>

added a new test for rgw_readwrite with front end as civetweb instead of apache

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

added a new test for rgw_readwrite with front end as civetweb instead of apache

Merge pull request #66 from ceph/wip_tune_upgrade-firefly

Changed upgrade order and re-enabled rados/tests.sh

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Changed upgrade order and re-enabled rados/tests.sh

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #296 from ceph/wip-standby-mds

Wip standby mds

task/osd_recovery: use rbd instead of metadata pool

Signed-off-by: Sage Weil <sage@redhat.com>

task/osd_backfill: use 'rbd' instead of 'data' pool

Signed-off-by: Sage Weil <sage@redhat.com>

task/workunit: general tidy

* PEP8-ize whitespace
* specialize a catch-all except:
* don't alias 'misc' to 'teuthology'

Signed-off-by: John Spray <john.spray@redhat.com>

task/workunit: clean up dir deletion

This was always trying to remove the mountpoint,
and then swallowing the exception and printing
it to the log.

Instead:
 * Ensure it's only trying to delete mnt if it created it
 * Don't swallow those exceptions: if deleting the dirs
   fails then something has gone wrong and it should bubble
   up.

Signed-off-by: John Spray <john.spray@redhat.com>

task/cephfs: generalise Filesystem for multi-MDS

This enables tasks like mds_journal_migration to be
run in an environment with standby-replay MDSs present.

Signed-off-by: John Spray <john.spray@redhat.com>

rados/verify: increase api tests timeout

This has been timing out for weeks to months (hard to say since before that
we were consistently hitting an OSD crash on shutdown).  The runs I've looked
at are making progress and seem fine ... just slow because of valgrind and
because of thrashing.

Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>

use notcmalloc builder for valgrind leak checking

This reverts 453d72b294af6d3db1ae7a212ba9b43209d69f26.  It turns out that
tcmalloc defeats the leak checking in valgrind.

Signed-off-by: Sage Weil <sage@inktank.com>

Remove oddly-placed, broken import

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Rename CephState to DaemonGroup and move to orchestra

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move DaemonState to teuthology.orchestra

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

clusters/fixed-3-cephfs.yaml: put client.0 on separate node, remove client.1

Only one job needs 2 clients; put them on separate hosts.  They should not
be colocated with the OSDs!

Signed-off-by: Sage Weil <sage@redhat.com>

rados/objectstore: move objectstore related tests from singleton-nomsgr

Just so they're in a nice convenient bunch.

Signed-off-by: Sage Weil <sage@redhat.com>

added debug messages for radosbench.yaml

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

Fail sooner if an invalid config_yaml is passed

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Removed rados/test.sh for now

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Remove kcon_most

It was unused.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #293 from ceph/wip-ship-utilities

move ship_utilities to install task (from ceph test)

ceph_deploy: use new ship_utilities location

Signed-off-by: Sage Weil <sage@redhat.com>

Remove mds role from rados & rgw tests

Follow up to a24efaef, remove the mds from
the (mainly singleton) test configs that
explicitly list it.

Signed-off-by: John Spray <john.spray@redhat.com>

Modified print task

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #64 from ceph/wip_dumpling-firefly-x_upgrade_suite

Wip dumpling firefly x upgrade suite

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-firefly-x: remove unnecessary files

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-firefly-x: upgrade clients to firefly

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

upgrade/dumpling-firefly-x: use correct tests against final workload

No reason to run old tests against new code here.

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/dumpling-firefly-x: rename final upgrade yamls; expect quorum

The difference is whether we upgrade all at once or each individually.

Also, expect a quorum between a mix of dumpling and firefly monitors.

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/dumpling-firefly-x: run firefly tests against firefly

At this point we've upgraded to firefly.

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/dumpling-firefly-x: test rados api

not sure why this was left off?

Signed-off-by: Sage Weil <sage@redhat.com>

upgrade/dumpling-firefly-x: drop useless line

Signed-off-by: Sage Weil <sage@redhat.com>

rados/singleton-nomsgr/all/alloc-hint: fix config syntax

Put in [osd] section.

Signed-off-by: Sage Weil <sage@redhat.com>

task/mds_journal_migration: use existing clients

Since refactoring ceph_fuse and kclient tasks
to store Mount objects on ctx, the mds_journal_migration
task can use those instead of explicitly instantiating its own.

Signed-off-by: John Spray <john.spray@redhat.com>

move ship_utilities to install task (from ceph test)

No need to install ceph just to get daemon-helper, adjust-ulimits, etc..
These utilities are used by lots of tasks, not just ceph.

Signed-off-by: Sage Weil <sage@redhat.com>

Removed upgrade-sequence to avoid failures (becasue 3-firefly-upgrade is downgrading then to firefly causing failures)

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rados/singleton-nomsgr/all/alloc-hint: enable xfs extsize for test

This is off by default; enable it for this test.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #61 from ceph/wip-no-mds

clusters: Remove mds from default fixed-* configs

Reviewed-by: Greg Farnum <greg@inktank.com>

clusters: Remove mds from default fixed-* configs

Create a separate fixed-3-cephfs cluster config for
use in the filesystem tests.

Signed-off-by: John Spray <john.spray@redhat.com>

Re-enabled rgw tests, #8846 should be fixed now

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed prints
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added prints

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed missed line

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Removed 'firefly' branch name,  upgrade step will be set to 'next' or 'master' from teuthology-suite comman line

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Again fixed identations

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed indentation

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Added print tasks

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>