remove redefined StringIO import

Signed-off-by: Alfredo Deza <adeza@redhat.com>

stdin is no longer a kwarg

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add the log object to ceph_manager

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused import from repair test

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add missing mon object to osd_failsafe

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused imports from populate_rbd

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused imports from peering_speed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused variable assignment

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove unused import in calamari_setup

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix undefined var in divergent_priors

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix lint errors on ceph_fuse

Signed-off-by: Alfredo Deza <adeza@redhat.com>

initial tox.ini to run flake8

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ignore tox hidden dir

Signed-off-by: Alfredo Deza <adeza@redhat.com>

rbd: fix copy-on-read setting

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

rbd: add merge_diff test

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #346 from ceph/wip-librbd-default-config

suites/rbd: add object map tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

suites/rbd: add object map tests

Enable the object map feature for CLI tests and librbd API tests.
Moved the CLI tests to a new group to exercise old format, basic
new format, and new format w/ object map.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

ceph: ugh fix syntax

Signed-off-by: Sage Weil <sage@redhat.com>

ceph: fix ps axuf lsof line

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #344 from tchaikov/log-exec-from-thrasher

Thrasher: log backtrace of thrown exception

Reviewed-by: Samuel Just <sjust@redhat.com>

Thrasher: log backtrace of thrown exception

* add a wrapper to log uncaught exception to self.logger, greenlet also
  prints the backtrace and exception to stderr, but teuthology.log does
  not capture stderr. so we need to catch them by ourselves to reveal
  more info to root-cause this issue.
* log uncaught exception thrown by Thrasher.do_thrash() to self.log.

See: #10630
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #343 from ceph/wip-10680

Use an NFS mount instead of virtio-9p in the qemu task

Use an NFS mount instead of virtio-9p in the qemu task

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #342 from ceph/wip-psauxf

ceph: ps axf too before lsof

ceph: ps axf too before lsof

Specifically, I want to know *who* is running the ceph-osd that is
holding the files open.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #341 from ceph/wip-path

workunit: include /usr/sbin in the PATH for all commands

Merge pull request #340 from ceph/hadoop-workunits

Hadoop workunits

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

workunit: include /usr/sbin in the PATH for all commands

Fixes: #10600
Backport: hammer, giant, firefly, dumpling

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #274 from ceph/wip-promote

rados/thrash: add readproxy facet

Merge pull request #313 from armaseg/master

teuthology: some suites still use http://ceph.newdream.net

hadoop: fixup for new replication test

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

Merge remote-tracking branch 'gh/hammer'

Fixed typoes

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit e2794173026c196a30ee042e6e77c4a278267dc2)

Fixed typo causing "too many values to unpack" error

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit fdd175514738fd4f6cf3dea6d56ffb2eda78d64b)

Fixes #10704

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit a9252436e81ab7d21110ffbe2f6b469f08e47d82)

Fixed typoes

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit e2794173026c196a30ee042e6e77c4a278267dc2)

Fixed typo causing "too many values to unpack" error

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit fdd175514738fd4f6cf3dea6d56ffb2eda78d64b)

Fixes #10704

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit a9252436e81ab7d21110ffbe2f6b469f08e47d82)

Merge pull request #337 from ceph/wip-umount

lsof on umount failure; catpure logs for aggressively

ceph: lsof if umount fails

Signed-off-by: Sage Weil <sage@redhat.com>

ceph: archive logs at very end

This ensures that we still gather the logs even if the other nested tasks
throw an exception in the finally block.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #339 from ceph/wip-10652-2

Fixes #10652

Fixes #10652

Removed firefly-giant dir as it's not needed
Fixed branch assignment in dumpling-x

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixes #10652
Removed firefly-giant dir as it's not needed
Fixed branch assignment in dumpling-x

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit a91994f09201fdf497798d2c8051b27189b5e486)

hadoop: add terasort task

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

Merge branch 'hammer' of https://github.com/ceph/ceph-qa-suite into hammer

Fixes #10652

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixes http://tracker.ceph.com/issues/10652

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #333 from ceph/teuthology-update

Mirror the supported distros used in nightlies in the teuthology suite

Mirror the supported distros used in nightlies in the teuthology suite

I decided not to symlink because I'm using a file name convention to
easily filter out distros that need a vps.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Fixes #10869, added {role} to the dir name.

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Thrasher: Fix log message

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #330 from ceph/teuthology-cleanup

Make jobs in the teuthology suite that install ceph run the 'tests' task

Run the 'tests' task for jobs in the teuthology suite that install ceph

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Ignore *.pyc files and __pycache__ folders

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #329 from ceph/wip-10828

normalize acl responses from rgw

rename test to tests, follows best practices for tests dirs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create a new get_acl helper to ensure proper xml is compared

Signed-off-by: Alfredo Deza <adeza@redhat.com>

tests for the new acl helper in radosgw_admin

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #328 from ceph/wip-10736

Created a new suite to test teuthology

Created a new suite to test teuthology

This suite locks machines of varying distros and runs the 'tests' tasks
against them. This will test both vps locking / provisioning and
baremetal locking.

Also, we test the chef and install tasks with ubuntu and rhel.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #327 from ceph/wip-10702

tasks/cephfs: fix fuse force unmount

tasks/cephfs: fix fuse force unmount

This was broken in the case of multiple
mounts, and in the case of stuck mounts.

Fixes: #10702
Signed-off-by: John Spray <john.spray@redhat.com>

Corrected "branch" to be outside of the 'clients:' section

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Corrected "branch" to be outside of the 'clients:' section

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Merge pull request #324 from dmick/master

tasks/calamari_setup: ice_setup 0.2.0 has added another prompt

tasks/calamari_setup: ice_setup 0.2.0 has added another prompt

Add an extra '\n' to the interaction string to answer it

Signed-off-by: Dan Mick <dan.mick@redhat.com>

extra_packages: stop trying to install libcephfs stuff

These package names all differ across distros, and they're included in
teuthology's install task anyway.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 977a221f9226cf479c9d2c1fbdd1d8df13bbce44)

extra_packages: stop trying to install libcephfs stuff

These package names all differ across distros, and they're included in
teuthology's install task anyway.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

overrides/short_pg_log: 30/50 was too short, make 100/200

Signed-off-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #322 from ceph/wip-10753

Add labels to a couple common task failures

Add labels to a couple common task failures

The labels will help us quickly determine what the command was trying to
accomplish in log output.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #319 from athanatos/wip-min-size

Wip min size

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #304 from yuyuyu101/add-msgr-test

rados: include msgr tests

Fixes http://tracker.ceph.com/issues/10652

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

rados/thrash: add short_pg_log variant to encourage backfill

Signed-off-by: Samuel Just <sjust@redhat.com>

do not try and install libcephfs-java via extra_packages

It's been added to the default install task, because the
package name varies across distros.

Fixes: #10510
Signed-off-by: Greg Farnum <greg@gregs42.com>

Merge pull request #316 from ceph/wip-active-asok-10361

mds_scrub_checks: only direct ops at the active MDS

Reviewed-by: John Spray <john.spray@redhat.com>

rados: add size/min_size combinations to rados/thrash

Signed-off-by: Samuel Just <sjust@redhat.com>

fs: move into the ceph-fuse mount before doing a test

Fixes: #10465
Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #312 from ceph/wip-prio-hb-pkts

exercise osd heartbeat prioritization

Merge pull request #296 from majianpeng/master

rados.py: Add write_fadvise_dontneed field

Merge pull request #302 from ceph/wip-crush-tunables

ceph: set crush tunables

rados: exercise a few different crush tunable profiles

Signed-off-by: Sage Weil <sage@redhat.com>

mds_scrub_checks: only direct ops at the active MDS

Change the config option from mds_id to mds_rank to reflect the
fact that it's the rank we want to make use of (and will continue
to want when we're doing stuff like force exporting from one rank
to another).

Fixes: #10361
Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/next'

Merge pull request #315 from ceph/wip-10577

Added "branch: dumpling" to fix #10577

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Added "branch: dumpling" to fix #10577

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

ceph: set crush tunables

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #314 from ceph/wip-wait-for-failure

ceph: test pg removal interruption; add ceph daemon failur einjection support

suites/rbd: add copy-on-read tests

Add as a facet of librbd tests, since they all use cloning, and to a
couple tests with thrashing.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

suites/rbd: split qemu and librbd tests

qemu tests take a long time. We'll want to test more combinations of
options with librbd directly.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

suites/rbd: Add rbd api tests with exclusive locking features

Keep testing the old, non-default features in a renamed yaml file.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #303 from ceph/wip-10388

tasks/mds_flush: use new stray/purge perfcounters

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

rados/singleton: test interrupted pg removal

Inject osd failure during pg removal.  Verify the OSD successfully
recovers.

Signed-off-by: Sage Weil <sage@redhat.com>

mds_flush: fix the flush test output expectations

Fixes: #10620
Signed-off-by: Greg Farnum <gfarnum@redhat.com>

ceph: no need to stop() before restart()

restart() will stop if the daemon is running.  This will get rid of the
spurious error

2015-01-23 15:19:36,828.828 ERROR:tasks.ceph.osd.0:tried to stop a non-running daemon

when the daemon isn't already running.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph: add wait_for_failure command

Expect and then ignore a daemon failure.

Signed-off-by: Sage Weil <sage@redhat.com>

samba: run only on ubuntu until #10627 is resolved

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 1dcff968a4fc359086723e8a3cb941051297f14a)

samba: run only on ubuntu until #10627 is resolved

Signed-off-by: Greg Farnum <gfarnum@redhat.com>