]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
10 years agoMerge pull request #316 from ceph/wip-active-asok-10361
John Spray [Wed, 28 Jan 2015 13:59:48 +0000 (13:59 +0000)]
Merge pull request #316 from ceph/wip-active-asok-10361

mds_scrub_checks: only direct ops at the active MDS

Reviewed-by: John Spray <john.spray@redhat.com>
10 years agofs: move into the ceph-fuse mount before doing a test
Greg Farnum [Tue, 27 Jan 2015 22:50:29 +0000 (14:50 -0800)]
fs: move into the ceph-fuse mount before doing a test

Fixes: #10465
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
10 years agoMerge pull request #312 from ceph/wip-prio-hb-pkts
Sage Weil [Tue, 27 Jan 2015 20:57:03 +0000 (12:57 -0800)]
Merge pull request #312 from ceph/wip-prio-hb-pkts

exercise osd heartbeat prioritization

10 years agoMerge pull request #296 from majianpeng/master
Sage Weil [Tue, 27 Jan 2015 20:56:31 +0000 (12:56 -0800)]
Merge pull request #296 from majianpeng/master

rados.py: Add write_fadvise_dontneed field

10 years agoMerge pull request #302 from ceph/wip-crush-tunables
Sage Weil [Tue, 27 Jan 2015 19:26:10 +0000 (11:26 -0800)]
Merge pull request #302 from ceph/wip-crush-tunables

ceph: set crush tunables

10 years agorados: exercise a few different crush tunable profiles
Sage Weil [Tue, 27 Jan 2015 19:25:12 +0000 (11:25 -0800)]
rados: exercise a few different crush tunable profiles

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agomds_scrub_checks: only direct ops at the active MDS
Greg Farnum [Tue, 27 Jan 2015 19:14:46 +0000 (11:14 -0800)]
mds_scrub_checks: only direct ops at the active MDS

Change the config option from mds_id to mds_rank to reflect the
fact that it's the rank we want to make use of (and will continue
to want when we're doing stuff like force exporting from one rank
to another).

Fixes: #10361
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
10 years agoMerge remote-tracking branch 'origin/next'
Josh Durgin [Tue, 27 Jan 2015 17:37:19 +0000 (09:37 -0800)]
Merge remote-tracking branch 'origin/next'

10 years agoMerge pull request #315 from ceph/wip-10577
Josh Durgin [Tue, 27 Jan 2015 00:09:33 +0000 (16:09 -0800)]
Merge pull request #315 from ceph/wip-10577

Added "branch: dumpling" to fix #10577

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
10 years agoAdded "branch: dumpling" to fix #10577
Yuri Weinstein [Tue, 27 Jan 2015 00:00:46 +0000 (16:00 -0800)]
Added "branch: dumpling" to fix #10577

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
10 years agoceph: set crush tunables
Sage Weil [Mon, 19 Jan 2015 15:58:39 +0000 (07:58 -0800)]
ceph: set crush tunables

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #314 from ceph/wip-wait-for-failure
Zack Cerza [Mon, 26 Jan 2015 19:26:14 +0000 (12:26 -0700)]
Merge pull request #314 from ceph/wip-wait-for-failure

ceph: test pg removal interruption; add ceph daemon failur einjection support

10 years agosuites/rbd: add copy-on-read tests
Josh Durgin [Sat, 24 Jan 2015 05:55:39 +0000 (21:55 -0800)]
suites/rbd: add copy-on-read tests

Add as a facet of librbd tests, since they all use cloning, and to a
couple tests with thrashing.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
10 years agosuites/rbd: split qemu and librbd tests
Josh Durgin [Sat, 24 Jan 2015 05:50:01 +0000 (21:50 -0800)]
suites/rbd: split qemu and librbd tests

qemu tests take a long time. We'll want to test more combinations of
options with librbd directly.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
10 years agosuites/rbd: Add rbd api tests with exclusive locking features
Josh Durgin [Sat, 24 Jan 2015 00:02:22 +0000 (16:02 -0800)]
suites/rbd: Add rbd api tests with exclusive locking features

Keep testing the old, non-default features in a renamed yaml file.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
10 years agoMerge pull request #303 from ceph/wip-10388
Gregory Farnum [Sat, 24 Jan 2015 01:10:06 +0000 (17:10 -0800)]
Merge pull request #303 from ceph/wip-10388

tasks/mds_flush: use new stray/purge perfcounters

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
10 years agorados/singleton: test interrupted pg removal
Sage Weil [Fri, 23 Jan 2015 23:43:01 +0000 (15:43 -0800)]
rados/singleton: test interrupted pg removal

Inject osd failure during pg removal.  Verify the OSD successfully
recovers.

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agomds_flush: fix the flush test output expectations
Greg Farnum [Fri, 23 Jan 2015 23:24:02 +0000 (15:24 -0800)]
mds_flush: fix the flush test output expectations

Fixes: #10620
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
10 years agoceph: no need to stop() before restart()
Sage Weil [Fri, 23 Jan 2015 23:21:31 +0000 (15:21 -0800)]
ceph: no need to stop() before restart()

restart() will stop if the daemon is running.  This will get rid of the
spurious error

2015-01-23 15:19:36,828.828 ERROR:tasks.ceph.osd.0:tried to stop a non-running daemon

when the daemon isn't already running.

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoceph: add wait_for_failure command
Sage Weil [Fri, 23 Jan 2015 23:20:50 +0000 (15:20 -0800)]
ceph: add wait_for_failure command

Expect and then ignore a daemon failure.

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agosamba: run only on ubuntu until #10627 is resolved
Greg Farnum [Fri, 23 Jan 2015 22:49:34 +0000 (14:49 -0800)]
samba: run only on ubuntu until #10627 is resolved

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 1dcff968a4fc359086723e8a3cb941051297f14a)

10 years agosamba: run only on ubuntu until #10627 is resolved
Greg Farnum [Fri, 23 Jan 2015 22:49:34 +0000 (14:49 -0800)]
samba: run only on ubuntu until #10627 is resolved

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
10 years agoMerge pull request #277 from ceph/wip-9780-9781
Samuel Just [Thu, 22 Jan 2015 00:51:28 +0000 (16:51 -0800)]
Merge pull request #277 from ceph/wip-9780-9781

ceph-objectstore-tool import/export and related fixes

Reviewed-by: Samuel Just <sjust@redhat.com>
10 years agosuites/rados: exercise heartbeat prioritization
Sage Weil [Wed, 21 Jan 2015 22:13:24 +0000 (14:13 -0800)]
suites/rados: exercise heartbeat prioritization

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoFormatting changes
David Zafman [Fri, 16 Jan 2015 19:21:49 +0000 (11:21 -0800)]
Formatting changes

10 years agoFix wrapped line
David Zafman [Wed, 14 Jan 2015 22:38:53 +0000 (14:38 -0800)]
Fix wrapped line

10 years agoFix objectstore name changed to keyvaluestore
David Zafman [Thu, 8 Jan 2015 20:02:53 +0000 (12:02 -0800)]
Fix objectstore name changed to keyvaluestore

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: Fix Thrasher kill_osd() to ignore pool going away
David Zafman [Mon, 15 Dec 2014 18:06:02 +0000 (10:06 -0800)]
ceph_manager: Fix Thrasher kill_osd() to ignore pool going away

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: Thrasher fixes to run() calls to set check_status = False
David Zafman [Mon, 12 Jan 2015 23:29:31 +0000 (15:29 -0800)]
ceph_manager: Thrasher fixes to run() calls to set check_status = False

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: Re-enable Thrasher ceph-objectstore-tool testing
David Zafman [Fri, 24 Oct 2014 03:28:28 +0000 (20:28 -0700)]
ceph_manager: Re-enable Thrasher ceph-objectstore-tool testing

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: In Thrasher randomly remove past intervals
David Zafman [Mon, 20 Oct 2014 22:03:54 +0000 (15:03 -0700)]
ceph_manager: In Thrasher randomly remove past intervals

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing...
David Zafman [Thu, 23 Oct 2014 17:45:09 +0000 (10:45 -0700)]
ceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing command

Require ceph-objectstore-tool to be available on all OSD nodes
Log a message when tool is not available

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoMerge pull request #308 from ceph/wip-10579
Gregory Farnum [Wed, 21 Jan 2015 15:08:45 +0000 (07:08 -0800)]
Merge pull request #308 from ceph/wip-10579

suites/fs: isolate quota task

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
10 years agosuites/fs: isolate quota task
John Spray [Wed, 21 Jan 2015 14:39:47 +0000 (14:39 +0000)]
suites/fs: isolate quota task

Quota script is moved out of fs/misc so that kclient
doesn't try to run it.  Update cfuse suite to find
the new location, and only enable quota for this
one script rather than enabling across
all misc tests.

Fixes: #10579
Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/mds_flush: use new stray/purge perfcounters
John Spray [Mon, 19 Jan 2015 21:32:50 +0000 (21:32 +0000)]
tasks/mds_flush: use new stray/purge perfcounters

Where previously we only tracked RADOS-level delete
ops during deletion, now also verify that they
correspond to the right number of MDS-level purge
operations.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agoMerge pull request #285 from ceph/wip-9883
John Spray [Mon, 19 Jan 2015 21:20:11 +0000 (21:20 +0000)]
Merge pull request #285 from ceph/wip-9883

tasks/mds_journal_repair: create new test

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
10 years agotasks/mds_journal_repair: add test_table_tool
John Spray [Wed, 14 Jan 2015 13:09:51 +0000 (13:09 +0000)]
tasks/mds_journal_repair: add test_table_tool

Explicit test of the tool's various modes, to
complement the places it's used in other tests.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/mds_journal_repair: create new test
John Spray [Fri, 19 Dec 2014 13:49:07 +0000 (13:49 +0000)]
tasks/mds_journal_repair: create new test

This tests the new #9883 repair functionality
where we selectively scrape dentries out of
the journal while the MDS is offline.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agoMerge pull request #298 from ceph/wip-bi-sharding-3
Alfredo Deza [Mon, 19 Jan 2015 17:17:27 +0000 (12:17 -0500)]
Merge pull request #298 from ceph/wip-bi-sharding-3

Wip bi sharding 3

10 years agoMerge pull request #300 from ceph/restore_giant-x_on_master
Yuri Weinstein [Fri, 16 Jan 2015 22:45:13 +0000 (14:45 -0800)]
Merge pull request #300 from ceph/restore_giant-x_on_master

Restored giant-x suite on master

10 years agoMerge pull request #301 from ceph/restore_giant-x_on_next
Yuri Weinstein [Fri, 16 Jan 2015 22:45:00 +0000 (14:45 -0800)]
Merge pull request #301 from ceph/restore_giant-x_on_next

Restore giant x on next

10 years agoRestored giant-x on next
Yuri Weinstein [Fri, 16 Jan 2015 19:48:53 +0000 (14:48 -0500)]
Restored giant-x on next

Signed-off-by: Yuri Weinstein <yuriw@magna002.ceph.redhat.com>
10 years agoRestored giant-x suite on master
Yuri Weinstein [Fri, 16 Jan 2015 19:46:16 +0000 (14:46 -0500)]
Restored giant-x suite on master

Signed-off-by: Yuri Weinstein <yuriw@magna002.ceph.redhat.com>
10 years agoMerge pull request #288 from dmick/master
Andrew Schoen [Thu, 15 Jan 2015 22:01:30 +0000 (16:01 -0600)]
Merge pull request #288 from dmick/master

Tweaks to calamari-setup

10 years agoradosgw_admin: don't use boto for testing 301 responses
Yehuda Sadeh [Wed, 14 Jan 2015 23:10:23 +0000 (15:10 -0800)]
radosgw_admin: don't use boto for testing 301 responses

boto follows up on the redirects. Switched to using httplib2 for sending
this request.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
10 years agorgw: set default region and zone to all clients
Yehuda Sadeh [Tue, 13 Jan 2015 21:53:40 +0000 (13:53 -0800)]
rgw: set default region and zone to all clients

Otherwise it's going to use zone 'default' for client.0, not as expected. Also
add region configuration to task.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
10 years agoMerge pull request #291 from dachary/wip-10018-scrub
Loic Dachary [Wed, 14 Jan 2015 08:29:19 +0000 (09:29 +0100)]
Merge pull request #291 from dachary/wip-10018-scrub

add erasure code repair / scrub tests (take 2)

Reviewed-by: David Zafman <dzafman@redhat.com>
10 years agotest: add write_fadvise_dontneed.yaml to test write_fadvise_dontneed.
Jianpeng Ma [Wed, 14 Jan 2015 05:34:25 +0000 (13:34 +0800)]
test: add write_fadvise_dontneed.yaml to test write_fadvise_dontneed.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
10 years agorados.py: Add write_fadvise_dontneed field
Jianpeng Ma [Wed, 14 Jan 2015 03:36:25 +0000 (11:36 +0800)]
rados.py: Add write_fadvise_dontneed field

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
10 years agorepair_test: hinfo_key error injection
Loic Dachary [Fri, 21 Nov 2014 15:43:29 +0000 (16:43 +0100)]
repair_test: hinfo_key error injection

Add a function dedicated to erasure coded pools tests, similar to
repair_test_1. Add a corrupter that removes the hinfo_key from the object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: add ceph-objectstore-tool wrapper
Loic Dachary [Fri, 21 Nov 2014 15:38:54 +0000 (16:38 +0100)]
ceph_manager: add ceph-objectstore-tool wrapper

Add the CephManager.objectstore_tool method to encapsulate a call to
ceph-objectstore-tool. The wrapper can convert an object name into the
PG id and figure out the primary OSD. The designated OSD is stopped
before running the command and restarted afterwards.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: add object helpers
Loic Dachary [Fri, 21 Nov 2014 15:36:59 +0000 (16:36 +0100)]
ceph_manager: add object helpers

Add CephManager.methods to get information regarding the pools and PGs
used to store a given object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agorepair_test: rework indentation to make it pep8 clean
Loic Dachary [Fri, 21 Nov 2014 14:52:25 +0000 (15:52 +0100)]
repair_test: rework indentation to make it pep8 clean

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agorepair_test: rework to remove levels of indirection
Loic Dachary [Fri, 21 Nov 2014 15:13:26 +0000 (16:13 +0100)]
repair_test: rework to remove levels of indirection

The commit is large but does not introduce any semantic change and
consists primarily in code moving around, re-indented and removed.

Replace functions generating functions by functions and sequentially
iterating over a list of functions with a sequential call to the
functions.

Replace the setup/teardown with an equivalent using a with
statement and the ceph_manager.pool method.

Replace inline code with a call to ceph_manager.wait_for_all_up

It makes it easier to modify the tests, for instance to create erasure
coded pools and tests specific to them.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: rework indentation to make it pep8 clean
Loic Dachary [Fri, 21 Nov 2014 14:58:27 +0000 (15:58 +0100)]
ceph_manager: rework indentation to make it pep8 clean

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: fix docstring typo
Loic Dachary [Thu, 20 Nov 2014 12:55:18 +0000 (13:55 +0100)]
ceph_manager: fix docstring typo

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: define pool context
Loic Dachary [Thu, 20 Nov 2014 12:54:11 +0000 (13:54 +0100)]
ceph_manager: define pool context

To create a pool before running a code bloc and remove it after.

   with manager.pool("mypool"):
        mytest..

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoMerge pull request #290 from ceph/revert-250-wip-10018-scrub
David Zafman [Tue, 13 Jan 2015 19:14:14 +0000 (11:14 -0800)]
Merge pull request #290 from ceph/revert-250-wip-10018-scrub

Revert "add erasure code repair / scrub tests"

10 years agoRevert "add erasure code repair / scrub tests"
David Zafman [Tue, 13 Jan 2015 19:12:25 +0000 (11:12 -0800)]
Revert "add erasure code repair / scrub tests"

10 years agoMerge pull request #286 from ceph/wip-10261-wusui
Warren Usui [Tue, 13 Jan 2015 18:57:31 +0000 (10:57 -0800)]
Merge pull request #286 from ceph/wip-10261-wusui

Calamari_setup now allows > 1 mon.

10 years agoMerge pull request #250 from dachary/wip-10018-scrub
Loic Dachary [Tue, 13 Jan 2015 18:44:22 +0000 (19:44 +0100)]
Merge pull request #250 from dachary/wip-10018-scrub

add erasure code repair / scrub tests

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
10 years agorepair_test: hinfo_key error injection
Loic Dachary [Fri, 21 Nov 2014 15:43:29 +0000 (16:43 +0100)]
repair_test: hinfo_key error injection

Add a function dedicated to erasure coded pools tests, similar to
repair_test_1. Add a corrupter that removes the hinfo_key from the object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: add ceph-objectstore-tool wrapper
Loic Dachary [Fri, 21 Nov 2014 15:38:54 +0000 (16:38 +0100)]
ceph_manager: add ceph-objectstore-tool wrapper

Add the CephManager.objectstore_tool method to encapsulate a call to
ceph-objectstore-tool. The wrapper can convert an object name into the
PG id and figure out the primary OSD. The designated OSD is stopped
before running the command and restarted afterwards.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: add object helpers
Loic Dachary [Fri, 21 Nov 2014 15:36:59 +0000 (16:36 +0100)]
ceph_manager: add object helpers

Add CephManager.methods to get information regarding the pools and PGs
used to store a given object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agorepair_test: rework indentation to make it pep8 clean
Loic Dachary [Fri, 21 Nov 2014 14:52:25 +0000 (15:52 +0100)]
repair_test: rework indentation to make it pep8 clean

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agorepair_test: rework to remove levels of indirection
Loic Dachary [Fri, 21 Nov 2014 15:13:26 +0000 (16:13 +0100)]
repair_test: rework to remove levels of indirection

The commit is large but does not introduce any semantic change and
consists primarily in code moving around, re-indented and removed.

Replace functions generating functions by functions and sequentially
iterating over a list of functions with a sequential call to the
functions.

Replace the setup/teardown with an equivalent using a with
statement and the ceph_manager.pool method.

Replace inline code with a call to ceph_manager.wait_for_all_up

It makes it easier to modify the tests, for instance to create erasure
coded pools and tests specific to them.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: rework indentation to make it pep8 clean
Loic Dachary [Fri, 21 Nov 2014 14:58:27 +0000 (15:58 +0100)]
ceph_manager: rework indentation to make it pep8 clean

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: fix docstring typo
Loic Dachary [Thu, 20 Nov 2014 12:55:18 +0000 (13:55 +0100)]
ceph_manager: fix docstring typo

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoceph_manager: define pool context
Loic Dachary [Thu, 20 Nov 2014 12:54:11 +0000 (13:54 +0100)]
ceph_manager: define pool context

To create a pool before running a code bloc and remove it after.

   with manager.pool("mypool"):
        mytest..

Signed-off-by: Loic Dachary <ldachary@redhat.com>
10 years agoFix objectstore name changed to keyvaluestore
David Zafman [Thu, 8 Jan 2015 20:02:53 +0000 (12:02 -0800)]
Fix objectstore name changed to keyvaluestore

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: Fix Thrasher kill_osd() to ignore pool going away
David Zafman [Mon, 15 Dec 2014 18:06:02 +0000 (10:06 -0800)]
ceph_manager: Fix Thrasher kill_osd() to ignore pool going away

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: Thrasher fixes to run() calls to set check_status = False
David Zafman [Fri, 24 Oct 2014 04:49:03 +0000 (21:49 -0700)]
ceph_manager: Thrasher fixes to run() calls to set check_status = False

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: Re-enable Thrasher ceph-objectstore-tool testing
David Zafman [Fri, 24 Oct 2014 03:28:28 +0000 (20:28 -0700)]
ceph_manager: Re-enable Thrasher ceph-objectstore-tool testing

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: In Thrasher randomly remove past intervals
David Zafman [Mon, 20 Oct 2014 22:03:54 +0000 (15:03 -0700)]
ceph_manager: In Thrasher randomly remove past intervals

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agoceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing...
David Zafman [Thu, 23 Oct 2014 17:45:09 +0000 (10:45 -0700)]
ceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing command

Require ceph-objectstore-tool to be available on all OSD nodes
Log a message when tool is not available

Signed-off-by: David Zafman <dzafman@redhat.com>
10 years agotasks/calamari_setup: build ice-tools virtualenv if building iceball
Dan Mick [Tue, 13 Jan 2015 03:42:19 +0000 (19:42 -0800)]
tasks/calamari_setup: build ice-tools virtualenv if building iceball

ice-tools needs a virtualenv populated to properly run to build
an iceball; add the commands to do that.  Also remove the built
iceball when the task exits.

Fixes: #10523
Signed-off-by: Dan Mick <dan.mick@redhat.com>
10 years agotasks/calamari_setup: remove HTTP-downloaded iceball, if any
Dan Mick [Tue, 13 Jan 2015 00:36:53 +0000 (16:36 -0800)]
tasks/calamari_setup: remove HTTP-downloaded iceball, if any

Fixes: #10522
Signed-off-by: Dan Mick <dan.mick@redhat.com>
10 years agotasks/calamari_setup: use ice_version to completely specify iceball
Dan Mick [Tue, 13 Jan 2015 00:36:14 +0000 (16:36 -0800)]
tasks/calamari_setup: use ice_version to completely specify iceball

Previously, the task would search for the lexicographically-greatest
filename matching ICE-*.tar.gz; now it builds a specific name
ICE-{ice_version}-{ice_distro}.tar.gz

Fixes: #10521
Signed-off-by: Dan Mick <dan.mick@redhat.com>
10 years agofs: enable client quota on cfuse_workunit_misc
Greg Farnum [Mon, 12 Jan 2015 19:22:06 +0000 (11:22 -0800)]
fs: enable client quota on cfuse_workunit_misc

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
10 years agoCalamari_setup now allows > 1 mon.
Warren Usui [Sat, 10 Jan 2015 00:10:11 +0000 (16:10 -0800)]
Calamari_setup now allows > 1 mon.

Signed-off-by: Warren Usui <warren.usui@inktank.com>
Fixes: #10261
10 years agoMerge pull request #279 from ceph/wip-cephfs-cleanup
John Spray [Fri, 9 Jan 2015 14:42:42 +0000 (14:42 +0000)]
Merge pull request #279 from ceph/wip-cephfs-cleanup

Assorted cleanup in the CephFS tests

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
10 years agotasks/mds_auto_repair: remove unneeded log settings
John Spray [Thu, 18 Dec 2014 19:39:44 +0000 (19:39 +0000)]
tasks/mds_auto_repair: remove unneeded log settings

The small segments and small segment limit
were used when doing a hacky flush by doing
IO and waiting: now that we have the explicit
'flush journal' asok in use, we can just use
a normal journal configuration.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: remove `config` from Filesystem cons
John Spray [Tue, 23 Dec 2014 16:11:12 +0000 (16:11 +0000)]
tasks/cephfs: remove `config` from Filesystem cons

This was only used in get_first_mon, which doesn't actually
need the parameter itself.  Makes it easier to casually
use Filesystem from any place with a ctx to hand.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: umount unused clients before running
John Spray [Fri, 19 Dec 2014 14:03:41 +0000 (14:03 +0000)]
tasks/cephfs: umount unused clients before running

When unused clients were mounted during an fs new,
they would end up in a state where they stalled
on subsequent attempts to umount them (ceph-fuse
stalls on exit if it can't terminate its mds_session)

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: move ROOT_INO into filesystem module
John Spray [Fri, 19 Dec 2014 13:44:20 +0000 (13:44 +0000)]
tasks/cephfs: move ROOT_INO into filesystem module

...so that other tests can get at it.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: be more precise in set_clients_block
John Spray [Thu, 18 Dec 2014 19:38:53 +0000 (19:38 +0000)]
tasks/cephfs: be more precise in set_clients_block

Instead of blocking the whole port range (which
might make OSDs running on that node collateral
damage), read the MDS's port out of the MDS map
and just block that.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: use set_conf() from test case class
John Spray [Thu, 18 Dec 2014 18:24:37 +0000 (18:24 +0000)]
tasks/cephfs: use set_conf() from test case class

...because this is the one that will store up
changes to roll back during teardown.

Doing this makes it easy to run lots of test cases
togeher in a single teuthology run, raher than
setting up/tearing down the ceph cluster for each
on.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: move common setUp/tearDown to parent
John Spray [Thu, 18 Dec 2014 13:03:40 +0000 (13:03 +0000)]
tasks/cephfs: move common setUp/tearDown to parent

Now that we have more of these cases, there was lots
of duplication in setup and teardown.  For some tests
the "reset everything" setup/teardown is overkill,
but it's harmless.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/cephfs: move wait_until helpers to testcase
John Spray [Thu, 18 Dec 2014 12:50:16 +0000 (12:50 +0000)]
tasks/cephfs: move wait_until helpers to testcase

...so that other test cases can use them

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agotasks/ceph: update mds auth caps to 'allow *'
John Spray [Thu, 18 Dec 2014 18:29:53 +0000 (18:29 +0000)]
tasks/ceph: update mds auth caps to 'allow *'

Since the new 'tell' for the MDS was introduced,
caps have to have the '*' to permit running remote
administrative commands.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agoMerge pull request #283 from ceph/issue-10275
Zack Cerza [Thu, 8 Jan 2015 20:32:27 +0000 (13:32 -0700)]
Merge pull request #283 from ceph/issue-10275

Use qemu-kvm in the qemu task for rpm based systems.

10 years agoUse qemu-kvm in the qemu task for rpm based systems.
Andrew Schoen [Mon, 22 Dec 2014 16:51:25 +0000 (10:51 -0600)]
Use qemu-kvm in the qemu task for rpm based systems.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
10 years agoMerge pull request #280 from ceph/wip-10387-cleanup
Gregory Farnum [Thu, 8 Jan 2015 04:05:07 +0000 (20:05 -0800)]
Merge pull request #280 from ceph/wip-10387-cleanup

tasks/mds_flush: remove #10387 workaround

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
10 years agoMerge pull request #282 from ceph/wip-10469
Zack Cerza [Wed, 7 Jan 2015 17:10:28 +0000 (10:10 -0700)]
Merge pull request #282 from ceph/wip-10469

Inherit teuthology's log level

10 years agoInherit teuthology's log level
Zack Cerza [Wed, 7 Jan 2015 16:53:38 +0000 (09:53 -0700)]
Inherit teuthology's log level

Signed-off-by: Zack Cerza <zack@redhat.com>
10 years agotasks/mds_flush: remove #10387 workaround
John Spray [Wed, 7 Jan 2015 13:08:30 +0000 (13:08 +0000)]
tasks/mds_flush: remove #10387 workaround

Now that #10387 is fixed in master, we can tighten
up this test to ensure that the expected deletions
are happening.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agoMerge pull request #278 from ceph/wip-rm-tiobench
Sage Weil [Tue, 6 Jan 2015 16:25:47 +0000 (08:25 -0800)]
Merge pull request #278 from ceph/wip-rm-tiobench

#10152: drop tiobench tests

10 years agodrop tiobench tests
Ken Dreyer [Tue, 6 Jan 2015 15:59:14 +0000 (08:59 -0700)]
drop tiobench tests

The tiobench software has been abandoned upstream for years. Fedora and
Debian are no longer shipping the tiobench package, so we've had to
carry the package ourselves in the Ceph project, and we're trying to
slim down our dependencies where it makes sense to do so.

Nuke the tiobench tests.

http://tracker.ceph.com/issues/10152 Refs: #10152

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
10 years agoRevert "Move output in task/s3readwrite"
Sage Weil [Mon, 29 Dec 2014 20:39:26 +0000 (12:39 -0800)]
Revert "Move output in task/s3readwrite"

This reverts commit 26a33c3a5aa2aedb52eb5ce140c76503f099b253.

This is tryign to create the archive dir on the remote host:

2014-12-29T12:15:30.213 INFO:teuthology.orchestra.run.plana31:Running: 'mkdir -p /var/lib/teuthworker/archive/sage-2014-12-29_11:40:52-rgw-next---basic-multi/683052'
2014-12-29T12:15:30.231 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 28, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/var/lib/teuthworker/src/ceph-qa-suite_next/tasks/s3readwrite.py", line 241, in run_tests
    ctx.cluster.only(client).run(args=['mkdir', '-p', archive_dir])
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 368, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 106, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on plana31 with status 1: 'mkdir -p /var/lib/teuthworker/archive/sage-2014-12-29_11:40:52-rgw-next---basic-multi/683052'

...but it should only be on the local host.
(cherry picked from commit 3960530b7decc360c72d4670475806c04f218bfa)

10 years agoRevert "Move output in task/s3readwrite"
Sage Weil [Mon, 29 Dec 2014 20:39:26 +0000 (12:39 -0800)]
Revert "Move output in task/s3readwrite"

This reverts commit 26a33c3a5aa2aedb52eb5ce140c76503f099b253.

This is tryign to create the archive dir on the remote host:

2014-12-29T12:15:30.213 INFO:teuthology.orchestra.run.plana31:Running: 'mkdir -p /var/lib/teuthworker/archive/sage-2014-12-29_11:40:52-rgw-next---basic-multi/683052'
2014-12-29T12:15:30.231 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 28, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/var/lib/teuthworker/src/ceph-qa-suite_next/tasks/s3readwrite.py", line 241, in run_tests
    ctx.cluster.only(client).run(args=['mkdir', '-p', archive_dir])
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 368, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 106, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on plana31 with status 1: 'mkdir -p /var/lib/teuthworker/archive/sage-2014-12-29_11:40:52-rgw-next---basic-multi/683052'

...but it should only be on the local host.