tasks/ceph_deploy: work with systemd

This is ugly, but I'm not going to rewrite this right now.

Signed-off-by: Sage Weil <sage@redhat.com>

distros: add debian 8 jessie, remove wheezy from supported list

Wheezy only has experiemntal c++11 support; it's not new enough.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-deploy: install w/ ceph-deploy, not install.py

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #546 from dachary/wip-11881-multipath

ceph-disk workunit

rados/basic/msgr: enable all experimental features if random/async

Signed-off-by: Kefu Chai <kchai@redhat.com>

Revert "rados/basic/msgr: enable all experimental features if random/async"

This reverts commit 40db8376ab42756e7c2f45469153099183439744.

Getting errors trying to schedule with this commit.

Merge remote-tracking branch 'gh/next'

Merge pull request #548 from tchaikov/wip-enable-exp-features

rados/basic/msgr: enable all experimental features if random/async

Reviewed-by: Samuel Just <sjust@redhat.com>

rados/basic/msgr: enable all experimental features if random/async

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #547 from ceph/wip-12822

tasks/cephfs: timeout on wait in test_network_death

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

tasks/cephfs: timeout on wait in test_network_death

So that we can get a failure instead of a hang in

Signed-off-by: John Spray <john.spray@redhat.com>

Merge remote-tracking branch 'origin/next'

Merge pull request #545 from ceph/wip-12777-next

tasks/cephfs: fix test_pool_perm teardown

implement the ceph-disk suite

Run the ceph-disk workunit with a mon setup with ceph-deploy. It is
prefered to the install done by the ceph tasks because it relies on the
init system and udev rules which are going to be tested by the ceph-disk
workunit.

http://tracker.ceph.com/issues/11881 Refs: #11881

Signed-off-by: Loic Dachary <loic@dachary.org>

ceph-deploy: implement only_mon

If only_mon is true, do not attempt to deploy osds.

Signed-off-by: Loic Dachary <loic@dachary.org>

ceph-deploy: implement keep_running

When keep_running is true, do not shutdown the cluster, leave it as it
is for other workunits or tasks to use. This effectively allows the
ceph-deploy task to be used as a helper to deploy clusters.

The call to build_ceph_cluster is simplified by giving it the whole
configuration dictionary instead of re-building one with selected arguments.

Signed-off-by: Loic Dachary <loic@dachary.org>

ceph-deploy: ceph report on failure

When ceph-deploy fails, run ceph report to get more information about
the state of the cluster at the time of the failure.

Signed-off-by: Loic Dachary <loic@dachary.org>

Update rados_api.yaml(cherry picked from commit 5b9d41e3ea0f07171ce59f0bb1f5636733452062)

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Initial check in to add firefly-hammer-x suite #12641

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 998ba8b58c5c70e8a110c3e1cf29cd24ae9692b9)

Merge pull request #528 from ceph/wip-12641

Initial check in to add firefly-hammer-x suite #12641

Merge pull request #534 from ceph/wip-12625-master

Added singleton hammer-x test to address #525

Reviewed-by: Samuel Just <sjust@redhat.com>

tasks/cephfs: fix test_pool_perm teardown

Fixes: #12777
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #544 from ceph/wip-ms-type-async

rados: test both simple, async, and a mix

Reviewed-by: Samuel Just <sjust@redhat.com>

rados: test both simple, async, and a mix

- in general, test simple vs async vs random
- not for msgr-less workloads
- not for thrash-erasure-*.. the regular thrash
should cover it.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #540 from ceph/wip-hobj-sort

suites/rados/thrash: randomize hobject sort order

Reviewed-by: Samuel Just <sjust@redhat.com>

suites/rados/thrash: randomize hobject sort order

Signed-off-by: Sage Weil <sage@redhat.com>

Update rados_api.yaml

Initial check in to add firefly-hammer-x suite #12641

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #538 from ceph/wip-12758

ceph_deploy: if a branch is given, use it when installing rgw

ceph_deploy: if a branch is given, use it when installing rgw

Fixes: http://tracker.ceph.com/issues/12758
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge remote-tracking branch 'gh/next'

Merge pull request #523 from dachary/wip-10887-shec

erasure-code: CEPH_FEATURE_ERASURE_CODE_PLUGINS_V3 integration tests

Reviewed-by: Takeshi Miyamae <miyamae.takeshi@jp.fujitsu.com>

Merge pull request #526 from ceph/wip-stashed-layout

tasks/cephfs: implement TestDataScan.test_stashed_layout

Merge pull request #536 from ceph/wip-11881-multipath

ceph-deploy: hints for OpenStack

update the list of supported distributions

CentOS 6 and Ubuntu 12.04 are not support after Infernalis.
CentOS 7 is supported starting with Infernalis.

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #537 from dachary/wip-supported

update the list of supported distributions

Reviewed-by: Sage Weil <sage@redhat.com>

update the list of supported distributions

CentOS 6 and Ubuntu 12.04 are not support after Infernalis.
CentOS 7 is supported starting with Infernalis.

Signed-off-by: Loic Dachary <loic@dachary.org>

ceph-deploy: hints for OpenStack

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #531 from ceph/wip-mds-debug

tasks/kcephfs: enable MDS debug

Added singleton hammer-x test to address #12625

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #533 from ceph/revert-525-wip-12625-master

Revert "Added singleton hammer-x test to address #12625"

Revert "Added singleton hammer-x test to address #12625"

Merge pull request #525 from ceph/wip-12625-master

Added singleton hammer-x test to address #12625

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #514 from ceph/wip-cd-add-branch-install

 - Use branch from config for ceph-deploy testing

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #529 from ceph/wip-calamari-cli

calamari_setup: install "cli" utils on Calamari node

Reviewed-by: Dan Mick <dmick@redhat.com>

tasks/kcephfs: enable MDS debug

To help us debug #11482

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: implement TestDataScan.test_stashed_layout

This is for testing how cephfs-data-scan handles
the new 'layout' xattr when found during recovery.

Signed-off-by: John Spray <john.spray@redhat.com>

calamari_setup: install "cli" utils on Calamari node

In our RHCS 1.3 ceph-deploy docs, we tell users to run "ceph-deploy
install --cli" on their calamari admin node, but our smoke test wasn't
actually doing this.

See https://bugzilla.redhat.com/1252929 , "[Ubuntu 1.3.0] - ceph-deploy
install --no-adjust-repos --cli `hostname` is failing with a Traceback
error"

Merge pull request #527 from dmick/master

calamari_setup: change to use ceph-deploy repo command

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

calamari_setup: change to use ceph-deploy repo command

Fixes: #12643
Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #524 from ceph/wip-kdreyer-calamari-1.2

calamari_setup: handle RHCS 1.2 (missing /mnt/MON)

Reviewed-by: Dan Mick <dmick@redhat.com>

Added singleton hammer-x test to address #12625

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #445 from dachary/wip-11666-erasure-code-lrc

erasure-code: lrc plugin workload

Reviewed-by: Samuel Just <sjust@redhat.com>

erasure-code: CEPH_FEATURE_ERASURE_CODE_PLUGINS_V3 integration tests

http://tracker.ceph.com/issues/10887 Refs: #10887

Signed-off-by: Loic Dachary <ldachary@redhat.com>

fix indentation error in docstring

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit af973259eff9ffbbbe9aa209c3b3dd2d80d7219b)

do not ommit syntax errors in linter checks

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit db69142b9078fd9ed35fb3a542fc340dae9be665)

tasks: fix syntax error in ceph.py

From e195f9fa.

Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 9f530092e2aa3bdc73fcddc0feabe39759e79b4f)

calamari_setup: handle RHCS 1.2 (missing /mnt/MON)

In RHCS 1.2 we don't have a /mnt/MON directory. The intention of
35c6363a1eaf5011e26be8561ffcd4e9324d13a2 was to handle this condition,
but in 1.2, the non-zero return code makes Teuthology fail the whole
test.

We don't want *Teuthology* itself to act on the return code here; we
simply want to know what it was and structure the rest of the test
accordingly.

erasure-code: add write_append_excl: false

Add write_append_excl: false to all erasure-code workloads and use the
same workload in all upgrade tests. write_append_excl: false is not
meaningfull for all Ceph versions but when it's not it will just be
ignored.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #522 from ceph/syntax-check

Include `SyntaxError` checks in linter

Reviewed-by: John Spray <john.spray@redhat.com>

fix indentation error in docstring

Signed-off-by: Alfredo Deza <adeza@redhat.com>

do not ommit syntax errors in linter checks

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #521 from ceph/wip-fix-ceph

tasks: fix syntax error in ceph.py

Reviewed-by: Kefu Chai <kchai@redhat.com>

tasks: fix syntax error in ceph.py

From e195f9fa.

Signed-off-by: John Spray <john.spray@redhat.com>

Set the SELinux context of the logrotate config

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit e195f9fa1c3415157ce7be0bb50aead9794f49f1)

Merge pull request #520 from ceph/wip-logrotate-chcon

Set the SELinux context of the logrotate config

Merge pull request #519 from ceph/wip-silent-siganl

tasks/ceph_manager: be silent about sending SIGHUPs

Set the SELinux context of the logrotate config

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #518 from ceph/fix-async-test

Fix experimental feature override makes user config useless

Reviewed-by: Loic Dachary <ldachary@redhat.com>

tasks/ceph_manager: be silent about sending SIGHUPs

At the default interval this generates tons of log noise.

Signed-off-by: Sage Weil <sage@redhat.com>

Fix experimental feature override makes user config useless

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Merge pull request #515 from ceph/wip-12476

thrashosds: send a random osd a signal.SIGHUP

Merge pull request #510 from dmick/master

calamari_setup: Add --no-adjust-repos to ceph-deploy install --<type>

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

calamari_setup: only stop ceph on osd/mon machines

Fixes bogus failure at end of run on calamari server

Signed-off-by: Dan Mick <dan.mick@redhat.com>

calamari_setup: hack for 1.3.0 on centos: install lttng from EPEL

lttng is not yet part of any private repo; since 1.3.0/CentOS is not
a supported product, just grab it from EPEL for this test.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

calamari_setup: pep8 fix

Signed-off-by: Dan Mick <dan.mick@redhat.com>

calamari_setup: Add --no-adjust-repos to ceph-deploy install --<type>

Otherwise, ceph-deploy will install an apt source that points to
ceph.com, which will override the local ISO repos.

No --mon/--osd yet until 12147 is fixed

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #446 from ceph/wip-krbd-unmap-suite

unmap subsuite for krbd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

ceph_manager: don't add an osd to live_osds until it's been revived

also waits to remove it from dead_osds. this fixes an issue where
do_sighup tries to send a signal to an osd that has not been revived
yet.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

thrashosds: adds a sighup_delay option, defaulted to 0.1

This will call Thrasher.do_sighup which picks a random osd and sends a
signal.SIGHUP to it, delaying for the value of sighup_delay between each
time it picks a new osd to signal.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph_manager: adds a do_sighup method

This method runs in a separate greenlet than do_thrash and will pick a
random live osd to send a signal.SIGHUP to. There is a config option,
sighup_delay, which controls how long to delay between sending the
signals.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph_manager: adds a signal_osd method

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

 - Use branch from config for ceph-deploy testing instead of released branch

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #509 from ceph/wip-12225

Don't pass host to mon create-initial

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #512 from ceph/wip-pool-perm-fixes

Fixes to test_pool_perm

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #489 from dachary/wip-12320-ceph-fuse

tasks/ceph_fuse.py: virtual machines need flexible mount timeout

Reviewed-by: John Spray <john.spray@redhat.com>

tasks/cephfs: reset auth caps in setUp

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: don't hardcode data pool name in test_pool_perm

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: test_pool_perm: reinstate proper caps on teardown

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: don't hardcode client ID in test_pool_perm

Our teuthology yamls all happen to use "client.0" but
it's not guaranteed.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: test_pool_perm whitespace

PEP8-ize.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #511 from ceph/wip-drop-chef

Remove chef task

Remove chef task

It is obsoleted by teuthology.task.ansible.cephlab

Signed-off-by: Zack Cerza <zack@redhat.com>

 - Fix for wip-12225, Extra argument to mon create-initial was never required

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Fixes #12460

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit bb71120b37ec6238daf53561d9e6facdb438feb5)

Merge pull request #508 from ceph/wip-12460

Fixes #508
Reviewed-by: Samuel Just <sjust@redhat.com>

Fixes #12460

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Fixes #12068

point-to-point test moved from upgrade/hammer and modified to run as -x type upgrade

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 2ab6029764f33aa55e32307c38eb39e282b54aa8)

Merge pull request #506 from ceph/wip-12068-master

Fixes #506
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #505 from dmick/master

calamari_setup: disable epel again after ceph-deploy

Reviewed-By: Travis Rhoden <trhoden@redhat.com>