Added blogbench.yaml to parallel before and after -x upgrade steps

Fixes #15093

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge branch 'master' into jewel

Merge pull request #865 from ceph/wip-dbg-packages-1

packages: update for all the new debug packages we have in jewel

packages: update for all the new debug packages we have in jewel

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #859 from ceph/wip-15014

Add packages.yaml

Removed branch: firefly from 4-after.yaml

Fixes #15012

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 872aed9e72d0bac1fc21152544eef3c42abbd0bb)

Merge pull request #864 from ceph/wip-15012-jewel

Removed branch: firefly from 4-after.yaml

Removed branch: firefly from 4-after.yaml

Fixes #15012

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #862 from ceph/wip-odsync

rados: Enable odsync write for pggrow thrasher

rados: Enable odsync write for pggrow thrasher

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #812 from ceph/jewel-10436

suites/fs: enable all snapshost test scripts

Merge remote-tracking branch 'origin/greg-fs-testing-3-7-damage'

Merge pull request #731 from ceph/wip-scrub-repair

Wip scrub repair

Merge pull request #860 from ceph/wip-krbd-fio

Fixes for krbd test cases

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Reflect that ceph-dbg is dropped

Signed-off-by: Zack Cerza <zack@redhat.com>

Add packages.yaml

Signed-off-by: Zack Cerza <zack@redhat.com>

rados/thrash/workloads/radosbench: shorten 300s->200s

Signed-off-by: Sage Weil <sage@redhat.com>

Merge remote-tracking branch 'origin/wip-damage-table' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/782

Conflicts:
tasks/cephfs/test_scrub_checks.py

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-scrub-repair' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/731

krbd: do not test unsupported striping feature

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tasks/rbd_fio: create sane image name based on feature set

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #858 from ceph/wip-pg-dump

tasks/ceph_manager: dump pgs if other peering timeouts expire

tasks/ceph_manager: dump pgs if other peering timeouts expire

We were doing this for one of the recovery timeouts but not all of them.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #857 from smithfarm/wip-move-plus-to-clusters

suites/smoke/1node: move + to clusters/ subdirectory

suites/smoke/1node: move + to clusters/ subdirectory

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #854 from SUSE/wip-opensuse-distros

distros: add yaml fragments for openSUSE 13.2 and 42.1

Reviewed-by: Loic Dachary <ldachary@redhat.com>

tasks: add TestDamage.test_damaged_dentry

A more detailed test for the case of damaged dentries,
because the handling involves the system passing through
a state where the containing dir has invalid stats,
and has the complete flag set even though the
dentry in question is missing.

Signed-off-by: John Spray <john.spray@redhat.com>

suites: update log whitelist for TestDamage

For branch wip-damage-table.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: update TestDamage

...to account for the behavioural changes with
the addition of DamageTable.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks: move wait_for_health up into CephFSTestCase

...so that TestDamage can use it too.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: optionally stat() in background

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: avoid sleep in test_client_cache_size

Instead of waiting 30s and then checking, use
wait_until_true to complete as soon as the
condition is met.  Test runs faster this way.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: remove extraneous ;s in test_client_limits

These are harmless but they stand out in some editors.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: add test case for scrub repair

Signed-off-by: Yan, Zheng <zyan@redhat.com>

distros: add yaml fragments for openSUSE 13.2 and 42.1

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge remote-tracking branch 'gh/wip-file-layout'

Merge remote-tracking branch 'gh/jewel'

Merge pull request #852 from ceph/wip-ceph-ansible

ceph-ansible: Add openstack hints for volumes

ceph-ansible: Add openstack hints for volumes

3x20GB per instance

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #851 from ceph/wip-ceph-ansible

ceph-ansible: Install ceph-test

Merge pull request #848 from ceph/wip-ceph-ansible

ceph-ansible suite improvements

Install ceph-test

Signed-off-by: Zack Cerza <zack@redhat.com>

Disable rbd_cli_tests for now

They don't seem to ever fail.

Signed-off-by: Zack Cerza <zack@redhat.com>

Add ceph-deploy_hello_world.sh

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #843 from ceph/wip-list-inconsistent-obj

tasks/scrub_test: match the NOSNAP with "head"

Reviewed-by: Samuel Just <sjust@redhat.com>

suites/fs/verify: debug mon too

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/cephfs/filesystem: ceph_file_layout -> file_layout_t

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #844 from ceph/wip-rbd-cli-features

rbd/cli: add older default features

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #846 from dachary/wip-14931-cram

cram: pin to version 0.6 because 0.7 handles \r differently

Reviewed-by: Xiaoxi Chen <xiaoxchen@ebay.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

cram: pin to version 0.6 because 0.7 handles \r differently

http://tracker.ceph.com/issues/14931 Fixes: #14931

Signed-off-by: Loic Dachary <loic@dachary.org>

tasks/scrub_test: match the NOSNAP with "head"

* rados cli prints "head" at seeing CEPH_NOSNAP, so update the test
  accordingly
* print inconsistent objs before testing them

Fixes: #14924
Signed-off-by: Kefu Chai <kchai@redhat.com>

rbd/cli: add older default features

Explicitly set features and default format so they don't become out of
date. Remove none.yaml, since default.yaml is an explicit version of
it now.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #842 from ceph/wip-rbd-features

rbd: updated tests to use new rbd default feature set

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #841 from ceph/wip-krbd-default-features

krbd: override rbd defaults features to 1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #821 from ceph/wip-fsx-journal

rbd: add fsx journal replay test case

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Make the keyring world-readable

Signed-off-by: Zack Cerza <zack@redhat.com>

Rename mon.0 to mon.a

Signed-off-by: Zack Cerza <zack@redhat.com>

Run 'ceph health' after deployment

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #832 from athanatos/wip-lost

Wip lost

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #839 from ceph/wip-ceph-ansible

Add ceph-ansible suite

rbd: updated tests to use new rbd default feature set

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

krbd: override rbd defaults features to 1

Jewel will update the default feature set to features
unsupported by krbd.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Add ceph-ansible suite

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #837 from ceph/wip-valgrind

suites: debuginfo: true for valgrind

Merge pull request #833 from ceph/wip-async

Revert "basic/msgr: remove async and random for now"

suites: debuginfo: true for valgrind

This lets us get line numbers in the valgrind xml output.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #795 from ceph/wip-list-inconsistent-obj

task/scrub_test: tests for list inconsistent obj APIs

Reviewed-by: Samuel Just <sjust@redhat.com>

Reduced runtime for radosbench to 600

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit a72bba29103cd287131eb7b56953c417649fed5d)

Merge pull request #835 from ceph/wip-14810-master-2

Reduced runtime for radosbench to 600

Reduced runtime for radosbench to 600

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

tasks/cephfs: add test case for scrub repair

Signed-off-by: Yan, Zheng <zyan@redhat.com>

tasks/scrub_test: add test for get-inconsistent-* commands

Signed-off-by: Kefu Chai <kchai@redhat.com>

tasks/scrub_test: restore the changes to omap after the test

because the repair for digest mismatch will rewrite the omap digest
in the corresponding OI attribute with the one calculated from the
omap read from disk. this is fine. but the succeeding test can not
use the same way used before to mess up the victim object in hope
to get an inconsistent object, as we have accepted it as an authroized
copy and populate the change to its replicas. to address this
problem, the crime scene of the `test_repair_bad_omap()` is cleaned
up before calling `repair()`. it helps with isolating the different
tests, so new tests should not worry about what the current omap
should look like.

Signed-off-by: Kefu Chai <kchai@redhat.com>

divergent_priors: add sleep after reviving divergent

Basically same thing as
c0b0ec2831f410d89b695a1d08122334d8ee907a
client is getting ENXIO when trying to do osd tell because
the osd isn't quite up yet.

Signed-off-by: Samuel Just <sjust@redhat.com>

rados: add lost-unfound upgrade tests

Signed-off-by: Samuel Just <sjust@redhat.com>

tasks/*unfound*.py: run rados bench in parallel

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: use time before mon command for timeout

Slow mon commands can cause a false failure.

Signed-off-by: Samuel Just <sjust@redhat.com>

rados/singleton: use xfs instead

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #823 from ceph/wip-dir-rstats

add test for norstats functionality

Merge pull request #776 from ceph/wip-sharded-scan

tasks/cephfs: test sharded cephfs-data-scan

Merge pull request #789 from ceph/wip-14146

tasks/cephfs: check status asok output while in reconnect

Merge pull request #787 from ceph/wip-13903

Wip 13903 tests

tasks/scrub_test: refactor this test

prepare for the scrub API tests

Signed-off-by: Kefu Chai <kchai@redhat.com>

cephfs/test_full: add some gratuitous debugging

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge remote-tracking branch 'origin/wip-14365' into greg-fs-testing

https://github.com/ceph/ceph-qa-suite/pull/805

rbd: add fsx journal replay test case

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rados/upgrade: add '%' to combine rados.yaml with other yamls

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit a13d9e89a8fb280ef1538104e2f4f9c77d288501)

rados/: remove unnecessary rados.yaml entries

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit ebea8ade8ec0aa41058fabed5ac7796ee60b20a7)

Merge pull request #820 from ceph/wip-rados-yaml

Wip rados yaml

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>

rados/upgrade: add '%' to combine rados.yaml with other yamls

Signed-off-by: Samuel Just <sjust@redhat.com>

rados/: remove unnecessary rados.yaml entries

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge branch 'jewel' of https://github.com/ceph/ceph-qa-suite into jewel

Whitelisted 'soft lockup' and 'detected stalls on CPUs'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 367bd5b49c1584b8132fb312be3af83486001fa9)

Merge pull request #819 from ceph/wip-whitelist-jewel

Whitelisted 'soft lockup' and 'detected stalls on CPUs'

Whitelisted 'soft lockup' and 'detected stalls on CPUs'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

tasks/cephfs: add TestConfigCommands

Get some coverage on the otherwise rarely touched
injectargs and `config set` interfaces.

Fixes: #14365
Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: run ceph-fuse in foreground

Previously was running this in background, which prevented
checking for nonzero exit codes.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: optionally check result of fuse proc on umount

For cases where the client process successfully unmounts,
but then crashes before finishing.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: make FuseMount.admin_socket public

For tests that specifically want to exercise an
asok operation (the test is responsible for
verifying that its mount object really is a
FuseMount and not a KernelMount)

Signed-off-by: John Spray <john.spray@redhat.com>

Merge remote-tracking branch 'gh/jewel'