rados: specify short names for misc jobs

These need to specify short names bc they don't have all osds on
a dedicated block device.

Signed-off-by: Sage Weil <sage@redhat.com>

suites/upgrade/hammer-x: specify xfs

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #965 from ceph/wip-xfs

rados: specify xfs

Reviewed-by: Samuel Just <sjust@redhat.com>

rados: specify xfs

If no fs is specified, the OSD is created on /, and the scratch
devices aren't used at all.  That means ext4, and the long file
name lameness.

Signed-off-by: Sage Weil <sage@redhat.com>

fs/ext4: longer names

Signed-off-by: Sage Weil <sage@redhat.com>

fs/ext4: max of 256 works better

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #964 from ceph/wip-ext4

set shorter limits when using ext4

Reviewed-by: Samuel Just <sjust@redhat.com>

fs/ext4: set shorter object name limits so that osds can start

Signed-off-by: Sage Weil <sage@redhat.com>

rados/basic: test over xfs (not just btrfs)

Signed-off-by: Sage Weil <sage@redhat.com>

Repleaced ext4 with xfs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #962 from ceph/wip-rgw-ext4

suites/rgw/multifs: do not test on ext4

suites/rgw/multifs: do not test on ext4

Swift tests fail.  RGW long object names will fail in general.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #948 from ceph/wip-teuthology-master

Fixed distro symlinks

Merge pull request #957 from ceph/wip-teuthology-master2

Added civetweb test case

Merge pull request #936 from ceph/wip-layout-snafu-followup

tasks/cephfs: test health messages from readonly stat

Merge pull request #933 from ceph/wip-fs-lockouts

cephfs: update tests to enable multimds when needed

Reproducer for 15303

Reproducer for http://tracker.ceph.com/issues/15303

Merge pull request #958 from ceph/wip-rgw-prefer-civetweb

rgw: use civetweb if no frontend was configured

rgw: use civetweb if no frontend was configured

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

FIXUP 'cephfs: update tests to enable multimds when needed'

cephfs: enable dirfrags in test_data_scan fragmentation test

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Added civetweb test case

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Fixed distro symblinks

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #944 from athanatos/wip-lfn-upgrade

LFN upgrade tests and a few other misc fixes

Merge pull request #954 from ceph/wip-rgw-fix-zone-get

rgw: add default zone name

Merge pull request #950 from dachary/wip-buildpackages-xenial

buildpackages: xenial support

Merge pull request #945 from dachary/wip-pr-763

buildpackages: openstack image names not unique.

Reviewed-by: Loic Dachary <ldachary@redhat.com>

buildpackages: add build timeouts.

The build/upload process CAN get stuck sometimes. As we are paying
utility rates for the high-power build server, we should timeout when
it's likely the build is stuck.

Use a default timeout just short of 4 hours, as some providers round up
partial instance-hours for billing.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

buildpackages: support ubuntu 12.04.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

buildpackages: fix configure on Ubuntu 12.04.

Ubuntu 12.04/precise has a buggy lttng; it fails our lttng-is-sane
check, as it leaves out headers.

This should not stop building of Ceph, as the automatic build handling
from debian/rules will correctly omit LTTNG on Precise.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

buildpackages: catch VM instances in ERROR state.

It is possible for 'server create' to return success, but then NOT have
a good VM afterwards. The instance will be in state ERROR.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

rgw: add default zone name

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #946 from ceph/wip-rgw-fix-teu-bucket-policy

rgw: policy acl format should be xml

rgw: policy acl format should be xml

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

buildpackages: add ubuntu 16.04 xenial support

Signed-off-by: Loic Dachary <loic@dachary.org>

admin malloc interface testsReviewed-by: Josh Durgin <jdurgin@redhat.com>

admin malloc interface tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rados/singleton-nomsgr: add lfn upgrade tests

Upgrade from hammer/infernalis to x and verify lfn objects are valid
across upgrade.

Signed-off-by: Samuel Just <sjust@redhat.com>

tasks: add create_verify_lfn_objects

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: return exit status on do_get, do_put, do_rm

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: add do_rm

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: extend do_put and do_get to allow a namespace

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: fix do_get to actually do a get

Currently unused.

Signed-off-by: Samuel Just <sjust@redhat.com>

rados_api_tests: reduce the osd_max_object_name_len value

This test can be run against ext4, which maxes out under
1k.

Signed-off-by: Samuel Just <sjust@redhat.com>

short_pg_log: make the log less short

Fixes: http://tracker.ceph.com/issues/15407
Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #941 from dachary/wip-xenial

distros: add ubuntu 16.04 / xenial

distros: add ubuntu 16.04 / xenial

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #914 from dachary/wip-archs

buildpackages: add missing arm64 to make-deb.sh

buildpackages: discard google-perftools on trusty aarch64

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #938 from ceph/wip-15304

samba: run kclient mount tests on testing kernel

Reviewed-by: John Spray <john.spray@redhat.com>

samba: run kclient mount tests on testing kernel

Fixes: http://tracker.ceph.com/issues/15304
Signed-off-by: Yan, Zheng <zyan@redhat.com>

cephfs: update tests to enable multimds when needed

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

arch: teuthology must use aarch64, not arm64

teuthology / gitbuilder / ansible_architecture arch is

   dpkg-architecture --query DEB_HOST_GNU_CPU (x86_64 and aarch64)

deb package Architectures: (conf/distributions) is

   dpkg-architecture --query DEB_HOST_GNU_ARCH (amd64 and arm64)

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: runabove has 30GB root disk max

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: install rsync

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: add missing arm64 to make-deb.sh

Signed-off-by: Loic Dachary <loic@dachary.org>

tasks/cephfs: test health messages from readonly stat

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #927 from ceph/wip-rbd-firefly-client-upgrade

suites/upgrade/client-upgrade: use firefly default features for upgrade test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #932 from athanatos/wip-journal-defaults

morepggrow: enable filestore and journal soft backoffs

Merge remote-tracking branch 'gh/jewel'

Merge pull request #923 from dachary/wip-buildpackages-debian

buildpackages: add debian 8.0 support

Update start.yaml

Merge pull request #926 from ceph/wip-bench

suites: radosbench 180 -> 150s

suites: radosbench 180 -> 150s

I hit an ENOSPC after 150s on bluestore.

Signed-off-by: Sage Weil <sage@redhat.com>

buildpackages: add debian 8.0 support

Signed-off-by: Loic Dachary <loic@dachary.org>

Added blogbench.yaml to parallel before and after -x upgrade steps

Fixes #15093

Note: sequential and full_sequential (dictionary) can't be both under parallel stanza

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 1007011bef614bd92472cd2e445fa1ae4f676ce3)

Merge pull request #919 from ceph/wip-15093-jewel

upgrade/parallel: fix parallel task usage

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #922 from dachary/wip-15324-openstack-rados

openstack: thrash_cache_writeback_proxy_none.yaml need bigger disks

openstack: thrash_cache_writeback_proxy_none.yaml need bigger disks

http://tracker.ceph.com/issues/15324 Fixes: #15324

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #906 from ceph/wip-12814

rados/singleton: thrash proxy (not forward) cache mode

rados/singleton-nomsgr/all/full-tiering: s/readforwad/readproxy/

Signed-off-by: Sage Weil <sage@redhat.com>

rados/singleton: thrash proxy (not forward) cache mode

See #12814

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #916 from ceph/wip-cmake-cython

tasks/cephfs: update vstart_runner for cmake build changes

Merge pull request #920 from dachary/wip-rados-openstack

openstack: define the resources required to run a rados suite

openstack: define the resources required to run a rados suite

Signed-off-by: Loic Dachary <loic@dachary.org>

Added blogbench.yaml to parallel before and after -x upgrade steps

Fixes #15093

Note: sequential and full_sequential (dictionary) can't be both under parallel stanza

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #902 from smithfarm/wip-14984

rbd: add singleton to assert no rbdmap regression

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #907 from dachary/wip-15236-infernalis-x

upgrade/infernalis-x: allocate OpenStack volumes for each OSD

Reviewed-by: Nathan Cutler <ncutler@suse.cz>

Merge remote-tracking branch 'gh/jewel'

tasks/cephfs: update vstart_runner for cmake build changes

All binaries now go into bin/

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: reproducer for #15303 client bug

Run through two-client scenario where the first client
thinks a dir is empty even though the second client
has written some files to it.

Signed-off-by: John Spray <john.spray@redhat.com>

tasks/cephfs: tidy Mount.ls to return [] on empty dir

Previously returned ['']

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #908 from dachary/wip-archs

archs: add files for each known architecture

Merge pull request #869 from ceph/wip-15093-jewel

Added blogbench.yaml to parallel before and after -x upgrade steps

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Added blogbench.yaml to parallel before and after -x upgrade steps

Fixes #15093

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #827 from ceph/jewel-14805

Disable client-side permission checking in Hadoop.

It's not set up to pass appropriate UIDs/GIDs through, so everything breaks.

buildpackages: do not try tcmalloc on arm64

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: desambiguate nic on server create

When there are more than one network, it is required to select the one
to be attached to the nic of the instance.

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge remote-tracking branch 'gh/jewel'

dummy: reduce run time, run user.yaml playbook

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #898 from ceph/wip-15206

test_msgr: improve debug ms level

buildpackages: build will work on a range of flavors

When selecting a flavor to build, we prefer the largest we can find and
fallback to smaller ones, down to the minimum acceptable flavor, if
there is no other available.

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: do not hardcode x86_64 in build scripts

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: use architecture suffixed images

Signed-off-by: Loic Dachary <loic@dachary.org>

archs: add files for each known architecture

So that they can be prepend to teuthology-suite to run a job on a
designated architecture.

Signed-off-by: Loic Dachary <loic@dachary.org>

suites: run rados bench for max 180 seconds

If we want a longer runtime than that, run it several times in
sequence.

This limits the amount of disk space we'll consume.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2b3ec8de8d08d9a2b694f898f47d8ca27d0aff1f)

Merge pull request #910 from ceph/wip-oldupgrades

suites/upgrades: clean up old upgrade suites

Merge pull request #909 from ceph/wip-radosbench

suites: run rados bench for max 180 seconds

suites/upgrade: remove stable upgrade suites

These are maintained in their respective branches (e.g.,
the latest suites/upgrade/hammer is in the hammer branch).

Signed-off-by: Sage Weil <sage@redhat.com>

suites/upgrade: remove obsolete *-x suites

These versions can no longer upgrade to jewel.

Signed-off-by: Sage Weil <sage@redhat.com>

suites: run rados bench for max 180 seconds

If we want a longer runtime than that, run it several times in
sequence.

This limits the amount of disk space we'll consume.

Signed-off-by: Sage Weil <sage@redhat.com>