rgw: increase timeout to wait for master to 20 seconds

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: we can have multicluster without multizone

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: no need to do period pull

realm pull already pulls latest period

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: non master zones need to be created on the remote gateway

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: mtime is now a time string with microseconds

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: add --rgw-zone

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: create default zone after zonegroup creation

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: debug zone info

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: set default zonegroup on all clients

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: default zone should be always master zone

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: different clients have different defaults zone

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: In multisite configuration start the master gw first

Than pull realm and period configuration from it

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: use master_zonegroup not master_region

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: use zonegroups instead of regions

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: move realm pull and period pull to pull_configuration

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: update and commit period

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

add realm configuration to all multisite test

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: add realm creation

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw suite: always add --rgw-frontends fastcgi

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

use ceph-master branch for s3tests

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

suites/krbd/unmap: specify xfs

Signed-off-by: Sage Weil <sage@redhat.com>

tasks/ceph: allow set allow_multiple to fail

This will fail on upgrade tests.

Signed-off-by: Sage Weil <sage@redhat.com>

suites/rest: specify xfs

Signed-off-by: Sage Weil <sage@redhat.com>

suites/fs: specify xfs as needed

Signed-off-by: Sage Weil <sage@redhat.com>

suites/rgw: specify xfs as needed

Signed-off-by: Sage Weil <sage@redhat.com>

suites/rbd: specify xfs as needed

Signed-off-by: Sage Weil <sage@redhat.com>

rados: specify short names for misc jobs

These need to specify short names bc they don't have all osds on
a dedicated block device.

Signed-off-by: Sage Weil <sage@redhat.com>

suites/upgrade/hammer-x: specify xfs

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #965 from ceph/wip-xfs

rados: specify xfs

Reviewed-by: Samuel Just <sjust@redhat.com>

rados: specify xfs

If no fs is specified, the OSD is created on /, and the scratch
devices aren't used at all.  That means ext4, and the long file
name lameness.

Signed-off-by: Sage Weil <sage@redhat.com>

fs/ext4: longer names

Signed-off-by: Sage Weil <sage@redhat.com>

fs/ext4: max of 256 works better

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #964 from ceph/wip-ext4

set shorter limits when using ext4

Reviewed-by: Samuel Just <sjust@redhat.com>

fs/ext4: set shorter object name limits so that osds can start

Signed-off-by: Sage Weil <sage@redhat.com>

rados/basic: test over xfs (not just btrfs)

Signed-off-by: Sage Weil <sage@redhat.com>

Repleaced ext4 with xfs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #962 from ceph/wip-rgw-ext4

suites/rgw/multifs: do not test on ext4

suites/rgw/multifs: do not test on ext4

Swift tests fail.  RGW long object names will fail in general.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #948 from ceph/wip-teuthology-master

Fixed distro symlinks

Merge pull request #957 from ceph/wip-teuthology-master2

Added civetweb test case

Merge pull request #936 from ceph/wip-layout-snafu-followup

tasks/cephfs: test health messages from readonly stat

Merge pull request #933 from ceph/wip-fs-lockouts

cephfs: update tests to enable multimds when needed

Reproducer for 15303

Reproducer for http://tracker.ceph.com/issues/15303

Merge pull request #958 from ceph/wip-rgw-prefer-civetweb

rgw: use civetweb if no frontend was configured

rgw: use civetweb if no frontend was configured

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

FIXUP 'cephfs: update tests to enable multimds when needed'

cephfs: enable dirfrags in test_data_scan fragmentation test

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Added civetweb test case

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Fixed distro symblinks

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #944 from athanatos/wip-lfn-upgrade

LFN upgrade tests and a few other misc fixes

Merge pull request #954 from ceph/wip-rgw-fix-zone-get

rgw: add default zone name

Merge pull request #950 from dachary/wip-buildpackages-xenial

buildpackages: xenial support

Merge pull request #945 from dachary/wip-pr-763

buildpackages: openstack image names not unique.

Reviewed-by: Loic Dachary <ldachary@redhat.com>

buildpackages: add build timeouts.

The build/upload process CAN get stuck sometimes. As we are paying
utility rates for the high-power build server, we should timeout when
it's likely the build is stuck.

Use a default timeout just short of 4 hours, as some providers round up
partial instance-hours for billing.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

buildpackages: support ubuntu 12.04.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

buildpackages: fix configure on Ubuntu 12.04.

Ubuntu 12.04/precise has a buggy lttng; it fails our lttng-is-sane
check, as it leaves out headers.

This should not stop building of Ceph, as the automatic build handling
from debian/rules will correctly omit LTTNG on Precise.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

buildpackages: catch VM instances in ERROR state.

It is possible for 'server create' to return success, but then NOT have
a good VM afterwards. The instance will be in state ERROR.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>

rgw: add default zone name

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #946 from ceph/wip-rgw-fix-teu-bucket-policy

rgw: policy acl format should be xml

rgw: policy acl format should be xml

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

buildpackages: add ubuntu 16.04 xenial support

Signed-off-by: Loic Dachary <loic@dachary.org>

admin malloc interface testsReviewed-by: Josh Durgin <jdurgin@redhat.com>

admin malloc interface tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rados/singleton-nomsgr: add lfn upgrade tests

Upgrade from hammer/infernalis to x and verify lfn objects are valid
across upgrade.

Signed-off-by: Samuel Just <sjust@redhat.com>

tasks: add create_verify_lfn_objects

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: return exit status on do_get, do_put, do_rm

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: add do_rm

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: extend do_put and do_get to allow a namespace

Signed-off-by: Samuel Just <sjust@redhat.com>

ceph_manager: fix do_get to actually do a get

Currently unused.

Signed-off-by: Samuel Just <sjust@redhat.com>

rados_api_tests: reduce the osd_max_object_name_len value

This test can be run against ext4, which maxes out under
1k.

Signed-off-by: Samuel Just <sjust@redhat.com>

short_pg_log: make the log less short

Fixes: http://tracker.ceph.com/issues/15407
Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #941 from dachary/wip-xenial

distros: add ubuntu 16.04 / xenial

distros: add ubuntu 16.04 / xenial

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #914 from dachary/wip-archs

buildpackages: add missing arm64 to make-deb.sh

buildpackages: discard google-perftools on trusty aarch64

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #938 from ceph/wip-15304

samba: run kclient mount tests on testing kernel

Reviewed-by: John Spray <john.spray@redhat.com>

samba: run kclient mount tests on testing kernel

Fixes: http://tracker.ceph.com/issues/15304
Signed-off-by: Yan, Zheng <zyan@redhat.com>

cephfs: update tests to enable multimds when needed

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

arch: teuthology must use aarch64, not arm64

teuthology / gitbuilder / ansible_architecture arch is

   dpkg-architecture --query DEB_HOST_GNU_CPU (x86_64 and aarch64)

deb package Architectures: (conf/distributions) is

   dpkg-architecture --query DEB_HOST_GNU_ARCH (amd64 and arm64)

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: runabove has 30GB root disk max

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: install rsync

Signed-off-by: Loic Dachary <loic@dachary.org>

buildpackages: add missing arm64 to make-deb.sh

Signed-off-by: Loic Dachary <loic@dachary.org>

tasks/cephfs: test health messages from readonly stat

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #927 from ceph/wip-rbd-firefly-client-upgrade

suites/upgrade/client-upgrade: use firefly default features for upgrade test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #932 from athanatos/wip-journal-defaults

morepggrow: enable filestore and journal soft backoffs

Merge remote-tracking branch 'gh/jewel'

Merge pull request #923 from dachary/wip-buildpackages-debian

buildpackages: add debian 8.0 support

Update start.yaml

Merge pull request #926 from ceph/wip-bench

suites: radosbench 180 -> 150s

suites: radosbench 180 -> 150s

I hit an ENOSPC after 150s on bluestore.

Signed-off-by: Sage Weil <sage@redhat.com>

buildpackages: add debian 8.0 support

Signed-off-by: Loic Dachary <loic@dachary.org>

Added blogbench.yaml to parallel before and after -x upgrade steps

Fixes #15093

Note: sequential and full_sequential (dictionary) can't be both under parallel stanza

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 1007011bef614bd92472cd2e445fa1ae4f676ce3)

Merge pull request #919 from ceph/wip-15093-jewel

upgrade/parallel: fix parallel task usage

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #922 from dachary/wip-15324-openstack-rados

openstack: thrash_cache_writeback_proxy_none.yaml need bigger disks

openstack: thrash_cache_writeback_proxy_none.yaml need bigger disks

http://tracker.ceph.com/issues/15324 Fixes: #15324

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #906 from ceph/wip-12814

rados/singleton: thrash proxy (not forward) cache mode

rados/singleton-nomsgr/all/full-tiering: s/readforwad/readproxy/

Signed-off-by: Sage Weil <sage@redhat.com>

rados/singleton: thrash proxy (not forward) cache mode

See #12814

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #916 from ceph/wip-cmake-cython

tasks/cephfs: update vstart_runner for cmake build changes

Merge pull request #920 from dachary/wip-rados-openstack

openstack: define the resources required to run a rados suite

openstack: define the resources required to run a rados suite

Signed-off-by: Loic Dachary <loic@dachary.org>