]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoceph-volume tests.functional comment why not use --destroy when zapping lvs in filestore 24081/head
Alfredo Deza [Thu, 13 Sep 2018 14:03:06 +0000 (10:03 -0400)]
ceph-volume tests.functional comment why not use --destroy when zapping lvs in filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 11858c74a1e704d63185f0ef4b6cd6aa02f17e52)

6 years agoceph-volume tests.functional use --destroy when zapping lvs in bluestore
Alfredo Deza [Thu, 13 Sep 2018 14:00:37 +0000 (10:00 -0400)]
ceph-volume tests.functional use --destroy when zapping lvs in bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 87af815691a7f43d14067c24e308d60f39d58051)

6 years agoceph-volume lvm.zap use remove_pv only for physical devices
Alfredo Deza [Thu, 13 Sep 2018 13:34:54 +0000 (09:34 -0400)]
ceph-volume lvm.zap use remove_pv only for physical devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 036683fde799ab1cfad7d6192981515d6b3419cc)

6 years agoMerge pull request #23105 from ukernel/mimic-24914
Yuri Weinstein [Thu, 13 Sep 2018 16:16:01 +0000 (09:16 -0700)]
Merge pull request #23105 from ukernel/mimic-24914

mimic: mds: introduce cephfs' own feature bits

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24058 from theanalyst/civetweb-mimic-poll
Yuri Weinstein [Thu, 13 Sep 2018 15:17:32 +0000 (08:17 -0700)]
Merge pull request #24058 from theanalyst/civetweb-mimic-poll

mimic: rgw: civetweb: use poll instead of select while waiting on sockets

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #24041 from smithfarm/wip-35942-mimic
Yuri Weinstein [Thu, 13 Sep 2018 15:16:08 +0000 (08:16 -0700)]
Merge pull request #24041 from smithfarm/wip-35942-mimic

mimic: ceph tell osd.x bench writes resulting JSON to stderr instead of stdout.

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24074 from alfredodeza/mimic-rm34535
Andrew Schoen [Thu, 13 Sep 2018 12:37:16 +0000 (07:37 -0500)]
Merge pull request #24074 from alfredodeza/mimic-rm34535

mimic: ceph-volume batch carve out lvs for bluestore

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests.util verify Disk objects don't change state with divisions 24074/head
Alfredo Deza [Mon, 10 Sep 2018 16:28:57 +0000 (12:28 -0400)]
ceph-volume tests.util verify Disk objects don't change state with divisions

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9ca526336221ea2ad32e7daf3e5e46b07291a1d8)

6 years agoceph-volume util.disk fix an issue where Disk objects would mutate on div operations
Alfredo Deza [Mon, 10 Sep 2018 16:18:49 +0000 (12:18 -0400)]
ceph-volume util.disk fix an issue where Disk objects would mutate on div operations

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7d1a3c74240e67621e993a304eaf566d4e2789d1)

6 years agoceph-volume util.prepare add a helper to get block.db sizes from ceph.conf
Alfredo Deza [Mon, 10 Sep 2018 16:09:50 +0000 (12:09 -0400)]
ceph-volume util.prepare add a helper to get block.db sizes from ceph.conf

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 860068ec5daca6d7087cf1ce0594a2fe36e91193)

6 years agoceph-volume lvm.batch.bluestore add TODOs for custom fast/slow devices
Alfredo Deza [Mon, 10 Sep 2018 16:09:15 +0000 (12:09 -0400)]
ceph-volume lvm.batch.bluestore add TODOs for custom fast/slow devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0eb0bdfc55d8ceb27cd12bc3a7fb807a7e65c788)

6 years ago-f ceph-volume lvm.batch.bluestore validation and reporting with VG reuse
Alfredo Deza [Mon, 10 Sep 2018 16:08:35 +0000 (12:08 -0400)]
-f  ceph-volume lvm.batch.bluestore validation and reporting with VG reuse

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d117d66903fa740108c9948b499150b02523fdf4)

6 years agoceph-volume lvm.batch fix error reporting, Device objects aren't strings
Alfredo Deza [Fri, 7 Sep 2018 18:11:33 +0000 (14:11 -0400)]
ceph-volume lvm.batch fix error reporting, Device objects aren't strings

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 267a386cc270081b2cd284bf78bf94b52be113dc)

6 years agoceph-volume lvm.batch.bluestore validation and reporting with VG reuse
Alfredo Deza [Fri, 7 Sep 2018 18:06:13 +0000 (14:06 -0400)]
ceph-volume lvm.batch.bluestore validation and reporting with VG reuse

Reworks the bluestore validation and reporting to account for reusable
VGs from fast devices, and adds validation calls to ensure the new way
to calculate this process will work.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 27f47565a0d43ecee03dea4f6addc739e3e78655)

6 years agoceph-volume lvm.batch.filestore capture SizeAllocationErrors
Alfredo Deza [Fri, 7 Sep 2018 18:04:58 +0000 (14:04 -0400)]
ceph-volume lvm.batch.filestore capture SizeAllocationErrors

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 71fcd35c3d44795f92b17e9aedb7ca868b3750d3)

6 years agoceph-volume lvm.batch make sure data devices don't have existing LVs on bluestore
Alfredo Deza [Thu, 6 Sep 2018 17:03:58 +0000 (13:03 -0400)]
ceph-volume lvm.batch make sure data devices don't have existing LVs on bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d2ea49a4e64820fc3cd95c2a6ca8869309638e00)

6 years agoMerge pull request #23503 from ukernel/mimic-26834
Yuri Weinstein [Wed, 12 Sep 2018 17:14:24 +0000 (10:14 -0700)]
Merge pull request #23503 from ukernel/mimic-26834

mimic: mds: calculate load by checking self CPU usage

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23672 from smithfarm/wip-26982-mimic
Yuri Weinstein [Wed, 12 Sep 2018 17:13:52 +0000 (10:13 -0700)]
Merge pull request #23672 from smithfarm/wip-26982-mimic

mimic: mds: crash when dumping ops in flight

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23700 from joscollin/wip-26984-mimic
Yuri Weinstein [Wed, 12 Sep 2018 17:13:26 +0000 (10:13 -0700)]
Merge pull request #23700 from joscollin/wip-26984-mimic

mimic: client: requests that do name lookup may be sent to wrong mds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23703 from pdvian/wip-26923-mimic
Yuri Weinstein [Wed, 12 Sep 2018 17:12:56 +0000 (10:12 -0700)]
Merge pull request #23703 from pdvian/wip-26923-mimic

mimic: mds: use fast dispatch to handle MDSBeacon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23704 from pdvian/wip-26929-mimic
Yuri Weinstein [Wed, 12 Sep 2018 17:12:30 +0000 (10:12 -0700)]
Merge pull request #23704 from pdvian/wip-26929-mimic

mimic: MDSMonitor: note ignored beacons/map changes at higher debug level

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23725 from joscollin/wip-25206-mimic
Yuri Weinstein [Wed, 12 Sep 2018 17:12:05 +0000 (10:12 -0700)]
Merge pull request #23725 from joscollin/wip-25206-mimic

mimic: CephVolumeClient: delay required after adding data pool to MDSMap

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23769 from pdvian/wip-26956-mimic
Yuri Weinstein [Wed, 12 Sep 2018 17:11:30 +0000 (10:11 -0700)]
Merge pull request #23769 from pdvian/wip-26956-mimic

mimic: qa: cfuse_workunit_kernel_untar_build fails on Ubuntu 18.04

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23792 from pdvian/wip-26988-mimic
Yuri Weinstein [Wed, 12 Sep 2018 16:40:18 +0000 (09:40 -0700)]
Merge pull request #23792 from pdvian/wip-26988-mimic

mimic: mds: explain delayed client_request due to subtree migration

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23818 from pdvian/wip-26989-mimic
Yuri Weinstein [Wed, 12 Sep 2018 16:39:43 +0000 (09:39 -0700)]
Merge pull request #23818 from pdvian/wip-26989-mimic

mimic: cephfs-journal-tool: enable purge_queue journal's event commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23878 from smithfarm/wip-24863-mimic
Yuri Weinstein [Wed, 12 Sep 2018 16:39:17 +0000 (09:39 -0700)]
Merge pull request #23878 from smithfarm/wip-24863-mimic

mimic: ceph_volume_client: allow atomic update of RADOS objects

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23880 from smithfarm/wip-26978-mimic
Yuri Weinstein [Wed, 12 Sep 2018 16:38:05 +0000 (09:38 -0700)]
Merge pull request #23880 from smithfarm/wip-26978-mimic

mimic: tools: cephfs-data-scan: print the max used ino

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #23883 from smithfarm/wip-32086-mimic
Yuri Weinstein [Wed, 12 Sep 2018 16:37:28 +0000 (09:37 -0700)]
Merge pull request #23883 from smithfarm/wip-32086-mimic

mimic: mds: MDBalancer::try_rebalance() may stop prematurely

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agomimic: rgw: civetweb: use poll instead of select while waiting on sockets 24058/head
Abhishek Lekshmanan [Wed, 12 Sep 2018 13:27:19 +0000 (15:27 +0200)]
mimic: rgw: civetweb: use poll instead of select while waiting on sockets

Non cherry-picked backport of 4d0035830e5783a828a275245b8bc3ae88edc417 as the
commit hashes of the submodules are different in different upstream release
branches of ceph/civetweb, so creating this new commit which directly references
the tip of ceph-mimic branch instead picking from ceph-master, as ceph-master
and ceph-mimic may diverge at a later stage.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge pull request #24047 from pdvian/wip-35706-mimic
Lenz Grimmer [Wed, 12 Sep 2018 08:48:55 +0000 (10:48 +0200)]
Merge pull request #24047 from pdvian/wip-35706-mimic

mimic: mgr/dashboard: Display RGW user/bucket quota max size in human readable form

Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Display RGW user/bucket quota max size in human readable form 24047/head
Volker Theile [Fri, 31 Aug 2018 16:49:45 +0000 (18:49 +0200)]
mgr/dashboard: Display RGW user/bucket quota max size in human readable form

Fixes: https://tracker.ceph.com/issues/34315
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 8311e4b6f5db5391b535f7d19c60bbd621978239)

6 years agoMerge PR #23659 into mimic
Patrick Donnelly [Tue, 11 Sep 2018 20:40:29 +0000 (13:40 -0700)]
Merge PR #23659 into mimic

* refs/pull/23659/head:
qa: fix mon config section
qa: ignore normal slow IO warnings for cephfs
qa: create common conf for all cephfs suites

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24038 from ceph/wip-s3a-fix-mirror-mimic
vasukulkarni [Tue, 11 Sep 2018 20:39:59 +0000 (13:39 -0700)]
Merge pull request #24038 from ceph/wip-s3a-fix-mirror-mimic

mimic: qa/tasks: s3a fix mirror

6 years agoMerge pull request #23956 from pdvian/wip-32129-mimic
Nathan Cutler [Tue, 11 Sep 2018 20:09:21 +0000 (22:09 +0200)]
Merge pull request #23956 from pdvian/wip-32129-mimic

mimic: docs: radosgw: ldap-auth: fixed option name 'rgw_ldap_searchfilter'

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoosd: Additional fields for osd "bench" command 24041/head
Коренберг Марк [Sat, 12 May 2018 17:34:45 +0000 (22:34 +0500)]
osd: Additional fields for osd "bench" command

This patch adds new fields for output of "bench" OSD command:

* elapsed_sec (elapsed time of benchmarking process)
* iops (writes per second)

And also, it improves precision for bytes_per_sec field.

Signed-off-by: Коренберг Маркr <socketpair@gmail.com>
(cherry picked from commit ffe4b045169b840b6bd3bbdb375eb137c99eaa84)

6 years agotest/pybind/test_rados.py: collect output in stdout for "bench" cmd
Kefu Chai [Sat, 12 May 2018 11:33:52 +0000 (19:33 +0800)]
test/pybind/test_rados.py: collect output in stdout for "bench" cmd

it was changed from stderr to stdout in 23583ccc

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d9c2ddd9fe33aa342733762b9b0fece5c8d972d0)

6 years agoosd: write "bench" output to stdout
John Spray [Wed, 9 May 2018 14:19:18 +0000 (15:19 +0100)]
osd: write "bench" output to stdout

...not stderr.  Seems more reasonable as this
command is essentially feeding back a measurement result,
rather than just commenting on its status

Fixes: http://tracker.ceph.com/issues/24022
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 23583ccc25a33c1d997cff9d65a48569eac1392c)

6 years agoqa/tasks: update mirror link for maven, the original mirror no longer exists 24038/head
Vasu Kulkarni [Thu, 6 Sep 2018 00:08:24 +0000 (17:08 -0700)]
qa/tasks: update mirror link for maven, the original mirror no longer exists

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
(cherry picked from commit 13e100259e3658fcfd2123474cb8ea8498ac3fb6)

6 years agoMerge pull request #23875 from smithfarm/wip-35079-mimic
Yuri Weinstein [Tue, 11 Sep 2018 16:04:28 +0000 (09:04 -0700)]
Merge pull request #23875 from smithfarm/wip-35079-mimic

mimic: mgr/dashboard: RestClient can't handle ProtocolError exceptions

Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #23966 from alfredodeza/mimic-rm35535
Andrew Schoen [Mon, 10 Sep 2018 14:28:58 +0000 (09:28 -0500)]
Merge pull request #23966 from alfredodeza/mimic-rm35535

mimic: ceph-volume: batch tests for mixed-type of devices

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #23744 from liewegas/wip-valgrind-distro-mimic
Yuri Weinstein [Sat, 8 Sep 2018 15:32:57 +0000 (08:32 -0700)]
Merge pull request #23744 from liewegas/wip-valgrind-distro-mimic

mimic: qa/suites/rados: move valgrind test to singleton-flat

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #23951 from smithfarm/wip-pglog-mimic
Yuri Weinstein [Sat, 8 Sep 2018 15:32:23 +0000 (08:32 -0700)]
Merge pull request #23951 from smithfarm/wip-pglog-mimic

mimic: osd/PrimaryLogPG: avoid dereferencing invalid complete_to

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #23885 from smithfarm/wip-24905-mimic
Yuri Weinstein [Fri, 7 Sep 2018 20:06:41 +0000 (13:06 -0700)]
Merge pull request #23885 from smithfarm/wip-24905-mimic

mimic: build/ops: mimic 13.2.0 doesn't build in Fedora rawhide

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #23886 from smithfarm/wip-25119-mimic
Yuri Weinstein [Fri, 7 Sep 2018 20:05:48 +0000 (13:05 -0700)]
Merge pull request #23886 from smithfarm/wip-25119-mimic

mimic: tests: cluster [WRN] 25 slow requests in powercycle

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #23888 from smithfarm/wip-26933-mimic
Yuri Weinstein [Fri, 7 Sep 2018 20:05:05 +0000 (13:05 -0700)]
Merge pull request #23888 from smithfarm/wip-26933-mimic

mimic: osd: segv in OSDMap::calc_pg_upmaps from balancer

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #23893 from pdvian/wip-32079-mimic
Yuri Weinstein [Fri, 7 Sep 2018 20:04:11 +0000 (13:04 -0700)]
Merge pull request #23893 from pdvian/wip-32079-mimic

mimic: test: Use pids instead of jobspecs which were wrong

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #23874 from smithfarm/wip-25120-mimic
Nathan Cutler [Fri, 7 Sep 2018 19:56:01 +0000 (21:56 +0200)]
Merge pull request #23874 from smithfarm/wip-25120-mimic

mimic: mgr/dashboard: URL prefix is not working

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agomgr/dashboard: RestClient can't handle ProtocolError exceptions 23875/head
Volker Theile [Tue, 31 Jul 2018 08:43:06 +0000 (10:43 +0200)]
mgr/dashboard: RestClient can't handle ProtocolError exceptions

Fixes: https://tracker.ceph.com/issues/25190
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 446881f8fe26b5af5d535d72f912d16dbd01b500)

6 years agomgr/dashboard: Set timeout in RestClient calls
Volker Theile [Tue, 24 Jul 2018 09:52:29 +0000 (11:52 +0200)]
mgr/dashboard: Set timeout in RestClient calls

Set a default timeout of 45 seconds to all REST client calls. This can be customized via 'ceph dashboard set-rest-requests-timeout <seconds>'. Currently the REST client is only used by the RGW controller.

Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 23128391986bf89b29fad14e0f26e9cb6ecf5cc3)

Conflicts:
doc/mgr/dashboard.rst

6 years agoMerge pull request #23831 from pdvian/wip-27059-mimic
Nathan Cutler [Fri, 7 Sep 2018 08:27:03 +0000 (10:27 +0200)]
Merge pull request #23831 from pdvian/wip-27059-mimic

mimic : debian/rules: fix ceph-mgr .pyc files left behind

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoceph-volume lvm.batch use 'ceph' as the cluster name with filestore 23966/head
Alfredo Deza [Thu, 6 Sep 2018 19:19:01 +0000 (15:19 -0400)]
ceph-volume lvm.batch use 'ceph' as the cluster name with filestore

Custom cluster names are currently broken on ceph-volume, should get
addressed with http://tracker.ceph.com/issues/27210 which is out of
scope for these changes

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit c1481799a254eceb05258313aafd532e062ea0bc)

6 years agoceph-volume tests/functional update filestore xenial test vars
Alfredo Deza [Thu, 6 Sep 2018 15:23:30 +0000 (11:23 -0400)]
ceph-volume tests/functional update filestore xenial test vars

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit a096a016ccd0acc86ce816aba8ce95f6e3b68c11)

6 years agoceph-volume tests/functional update bluestore xenial test vars
Alfredo Deza [Thu, 6 Sep 2018 15:23:20 +0000 (11:23 -0400)]
ceph-volume tests/functional update bluestore xenial test vars

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 89e52dd19792072919bef6ba2f2ab50d7b0ff4ed)

6 years agoceph-volume tests/functional update filestore centos7 test vars
Alfredo Deza [Thu, 6 Sep 2018 15:18:20 +0000 (11:18 -0400)]
ceph-volume tests/functional update filestore centos7 test vars

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit a5ec54207a02c4bb85dc8226890def18da45e2ff)

6 years agoceph-volume tests/functional update bluestore centos7 test vars
Alfredo Deza [Thu, 6 Sep 2018 15:18:05 +0000 (11:18 -0400)]
ceph-volume tests/functional update bluestore centos7 test vars

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 2549d5737283b39ecf5b0af98c73ffeb18033c36)

6 years agoceph-volume lvm.api use double -f flags when calling pvremove
Alfredo Deza [Thu, 6 Sep 2018 14:55:31 +0000 (10:55 -0400)]
ceph-volume lvm.api use double -f flags when calling pvremove

Fairly destructive, just like everything else when zapping a device.
This is required in the case of double UUIDs detected, something that
surfaced when testing with a loop device to create an nvme (the loop
device ends up with the same UUID as the nvme).

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit c1cbc407c095e0bc3e25a8ff1519b4909ec519cc)

6 years agoceph-volume tests/functional remove duplicate test playbooks
Alfredo Deza [Thu, 6 Sep 2018 14:26:05 +0000 (10:26 -0400)]
ceph-volume tests/functional remove duplicate test playbooks

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit a008fe1385e4440f510eab97470a5d4e56a69402)

6 years agoceph-volume tests/functional setup playbook for nvme devices
Alfredo Deza [Thu, 6 Sep 2018 13:38:00 +0000 (09:38 -0400)]
ceph-volume tests/functional setup playbook for nvme devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 71db509df0c4a14598010568f8bb078f6b2841ab)

6 years agoceph-volume tests/functional single (test) playbook to zap and redeploy batch operations
Alfredo Deza [Thu, 6 Sep 2018 13:34:11 +0000 (09:34 -0400)]
ceph-volume tests/functional single (test) playbook to zap and redeploy batch operations

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 23330c0107a9f9ee436338c112b1852fd36e34a3)

6 years agoceph-volume tests/functional create a noop playbook to allow symlinking always to...
Alfredo Deza [Thu, 6 Sep 2018 13:33:21 +0000 (09:33 -0400)]
ceph-volume tests/functional create a noop playbook to allow symlinking always to setup.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 860e66083fe769714a10076fa101b94507e47169)

6 years agoceph-volume tests/functional add mixed-type scenarios to tox.ini
Alfredo Deza [Thu, 6 Sep 2018 13:32:00 +0000 (09:32 -0400)]
ceph-volume tests/functional add mixed-type scenarios to tox.ini

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0d5b90bb1fbf30c6e33dbf7e10a3d0ba053297ae)

6 years agoceph-volume tests/functional add CentOS7 bluestore mixed-type scenarios
Alfredo Deza [Wed, 5 Sep 2018 12:17:54 +0000 (08:17 -0400)]
ceph-volume tests/functional add CentOS7 bluestore mixed-type scenarios

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 799ce4508d9ed166ef6447daa21e0564262fbafe)

6 years agoceph-volume tests/functional add CentOS7 filestore mixed-type scenarios
Alfredo Deza [Wed, 5 Sep 2018 12:17:38 +0000 (08:17 -0400)]
ceph-volume tests/functional add CentOS7 filestore mixed-type scenarios

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 89bbcff659eed8f2cfa26fb93a0c12c7ff83e83b)

6 years agoMerge pull request #23854 from smithfarm/wip-35078-mimic
Yuri Weinstein [Thu, 6 Sep 2018 20:02:30 +0000 (13:02 -0700)]
Merge pull request #23854 from smithfarm/wip-35078-mimic

mimic: doc: broken bash example in bluestore migration

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #23868 from smithfarm/wip-27212-mimic
Nathan Cutler [Thu, 6 Sep 2018 11:14:50 +0000 (13:14 +0200)]
Merge pull request #23868 from smithfarm/wip-27212-mimic

mimic: rpm: should change ceph-mgr package depency from py-bcrypt to python2-bcrypt

Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoosd/PrimaryLogPG: avoid dereferencing invalid complete_to 23951/head
xie xingguo [Mon, 3 Sep 2018 07:37:36 +0000 (15:37 +0800)]
osd/PrimaryLogPG: avoid dereferencing invalid complete_to

For the auto-repair (EIO caused) case, we will not reinitialize
**complete_to** (because last_complete is equal to last_update!)
and hence there is chance that **complete_to** should aleady
point to **log.end()** before we call recover_got.

We could simply drop it here as we (already) logged the **complete_to**
iterator change in a more compatible way a few lines below.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 69a2cc35840939436da09691ca62476d7f599de4)

6 years agodocs: radosgw: ldap-auth: fixed option name 'rgw_ldap_searchfilter' 23956/head
Konstantin Shalygin [Thu, 22 Feb 2018 04:42:45 +0000 (11:42 +0700)]
docs: radosgw: ldap-auth: fixed option name 'rgw_ldap_searchfilter'

Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
(cherry picked from commit 4e1d3d8772b7f07becc646b7598cefbc0bc71111)

6 years agoMerge pull request #23860 from smithfarm/wip-25144-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:52:00 +0000 (14:52 -0700)]
Merge pull request #23860 from smithfarm/wip-25144-mimic

mimic: mon: Automatically set expected_num_objects for new pools with >=100 PGs per OSD

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #23869 from smithfarm/wip-27213-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:50:10 +0000 (14:50 -0700)]
Merge pull request #23869 from smithfarm/wip-27213-mimic

mimic: libradosstriper conditional compile

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #23676 from ifed01/wip-ifed-fix-get_fragmentation
Sage Weil [Wed, 5 Sep 2018 21:43:33 +0000 (16:43 -0500)]
Merge pull request #23676 from ifed01/wip-ifed-fix-get_fragmentation

mimic: os/bluestore: fix assertion in StupidAllocator::get_fragmentation

6 years agoMerge pull request #23722 from pdvian/wip-26931-mimic
Sage Weil [Wed, 5 Sep 2018 21:43:09 +0000 (16:43 -0500)]
Merge pull request #23722 from pdvian/wip-26931-mimic

mimic: scrub livelock

6 years agoMerge pull request #23861 from smithfarm/wip-25176-mimic
Sage Weil [Wed, 5 Sep 2018 21:42:29 +0000 (16:42 -0500)]
Merge pull request #23861 from smithfarm/wip-25176-mimic

mimic: osd,mon: increase mon_max_pg_per_osd to 300

6 years agoMerge pull request #23863 from smithfarm/wip-25204-mimic
Sage Weil [Wed, 5 Sep 2018 21:42:07 +0000 (16:42 -0500)]
Merge pull request #23863 from smithfarm/wip-25204-mimic

mimic: rados python bindings use prval from stack

6 years agoMerge pull request #23870 from smithfarm/wip-32108-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:39:15 +0000 (14:39 -0700)]
Merge pull request #23870 from smithfarm/wip-32108-mimic

mimic: object errors found in be_select_auth_object() aren't logged the same

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #23872 from smithfarm/wip-34532-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:38:24 +0000 (14:38 -0700)]
Merge pull request #23872 from smithfarm/wip-34532-mimic

mimic: core: force-create-pg broken

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #23873 from smithfarm/wip-35068-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:37:01 +0000 (14:37 -0700)]
Merge pull request #23873 from smithfarm/wip-35068-mimic

mimic: core: deep scrub cannot find the bitrot if the object is cached

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #23215 from b-ranto/wip-mgr-prom-bp-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:33:43 +0000 (14:33 -0700)]
Merge pull request #23215 from b-ranto/wip-mgr-prom-bp-mimic

[mimic] Sync the prometheus module

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge pull request #23403 from neha-ojha/wip-24989-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:32:13 +0000 (14:32 -0700)]
Merge pull request #23403 from neha-ojha/wip-24989-mimic

mimic: Limit pg log length during recovery/backfill so that we don't run out of memory

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #23748 from pdvian/wip-26944-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:30:35 +0000 (14:30 -0700)]
Merge pull request #23748 from pdvian/wip-26944-mimic

mimic: os/bluestore/BlueStore.cc: 1025: FAILED assert(buffer_bytes >= b->length) from ObjectStore/StoreTest.ColSplitTest2/2

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge pull request #23772 from ifed01/wip-ifed-perf-reset-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:28:52 +0000 (14:28 -0700)]
Merge pull request #23772 from ifed01/wip-ifed-perf-reset-mimic

mimic: os/bluestore: bluestore_buffer_hit_bytes perf counter doesn't reset

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #23782 from smithfarm/wip-32082-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:28:13 +0000 (14:28 -0700)]
Merge pull request #23782 from smithfarm/wip-32082-mimic

mimic: mgr balancer does not save optimized plan but latest

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #23865 from smithfarm/wip-26907-mimic
Yuri Weinstein [Wed, 5 Sep 2018 21:24:28 +0000 (14:24 -0700)]
Merge pull request #23865 from smithfarm/wip-26907-mimic

mimic: kv: MergeOperator name() returns string, and caller calls c_str() on the temporary

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoqa: fix mon config section 23659/head
Patrick Donnelly [Mon, 13 Aug 2018 02:13:06 +0000 (19:13 -0700)]
qa: fix mon config section

Fixes: fc6e683832125a1042638f21b623e29d0d4c34d8
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 47e60908a3c07fe262a50a8073dbd8e309e17261)

6 years agoqa: ignore normal slow IO warnings for cephfs
Patrick Donnelly [Tue, 7 Aug 2018 00:55:42 +0000 (17:55 -0700)]
qa: ignore normal slow IO warnings for cephfs

Generally the slow warnings we get are just over the threshold. These warnings
are related to deploying multiple Ceph daemons side-by-side. Let's see how we
do with two minutes.

Ignoring the warnings entirely is unsatisfactory as they serve as a useful
canary in the coal mine when you see warnings for ops > some unreasonably large
amount of time.

Fixes: http://tracker.ceph.com/issues/26900
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit fc6e683832125a1042638f21b623e29d0d4c34d8)

6 years agoqa: create common conf for all cephfs suites
Patrick Donnelly [Wed, 27 Jun 2018 16:53:12 +0000 (09:53 -0700)]
qa: create common conf for all cephfs suites

This will be followed by removing common CephFS configurations in the
ceph.conf.template in teuthology.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 73fa0efcbb15a47157615705043288f2913ff3bc)

Conflicts:
qa/suites/fs/32bits/overrides/debug.yaml
qa/suites/fs/basic_functional/overrides/debug.yaml
qa/suites/fs/basic_workload/overrides/debug.yaml
qa/suites/fs/multiclient/overrides/debug.yaml
qa/suites/fs/multifs/overrides/debug.yaml
qa/suites/fs/permission/overrides/debug.yaml
qa/suites/fs/snaps/overrides/debug.yaml
qa/suites/fs/thrash/overrides/debug.yaml
qa/suites/fs/traceless/overrides/debug.yaml
qa/suites/fs/upgrade/snaps/overrides/debug.yaml
qa/suites/fs/verify/overrides/debug.yaml
qa/suites/kcephfs/cephfs/overrides/debug.yaml
qa/suites/kcephfs/mixed-clients/overrides/debug.yaml
qa/suites/kcephfs/recovery/debug/.qa
qa/suites/kcephfs/recovery/overrides/debug.yaml
qa/suites/kcephfs/thrash/overrides/debug.yaml

All of the above files were deleted by the master commit, but showed up as
conflicts due to slightly different content in mimic. Resolved trivially by
"git rm".

        qa/suites/fs/bugs/conf

This file was deleted because sub-suite does not exist in Mimic. The QA test
for https://github.com/ceph/ceph/pull/22139 was chosen not to be backported.

6 years agoMerge pull request #23559 from dillaman/wip-25121-mimic
Yuri Weinstein [Wed, 5 Sep 2018 16:20:28 +0000 (09:20 -0700)]
Merge pull request #23559 from dillaman/wip-25121-mimic

mimic: rbd: improved trash snapshot namespace handling

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #23560 from dillaman/wip-24945-mimic
Yuri Weinstein [Wed, 5 Sep 2018 16:19:58 +0000 (09:19 -0700)]
Merge pull request #23560 from dillaman/wip-24945-mimic

mimic: librbd: validate data pool for self-managed snapshot support

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #23858 from smithfarm/wip-27060-mimic
Yuri Weinstein [Wed, 5 Sep 2018 16:19:24 +0000 (09:19 -0700)]
Merge pull request #23858 from smithfarm/wip-27060-mimic

mimic: run-rbd-unit-tests.sh test fails to finish in jenkin's make check run

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #23521 from pdvian/wip-26845-mimic
Yuri Weinstein [Wed, 5 Sep 2018 16:01:27 +0000 (09:01 -0700)]
Merge pull request #23521 from pdvian/wip-26845-mimic

mimic: rgw: Limit the number of lifecycle rules on one bucket.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
6 years agoMerge pull request #23686 from pdvian/wip-26921-mimic
Yuri Weinstein [Wed, 5 Sep 2018 16:00:05 +0000 (09:00 -0700)]
Merge pull request #23686 from pdvian/wip-26921-mimic

mimic: rgw: Fix log level of gc_iterate_entries

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #23855 from smithfarm/wip-26849-mimic
Yuri Weinstein [Wed, 5 Sep 2018 15:59:30 +0000 (08:59 -0700)]
Merge pull request #23855 from smithfarm/wip-26849-mimic

mimic: rgw: civetweb fails on urls with control characters

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
6 years agoMerge pull request #23771 from pdvian/wip-26946-mimic
Yuri Weinstein [Wed, 5 Sep 2018 15:56:53 +0000 (08:56 -0700)]
Merge pull request #23771 from pdvian/wip-26946-mimic

mimic: qa/rgw: patch keystone requirements.txt

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #23856 from smithfarm/wip-26980-mimic
Yuri Weinstein [Wed, 5 Sep 2018 15:55:39 +0000 (08:55 -0700)]
Merge pull request #23856 from smithfarm/wip-26980-mimic

mimic: multisite: intermittent failures in test_bucket_sync_disable_enable

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #23857 from smithfarm/wip-35070-mimic
Yuri Weinstein [Wed, 5 Sep 2018 15:55:10 +0000 (08:55 -0700)]
Merge pull request #23857 from smithfarm/wip-35070-mimic

mimic: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agotest: Use pids instead of jobspecs which were wrong 23893/head
David Zafman [Thu, 16 Aug 2018 21:30:09 +0000 (14:30 -0700)]
test: Use pids instead of jobspecs which were wrong

Fixes: http://tracker.ceph.com/issues/27056
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit bc3317031057b5737710a095ce593135b62f9302)

6 years agoTestOSDMap: Test with negative upmap values 23888/head
Brad Hubbard [Fri, 3 Aug 2018 06:42:57 +0000 (16:42 +1000)]
TestOSDMap: Test with negative upmap values

Check we can handle negative pg_upmap and pg_upmap_items values.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit f76c889c2cb02539f5c5bdfc7bd5ab8f506bad86)

6 years agoosd/OSDMap: Disallow negative values in _apply_upmap
Brad Hubbard [Fri, 3 Aug 2018 06:12:49 +0000 (16:12 +1000)]
osd/OSDMap: Disallow negative values in _apply_upmap

A negative pg_upmap or pg_upmap_item value can cause a segfault so
ignore them.

Fixes: http://tracker.ceph.com/issues/22056
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 689e1cfba74e9866d411d5d21e0cf0b28343519c)

6 years agoqa/tasks/thrashosds-health.yaml: whitelist slow requests 23886/head
Neha Ojha [Wed, 25 Jul 2018 17:20:12 +0000 (10:20 -0700)]
qa/tasks/thrashosds-health.yaml: whitelist slow requests

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit c0d9f7177c47a2b613fb1a3e9fa56eb90b36973a)

6 years agocmake: do not depend on ${DPDK_LIBRARIES} if not using bundled dpdk 23885/head
Kefu Chai [Sun, 8 Jul 2018 10:21:37 +0000 (18:21 +0800)]
cmake: do not depend on ${DPDK_LIBRARIES} if not using bundled dpdk

${DPDK_LIBRARIES} will be link flags instead of library targets if
libdpdk is not built using the bundled source.

Fixes: http://tracker.ceph.com/issues/24449
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 1c41870184a3857d94ccf2c77958e2f0aad8dad8)

6 years agomds: fix premature stop of MDBalancer::try_rebalance() 23883/head
Yan, Zheng [Fri, 3 Aug 2018 10:43:41 +0000 (18:43 +0800)]
mds: fix premature stop of MDBalancer::try_rebalance()

When mds wants to export loads to multiple targets. The amount of single
export can easily be less than (0.2 * target_loads). For example:

6 active mds, mds.0's load is 11, other ranks' loads are 5. target_load
is 6. Export amount for each target is 1.

Fixes: http://tracker.ceph.com/issues/26973
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit e68cbec6a647f0252d848620ce6e51b4f3eea1e3)