]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 years agoMerge pull request #22985 from joscollin/wip-24844-luminous
Yuri Weinstein [Wed, 1 Aug 2018 15:30:31 +0000 (08:30 -0700)]
Merge pull request #22985 from joscollin/wip-24844-luminous

luminous: rgw: require --yes-i-really-mean-it to run radosgw-admin orphans find

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge PR #23345 into luminous
Sage Weil [Wed, 1 Aug 2018 14:59:52 +0000 (09:59 -0500)]
Merge PR #23345 into luminous

* refs/pull/23345/head:
Revert "luminous: pybind/mgr/mgr_module: make rados handle available to all modules"

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge pull request #23137 from smithfarm/wip-24068-luminous
Yuri Weinstein [Tue, 31 Jul 2018 19:48:36 +0000 (12:48 -0700)]
Merge pull request #23137 from smithfarm/wip-24068-luminous

luminous: tests: osd sends op_reply out of order

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
7 years agoMerge pull request #23350 from ceph/backport-luminous-23348
Alfredo Deza [Tue, 31 Jul 2018 16:42:34 +0000 (12:42 -0400)]
Merge pull request #23350 from ceph/backport-luminous-23348

luminous: ceph-volume: adds test for `ceph-volume lvm list /dev/sda`

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume: adds a unit test for `lvm list /dev/sda` 23350/head
Andrew Schoen [Mon, 30 Jul 2018 18:52:37 +0000 (13:52 -0500)]
ceph-volume: adds a unit test for `lvm list /dev/sda`

This test is to prove that the issue from
http://tracker.ceph.com/issues/24957 was fixed
by http://tracker.ceph.com/issues/24784

When running lvm list against a raw device it should handle
gracefully the situation where there are multiple PVs with the
name of the given device.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit ef10886f1e061d4273d3c0763ab0827e7e58e9d7)

7 years agoceph-volume: move pvolumes fixture into conftest.py
Andrew Schoen [Tue, 31 Jul 2018 13:26:57 +0000 (08:26 -0500)]
ceph-volume: move pvolumes fixture into conftest.py

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 37ed1be08b226a5b3a7a5bb70c4d5d1fd22db5d1)

7 years agoRevert "luminous: pybind/mgr/mgr_module: make rados handle available to all modules" 23345/head
Ernesto Puerta [Tue, 31 Jul 2018 09:39:53 +0000 (11:39 +0200)]
Revert "luminous: pybind/mgr/mgr_module: make rados handle available to all modules"

Reverts: https://github.com/ceph/ceph/pull/23235
Reverts: 45c7170eb68571a3d690460f99392c6753994799

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
7 years agoMerge pull request #22883 from smithfarm/wip-24311-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:48:10 +0000 (13:48 -0700)]
Merge pull request #22883 from smithfarm/wip-24311-luminous

luminous: pjd: cd: too many arguments

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22955 from joscollin/wip-24828-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:47:39 +0000 (13:47 -0700)]
Merge pull request #22955 from joscollin/wip-24828-luminous

luminous: qa: fix ffsb cd argument

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22980 from joscollin/wip-24860-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:47:01 +0000 (13:47 -0700)]
Merge pull request #22980 from joscollin/wip-24860-luminous

luminous: cephfs-journal-tool: Fix purging when importing an zero-length journal.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #23012 from batrick/i23015
Yuri Weinstein [Mon, 30 Jul 2018 20:46:41 +0000 (13:46 -0700)]
Merge pull request #23012 from batrick/i23015

luminous: client: fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #23107 from pdvian/wip-24932-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:45:58 +0000 (13:45 -0700)]
Merge pull request #23107 from pdvian/wip-24932-luminous

luminous: client: add inst to asok status output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #23222 from pdvian/wip-25038-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:45:28 +0000 (13:45 -0700)]
Merge pull request #23222 from pdvian/wip-25038-luminous

luminous: mds: scrub doesn't always return JSON results

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22779 from batrick/i24538
Yuri Weinstein [Mon, 30 Jul 2018 20:44:12 +0000 (13:44 -0700)]
Merge pull request #22779 from batrick/i24538

luminous: common/DecayCounter: set last_decay to current time when decoding decay counter

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22780 from batrick/i24295
Yuri Weinstein [Mon, 30 Jul 2018 20:43:23 +0000 (13:43 -0700)]
Merge pull request #22780 from batrick/i24295

luminous: repeated eviction of idle client until some IO happens

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22782 from ukernel/luminous-23989
Yuri Weinstein [Mon, 30 Jul 2018 20:41:00 +0000 (13:41 -0700)]
Merge pull request #22782 from ukernel/luminous-23989

luminous: mds: don't report slow request for blocked filelock request

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22783 from ukernel/luminous-24540
Yuri Weinstein [Mon, 30 Jul 2018 20:39:28 +0000 (13:39 -0700)]
Merge pull request #22783 from ukernel/luminous-24540

luminous: client:  update inode fields according to issued caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22786 from pdvian/wip-24535-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:38:29 +0000 (13:38 -0700)]
Merge pull request #22786 from pdvian/wip-24535-luminous

luminous: client: _ll_drop_pins may access invalid iterator

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22811 from smithfarm/wip-24694-luminous
Yuri Weinstein [Mon, 30 Jul 2018 20:37:38 +0000 (13:37 -0700)]
Merge pull request #22811 from smithfarm/wip-24694-luminous

luminous: PurgeQueue sometimes ignores Journaler errors

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #23329 from ceph/backport-luminous-23234
Alfredo Deza [Mon, 30 Jul 2018 18:14:48 +0000 (14:14 -0400)]
Merge pull request #23329 from ceph/backport-luminous-23234

luminous: ceph-volume: PVolumes.get() should return one PV when using name or uuid

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #22814 from smithfarm/wip-24748-luminous
Yuri Weinstein [Mon, 30 Jul 2018 16:44:42 +0000 (09:44 -0700)]
Merge pull request #22814 from smithfarm/wip-24748-luminous

luminous: change default filestore_merge_threshold to -10

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22839 from vumrao/wip-vumrao-backport-d12ba37e0d0-to-luminous
Yuri Weinstein [Mon, 30 Jul 2018 16:44:01 +0000 (09:44 -0700)]
Merge pull request #22839 from vumrao/wip-vumrao-backport-d12ba37e0d0-to-luminous

luminous: osd: change log level when withholding pg creation

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoMerge pull request #22979 from VictorDenisov/backport_24033
Yuri Weinstein [Mon, 30 Jul 2018 16:42:54 +0000 (09:42 -0700)]
Merge pull request #22979 from VictorDenisov/backport_24033

luminous: rados.pyx: make all exceptions accept keyword arguments

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #23064 from pdvian/wip-24886-luminous
Yuri Weinstein [Mon, 30 Jul 2018 16:41:53 +0000 (09:41 -0700)]
Merge pull request #23064 from pdvian/wip-24886-luminous

luminous: os/bluestore: fix races on SharedBlob::coll in ~SharedBlob.

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #23331 from alfredodeza/wip-rm25170
Andrew Schoen [Mon, 30 Jul 2018 16:15:16 +0000 (16:15 +0000)]
Merge pull request #23331 from alfredodeza/wip-rm25170

luminous: ceph-volume add a __release__ string, to help version-conditional calls

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agoMerge pull request #23293 from smithfarm/wip-upgrade-cleanup-luminous
Yuri Weinstein [Mon, 30 Jul 2018 16:01:40 +0000 (09:01 -0700)]
Merge pull request #23293 from smithfarm/wip-upgrade-cleanup-luminous

luminous: qa: drop upgrade/luminous-x

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
7 years agoceph-volume add a __release__ string, to help version-conditional calls 23331/head
Alfredo Deza [Mon, 30 Jul 2018 15:58:37 +0000 (11:58 -0400)]
ceph-volume add a __release__ string, to help version-conditional calls

Signed-off-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume: PVolumes.get() should return one PV when using name or uuid 23329/head
Andrew Schoen [Wed, 25 Jul 2018 16:47:27 +0000 (11:47 -0500)]
ceph-volume: PVolumes.get() should return one PV when using name or uuid

It is possible to get duplicated pv entires from the 'pvs' lvm command.
If we're using PVolumes.get() with either pv_name or pv_uuid we can
safely return a single PVolume object. However, if we use pv_tags with
PVolumes.get() we must still raise a MultiplePVsError if many pvs
are found that have the tags, because they are not guaranteed to be the
same pv, as would be the case with pv_name or pv_uuid.

Fixes: http://tracker.ceph.com/issues/24784
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit e5e866e8ecaf0522f3ebac83fa6fbc5a666acd58)

7 years agoMerge pull request #23238 from alfredodeza/luminous-rm24993
Andrew Schoen [Mon, 30 Jul 2018 13:42:57 +0000 (13:42 +0000)]
Merge pull request #23238 from alfredodeza/luminous-rm24993

luminous ceph-volume process.call with stdin in Python 3 fix

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agoMerge pull request #23296 from b-ranto/wip-volume-selinux-luminous
Alfredo Deza [Sun, 29 Jul 2018 13:20:23 +0000 (09:20 -0400)]
Merge pull request #23296 from b-ranto/wip-volume-selinux-luminous

[luminous] ceph-volume: Restore SELinux context

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume: Restore SELinux context 23296/head
Boris Ranto [Tue, 10 Jul 2018 20:52:38 +0000 (22:52 +0200)]
ceph-volume: Restore SELinux context

We need to reset the root context of the file system after mounting it.
Otherwise, the SELinux policy rules will not be preserved.

Fixes: https://tracker.ceph.com/issues/24785
Signed-off-by: Boris Ranto <branto@redhat.com>
(cherry picked from commit 61dbf4ac2af7d1e9da927bbc4006c9fbccb55478)

7 years agoceph-volume tests.util verify as_bytes behavior 23238/head
Alfredo Deza [Fri, 27 Jul 2018 15:16:19 +0000 (11:16 -0400)]
ceph-volume tests.util verify as_bytes behavior

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 1802c386da3bf1e77f20d8a5456edd810a631c6f)

7 years agoceph-volume tests catch utf-8 encoded stdin errors
Alfredo Deza [Fri, 27 Jul 2018 15:15:58 +0000 (11:15 -0400)]
ceph-volume tests catch utf-8 encoded stdin errors

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 31f565e90bb346c2be982f7daba31431b5368677)

7 years agoceph-volume process use the as_bytes util for stdin
Alfredo Deza [Fri, 27 Jul 2018 15:14:13 +0000 (11:14 -0400)]
ceph-volume process use the as_bytes util for stdin

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 6a9368c1db468e05944607f9814f19053de80b6b)

7 years agoceph-volume util create a helper for converting to bytes
Alfredo Deza [Fri, 27 Jul 2018 15:13:19 +0000 (11:13 -0400)]
ceph-volume util create a helper for converting to bytes

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit fb518165445479cf08eefc8a2755ad78dcafd07f)

7 years agoceph-volume tests validate the new utils for prompts
Alfredo Deza [Mon, 16 Jul 2018 13:23:14 +0000 (09:23 -0400)]
ceph-volume tests validate the new utils for prompts

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 2d988337a96fe6cc8fffb37e4641c86cd47e1139)

7 years agoceph-volume tests verify str_to_int utility
Alfredo Deza [Fri, 13 Jul 2018 12:55:46 +0000 (08:55 -0400)]
ceph-volume tests verify str_to_int utility

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 56b1bf633d3d16cf335043450df95f191e2907a4)

7 years agoceph-volume util create prompt helpers
Alfredo Deza [Mon, 16 Jul 2018 13:22:50 +0000 (09:22 -0400)]
ceph-volume util create prompt helpers

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0283fcc38b13c2d090b1d25be732e6f5f43b834c)

7 years agoceph-volume util move the str_to_int utility out of lvm
Alfredo Deza [Fri, 13 Jul 2018 12:54:33 +0000 (08:54 -0400)]
ceph-volume util move the str_to_int utility out of lvm

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit cb5b30ab43f37adc45fb6114452b37722c65501e)

7 years agoceph-volume tests run to log_descriptors, verifying utf-8
Alfredo Deza [Wed, 25 Jul 2018 12:40:53 +0000 (08:40 -0400)]
ceph-volume tests run to log_descriptors, verifying utf-8

Signed-off-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume process decode to utf-8 when logging descriptors
Alfredo Deza [Wed, 25 Jul 2018 12:39:16 +0000 (08:39 -0400)]
ceph-volume process decode to utf-8 when logging descriptors

Signed-off-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume tests.process ensure that stdin works on py3 and py2.7
Alfredo Deza [Fri, 20 Jul 2018 13:49:59 +0000 (09:49 -0400)]
ceph-volume tests.process ensure that stdin works on py3 and py2.7

Signed-off-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume process encode stdin with utf-8 to prevent bytes TypeError
Alfredo Deza [Fri, 20 Jul 2018 13:48:38 +0000 (09:48 -0400)]
ceph-volume process encode stdin with utf-8 to prevent bytes TypeError

Signed-off-by: Alfredo Deza <adeza@redhat.com>
7 years agoluminous: qa: drop upgrade/luminous-x 23293/head
Nathan Cutler [Fri, 27 Jul 2018 20:45:46 +0000 (22:45 +0200)]
luminous: qa: drop upgrade/luminous-x

This suite would typically be run from the mimic or master branches, not
luminous.

This commit is intentionally not a cherry-pick, since it is relevant to
luminous only.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge pull request #23274 from yuriw/wip-yuriw-25123-luminous
Nathan Cutler [Fri, 27 Jul 2018 04:18:54 +0000 (06:18 +0200)]
Merge pull request #23274 from yuriw/wip-yuriw-25123-luminous

qa/upgrade/luminous-p2p: cleaned up "#branch: luminous" lines

Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge pull request #23179 from smithfarm/wip-25066-luminous
Nathan Cutler [Fri, 27 Jul 2018 03:46:53 +0000 (05:46 +0200)]
Merge pull request #23179 from smithfarm/wip-25066-luminous

luminous: build/ops: install-deps.sh fails on newest openSUSE Leap

Reviewed-by: Tim Serong <tserong@suse.com>
7 years agoqa/tests: cleaned up "#branch: luminous" lines 23274/head
Yuri Weinstein [Thu, 26 Jul 2018 22:13:38 +0000 (15:13 -0700)]
qa/tests: cleaned up "#branch: luminous" lines

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7 years agoMerge pull request #23265 from yuriw/wip-yuriw-25123-luminous
Yuri Weinstein [Thu, 26 Jul 2018 22:12:26 +0000 (15:12 -0700)]
Merge pull request #23265 from yuriw/wip-yuriw-25123-luminous

qa/tests: added 12.2.7 to the mix

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #23150 from alfredodeza/luminous-rm24952
Andrew Schoen [Thu, 26 Jul 2018 20:48:09 +0000 (20:48 +0000)]
Merge pull request #23150 from alfredodeza/luminous-rm24952

luminous: ceph-volume lvm.listing only include devices if they exist

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agoqa/tests: added 12.2.7 to the mix 23265/head
Yuri Weinstein [Thu, 26 Jul 2018 15:57:09 +0000 (08:57 -0700)]
qa/tests: added 12.2.7 to the mix
also added 'overall HEALTH_' to the whitelist

Fixes: https://tracker.ceph.com/issues/25123
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7 years agoMerge pull request #23177 from smithfarm/wip-25063-luminous
Nathan Cutler [Thu, 26 Jul 2018 20:05:37 +0000 (22:05 +0200)]
Merge pull request #23177 from smithfarm/wip-25063-luminous

luminous: doc: ceph-bluestore-tool manpage not getting rendered correctly

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
7 years agoceph-volume lvm.listing only include devices if they exist 23150/head
Alfredo Deza [Wed, 18 Jul 2018 20:50:25 +0000 (16:50 -0400)]
ceph-volume lvm.listing only include devices if they exist

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 37565f81634f47c389926d300ed5f92b223bddea)

7 years agoceph-volume: do not pin the testinfra version for the simple tests
Andrew Schoen [Thu, 26 Jul 2018 17:41:15 +0000 (12:41 -0500)]
ceph-volume: do not pin the testinfra version for the simple tests

For testinfra to work with a 2.6.x version of ansible it must use the
latest version.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 70b86012b56fd4b66fc0c7ce88a6cfbe895a0702)

7 years agoMerge pull request #23264 from ceph/backport-luminous-23263
Alfredo Deza [Thu, 26 Jul 2018 17:44:32 +0000 (13:44 -0400)]
Merge pull request #23264 from ceph/backport-luminous-23263

luminous: ceph-volume: update version of ansible to 2.6.x for simple tests

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume: update version of ansible to 2.6.x for simple tests 23264/head
Andrew Schoen [Thu, 26 Jul 2018 15:09:17 +0000 (10:09 -0500)]
ceph-volume: update version of ansible to 2.6.x for simple tests

ceph-ansible now requires a 2.5.x or 2.6.x version of ansible if you're
using the master branch. This updates our functional tests for the
simple subcommand to use a 2.6.x version of ansible.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 654578928dd840801967c5409b5b19ad6cf90317)

7 years agoMerge pull request #23245 from alfredodeza/luminous-ansible-26
Andrew Schoen [Wed, 25 Jul 2018 21:03:02 +0000 (21:03 +0000)]
Merge pull request #23245 from alfredodeza/luminous-ansible-26

luminous ceph-volume tests/functional use Ansible 2.6

Reviewed-by: Andrew Schoen <aschoen@redhat.com
7 years agoceph-volume tests/functional use testinfra latest for ansible 2.6 23245/head
Alfredo Deza [Mon, 23 Jul 2018 18:16:41 +0000 (14:16 -0400)]
ceph-volume tests/functional use testinfra latest for ansible 2.6

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 4f48ceab975539c9ce989aade7a1f3ae7d5b51d5)

7 years agoceph-volume tests/functional use Ansible 2.6
Alfredo Deza [Mon, 23 Jul 2018 14:18:34 +0000 (10:18 -0400)]
ceph-volume tests/functional use Ansible 2.6

The ceph-ansible project now refuses to use 2.4 even though it works
with that version

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9570864dd614d2442278e2ba3501788fefd753e3)

7 years agoMerge pull request #23235 from rhcs-dashboard/wip-25102-luminous
Ernesto Puerta [Wed, 25 Jul 2018 18:33:21 +0000 (20:33 +0200)]
Merge pull request #23235 from rhcs-dashboard/wip-25102-luminous

pybind/mgr/mgr_module: make rados handle available to all modules

7 years agopybind/mgr/mgr_module: make rados handle available to all modules 23235/head
Sage Weil [Tue, 16 Jan 2018 21:02:14 +0000 (15:02 -0600)]
pybind/mgr/mgr_module: make rados handle available to all modules

Fixes: http://tracker.ceph.com/issues/25102
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 366905fb5779ecb110ec4216afe7cde14fbbb2d8)
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
7 years agoMerge pull request #23227 from liewegas/wip-25057-luminous
Sage Weil [Wed, 25 Jul 2018 12:07:58 +0000 (07:07 -0500)]
Merge pull request #23227 from liewegas/wip-25057-luminous

luminous: osd/OSDMap: CRUSH_TUNABLES5 added in jewel, not kraken

7 years agotest: validate empty json output during recursive scrub 23222/head
Venky Shankar [Fri, 13 Jul 2018 11:39:12 +0000 (07:39 -0400)]
test: validate empty json output during recursive scrub

Signed-off-by: Venky Shankar <vshankar@redhat.com>
Fixes: http://tracker.ceph.com/issues/23958
(cherry picked from commit f253e3c3117aad183b05b863474c6d92fb923ed4)

7 years agotest: subclass test_scrub.Workload from CephFSTestCase
Venky Shankar [Tue, 17 Jul 2018 06:06:44 +0000 (02:06 -0400)]
test: subclass test_scrub.Workload from CephFSTestCase

This allows usage of assert*() calls instead of writing
our own version.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit ba23f5aa707b306f35939325b48de79859c93bcc)

7 years agomds: dump minimal cli output during recursive scrub trigger
Venky Shankar [Mon, 9 Jul 2018 06:42:06 +0000 (02:42 -0400)]
mds: dump minimal cli output during recursive scrub trigger

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit a70d21b162e00e49813f25149fa93442f5434e0b)

7 years agoosd/OSDMap: CRUSH_TUNABLES5 added in jewel, not kraken 23227/head
Sage Weil [Wed, 25 Jul 2018 01:30:54 +0000 (20:30 -0500)]
osd/OSDMap: CRUSH_TUNABLES5 added in jewel, not kraken

In 0ceb5c0f3694725c7043ea99b077816da2ca44a7 I screwed up the version that
CRUSH_TUANBLES5 (chooseleaf_stable) was added: it comes from
043a7378ec4e828f2568ea3906d9076848161ccd, v10.0.3, which leads up to
jewel.

This, in turn, means that when jewel tunables are set we do not actually
encode the jewel tunables.  At least, luminous doesn't; jewel uses a
different code path to decode how to encode the OSDMap.

This, in turn, leads to crc errors:

- luminous mons running
- require_osd_release is jewel
- jewel tunables are set.  mon in-memory crushmap gets chooseleaf_stable=1
- osds are luminous, but don't see the new field in the crushmap
- upgrade finishes, and require_osd_Release becomes luminous
- the full osdmap encodes the chooseleaf_stable field, finally, and it
  is 1
- the osds try to encode the same thing, but their crushmap has 0.
-> crc mismatch

This is a regression from 0ceb5c0f3694725c7043ea99b077816da2ca44a7,
backported to luminous in 686b054f48c50859bd5e8bad93007bf9d7d7899c in
12.2.6.

Fixes: 686b054f48c50859bd5e8bad93007bf9d7d7899c
Fixes: http://tracker.ceph.com/issues/25057
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7e9d24d0602abefa4cca245f5f86dcd4b412b97a)

7 years agoMerge pull request #23219 from liewegas/wip-slow-requests-upgrade-luminous
Sage Weil [Tue, 24 Jul 2018 22:55:55 +0000 (17:55 -0500)]
Merge pull request #23219 from liewegas/wip-slow-requests-upgrade-luminous

luminous: qa/suites/upgrade/jewel-x: whitelist 'slow requests'

7 years agoqa/suites/upgrade/jewel-x: whitelist 'slow requests' 23219/head
Sage Weil [Tue, 24 Jul 2018 22:54:27 +0000 (17:54 -0500)]
qa/suites/upgrade/jewel-x: whitelist 'slow requests'

This message is generated by jewel but not luminous.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoAdd new OpenSUSE Leap id for install-deps.sh 23179/head
Kyr Shatskyy [Mon, 2 Jul 2018 13:23:58 +0000 (15:23 +0200)]
Add new OpenSUSE Leap id for install-deps.sh

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
(cherry picked from commit bd0448c0b5a09a9314fddf1757502529801366e3)

Conflicts:
install-deps.sh (trivial resolution)

7 years agodoc: use :command: for subcommands in ceph-bluestore-tool manpage 23177/head
Nathan Cutler [Wed, 18 Jul 2018 12:01:42 +0000 (14:01 +0200)]
doc: use :command: for subcommands in ceph-bluestore-tool manpage

Older versions of Sphinx, such as the one in CentOS 7, do not render "..
option::" lines correctly if the option contains a hyphen but does not start
with a hyphen. And ceph-bluestore-tool appears to be the only Ceph manpage
affected by this bug.

Fixes: http://tracker.ceph.com/issues/24800
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 7c9229e7876dfc1bf6e415ed7cce924c3b50925d)

7 years agoMerge pull request #23147 from alfredodeza/luminous-rm24961
Andrew Schoen [Fri, 20 Jul 2018 19:25:20 +0000 (19:25 +0000)]
Merge pull request #23147 from alfredodeza/luminous-rm24961

ceph-volume tests/functional run lvm list after OSD provisioning

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agoceph-volume tests/functional run lvm list after OSD provisioning 23147/head
Alfredo Deza [Wed, 18 Jul 2018 16:39:01 +0000 (12:39 -0400)]
ceph-volume tests/functional run lvm list after OSD provisioning

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit e01fb206d67f26724f3b03e4b22f5ba6eea22207)

7 years agoMerge pull request #23102 from ceph/backport-luminous-23093
Alfredo Deza [Fri, 20 Jul 2018 18:24:48 +0000 (14:24 -0400)]
Merge pull request #23102 from ceph/backport-luminous-23093

luminous: ceph-volume: an OSD ID must exist and be destroyed before reuse

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #23128 from ceph/backport-luminous-23117
Alfredo Deza [Fri, 20 Jul 2018 16:38:45 +0000 (12:38 -0400)]
Merge pull request #23128 from ceph/backport-luminous-23117

luminous: ceph-volume: unmount lvs correctly before zapping

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoqa/suites: set osd_pg_log_dups_tracked in cfuse_workunit_suites_fsync.yaml 23137/head
Neha Ojha [Tue, 1 May 2018 23:20:14 +0000 (16:20 -0700)]
qa/suites: set osd_pg_log_dups_tracked in cfuse_workunit_suites_fsync.yaml

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 94a2d810826d710c3c71403d6a78249cc66a39e7)

7 years agoceph-volume: unmount lvs correctly before zapping 23128/head
Andrew Schoen [Wed, 18 Jul 2018 16:08:15 +0000 (11:08 -0500)]
ceph-volume: unmount lvs correctly before zapping

If the lv found does not include the meatadata to construct an osd path,
then we should try to unmount it's path instead.

Fixes: http://tracker.ceph.com/issues/24796
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 5b175a5bb68264b80c00cb4f04026a4d19ca20ad)

7 years agoclient: add inst to asok status output 23107/head
Patrick Donnelly [Thu, 28 Jun 2018 22:57:05 +0000 (15:57 -0700)]
client: add inst to asok status output

Makes it easier for checking if a client becomes blacklisted.

Fixes: http://tracker.ceph.com/issues/24724
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 47c67d584e204d56c2a5f9a414082bb523098015)

7 years agoceph-volume: an osd ID must exist and be destroyed before reuse 23102/head
Andrew Schoen [Mon, 16 Jul 2018 21:06:03 +0000 (16:06 -0500)]
ceph-volume: an osd ID must exist and be destroyed before reuse

Fixes: https://tracker.ceph.com/issues/24044
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 02a13f2de0783ff3c680a6042388a4692250edfb)

7 years agoceph-volume util/prepare.py
Ron Allred [Wed, 23 May 2018 14:34:41 +0000 (08:34 -0600)]
ceph-volume util/prepare.py

Replaces PR#21887
Rename function check_id to osd_id_exists in util/prepare.py
Fix boolean analysis of osd_id_exists when --osd-id is provided on command line

Signed-off-by: Ron Allred <rallred@itrefined.com>
(cherry picked from commit 4641ebb075adc987e83d7440f9756104fc04f83a)

7 years ago12.2.7 v12.2.7
Jenkins Build Slave User [Mon, 16 Jul 2018 16:00:31 +0000 (16:00 +0000)]
12.2.7

7 years agoMerge PR #23055 into luminous
Sage Weil [Mon, 16 Jul 2018 15:50:19 +0000 (10:50 -0500)]
Merge PR #23055 into luminous

* refs/pull/23055/head:
common/options: disable osd_skip_data_digest
common/options: make osd_skip_data_digest a DEV option
common: add osd_distrust_data_digest option
osd: apply osd_skip_data_digest to read operations
osd: do not skip_data_digests during scrub
osd/PrimaryLogPG: use legacy style for osd_skip_data_digest

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years agoos/bluestore: fix races on SharedBlob::coll in ~SharedBlob. 23064/head
Radoslaw Zarzynski [Tue, 10 Jul 2018 23:14:54 +0000 (01:14 +0200)]
os/bluestore: fix races on SharedBlob::coll in ~SharedBlob.

Example scenario:
  ```
  A: BlueStore::Collection::split_cache(src, dest)
  A: std::lock(src->cache->lock, dest->cache->lock)

  B: SharedBlob::~SharedBlob
  B: waits coll->cache->lock // coll == src

  A: sb->coll := dest
  A: unlocks both src and dest's cache mutexes

  C: // any locked operation on dest's cache
  C: acquires dest->cache->lock
  C: begins the op

  B: // with the src's cache mutex acquired
  B: BufferSpace::_clear(coll->cache) // coll == dest
  B: // oops, B operates on cache already locked by C
  ```

Fixes: http://tracker.ceph.com/issues/24859
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit d1b16749c7d32eead6e326c492ef9edf0d03a2b8)

7 years agocommon/options: disable osd_skip_data_digest 23055/head
Sage Weil [Sat, 14 Jul 2018 20:03:43 +0000 (15:03 -0500)]
common/options: disable osd_skip_data_digest

This is flawed in that it stops doing digests based on the primary's
backend store, not the replicas.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agocommon/options: make osd_skip_data_digest a DEV option
Sage Weil [Sat, 14 Jul 2018 18:26:31 +0000 (13:26 -0500)]
common/options: make osd_skip_data_digest a DEV option

And document/warn to never turn it off after it's been on.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agocommon: add osd_distrust_data_digest option
Sage Weil [Sat, 14 Jul 2018 13:59:15 +0000 (08:59 -0500)]
common: add osd_distrust_data_digest option

If we have reason to distrust the stored full-object oi data digests,
this option will ignore them (and opportunistically clear them).  It
basically affects the same behaviors that osd_skip_data_digest except
the previous option only takes effect if bluestore is in use, while this
option is unconditional.

This serves a workaround for clusters that suffered the 12.2.6 bug that
produced bad full-object digests and *also* had PGs' primaries move from
bluestore to filestore nodes.  In those situations, this option can be
set to true.

After all OSDs are upgrade and all PGs come back with a clean deep
scrub this option can be disabled again.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoosd: apply osd_skip_data_digest to read operations
Sage Weil [Sat, 14 Jul 2018 18:12:54 +0000 (13:12 -0500)]
osd: apply osd_skip_data_digest to read operations

If we would skip updating data digests, apply that same decision to read
operations as well.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoosd: do not skip_data_digests during scrub
Sage Weil [Sat, 14 Jul 2018 16:45:12 +0000 (11:45 -0500)]
osd: do not skip_data_digests during scrub

The goal was to skip storing per-object digests.  Scrub still needs to
calculate these digests in order to do a deep scrub, however!

This is not a cherry-pick of master because the code has changed a bit
and because the master fix is not merged yet.

Fixes: http://tracker.ceph.com/issues/24922
Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoosd/PrimaryLogPG: use legacy style for osd_skip_data_digest
Sage Weil [Sat, 14 Jul 2018 13:51:00 +0000 (08:51 -0500)]
osd/PrimaryLogPG: use legacy style for osd_skip_data_digest

This is more efficient.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #23039 from liewegas/wip-24903-workaround-luminous
Sage Weil [Fri, 13 Jul 2018 22:12:52 +0000 (17:12 -0500)]
Merge pull request #23039 from liewegas/wip-24903-workaround-luminous

rpm,deb: fix chown to use -h

7 years agorpm,deb: fix chown to use -h 23039/head
Sage Weil [Fri, 13 Jul 2018 22:10:38 +0000 (17:10 -0500)]
rpm,deb: fix chown to use -h

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 92207c76b91c26c0558688a358ade7c0d94d1b59)

7 years agoMerge PR #23028 into luminous
Sage Weil [Fri, 13 Jul 2018 19:44:09 +0000 (14:44 -0500)]
Merge PR #23028 into luminous

* refs/pull/23028/head:
osd/PrimaryLogPG: clear data digest on WRITEFULL if skip_data_digest

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #23035 into luminous
Sage Weil [Fri, 13 Jul 2018 19:44:01 +0000 (14:44 -0500)]
Merge PR #23035 into luminous

* refs/pull/23035/head:
rpm,deb: chown bluestore block* links to ceph.ceph on install/upgrade

7 years agorpm,deb: chown bluestore block* links to ceph.ceph on install/upgrade 23035/head
Sage Weil [Fri, 13 Jul 2018 14:56:48 +0000 (09:56 -0500)]
rpm,deb: chown bluestore block* links to ceph.ceph on install/upgrade

This works around https://tracker.ceph.com/issues/24903

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 58cde3fd793c037beca6645cc30b2ae1c30e2af1)

7 years agoMerge pull request #22369 from linuxbox2/wip-luminous-rgw-cache-time-added
Matt Benjamin [Fri, 13 Jul 2018 15:53:36 +0000 (11:53 -0400)]
Merge pull request #22369 from linuxbox2/wip-luminous-rgw-cache-time-added

Wip luminous rgw cache time added

7 years agoMerge PR #22962 into luminous
Sage Weil [Fri, 13 Jul 2018 12:11:54 +0000 (07:11 -0500)]
Merge PR #22962 into luminous

* refs/pull/22962/head:
osd/PrimaryLogPG: rebuild attrs from clients

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #22976 into luminous
Sage Weil [Fri, 13 Jul 2018 12:11:48 +0000 (07:11 -0500)]
Merge PR #22976 into luminous

* refs/pull/22976/head:
qa/standalone/osd/ec-error-rollforward: reproduce bug 24597
qa/standalone/osd/repro_long_log.sh: fix test
osd/PG: do not blindly roll forward to log.head

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #23007 into luminous
Sage Weil [Fri, 13 Jul 2018 12:11:43 +0000 (07:11 -0500)]
Merge PR #23007 into luminous

* refs/pull/23007/head:
qa/suites/rados/singleton/all/osd-recovery*: whitelist REQUEST_SLOW

7 years agoosd/PrimaryLogPG: clear data digest on WRITEFULL if skip_data_digest 23028/head
Sage Weil [Thu, 26 Apr 2018 14:15:50 +0000 (09:15 -0500)]
osd/PrimaryLogPG: clear data digest on WRITEFULL if skip_data_digest

If we detect we are on bluestore and should skip the data digest, we
need to clear any old digest on WRITEFULL.  This aligns us with the
WRITE behavior, which is also either an update or a clear (but never
neither!).

Fixes: https://tracker.ceph.com/issues/23871
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit fe5038c7f9577327f82913b4565712c53903ee48)

7 years agoMerge PR #22872 into luminous
Patrick Donnelly [Thu, 12 Jul 2018 19:31:29 +0000 (12:31 -0700)]
Merge PR #22872 into luminous

* refs/pull/22872/head:
doc: outline steps to take CephFS fs down

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge PR #22963 into luminous
Patrick Donnelly [Thu, 12 Jul 2018 19:28:24 +0000 (12:28 -0700)]
Merge PR #22963 into luminous

* refs/pull/22963/head:
mon/AuthMonitor: improve error message

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
7 years agoclient: fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL 23012/head
huanwen ren [Tue, 16 Jan 2018 06:18:46 +0000 (14:18 +0800)]
client: fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL

fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL,
Because the original fuction does not have a global Lock to
ensure the atomicity of the lookup inode process,It eventually
caused an exception when the NFS-Ganesha FSAL module called
this interface in parallel,see the Bug report.

Fixes: http://tracker.ceph.com/issues/22683
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
(cherry picked from commit b1248273d67d32eaba35cadf0f6f02942f9da81f)

Conflicts:
src/client/Client.cc
src/libcephfs.cc