]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoMerge pull request #27903 from pdvian/wip-39226-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:14:39 +0000 (09:14 -0700)]
Merge pull request #27903 from pdvian/wip-39226-nautilus

nautilus: librbd: support EC data pool images sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27988 from smithfarm/wip-39541-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:13:25 +0000 (09:13 -0700)]
Merge pull request #27988 from smithfarm/wip-39541-nautilus

nautilus: tests: rbd: qemu-iotests tests fail under latest Ubuntu kernel

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28019 from pdvian/wip-39315-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:11:32 +0000 (09:11 -0700)]
Merge pull request #28019 from pdvian/wip-39315-nautilus

nautilus: krbd: fix rbd map hang due to udev return subsystem unordered

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28128 from dillaman/wip-39729-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:10:56 +0000 (09:10 -0700)]
Merge pull request #28128 from dillaman/wip-39729-nautilus

nautilus: qa/workunits/rbd: use https protocol for devstack git operations

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28132 from dillaman/wip-39195-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:10:18 +0000 (09:10 -0700)]
Merge pull request #28132 from dillaman/wip-39195-nautilus

nautilus: librbd: fixed several race conditions related to copyup

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #27752 from liewegas/wip-devices-doc-nautilus
Nathan Cutler [Tue, 21 May 2019 08:11:02 +0000 (10:11 +0200)]
Merge pull request #27752 from liewegas/wip-devices-doc-nautilus

nautilus: doc/rados/operations/devices: document device prediction

Reviewed-by: Sébastien Han <seb@redhat.com>
6 years agoMerge pull request #27488 from sebastian-philipp/wip-39169-nautilus
Nathan Cutler [Mon, 20 May 2019 12:31:48 +0000 (14:31 +0200)]
Merge pull request #27488 from sebastian-philipp/wip-39169-nautilus

nautilus: doc/mgr/orchestrator_cli: Rook orch supports mon update

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #28163 from smithfarm/wip-39962-nautilus
Lenz Grimmer [Mon, 20 May 2019 10:56:19 +0000 (12:56 +0200)]
Merge pull request #28163 from smithfarm/wip-39962-nautilus

nautilus: mgr/dashboard: openssl exception when verifying certificates of HTTPS requests

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agosystemd: ceph-mgr: set MemoryDenyWriteExecute to false 28163/head
Ricardo Dias [Wed, 8 May 2019 13:57:07 +0000 (14:57 +0100)]
systemd: ceph-mgr: set MemoryDenyWriteExecute to false

Fixes: http://tracker.ceph.com/issues/39628
Signed-off-by: Ricardo Dias <rdias@suse.com>
(cherry picked from commit 1d7506fdce4924fb30bbabc65e26dafa06aab24f)

6 years agolibrbd: copyup read stats were incorrectly tied to child 28132/head
Jason Dillaman [Wed, 24 Apr 2019 15:37:41 +0000 (11:37 -0400)]
librbd: copyup read stats were incorrectly tied to child

The parent IO stats should be updated when reading from the parent
image for a copyup.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 9b615c30753ad35636c875696ed951e807fd694c)

6 years agolibrbd: force a copyup object map update if migration completes
Jason Dillaman [Mon, 8 Apr 2019 17:42:16 +0000 (13:42 -0400)]
librbd: force a copyup object map update if migration completes

If a live-migration copyup was in-progress when the copyup completes,
force the object map to be updated.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit e18e413b602208b38f432f4ba5bcb187fe102cb1)

6 years agolibrbd: cleaned up snap/parent lock release in read-from-parent path
Jason Dillaman [Thu, 4 Apr 2019 15:23:58 +0000 (11:23 -0400)]
librbd: cleaned up snap/parent lock release in read-from-parent path

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit b7f6ba710d2855ea8f223d205a55a1e425167afd)

6 years agotest/librbd: initial unit test for copyup state machine
Jason Dillaman [Tue, 2 Apr 2019 18:10:42 +0000 (14:10 -0400)]
test/librbd: initial unit test for copyup state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit ea4901f539c7404c07e72f5c42fc8abcf840dafa)

6 years agolibrbd: copyup should restart delayed ops against the same object
Jason Dillaman [Thu, 4 Apr 2019 01:35:40 +0000 (21:35 -0400)]
librbd: copyup should restart delayed ops against the same object

This avoids the potential for a race condition where an in-flight
copyup is removed from the in-flight copyup list and a subsequent
IO against the same object causes a second in-flight copyup.

Fixes: http://tracker.ceph.com/issues/39021
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 31ed673a7484c8067dd928cabd5bcb923a35dbaf)

6 years agolibrbd: merge copyup object map update states
Jason Dillaman [Tue, 2 Apr 2019 15:51:36 +0000 (11:51 -0400)]
librbd: merge copyup object map update states

The object map HEAD and HEAD/snapshot update states have been
simplified and merged into a single state. This also fixes
several potential race conditions and an issue where CoR might
incorrectly mark the HEAD object has exists+dirty.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 5b90dbe0ae4be3dccfc3fbc0c8d5eb1ed7bb3168)

6 years agolibrbd: refactor copyup state machine to match current code style
Jason Dillaman [Fri, 29 Mar 2019 18:17:15 +0000 (14:17 -0400)]
librbd: refactor copyup state machine to match current code style

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 711a070fa086b499eeba9a4c62005456f406689b)

6 years agolibrbd: properly hold snap/parent locks during IO
Jason Dillaman [Fri, 29 Mar 2019 17:23:37 +0000 (13:23 -0400)]
librbd: properly hold snap/parent locks during IO

The ImageCtx::parent pointer was dereferenced without holding the lock
which could lead to a crash. The ImageCtx::migration_info structure
was also dereferenced without holding a lock.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 6dad1acee3f0a4b4b3c88e25c0cfafe21bc066c4)

6 years agolibrbd: empty IO requests should complete in new context
Jason Dillaman [Tue, 2 Apr 2019 19:33:00 +0000 (15:33 -0400)]
librbd: empty IO requests should complete in new context

This will avoid the possibility of a lock being held by the caller
and having the IO immediately complete back to the calling state
machine.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit c9ff6cf1945b248b38e83484aa4a22c206da846b)

6 years agolibrbd: deep-copy object copy should register an in-flight op
Jason Dillaman [Mon, 1 Apr 2019 18:48:47 +0000 (14:48 -0400)]
librbd: deep-copy object copy should register an in-flight op

When handling live migrations, the source image is the parent
image of the destination image. To prevent the parent image from
being closed while a request is in-flight, the object copy
state machine now registers an async operation with the source
image.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 89cfa6c8d328b9294c7f7efd53d82edcec59e66d)

6 years agolibrbd: deep-copy object copy should delay computing object existence
Jason Dillaman [Fri, 29 Mar 2019 20:33:21 +0000 (16:33 -0400)]
librbd: deep-copy object copy should delay computing object existence

This prevent a potential recursive lock on the destination image's
snap_lock.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 0c37066797737cd7c677b2649dae1e6422869afb)

6 years agoqa/workunits/rbd: use https protocol for devstack git operations 28128/head
Jason Dillaman [Thu, 9 May 2019 19:48:30 +0000 (15:48 -0400)]
qa/workunits/rbd: use https protocol for devstack git operations

Fixes: http://tracker.ceph.com/issues/39656
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit fb4f9a8a08edd18b1a23e1be4c1285d0ec4d1de6)

6 years agoMerge pull request #27740 from ifed01/wip-ifed-fix-39446
Yuri Weinstein [Wed, 15 May 2019 16:05:06 +0000 (09:05 -0700)]
Merge pull request #27740 from ifed01/wip-ifed-fix-39446

nautilus: os/bluestore: fix out-of-bound access in bmap allocator.

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27803 from pdvian/wip-39205-nautilus
Yuri Weinstein [Sat, 11 May 2019 15:43:00 +0000 (08:43 -0700)]
Merge pull request #27803 from pdvian/wip-39205-nautilus

nautilus: osd: shutdown recovery_request_timer earlier

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28065 from yuriw/wip-yuriw-fix-distros-nautilus
Yuri Weinstein [Fri, 10 May 2019 19:06:49 +0000 (12:06 -0700)]
Merge pull request #28065 from yuriw/wip-yuriw-fix-distros-nautilus

qa/tests: cleaned up supported distro for nautilus

6 years agoqa/tests: cleaned up supported disto for nautilus 28065/head
Yuri Weinstein [Fri, 10 May 2019 16:10:08 +0000 (09:10 -0700)]
qa/tests: cleaned up supported disto for nautilus

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #27608 from liewegas/wip-38157-nautilus
Yuri Weinstein [Fri, 10 May 2019 15:20:46 +0000 (08:20 -0700)]
Merge pull request #27608 from liewegas/wip-38157-nautilus

nautilus: mgr/progress: behave if pgs disappear (due to a racing pg merge)

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #27654 from neha-ojha/wip-38881-nautilus
Yuri Weinstein [Fri, 10 May 2019 15:19:38 +0000 (08:19 -0700)]
Merge pull request #27654 from neha-ojha/wip-38881-nautilus

nautilus: osd/PG: skip rollforward when !transaction_applied during append_log()

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27854 from smithfarm/wip-39504-nautilus
Yuri Weinstein [Fri, 10 May 2019 15:18:47 +0000 (08:18 -0700)]
Merge pull request #27854 from smithfarm/wip-39504-nautilus

nautilus: core: Give recovery for inactive PGs a higher priority

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #27857 from ashishkumsingh/wip-39465-nautilus
Yuri Weinstein [Fri, 10 May 2019 15:18:13 +0000 (08:18 -0700)]
Merge pull request #27857 from ashishkumsingh/wip-39465-nautilus

nautilus: msg: output peer address when detecting bad CRCs

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
6 years agoMerge pull request #27939 from pdvian/wip-39308-nautilus
Yuri Weinstein [Fri, 10 May 2019 15:17:32 +0000 (08:17 -0700)]
Merge pull request #27939 from pdvian/wip-39308-nautilus

nautilus: mgr/ActivePyModules: handle_command - fix broken lock

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27642 from LenzGr/nautilus-documentation
Ernesto Puerta [Fri, 10 May 2019 13:33:06 +0000 (15:33 +0200)]
Merge pull request #27642 from LenzGr/nautilus-documentation

nautilus: doc: Backported dashboard documentation changes

6 years agoMerge pull request #27936 from dillaman/wip-39450-nautilus
Yuri Weinstein [Thu, 9 May 2019 17:07:44 +0000 (10:07 -0700)]
Merge pull request #27936 from dillaman/wip-39450-nautilus

nautilus: librbd: re-add support for nautilus clients talking to jewel clusters

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28046 from neha-ojha/wip-28036-nautilus
Neha Ojha [Thu, 9 May 2019 15:26:33 +0000 (08:26 -0700)]
Merge pull request #28046 from neha-ojha/wip-28036-nautilus

nautilus: doc/dev/osd_internals/async_recovery: update cost calculation

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agodoc/dev/osd_internals/async_recovery: update cost calculation 28046/head
Neha Ojha [Thu, 9 May 2019 03:19:32 +0000 (20:19 -0700)]
doc/dev/osd_internals/async_recovery: update cost calculation

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 984073e44d096a3322d90b85da42c593fff94c6d)

6 years agoMerge pull request #28024 from ricardoasmarques/wip-39630-nautilus
Lenz Grimmer [Thu, 9 May 2019 10:33:00 +0000 (12:33 +0200)]
Merge pull request #28024 from ricardoasmarques/wip-39630-nautilus

nautilus: mgr/dashboard: iSCSI GET requests should not be logged

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #27942 from LenzGr/wip-39524-nautilus
Lenz Grimmer [Thu, 9 May 2019 07:52:56 +0000 (09:52 +0200)]
Merge pull request #27942 from LenzGr/wip-39524-nautilus

nautilus: mgr/dashboard: make auth token work with UTC times only

6 years agomgr/dashboard: iSCSI GET requests should not be logged 28024/head
Ricardo Marques [Fri, 26 Apr 2019 10:13:20 +0000 (11:13 +0100)]
mgr/dashboard: iSCSI GET requests should not be logged

Fixes: https://tracker.ceph.com/issues/39492
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit 93d74cf9b9926c1638f15da6c8e6d3fd68d61831)

6 years agoMerge pull request #27758 from ricardoasmarques/wip-39452-nautilus
Lenz Grimmer [Wed, 8 May 2019 11:55:54 +0000 (13:55 +0200)]
Merge pull request #27758 from ricardoasmarques/wip-39452-nautilus

nautilus: mgr/dashboard: iSCSI form is showing a warning

Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agonautilus: mgr/dashboard: Adapt iSCSI discovery auth for read-only users (#27759)
Lenz Grimmer [Wed, 8 May 2019 11:29:35 +0000 (13:29 +0200)]
nautilus: mgr/dashboard: Adapt iSCSI discovery auth for read-only users (#27759)

nautilus: mgr/dashboard: Adapt iSCSI discovery auth for read-only users

Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agonautilus: mgr/dashboard: Upgrade to ceph-iscsi config v9 (#28001)
Lenz Grimmer [Wed, 8 May 2019 11:18:58 +0000 (13:18 +0200)]
nautilus: mgr/dashboard: Upgrade to ceph-iscsi config v9 (#28001)

nautilus: mgr/dashboard: Upgrade to ceph-iscsi config v9

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agokrbd: fix rbd map hang due to udev return subsystem unordered 28019/head
Zhi Zhang [Thu, 11 Apr 2019 05:09:01 +0000 (13:09 +0800)]
krbd: fix rbd map hang due to udev return subsystem unordered

The order of subsystem returned by udev_device_get_subsystem
might not be same order as adding subsystem by
udev_monitor_filter_add_match_subsystem_devtype. So if block
event is returned first and rbd event is returned next, then
further poll will get nothing back until timed-out.

Fixes: http://tracker.ceph.com/issues/39089
Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
(cherry picked from commit 42dd1eae630f31a628051049e4007175561f1939)

6 years agomgr/dashboard: Support ceph-iscsi config v9 28001/head
Ricardo Marques [Mon, 8 Apr 2019 20:22:25 +0000 (21:22 +0100)]
mgr/dashboard: Support ceph-iscsi config v9

Fixes: https://tracker.ceph.com/issues/39147
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit 1b5bf05a2ce0590f034bbbc7ae750ed478f6ffe3)

6 years agonautilus: mgr/dashboard: Make all columns sortable (#27889)
Lenz Grimmer [Tue, 7 May 2019 09:18:59 +0000 (11:18 +0200)]
nautilus: mgr/dashboard: Make all columns sortable (#27889)

nautilus: mgr/dashboard: Make all columns sortable

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
6 years agonautilus: mgr/dashboard: Buggy data table search field (#27672)
Lenz Grimmer [Tue, 7 May 2019 08:25:31 +0000 (10:25 +0200)]
nautilus: mgr/dashboard: Buggy data table search field (#27672)

nautilus: mgr/dashboard: Buggy data table search field

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
6 years agoMerge pull request #27886 from rhcs-dashboard/39459-nautilus-prometheus-replace-white...
Lenz Grimmer [Tue, 7 May 2019 08:19:30 +0000 (10:19 +0200)]
Merge pull request #27886 from rhcs-dashboard/39459-nautilus-prometheus-replace-whitespaces

nautilus: mgr/prometheus: replace whitespaces in metrics' names

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27673 from Devp00l/wip-39371-nautilus
Lenz Grimmer [Tue, 7 May 2019 07:57:36 +0000 (09:57 +0200)]
Merge pull request #27673 from Devp00l/wip-39371-nautilus

 nautilus: mgr/dashboard: Localization for date picker module

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoqa/workunits/rbd: use more recent qemu-iotests that support Bionic 27988/head
Jason Dillaman [Thu, 18 Apr 2019 18:02:45 +0000 (14:02 -0400)]
qa/workunits/rbd: use more recent qemu-iotests that support Bionic

Fixes: http://tracker.ceph.com/issues/24668
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit b184acd218b36b85f5a25678d773c35407a2b745)

6 years agoPendingReleaseNotes: librbd can open images on Jewel clusters 27936/head
Jason Dillaman [Mon, 6 May 2019 12:20:42 +0000 (08:20 -0400)]
PendingReleaseNotes: librbd can open images on Jewel clusters

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agodoc: Fix small typo in dashboard documentation 27642/head
Tatjana Dehler [Mon, 29 Apr 2019 09:56:59 +0000 (11:56 +0200)]
doc: Fix small typo in dashboard documentation

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
(cherry picked from commit 038ef6291d5f5728385683c693046f03184309fa)

6 years agodoc: Improved the dashboard proxy config section
Lenz Grimmer [Sun, 14 Apr 2019 14:28:30 +0000 (16:28 +0200)]
doc: Improved the dashboard proxy config section

Added paragraph that explains how standby dashboard instances perform
HTTP redirections to the currently active ceph-mgr node.
Added note about current limitations (see Bug#24662 for details).

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
(cherry picked from commit 70a28a3e474177719fef250d0c84d28703946a2d)

6 years agodoc: dashboard: refined object gateway configuration
Lenz Grimmer [Fri, 12 Apr 2019 11:17:23 +0000 (13:17 +0200)]
doc: dashboard: refined object gateway configuration

As discussed in BUG#39252, the dashboard currently does not
support all possible RGW configuration possibilities when trying
to obtain hostname and port number. Update the docs to better
reflect this.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
(cherry picked from commit 43c56e1a5a92fc876e6edc184459b665d270ce29)

6 years agodoc: Updated dashboard iSCSI configuration, added labels
Lenz Grimmer [Sun, 31 Mar 2019 18:32:15 +0000 (13:32 -0500)]
doc: Updated dashboard iSCSI configuration, added labels

Added note about the requirement for the latest ceph-iscsi version
3 to the dashboard documentation. Added some doc references
and replaced some URLs in the iSCSI docs with reST labels instead.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
(cherry picked from commit 71e46887d4b0f1afd7dc8af461879dc0f9440d50)

6 years agolibrbd: re-add support for nautilus clients talking to jewel clusters
Jason Dillaman [Thu, 2 May 2019 20:55:44 +0000 (16:55 -0400)]
librbd: re-add support for nautilus clients talking to jewel clusters

We want to support N - 3 client backward compatibility (special case
to support Jewel since it was a LTS release). The "get_snapshot_timestamp"
cls method does not exist in Jewel clusters so librbd should fallback
to excluding the op if it fails.

Note: this is a direct backport to Nautilus since Octopus (master) does not
need to support Jewel-backed clusters

Fixes: http://tracker.ceph.com/issues/39450
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27923 from Vicente-Cheng/wip-39046-nautilus
Nathan Cutler [Fri, 3 May 2019 09:00:05 +0000 (11:00 +0200)]
Merge pull request #27923 from Vicente-Cheng/wip-39046-nautilus

nautilus: rgw: update resharding documentation

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27922 from Vicente-Cheng/wip-38874-nautilus
Nathan Cutler [Fri, 3 May 2019 08:56:39 +0000 (10:56 +0200)]
Merge pull request #27922 from Vicente-Cheng/wip-38874-nautilus

nautilus: doc: cleanup HTTP Frontends documentation

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agomgr/dashboard: auth: fix user lastUpdate timestamp generation 27942/head
Ricardo Dias [Tue, 16 Apr 2019 08:38:31 +0000 (09:38 +0100)]
mgr/dashboard: auth: fix user lastUpdate timestamp generation

Fixes: http://tracker.ceph.com/issues/39300
Signed-off-by: Ricardo Dias <rdias@suse.com>
(cherry picked from commit 90f6142d6f9ecd712c6c1e7a801a87c346e17855)

6 years agomgr/ActivePyModules: handle_command - fix broken lock 27939/head
xie xingguo [Wed, 10 Apr 2019 03:25:02 +0000 (11:25 +0800)]
mgr/ActivePyModules: handle_command - fix broken lock

by unlocking properly when module is not available.

Fixes: http://tracker.ceph.com/issues/39235
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 377de7af5fec521642cc781ac67d555d98ea5e03)

6 years agoMerge pull request #27791 from mogeb/wip-lvmcache-nautilus
Alfredo Deza [Thu, 2 May 2019 22:05:42 +0000 (18:05 -0400)]
Merge pull request #27791 from mogeb/wip-lvmcache-nautilus

nautilus: ceph-volume: add utility functions

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #27687 from dzafman/wip-39389
Neha Ojha [Thu, 2 May 2019 21:49:20 +0000 (14:49 -0700)]
Merge pull request #27687 from dzafman/wip-39389

nautilus: osd: Increase log level of messages which unnecessarily fill up logs

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>

6 years agorgw: updates to resharding documentation 27923/head
J. Eric Ivancich [Thu, 28 Mar 2019 17:30:08 +0000 (13:30 -0400)]
rgw: updates to resharding documentation

Some minor updates to the resharding documentation with the aim of
clarifying the language and using terms consistently.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 54b6b650eeeeac0e754bd5860cd53109ba7865bd)

6 years agodoc/rgw: update civetweb rgw_frontends config example 27922/head
Casey Bodley [Tue, 19 Mar 2019 16:57:55 +0000 (12:57 -0400)]
doc/rgw: update civetweb rgw_frontends config example

all of these civetweb options have to be on the same line as rgw_frontends

Fixes: https://tracker.ceph.com/issues/37770
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 2f16fcb2fdb8dbd917e804dec97d1be056dc1749)

6 years agoMerge pull request #27899 from Vicente-Cheng/wip-39051-nautilus
Nathan Cutler [Wed, 1 May 2019 09:58:03 +0000 (11:58 +0200)]
Merge pull request #27899 from Vicente-Cheng/wip-39051-nautilus

nautilus: doc: add LAZYIO

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27900 from Vicente-Cheng/wip-39176-nautilus
Nathan Cutler [Wed, 1 May 2019 09:39:40 +0000 (11:39 +0200)]
Merge pull request #27900 from Vicente-Cheng/wip-39176-nautilus

nautilus: doc: add documentation for "fs set min_compat_client"

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agodoc: add doc for blacklisting older CephFS clients 27900/head
Patrick Donnelly [Fri, 5 Apr 2019 21:11:11 +0000 (14:11 -0700)]
doc: add doc for blacklisting older CephFS clients

Fixes: http://tracker.ceph.com/issues/39130
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 19372b8492a75ea8423cb9826f4ddaec0a947554)

6 years agodoc: add doc for cephfs lazyio 27899/head
Yan, Zheng [Fri, 15 Mar 2019 10:11:57 +0000 (18:11 +0800)]
doc: add doc for cephfs lazyio

Fixes: http://tracker.ceph.com/issues/38729
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit 8ebd0fb74a0ed06259fc84b13b249756e7f432d3)

6 years agolibrbd: support EC data pool images sparsify 27903/head
Mykola Golub [Fri, 29 Mar 2019 09:04:57 +0000 (09:04 +0000)]
librbd: support EC data pool images sparsify

(object truncate or remove)

Fixes: https://tracker.ceph.com/issues/38364
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit d6bf5ce6f5227c346253ecb40b04f832e8dd7821)

6 years agoMerge PR #27623 into nautilus
Sage Weil [Tue, 30 Apr 2019 22:31:29 +0000 (17:31 -0500)]
Merge PR #27623 into nautilus

* refs/pull/27623/head:
qa: add crush-node-flags test
mon/OSDMonitor: remove crush node flags too on "crush rm"
mon/OSDMonitor: make per-OSD no{out,down,in,out} flags prior to CRUSH nodes
mon/OSDMonitor: osd add-no{up,down,in,out} - remove state checker
mon/OSDMonitor: respect crush node flags for can_mark_*()
osd/OSDMap: add get_crush_node_flags(int osd)
mon/OSDMonitor: make 'osd {add,rm}-{noin,noout,...}' support crush nodes
osd/OSDMap: raise OSD_FLAGS health alert for crush node flags, too
osd/OSDMap: add flags for crush nodes

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agotest: osd-recovery-scrub.sh ignore error from kill_daemons() 27854/head
David Zafman [Wed, 24 Apr 2019 03:26:22 +0000 (20:26 -0700)]
test: osd-recovery-scrub.sh ignore error from kill_daemons()

Another work around for http://tracker.ceph.com/issues/38195

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 71d254647ac2019c6973bd58649dbb242651ca7c)

6 years agotest: Add tests for pool recovery priority conversion
David Zafman [Tue, 23 Apr 2019 21:04:54 +0000 (14:04 -0700)]
test: Add tests for pool recovery priority conversion

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 71d82dbeb9b83fc24511de9dd56110143e3efdfd)

6 years agomgr: If the requested OSD is down don't trust osd_stat info
David Zafman [Thu, 18 Apr 2019 02:41:58 +0000 (19:41 -0700)]
mgr: If the requested OSD is down don't trust osd_stat info

If we have a down AND out OSD it may contains osd_stat with num_pgs == 0.
When all PGs aren't active+clean we need an accurate value or we consider
the osd missing stat info.

Fixes: https://tracker.ceph.com/issues/38930
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 97f3b7c2e93f72223ae2c9a904e38bbb30e275da)

6 years agomon, mgr: Improve PG count by changing up to up_no_acting in pg_count
David Zafman [Thu, 18 Apr 2019 00:11:02 +0000 (17:11 -0700)]
mon, mgr: Improve PG count by changing up to up_no_acting in pg_count

By not adding a field to pg_count, we don't have to worry about
versioning or backwards compatibility.  A mixed cluster won't
be any worse than before.

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 69eaaaadd00f190f3013abbf8c713b47c0b3e7bc)

6 years agoosd: Add new object_location_counts to pg_stat_t
David Zafman [Tue, 16 Apr 2019 21:44:07 +0000 (14:44 -0700)]
osd: Add new object_location_counts to pg_stat_t

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 796794b38b49e44dc9112d684a76e87272697043)

Conflicts:
src/osd/osd_types.h
- nautilus does not have 75014ceb1437c5bb48293574ec6f991e4bec64bb

6 years agomgr: Improve ok-to-stop by using the avail_no_missing for recovery
David Zafman [Sat, 13 Apr 2019 18:32:19 +0000 (11:32 -0700)]
mgr: Improve ok-to-stop by using the avail_no_missing for recovery

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 9750061d5d4236aaba156d60790e0b8bcd7cfb64)

6 years agoosd: Prevent priority from overflowing in the next base level
David Zafman [Fri, 12 Apr 2019 23:21:12 +0000 (16:21 -0700)]
osd: Prevent priority from overflowing in the next base level

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 42497780db7f1535407a644fca408985456e2fbc)

6 years agoosd, mon: New pool recovery priority range -10 to 10
David Zafman [Thu, 11 Apr 2019 23:54:52 +0000 (16:54 -0700)]
osd, mon: New pool recovery priority range -10 to 10

Use OSD_POOL_PRIORITY_MAX and OSD_POOL_PRIORITY_MIN constants
Scale legacy priorities if exceeds maximum

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 444aa9f9fe0bbbdb34bf2108044598785db6ef65)

6 years agoosd: For recovery track OSDs that have 0 missing to know how degraded we are
David Zafman [Thu, 11 Apr 2019 01:45:32 +0000 (18:45 -0700)]
osd: For recovery track OSDs that have 0 missing to know how degraded we are

Add backfill priority log message and remove redundanacy to recovery priority

Fixes: https://tracker.ceph.com/issues/39099
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f0e7202cffed6e4adf54513891f1deeea2341d81)

Conflicts:
src/osd/osd_types.h
- nautilus does not have 75014ceb1437c5bb48293574ec6f991e4bec64bb

6 years agomgr/dashboard: Make all columns sortable 27889/head
Stephan Müller [Thu, 25 Apr 2019 12:34:00 +0000 (14:34 +0200)]
mgr/dashboard: Make all columns sortable

Fixes: https://tracker.ceph.com/issues/39483
Signed-off-by: Stephan Müller <smueller@suse.com>
(cherry picked from commit ba6d0f96dbdd2ccb4824a6377e741a9534d46287)

6 years agomgr/prometheus: replace whitespaces in metrics' names 27886/head
alfonsomthd [Tue, 23 Apr 2019 14:20:47 +0000 (16:20 +0200)]
mgr/prometheus: replace whitespaces in metrics' names

Fixes: https://tracker.ceph.com/issues/39434
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 843802f43eaa8d0117dd2585b19ac71add3f1024)

6 years agomsg: output peer address when detecting bad CRCs 27857/head
Greg Farnum [Wed, 17 Apr 2019 22:27:22 +0000 (15:27 -0700)]
msg: output peer address when detecting bad CRCs

Fixes: http://tracker.ceph.com/issues/39367
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 19679231fc32daa405cc060847a02ac1cfd51300)

6 years agoosd: shutdown recovery_request_timer earlier 27803/head
Zengran Zhang [Wed, 27 Mar 2019 01:39:31 +0000 (09:39 +0800)]
osd: shutdown recovery_request_timer earlier

recovery_request_timer may hold some QueuePeeringEvts which PGRef,
if we dont shutdown it earlier, it potentially cause the PGRef leak
when kicking pg.

Fixes: https://tracker.ceph.com/issues/38945
Signed-off-by: Zengran Zhang <zhangzengran@sangfor.com.cn>
(cherry picked from commit bb41bdfdb14768b5d46b7b1334bba1a3909e2618)

Conflicts:
src/osd/OSD.cc : Resolved in shutdown_reserver

6 years ago14.2.1 v14.2.1
Jenkins Build Slave User [Thu, 25 Apr 2019 18:15:48 +0000 (18:15 +0000)]
14.2.1

6 years agoceph-volume: add test for create_lv using a PV 27791/head
Mohamad Gebai [Tue, 2 Apr 2019 10:51:14 +0000 (06:51 -0400)]
ceph-volume: add test for create_lv using a PV

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 90d296b302e74b59fc67c395b4d08537e2d37a1e)

6 years agoceph-volume: update volume's tags structure when setting tags
Mohamad Gebai [Tue, 2 Apr 2019 10:45:02 +0000 (06:45 -0400)]
ceph-volume: update volume's tags structure when setting tags

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 4a1198deffb0baf647a6a31e03cbfe98f011ff14)

6 years agoceph-volume: add tests for tags
Mohamad Gebai [Tue, 2 Apr 2019 10:44:10 +0000 (06:44 -0400)]
ceph-volume: add tests for tags

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit c88a6a8ad38410c60ea4945b46da6b3d458c0ff6)

6 years agoceph-volume: add tests for reduce_vg()
Mohamad Gebai [Mon, 1 Apr 2019 23:27:41 +0000 (19:27 -0400)]
ceph-volume: add tests for reduce_vg()

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 1f07776615b7bba5eacf34a8c9fa62c06a57eb4b)

6 years agoceph-volume: add tests for size_from_human_readable()
Mohamad Gebai [Mon, 1 Apr 2019 23:24:42 +0000 (19:24 -0400)]
ceph-volume: add tests for size_from_human_readable()

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 6e3b5306140a433667d1be95df2eba0b57d95ae9)

6 years agoceph-volume: add function to convert from a readable string to Size
Mohamad Gebai [Sun, 31 Mar 2019 17:06:43 +0000 (13:06 -0400)]
ceph-volume: add function to convert from a readable string to Size

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 50428062175623d561be01a8124e010a61221845)

6 years agoceph-volume: add clear_tag function for LVs
Mohamad Gebai [Sun, 31 Mar 2019 17:06:23 +0000 (13:06 -0400)]
ceph-volume: add clear_tag function for LVs

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 776d485af8b6225fd4059952df36e40ef0ad12b4)

6 years agoceph-volume: add option to specify a pv for lvcreate
Mohamad Gebai [Sun, 31 Mar 2019 17:05:35 +0000 (13:05 -0400)]
ceph-volume: add option to specify a pv for lvcreate

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 38b2d7a66c76d9c5b1d2e00ada9503f22a7d8fb6)

6 years agoceph-volume: add reduce_vg function
Mohamad Gebai [Sun, 31 Mar 2019 17:04:40 +0000 (13:04 -0400)]
ceph-volume: add reduce_vg function

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit ce0184b5d7f24f2b3b6a9491e0f3c1c847b8c0e7)

6 years agoceph-volume: look for hidden partitions when populating lvs
Mohamad Gebai [Sun, 31 Mar 2019 17:04:10 +0000 (13:04 -0400)]
ceph-volume: look for hidden partitions when populating lvs

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
(cherry picked from commit 463091e46ba4032f1b8d90a6770fd7e2d3277a74)

6 years agoMerge PR #27778 into nautilus
Sage Weil [Thu, 25 Apr 2019 13:28:11 +0000 (08:28 -0500)]
Merge PR #27778 into nautilus

* refs/pull/27778/head:
tools: pin the version of breathe that works with Python2

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agotools: pin the version of breathe that works with Python2 27778/head
Alfredo Deza [Tue, 23 Apr 2019 13:09:09 +0000 (09:09 -0400)]
tools: pin the version of breathe that works with Python2

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7ab6a390053d7034b8dcf5a3d94c23a83d29f8ab)

6 years agomgr/dashboard: Fix iSCSI Discovery user permissions 27759/head
Tiago Melo [Thu, 18 Apr 2019 09:31:38 +0000 (09:31 +0000)]
mgr/dashboard: Fix iSCSI Discovery user permissions

Fixes: http://tracker.ceph.com/issues/39328
Signed-off-by: Tiago Melo <tmelo@suse.com>
(cherry picked from commit cf3e5bb8641a77f7dde27abf690143b79bf390c9)

6 years agomgr/dashboard: Fix iSCSI target form warning 27758/head
Tiago Melo [Tue, 16 Apr 2019 14:18:03 +0000 (14:18 +0000)]
mgr/dashboard: Fix iSCSI target form warning

Chrome was throwing an warning because we had multiple inputs with the same id.

Fixes: http://tracker.ceph.com/issues/39324
Signed-off-by: Tiago Melo <tmelo@suse.com>
(cherry picked from commit 65654c9bd17a417ecc012a5a034307cf7443ea80)

6 years agoMerge PR #27709 into nautilus
Sage Weil [Wed, 24 Apr 2019 14:13:22 +0000 (09:13 -0500)]
Merge PR #27709 into nautilus

* refs/pull/27709/head:
mgr/telemetry: default to reports every 24h; lower minimum
mgr/telemetry: exclude hostname field in crash reports
mgr/telemetry: change crash dict to a list

Reviewed-by: Dan Mick <dmick@redhat.com>
6 years agodoc/rados/operations/devices: document device failure prediction 27752/head
Sage Weil [Tue, 9 Apr 2019 21:45:47 +0000 (16:45 -0500)]
doc/rados/operations/devices: document device failure prediction

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 67fadc711aadde093b2ad81442ce5c9e65141af4)

6 years agoos/bluestore: fix out-of-bound access in bmap allocator. 27740/head
Igor Fedotov [Fri, 19 Apr 2019 12:43:07 +0000 (15:43 +0300)]
os/bluestore: fix out-of-bound access in bmap allocator.

Fixes: https://tracker.ceph.com/issues/39334
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit b0d2411c9c48b49fff827841c5ec6b66533d9c58)

 Conflicts:
src/os/bluestore/fastbmap_allocator_impl.h

6 years agoqa: add crush-node-flags test 27623/head
xie xingguo [Tue, 23 Apr 2019 06:20:17 +0000 (14:20 +0800)]
qa: add crush-node-flags test

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit bae2231cc501d24cfc9fb0ad673d0d1ed691c440)

6 years agomon/OSDMonitor: remove crush node flags too on "crush rm"
xie xingguo [Tue, 23 Apr 2019 03:24:07 +0000 (11:24 +0800)]
mon/OSDMonitor: remove crush node flags too on "crush rm"

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit ee4d718d0fd049120aa5d1c2380efba5aa312b71)