]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agomgr/dashboard: Implement OSD purge 26242/head
Patrick Nawracay [Fri, 1 Feb 2019 10:58:22 +0000 (11:58 +0100)]
mgr/dashboard: Implement OSD purge

Removes the `remove` functionality from the UI.

Fixes: http://tracker.ceph.com/issues/35811
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
6 years agoMerge PR #26353 into master
Sage Weil [Sun, 17 Feb 2019 16:44:33 +0000 (10:44 -0600)]
Merge PR #26353 into master

* refs/pull/26353/head:
osd/PG: print get/put under debug_refs
osd: clear priv on heartbeat_reset

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoosd/PG: print get/put under debug_refs 26353/head
Sage Weil [Sun, 17 Feb 2019 14:18:34 +0000 (08:18 -0600)]
osd/PG: print get/put under debug_refs

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #24805 into master
Sage Weil [Sun, 17 Feb 2019 14:18:06 +0000 (08:18 -0600)]
Merge PR #24805 into master

* refs/pull/24805/head:
qa/suite: add dedup test
src/tools: fix compile error (master version issue)
src/tools: add stats (fixed objects,total objects)
src/tools: make room for cdc
src/tools: make enhacned stats and interface class
src/tools: set timelimit and add signal handler to check progress
src/tools: use the slice thing and make parallel (chunk_scrub)
src/test: add max-thread test in test_dedup_tool.sh
src/tools: use the slice thing and make parallel
src/test: add chunk-scrub test in test_dedup_tool.sh
src/tools: add chunk-scrub op in dedup tool
src/cls/cas: add has_chunk op
src/test: add test_dedup_tool.sh
src/tools: initial works for dedup tool

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26462 into master
Sage Weil [Sun, 17 Feb 2019 14:16:57 +0000 (08:16 -0600)]
Merge PR #26462 into master

* refs/pull/26462/head:
options: update some descriptions and see_also fields.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26187 into master
Sage Weil [Sat, 16 Feb 2019 15:39:59 +0000 (09:39 -0600)]
Merge PR #26187 into master

* refs/pull/26187/head:
mgr/balancer: balance pools with same crush_rule in batch
osd/OSDMap: more improvements to upmap

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26435 into master
Sage Weil [Sat, 16 Feb 2019 15:30:48 +0000 (09:30 -0600)]
Merge PR #26435 into master

* refs/pull/26435/head:
msg/async/ProtocolV2: assume peer has SERVER_NAUTILUS for encoding v2 frame

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26275 from trociny/wip-mksnap-errmsg
Kefu Chai [Sat, 16 Feb 2019 15:29:09 +0000 (23:29 +0800)]
Merge pull request #26275 from trociny/wip-mksnap-errmsg

rados: provide user with more meaningful error message

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
6 years agoMerge pull request #26454 from batrick/i37955-followup
Kefu Chai [Sat, 16 Feb 2019 15:26:49 +0000 (23:26 +0800)]
Merge pull request #26454 from batrick/i37955-followup

ceph.in: use correct module for cmd flags

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26446 from tchaikov/wip-mgr-plugins-are-arch-indep
Kefu Chai [Sat, 16 Feb 2019 15:20:27 +0000 (23:20 +0800)]
Merge pull request #26446 from tchaikov/wip-mgr-plugins-are-arch-indep

cmake,rpm,deb: install mgr plugins into /usr/share/ceph/mgr

Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #26449 from tchaikov/wip-monc-cleanup
Kefu Chai [Sat, 16 Feb 2019 15:16:09 +0000 (23:16 +0800)]
Merge pull request #26449 from tchaikov/wip-monc-cleanup

mon/MonClient: drop my_addr

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agooptions: update some descriptions and see_also fields. 26462/head
Mark Nelson [Fri, 4 Aug 2017 15:03:05 +0000 (10:03 -0500)]
options: update some descriptions and see_also fields.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
6 years agorpm: mark mgr plugins "noarch" 26446/head
Kefu Chai [Fri, 15 Feb 2019 13:02:23 +0000 (21:02 +0800)]
rpm: mark mgr plugins "noarch"

as they are architecture independent.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agodebian: s|lib/ceph/mgr|share/ceph/mgr|
Kefu Chai [Fri, 15 Feb 2019 13:00:10 +0000 (21:00 +0800)]
debian: s|lib/ceph/mgr|share/ceph/mgr|

as the mgr plugins are installed into $prefix/share/ceph/mgr now.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agorpm: s|lib/ceph/mgr|share/ceph/mgr|
Kefu Chai [Fri, 15 Feb 2019 12:54:51 +0000 (20:54 +0800)]
rpm: s|lib/ceph/mgr|share/ceph/mgr|

as the mgr plugins are installed into $prefix/share/ceph/mgr now.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocmake: rename CMAKE_INSTALL_{FULL_}?PKGLIBDIR
Kefu Chai [Fri, 15 Feb 2019 12:23:32 +0000 (20:23 +0800)]
cmake: rename CMAKE_INSTALL_{FULL_}?PKGLIBDIR

rename CMAKE_INSTALL_{FULL_}?PKGLIBDIR to
CEPH_INSTALL_{FULL_}?PKGLIBDIR. in order to differentiate them from the
paths not ended with "ceph".

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocmake: install mgr plugins into $prefix/share/ceph
Kefu Chai [Fri, 15 Feb 2019 12:14:53 +0000 (20:14 +0800)]
cmake: install mgr plugins into $prefix/share/ceph

as mgr plugins are architecture independent source files. see also
/usr/share/cmake-*/

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #26455 into master
Sage Weil [Sat, 16 Feb 2019 00:14:05 +0000 (18:14 -0600)]
Merge PR #26455 into master

* refs/pull/26455/head:
qa/suites/upgrade/mimic-x/stress-split: drop pglog_hardlimit test
qa/suites/upgrade/mimic-x/stress-split: update for msgr2
qa/suites/upgrade/mimic-x/parallel: update for msgr v2

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26416 from dzafman/wip-fix-test-loops
David Zafman [Fri, 15 Feb 2019 22:25:59 +0000 (14:25 -0800)]
Merge pull request #26416 from dzafman/wip-fix-test-loops

test: Limit loops waiting for force-backfill/force-recovery to happen

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26448 into master
Sage Weil [Fri, 15 Feb 2019 22:22:14 +0000 (16:22 -0600)]
Merge PR #26448 into master

* refs/pull/26448/head:
osd: do not send peers really old maps
osd: build_incremental_map_msg: recover if we are missing an incremental
osd: build_incremental_map_msg: behave if we have latest full but not incremental

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26345 into master
Sage Weil [Fri, 15 Feb 2019 22:08:55 +0000 (16:08 -0600)]
Merge PR #26345 into master

* refs/pull/26345/head:
ceph-osd: be helpful about upgrade gate
mon: record 'min_mon_release' file and prevent startup if it's too old
mon/Monitor: do not join cluster that is >2 releases old
mon/Elector: respect monmap min_mon_release
mon: check min_mon_release during probe
mon/MonmapMonitor: increase min_mon_release when full quorum is upgraded
mon: maintain quorum_min_mon_release
mon/MonMapMonitor: set initial min_mon_release
monmaptool: add --set-min-mon-release
monmaptool: don't spew usage on any error
mon/MonMap: add min_mon_release field

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge PR #26456 into master
Sage Weil [Fri, 15 Feb 2019 22:07:25 +0000 (16:07 -0600)]
Merge PR #26456 into master

* refs/pull/26456/head:
mgr/PyModuleRegistry: avoid null deref from get_progress_events

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoqa/suites/upgrade/mimic-x/stress-split: drop pglog_hardlimit test 26455/head
Sage Weil [Fri, 15 Feb 2019 02:16:12 +0000 (20:16 -0600)]
qa/suites/upgrade/mimic-x/stress-split: drop pglog_hardlimit test

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/mimic-x/stress-split: update for msgr2
Sage Weil [Thu, 14 Feb 2019 23:01:06 +0000 (17:01 -0600)]
qa/suites/upgrade/mimic-x/stress-split: update for msgr2

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/mimic-x/parallel: update for msgr v2
Sage Weil [Thu, 14 Feb 2019 22:54:37 +0000 (16:54 -0600)]
qa/suites/upgrade/mimic-x/parallel: update for msgr v2

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26212 from linuxbox2/wip-rgw-master-nosuch
Matt Benjamin [Fri, 15 Feb 2019 21:40:21 +0000 (16:40 -0500)]
Merge pull request #26212 from linuxbox2/wip-rgw-master-nosuch

rgw: check for non-existent bucket in RGWGetACLs

6 years agoosd: clear priv on heartbeat_reset
Sage Weil [Mon, 11 Feb 2019 14:44:12 +0000 (08:44 -0600)]
osd: clear priv on heartbeat_reset

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #25739 into master
Patrick Donnelly [Fri, 15 Feb 2019 18:37:13 +0000 (10:37 -0800)]
Merge PR #25739 into master

* refs/pull/25739/head:
mds: handle leftover reconnect information
client: split large reconnect into multiple messages
mds: update MClientReconnect encoding

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #26423 into master
Patrick Donnelly [Fri, 15 Feb 2019 18:36:32 +0000 (10:36 -0800)]
Merge PR #26423 into master

* refs/pull/26423/head:
mgr/volumes: create/delete fs subvolumes
pybind/ceph_volume_client: allow volume_client to

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #26434 into master
Patrick Donnelly [Fri, 15 Feb 2019 18:26:30 +0000 (10:26 -0800)]
Merge PR #26434 into master

* refs/pull/26434/head:
mds: return string_view for type
mds: reorg LogEvent def
mds: pass LogEvent as unique_ptr

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoceph.in: use correct module for cmd flags 26454/head
Patrick Donnelly [Fri, 15 Feb 2019 18:14:22 +0000 (10:14 -0800)]
ceph.in: use correct module for cmd flags

argparse != ceph_argparse

Introduced-by: 19fbdb3ffde5bcb73792b1d822fe3f8d0407d490
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomgr/PyModuleRegistry: avoid null deref from get_progress_events 26456/head
Sage Weil [Fri, 15 Feb 2019 18:14:13 +0000 (12:14 -0600)]
mgr/PyModuleRegistry: avoid null deref from get_progress_events

active_modules may be null.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26445 into master
Sage Weil [Fri, 15 Feb 2019 16:36:03 +0000 (10:36 -0600)]
Merge PR #26445 into master

* refs/pull/26445/head:
mgr: hold GIL while generating a typed option value
mgr/ActivePyModules: do not touch PyFormatter without the GIL

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agomon/MonClient: drop my_addr 26449/head
Kefu Chai [Fri, 15 Feb 2019 15:11:07 +0000 (23:11 +0800)]
mon/MonClient: drop my_addr

the only consumer of this member variable is MgrStandby, and MgrStandby
does have access to the messenger. so let it get the IP address
directly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoosd: do not send peers really old maps 26448/head
Sage Weil [Fri, 15 Feb 2019 14:43:23 +0000 (08:43 -0600)]
osd: do not send peers really old maps

We may receive a message that sat in a queue for a while with a low
priority and is tagged with an older epoch.  Don't send a bunch of old
maps that we have already sent the peer.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoosd: build_incremental_map_msg: recover if we are missing an incremental
Sage Weil [Fri, 15 Feb 2019 14:28:07 +0000 (08:28 -0600)]
osd: build_incremental_map_msg: recover if we are missing an incremental

If we are building a history and are missing an incremental, continue with
a full map in its place.

Generally speaking, an OSD should *always* have a full map stored, but
may not have the corresponding incremental for various reasons.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoosd: build_incremental_map_msg: behave if we have latest full but not incremental
Sage Weil [Fri, 15 Feb 2019 14:25:19 +0000 (08:25 -0600)]
osd: build_incremental_map_msg: behave if we have latest full but not incremental

Fixes 47a3f63ef71522d6b9572e81674598dd3e19df9d and
follow-on 57a13adc8d0e34b4bb1a4022eacbb3de2636df53

Fixes: http://tracker.ceph.com/issues/38330
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr: hold GIL while generating a typed option value 26445/head
Sage Weil [Fri, 15 Feb 2019 00:21:38 +0000 (18:21 -0600)]
mgr: hold GIL while generating a typed option value

Drop the GIL while looking up the module and option value.  Retake
it before calling get_typed_option_value(), where we generate the
Python objects for the value.

Fixes: http://tracker.ceph.com/issues/38123
Fixes: http://tracker.ceph.com/issues/38204
Fixes: http://tracker.ceph.com/issues/38292
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/ActivePyModules: do not touch PyFormatter without the GIL
Sage Weil [Thu, 14 Feb 2019 13:24:09 +0000 (07:24 -0600)]
mgr/ActivePyModules: do not touch PyFormatter without the GIL

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agocmake: move install(.. ./mgr) down to mgr
Kefu Chai [Fri, 15 Feb 2019 11:57:02 +0000 (19:57 +0800)]
cmake: move install(.. ./mgr) down to mgr

this helps to modularize the CMakeLists.txt

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26437 from tspmelo/wip-npm-update-19-2
Lenz Grimmer [Fri, 15 Feb 2019 11:25:23 +0000 (12:25 +0100)]
Merge pull request #26437 from tspmelo/wip-npm-update-19-2

mgr/dashboard: Update npm packages

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #26429 from rhcs-dashboard/fix-toast-notifications
Lenz Grimmer [Fri, 15 Feb 2019 10:38:27 +0000 (11:38 +0100)]
Merge pull request #26429 from rhcs-dashboard/fix-toast-notifications

mgr/dashboard: fix: toast notifications hiding utility menu

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #26334 from votdev/fix_typo
Lenz Grimmer [Fri, 15 Feb 2019 09:27:26 +0000 (10:27 +0100)]
Merge pull request #26334 from votdev/fix_typo

mgr/dashboard: Fix typo in NoOrchesrtatorConfiguredException class name

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Update prettier to 1.16 26437/head
Tiago Melo [Wed, 23 Jan 2019 01:02:50 +0000 (01:02 +0000)]
mgr/dashboard: Update prettier to 1.16

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Update npm packages
Tiago Melo [Tue, 12 Feb 2019 15:50:29 +0000 (15:50 +0000)]
mgr/dashboard: Update npm packages

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomds: return string_view for type 26434/head
Patrick Donnelly [Thu, 14 Feb 2019 20:27:11 +0000 (12:27 -0800)]
mds: return string_view for type

To avoid unnecessary heap allocation.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: reorg LogEvent def
Patrick Donnelly [Thu, 14 Feb 2019 18:55:41 +0000 (10:55 -0800)]
mds: reorg LogEvent def

To follow code-style guidelines and protect some members.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: pass LogEvent as unique_ptr
Patrick Donnelly [Thu, 14 Feb 2019 18:49:32 +0000 (10:49 -0800)]
mds: pass LogEvent as unique_ptr

To avoid leaks.

Fixes: http://tracker.ceph.com/issues/38324
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomsg/async/ProtocolV2: assume peer has SERVER_NAUTILUS for encoding v2 frame 26435/head
Sage Weil [Thu, 14 Feb 2019 19:44:43 +0000 (13:44 -0600)]
msg/async/ProtocolV2: assume peer has SERVER_NAUTILUS for encoding v2 frame

The v2 frames may contain entity_addr_t and entity_addrvec_t.  Those have
been understood since the MSG_ADDR2 feature, but with nautilus we've
additionally added the TYPE_ANY, and we encode TYPE_ANY addrs as
TYPE_LEGACY when the peer lacks SERVER_NAUTILUS.

For the purposes of the v2 protocol, we assume the peer understands
TYPE_ANY.

No other complex types are used in the v2 frame protocol, so this has no
effect on, e.g., what features we assume the peer has for the purposes
of encoding actual messages.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26375 from dzafman/wip-38034
David Zafman [Thu, 14 Feb 2019 18:36:38 +0000 (10:36 -0800)]
Merge pull request #26375 from dzafman/wip-38034

pg stuck in backfill_wait with plenty of disk space

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26238 into master
Patrick Donnelly [Thu, 14 Feb 2019 18:22:28 +0000 (10:22 -0800)]
Merge PR #26238 into master

* refs/pull/26238/head:
mds: resolve memory leak of recall gather

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge PR #26374 into master
Patrick Donnelly [Thu, 14 Feb 2019 18:21:37 +0000 (10:21 -0800)]
Merge PR #26374 into master

* refs/pull/26374/head:
mds: fix potential re-evaluate stray dentry in _unlink_local_finish

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge PR #26394 into master
Patrick Donnelly [Thu, 14 Feb 2019 18:20:44 +0000 (10:20 -0800)]
Merge PR #26394 into master

* refs/pull/26394/head:
mds: remove superfluous cap sequence increment
mds: fix MDCache::finish_snaprealm_reconnect()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoosd: Fix the problem by rechecking backfill status each time 26375/head
xie xingguo [Tue, 12 Feb 2019 04:07:42 +0000 (20:07 -0800)]
osd: Fix the problem by rechecking backfill status each time
a RemoteReservationRevoked message is received, so we can
restart the backfill process in a more safe and less-likely raced way.

Fixes: http://tracker.ceph.com/issues/38034
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoRevert "osd: Handle getting RecoveryDone while in RepWaitBackfillReserved"
David Zafman [Tue, 12 Feb 2019 03:42:43 +0000 (19:42 -0800)]
Revert "osd: Handle getting RecoveryDone while in RepWaitBackfillReserved"

This reverts commit 83c2521a5316c922875746a40b95100b62865e67.

This original fix handled the race by accepting the RecoveryDone
while in RepWaitBackfillReserved by going to RepNotRecovering.
Once we weren't crashing OSDs, none of the tests at the time
detected that backfill was actually hung.

Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #26371 from dzafman/wip-38262
David Zafman [Thu, 14 Feb 2019 17:28:33 +0000 (09:28 -0800)]
Merge pull request #26371 from dzafman/wip-38262

test: run-standalone.sh: point LD_LIBRARY_PATH to $(pwd)/lib

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26297 from s0nea/wip-dashboard-readonly-config-options
Lenz Grimmer [Thu, 14 Feb 2019 17:27:32 +0000 (18:27 +0100)]
Merge pull request #26297 from s0nea/wip-dashboard-readonly-config-options

mgr/dashboard: disallow editing read-only config options

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #26316 from wjwithagen/wjw-fix-FindStdFilesystem
Kefu Chai [Thu, 14 Feb 2019 17:06:08 +0000 (01:06 +0800)]
Merge pull request #26316 from wjwithagen/wjw-fix-FindStdFilesystem

cmake: Make the tests for finding Filesystem with more serious functions

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #26063 into master
Patrick Donnelly [Thu, 14 Feb 2019 16:27:41 +0000 (08:27 -0800)]
Merge PR #26063 into master

* refs/pull/26063/head:
ceph: omit hidden commands from suggestions

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26413 from liewegas/wip-38282
Kefu Chai [Thu, 14 Feb 2019 15:59:44 +0000 (23:59 +0800)]
Merge pull request #26413 from liewegas/wip-38282

osd: fix build_incremental_map_msg

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26420 from tchaikov/wip-pgmap-more-includes
Kefu Chai [Thu, 14 Feb 2019 15:51:55 +0000 (23:51 +0800)]
Merge pull request #26420 from tchaikov/wip-pgmap-more-includes

mon/PGMap: add more #include

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agomgr/dashboard: fix: toast notifications hiding utility menu 26429/head
alfonsomthd [Thu, 14 Feb 2019 15:15:58 +0000 (16:15 +0100)]
mgr/dashboard: fix: toast notifications hiding utility menu

* Fixed margin-top taking into account responsiveness.
* dropdown-menu class: set z-index to avoid notification
  hiding dropdown menus when menu item clicked.

Fixes: https://tracker.ceph.com/issues/38313
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
6 years agocmake: Make the tests for finding Filesystem with more serious functions 26316/head
Willem Jan Withagen [Thu, 14 Feb 2019 12:16:53 +0000 (13:16 +0100)]
cmake: Make the tests for finding Filesystem with more serious functions

Otherwise it is linked agains lc++ on FreeBSD,a dn that will satisfy both
tested libraries.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoMerge pull request #26085 from tspmelo/wip-dashboard-nfs
Lenz Grimmer [Thu, 14 Feb 2019 12:13:44 +0000 (13:13 +0100)]
Merge pull request #26085 from tspmelo/wip-dashboard-nfs

mgr/dashboard: NFS management UI

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26149 from votdev/improve_get_typed_config
Kefu Chai [Thu, 14 Feb 2019 11:59:42 +0000 (19:59 +0800)]
Merge pull request #26149 from votdev/improve_get_typed_config

mgr: Improve ActivePyModules::get_typed_config implementation

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26407 from votdev/rgw_column_style
Lenz Grimmer [Thu, 14 Feb 2019 11:40:57 +0000 (12:40 +0100)]
Merge pull request #26407 from votdev/rgw_column_style

mgr/dashboard: Sync column style with the rest of the UI

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agoMerge pull request #25963 from smithfarm/wip-python-dep-cleanup
Kefu Chai [Thu, 14 Feb 2019 11:27:04 +0000 (19:27 +0800)]
Merge pull request #25963 from smithfarm/wip-python-dep-cleanup

rpm: make Python dependencies somewhat less confusing

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26421 from b-ranto/wip-rest-fix
Kefu Chai [Thu, 14 Feb 2019 11:08:07 +0000 (19:08 +0800)]
Merge pull request #26421 from b-ranto/wip-rest-fix

restful: Fix regression when traversing leaf nodes

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/dashboard: Add UI for NFS Form 26085/head
Tiago Melo [Thu, 4 Oct 2018 16:24:20 +0000 (17:24 +0100)]
mgr/dashboard: Add UI for NFS Form

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Add UI for NFS List and Detail
Tiago Melo [Thu, 4 Oct 2018 16:20:10 +0000 (17:20 +0100)]
mgr/dashboard: Add UI for NFS List and Detail

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Add NFS frontend services
Tiago Melo [Thu, 4 Oct 2018 16:14:26 +0000 (17:14 +0100)]
mgr/dashboard: Add NFS frontend services

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/volumes: create/delete fs subvolumes 26423/head
Ramana Raja [Thu, 14 Feb 2019 09:41:02 +0000 (15:11 +0530)]
mgr/volumes: create/delete fs subvolumes

... within the specified fs volume.

Previously, subvolumes (fs subdirectories) weren't created within
the desired volumes (fs filestyems).

Fixes: https://tracker.ceph.com/issues/38297
Signed-off-by: Ramana Raja <rraja@redhat.com>
6 years agoMerge pull request #26410 from tspmelo/wip-bootstrap-3.4.1
Lenz Grimmer [Thu, 14 Feb 2019 10:07:18 +0000 (11:07 +0100)]
Merge pull request #26410 from tspmelo/wip-bootstrap-3.4.1

mgr/dashboard: Update bootstrap to v3.4.1

Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agoMerge pull request #26409 from rhcs-dashboard/fix-tox-ini
Lenz Grimmer [Thu, 14 Feb 2019 10:06:26 +0000 (11:06 +0100)]
Merge pull request #26409 from rhcs-dashboard/fix-tox-ini

mgr/dashboard: fix: tox not detecting deps changes

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Fix typo in NoOrchesrtatorConfiguredException class name 26334/head
Volker Theile [Fri, 8 Feb 2019 13:00:27 +0000 (14:00 +0100)]
mgr/dashboard: Fix typo in NoOrchesrtatorConfiguredException class name

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agopybind/ceph_volume_client: allow volume_client to
Ramana Raja [Thu, 14 Feb 2019 09:25:24 +0000 (14:55 +0530)]
pybind/ceph_volume_client: allow volume_client to

... mount a specificied ceph filesystem.

Signed-off-by: Ramana Raja <rraja@redhat.com>
6 years agorestful: Fix regression when traversing leaf nodes 26421/head
Boris Ranto [Thu, 14 Feb 2019 09:35:56 +0000 (10:35 +0100)]
restful: Fix regression when traversing leaf nodes

The commit 23b6c90 introduced a regression when traversing leaf nodes.
The issue is that it traverses the keys of a `dict` returned by
`nodes_by_id`, not the actual `items` of the node. That resulted in an
500 error because it tried to treat `str` as a `dict` and failed.

Signed-off-by: Boris Ranto <branto@redhat.com>
6 years agorpm: move Python deps out of distro-conditional blocks 25963/head
Nathan Cutler [Tue, 15 Jan 2019 14:43:13 +0000 (15:43 +0100)]
rpm: move Python deps out of distro-conditional blocks

The python%{_python_buildid}-bcrypt and python%{_python_buildid}-requests RPMs
are identically named across all the RPM distros, so move them out of the
distro conditional blocks.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
6 years agorpm: make Python build deps somewhat less confusing
Nathan Cutler [Tue, 15 Jan 2019 14:34:42 +0000 (15:34 +0100)]
rpm: make Python build deps somewhat less confusing

Signed-off-by: Nathan Cutler <ncutler@suse.com>
6 years agomon/PGMap: add more #include 26420/head
Kefu Chai [Thu, 14 Feb 2019 09:26:19 +0000 (17:26 +0800)]
mon/PGMap: add more #include

* common/Clock.h for ceph_clock_now()
* global/global_context.h for g_conf()

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26210 from falcon78921/wip-mgr-restful-python3
Kefu Chai [Thu, 14 Feb 2019 09:02:58 +0000 (17:02 +0800)]
Merge pull request #26210 from falcon78921/wip-mgr-restful-python3

mgr/restful: updated string formatting to str.format()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #26315 from tchaikov/wip-fix-Waddress-of-packed-member
Kefu Chai [Thu, 14 Feb 2019 09:01:02 +0000 (17:01 +0800)]
Merge pull request #26315 from tchaikov/wip-fix-Waddress-of-packed-member

msg/msg_types.h: do not cast `ceph_entity_name` to `entity_name_t` for printing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26380 from tchaikov/wip-split-dashboard-package
Kefu Chai [Thu, 14 Feb 2019 08:59:58 +0000 (16:59 +0800)]
Merge pull request #26380 from tchaikov/wip-split-dashboard-package

deb,rpm,qa: split dashboard package

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26419 from cyx1231st/wip-fix-echo
Kefu Chai [Thu, 14 Feb 2019 08:43:40 +0000 (16:43 +0800)]
Merge pull request #26419 from cyx1231st/wip-fix-echo

test/crimson: fixes of unittest_seastar_echo

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #25989 from votdev/feature_36488
Lenz Grimmer [Thu, 14 Feb 2019 08:43:15 +0000 (09:43 +0100)]
Merge pull request #25989 from votdev/feature_36488

mgr/dashboard: Add UI to configure the telemetry mgr plugin

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #26398 from SUSE/wip-fix-spec-badness
Kefu Chai [Thu, 14 Feb 2019 07:53:52 +0000 (15:53 +0800)]
Merge pull request #26398 from SUSE/wip-fix-spec-badness

ceph.spec.in: Don't use noarch for mgr module subpackages, fix /usr/lib64/ceph/mgr dir ownership

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomds: handle leftover reconnect information 25739/head
Yan, Zheng [Thu, 20 Dec 2018 13:16:15 +0000 (21:16 +0800)]
mds: handle leftover reconnect information

previous commit allows client to split reconnect into multiple
messages. mds may evict client after getting incomplete recconect.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agoclient: split large reconnect into multiple messages
Yan, Zheng [Thu, 20 Dec 2018 13:09:31 +0000 (21:09 +0800)]
client: split large reconnect into multiple messages

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agoMerge pull request #26393 from zmc/wip-rhel7-deps
Kefu Chai [Thu, 14 Feb 2019 05:03:07 +0000 (13:03 +0800)]
Merge pull request #26393 from zmc/wip-rhel7-deps

install-deps.sh: Fixes for RHEL 7

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomds: update MClientReconnect encoding
Yan, Zheng [Tue, 18 Dec 2018 08:22:21 +0000 (16:22 +0800)]
mds: update MClientReconnect encoding

The old encoding assumes that snaprealms are encoded at the tail of
message payload. So it does not allow adding new fields to the message.
The patch introduce new encoding for MClientReconnect, the new encoding
allows us to extend MClientReconnect.

The new encoding is not compatible with the old encoding. If mds does
not understand the new encoding. client needs to use the old encoding
to encode MClientReconnect.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agotest: Limit loops waiting for force-backfill/force-recovery to happen 26416/head
David Zafman [Wed, 13 Feb 2019 18:13:12 +0000 (10:13 -0800)]
test: Limit loops waiting for force-backfill/force-recovery to happen

Fixes: http://tracker.ceph.com/issues/38309
Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agomgr/balancer: balance pools with same crush_rule in batch 26187/head
xie xingguo [Tue, 12 Feb 2019 09:06:21 +0000 (17:06 +0800)]
mgr/balancer: balance pools with same crush_rule in batch

which is more efficient.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoosd/OSDMap: more improvements to upmap
xie xingguo [Sat, 26 Jan 2019 10:03:15 +0000 (18:03 +0800)]
osd/OSDMap: more improvements to upmap

- add ability of appending a 2nd, 3rd, etc... pair to existing upmaps
  when possible, rather than just continuing to the next PG
- handle the underfull case: we can rm-pg-upmap-items if there exist
  any upmaps which remapped a PG out from an underfull OSD

See-also: http://tracker.ceph.com/issues/37940
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #26411 from liewegas/wip-remove-smart
Dan Mick [Wed, 13 Feb 2019 22:49:11 +0000 (14:49 -0800)]
Merge pull request #26411 from liewegas/wip-remove-smart

mgr/smart: remove obsolete smart module

6 years agoMerge PR #26389 into master
Sage Weil [Wed, 13 Feb 2019 22:22:40 +0000 (16:22 -0600)]
Merge PR #26389 into master

* refs/pull/26389/head:
message/MMonMgrReport: conditionally reencode PGMapDigest
qa/suites/upgrade/luminous-x/parallel: enable all classes
qa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch
qa/suites/upgade/luminous-x: pglog_hardlimit succeeds now on luminous due to backport
mgr/DaemonServer: use a luminous-compatible 'mgr metadata' command
mgr/Mgr: print bad (non-object) json
qa/suites/upgrade/luminous-x/stress-split: mons on separate hosts, enable msgr2
qa/suites/upgrade/luminous-x/parallel: mon per host, msgr2
qa/suites/upgrade/luminous-x: whitelist 'slow request'
mon/HealthMonitor: add mon_warn_on_msgr2_not_enabled

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoosd: fix build_incremental_map_msg 26413/head
Sage Weil [Wed, 13 Feb 2019 21:01:48 +0000 (15:01 -0600)]
osd: fix build_incremental_map_msg

We need to fall back to an old map if since (the peer's epoch) is *older*
than our oldest.  If it's newer, we have it, and can just send
incrementals.

Fixes: http://tracker.ceph.com/issues/38282
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomessage/MMonMgrReport: conditionally reencode PGMapDigest 26389/head
Sage Weil [Wed, 13 Feb 2019 13:29:45 +0000 (07:29 -0600)]
message/MMonMgrReport: conditionally reencode PGMapDigest

The encoding changed between luminous and mimic.  Reencode the
structure if the target doesn't have all the features.

Fixes: http://tracker.ceph.com/issues/38295
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/luminous-x/parallel: enable all classes
Sage Weil [Fri, 8 Feb 2019 19:46:00 +0000 (13:46 -0600)]
qa/suites/upgrade/luminous-x/parallel: enable all classes

Otherwise it's annoying because the class list changes between luminous and nautilus,
and we don't want to futz around with changing this setting during the upgrade.

The problematic classes are 'cas' (added) and 'sdk' (not enabled by default but
included by the cls/ workunit.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch
Sage Weil [Sun, 3 Feb 2019 17:04:15 +0000 (11:04 -0600)]
qa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch

The luminous version is (1) not what we want and (2) will fail because
ceph_test_rados_api_tier no longer exists in master.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26397 from guits/guits-fix_ceph-volume
Andrew Schoen [Wed, 13 Feb 2019 19:53:03 +0000 (13:53 -0600)]
Merge pull request #26397 from guits/guits-fix_ceph-volume

ceph-volume: update testing playbook 'deploy.yml'

Reviewed-by: Andrew Schoen <aschoen@redhat.com>