]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agomgr/orchestrator: fix broken `device ls` 26094/head
Sebastian Wagner [Tue, 5 Feb 2019 11:05:10 +0000 (12:05 +0100)]
mgr/orchestrator: fix broken `device ls`

* Added `InventoryDevice.from_ceph_volume_inventory`
* Improved documentation

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agomgr/orchestrator: make use of @CLICommand
Sebastian Wagner [Tue, 22 Jan 2019 15:30:01 +0000 (16:30 +0100)]
mgr/orchestrator: make use of @CLICommand

Also Modified some command to allow multiple hosts
Also: Added more tests

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #26106 from yehudasa/wip-rgw-es-fixes
Yehuda Sadeh [Tue, 5 Feb 2019 01:54:43 +0000 (17:54 -0800)]
Merge pull request #26106 from yehudasa/wip-rgw-es-fixes

rgw: multiple es related fixes and improvements

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge PR #26111 into master
Patrick Donnelly [Mon, 4 Feb 2019 23:43:42 +0000 (15:43 -0800)]
Merge PR #26111 into master

* refs/pull/26111/head:
mds: broadcast quota message to client when disable quota

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge PR #26123 into master
Patrick Donnelly [Mon, 4 Feb 2019 23:39:52 +0000 (15:39 -0800)]
Merge PR #26123 into master

* refs/pull/26123/head:
mds: refactor MDSContext inheritance

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge pull request #26023 from jmolmo/inventory_pb_updated
Sebastian Wagner [Mon, 4 Feb 2019 22:00:00 +0000 (23:00 +0100)]
Merge pull request #26023 from jmolmo/inventory_pb_updated

mgr/ansible: Replace Ansible playbook used to retrieve storage devices data

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
6 years agoMerge pull request #26170 from ifed01/wip-ifed-fix-fsck-read
Yuri Weinstein [Mon, 4 Feb 2019 20:51:15 +0000 (12:51 -0800)]
Merge pull request #26170 from ifed01/wip-ifed-fix-fsck-read

os/bluestore: deep fsck fails on inspecting very large onodes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #26223 from majianpeng/remove-unused-function
Yuri Weinstein [Mon, 4 Feb 2019 20:50:45 +0000 (12:50 -0800)]
Merge pull request #26223 from majianpeng/remove-unused-function

osd: remove unused function.

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #25278 from ZVampirEM77/wip-deleteobject-policy
Adam C. Emerson [Mon, 4 Feb 2019 18:08:20 +0000 (13:08 -0500)]
Merge pull request #25278 from ZVampirEM77/wip-deleteobject-policy

rgw: fix obj can still be deleted even if deleteobject policy is set
rgw: cleanup for RGWDeleteObj::verify_permission(

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
6 years agoMerge pull request #26244 from idryomov/wip-krbd-alloc-size
Ilya Dryomov [Mon, 4 Feb 2019 14:13:18 +0000 (15:13 +0100)]
Merge pull request #26244 from idryomov/wip-krbd-alloc-size

krbd: alloc_size map option and tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #25309 from Devp00l/wip-prometheus-alerting
Tatjana Dehler [Mon, 4 Feb 2019 10:32:41 +0000 (11:32 +0100)]
Merge pull request #25309 from Devp00l/wip-prometheus-alerting

mgr/dashboard: Prometheus integration

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge PR #26256 into master
Sage Weil [Mon, 4 Feb 2019 05:59:54 +0000 (23:59 -0600)]
Merge PR #26256 into master

* refs/pull/26256/head:
msg/async/ProtocolV2: respect policy.resetcheck on cookie==0

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26240 from votdev/improve_get_module_option
Kefu Chai [Sun, 3 Feb 2019 17:37:02 +0000 (01:37 +0800)]
Merge pull request #26240 from votdev/improve_get_module_option

mgr: Use Py_BuildValue to create the argument tuple

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26233 from liewegas/wip-bluestore-disable-csum
Kefu Chai [Sun, 3 Feb 2019 17:24:08 +0000 (01:24 +0800)]
Merge pull request #26233 from liewegas/wip-bluestore-disable-csum

os/bluestore: add bluestore_ignore_data_csum option

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>

6 years agoMerge pull request #25077 from rzarzynski/wip-bl-kill_append_buffer
Kefu Chai [Sun, 3 Feb 2019 17:22:11 +0000 (01:22 +0800)]
Merge pull request #25077 from rzarzynski/wip-bl-kill_append_buffer

common: drop append_buffer from bufferlist. Use simple carriage instead

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26245 from liewegas/wip-38150
Kefu Chai [Sun, 3 Feb 2019 17:20:55 +0000 (01:20 +0800)]
Merge pull request #26245 from liewegas/wip-38150

os/bluestore/KernelDevice: use flock(2) for block device lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
6 years agomsg/async/ProtocolV2: respect policy.resetcheck on cookie==0 26256/head
Sage Weil [Thu, 31 Jan 2019 22:52:09 +0000 (16:52 -0600)]
msg/async/ProtocolV2: respect policy.resetcheck on cookie==0

It's possible the accepting end knows the cookie but the connecting end
does not if the fault happens before it receives server_ident.  If the
next connection attempt is in the other direction, we need to avoid a
reset or the queued messages at the first site will get lost.

Fixes: http://tracker.ceph.com/issues/38118
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa: update krbd tests for zeroout 26244/head
Ilya Dryomov [Fri, 1 Feb 2019 09:35:33 +0000 (10:35 +0100)]
qa: update krbd tests for zeroout

Discard no longer guarantees zeroing, use BLKZEROOUT and "fallocate -z"
instead (blkdiscard(8) in xenial doesn't support -z).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agoqa: krbd discard with alloc_size vs zeroout tests
Ilya Dryomov [Thu, 31 Jan 2019 17:54:24 +0000 (18:54 +0100)]
qa: krbd discard with alloc_size vs zeroout tests

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agoMerge pull request #26179 from xiexingguo/wip-37968
Xie Xingguo [Sat, 2 Feb 2019 09:24:42 +0000 (17:24 +0800)]
Merge pull request #26179 from xiexingguo/wip-37968

crush: fix upmap overkill

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26222 from tchaikov/wip-crimson-heartbeat
Kefu Chai [Sat, 2 Feb 2019 07:45:44 +0000 (15:45 +0800)]
Merge pull request #26222 from tchaikov/wip-crimson-heartbeat

crimson/osd: add heartbeat support

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocmake: disable GCC-9 warnings 26222/head
Kefu Chai [Fri, 25 Jan 2019 09:06:29 +0000 (17:06 +0800)]
cmake: disable GCC-9 warnings

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: add heartbeat support
Kefu Chai [Mon, 14 Jan 2019 08:59:09 +0000 (16:59 +0800)]
crimson/osd: add heartbeat support

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: move "_preboot" log to where it belongs to
Kefu Chai [Thu, 31 Jan 2019 05:43:46 +0000 (13:43 +0800)]
crimson/osd: move "_preboot" log to where it belongs to

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: bind and listen
Kefu Chai [Thu, 31 Jan 2019 04:34:04 +0000 (12:34 +0800)]
crimson/osd: bind and listen

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/net: add Messenger::try_bind()
Kefu Chai [Thu, 31 Jan 2019 10:07:20 +0000 (18:07 +0800)]
crimson/net: add Messenger::try_bind()

in case the server is just fine with any unused local port number, and it
will report it to monitor.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: s/client_msgr/public_msgr/
Kefu Chai [Thu, 31 Jan 2019 04:43:56 +0000 (12:43 +0800)]
crimson/osd: s/client_msgr/public_msgr/

because this messenger also serves requests from librados clients.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/common: add pick_address.cc to crimson-common
Kefu Chai [Thu, 31 Jan 2019 03:21:27 +0000 (11:21 +0800)]
crimson/common: add pick_address.cc to crimson-common

crimson-osd needs pick_address() for initializing the listening
addresses.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/pick_address: add necessary includes
Kefu Chai [Thu, 31 Jan 2019 04:29:51 +0000 (12:29 +0800)]
common/pick_address: add necessary includes

* add needed forward declaration
* add necessary #includes
* move `#include "common/config.h"` to .cc, as it's not part of
interface.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/pick_address: conditional compile for crimson
Kefu Chai [Thu, 31 Jan 2019 04:22:44 +0000 (12:22 +0800)]
common/pick_address: conditional compile for crimson

crimson can only update configuration async, so we cannot let
pick_addreses() call set_val_or_die() without chaning its function
signature.

for implementing crimson-osd, what we need is only a single
pick_addresses() variant, which returns entity_addrvec_t. so we just
enable it if WITH_SEASTAR is defined instead of adding a wrapper or
reimplement all pick_addresses() variants for crimson-osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/mon: add get_fsid() to mon::Client
Kefu Chai [Wed, 30 Jan 2019 13:03:20 +0000 (21:03 +0800)]
crimson/mon: add get_fsid() to mon::Client

we need it for creating some messages. `MOSDPing`, for instance.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: define OSDMapService interface
Kefu Chai [Wed, 30 Jan 2019 08:35:55 +0000 (16:35 +0800)]
crimson/osd: define OSDMapService interface

* define OSDMapService interface to decouple the consumers of
  this interface from its implementation -- the `OSD` class
* implement its methods in `OSD`

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: add editor variable settings
Kefu Chai [Wed, 30 Jan 2019 08:39:13 +0000 (16:39 +0800)]
crimson/osd: add editor variable settings

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: remove unused method
Kefu Chai [Wed, 30 Jan 2019 08:13:53 +0000 (16:13 +0800)]
crimson/osd: remove unused method

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomds: refactor MDSContext inheritance 26123/head
Patrick Donnelly [Wed, 23 Jan 2019 00:54:14 +0000 (16:54 -0800)]
mds: refactor MDSContext inheritance

This commit greatly simplifies things.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #26250 from falcon78921/wip-doc-rados-typo
Xie Xingguo [Sat, 2 Feb 2019 00:26:50 +0000 (08:26 +0800)]
Merge pull request #26250 from falcon78921/wip-doc-rados-typo

doc: fixed typo in add-or-rm-mons.rst

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agodoc: fixed typo in add-or-rm-mons.rst 26250/head
James McClune [Fri, 1 Feb 2019 22:12:24 +0000 (17:12 -0500)]
doc: fixed typo in add-or-rm-mons.rst

Redundant use of the word "monitor"

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
6 years agocommon: drop decltype(_buffers) from include/buffers.h. 25077/head
Radoslaw Zarzynski [Sun, 18 Nov 2018 04:32:32 +0000 (05:32 +0100)]
common: drop decltype(_buffers) from include/buffers.h.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agotests: introduce BufferList.ContiguousAppender.
Radoslaw Zarzynski [Fri, 19 Oct 2018 17:09:35 +0000 (19:09 +0200)]
tests: introduce BufferList.ContiguousAppender.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: optimize bufferlist::contiguous_appender.
Radoslaw Zarzynski [Tue, 13 Nov 2018 01:15:36 +0000 (02:15 +0100)]
common: optimize bufferlist::contiguous_appender.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: introduce obtain_contiguous_space() to bufferlist.
Radoslaw Zarzynski [Mon, 22 Oct 2018 16:22:52 +0000 (18:22 +0200)]
common: introduce obtain_contiguous_space() to bufferlist.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agotests: introduce BufferList.InternalCarriage.
Radoslaw Zarzynski [Fri, 19 Oct 2018 17:09:16 +0000 (19:09 +0200)]
tests: introduce BufferList.InternalCarriage.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: introduce bl::_carriage to track writeable area.
Radoslaw Zarzynski [Mon, 22 Oct 2018 16:19:52 +0000 (18:19 +0200)]
common: introduce bl::_carriage to track writeable area.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: kill remainings of bufferlist's append_buffer.
Radoslaw Zarzynski [Thu, 20 Sep 2018 12:12:07 +0000 (08:12 -0400)]
common: kill remainings of bufferlist's append_buffer.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: simplify the C-string-taking variant of bl::append().
Radoslaw Zarzynski [Wed, 19 Sep 2018 00:11:25 +0000 (20:11 -0400)]
common: simplify the C-string-taking variant of bl::append().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agotests: introduce BufferListIterator.iterate_with_empties.
Radoslaw Zarzynski [Fri, 19 Oct 2018 10:52:45 +0000 (12:52 +0200)]
tests: introduce BufferListIterator.iterate_with_empties.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: bufferlist can contain 0-length bptrs.
Radoslaw Zarzynski [Tue, 18 Sep 2018 20:03:06 +0000 (22:03 +0200)]
common: bufferlist can contain 0-length bptrs.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: contiguous_appender doesn't use append_buffer anymore.
Radoslaw Zarzynski [Tue, 18 Sep 2018 02:40:29 +0000 (04:40 +0200)]
common: contiguous_appender doesn't use append_buffer anymore.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: bl::appends don't use the append_buffer anymore.
Radoslaw Zarzynski [Mon, 17 Sep 2018 23:15:24 +0000 (01:15 +0200)]
common: bl::appends don't use the append_buffer anymore.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge PR #25703 into master
Sage Weil [Fri, 1 Feb 2019 18:43:03 +0000 (12:43 -0600)]
Merge PR #25703 into master

* refs/pull/25703/head:
os/bluestore: option to disable bluestore warns on spillover.
mon: expose object store health warnings
osd: expose object store alerts
os/bluestore: indicate BlueFS spillover and lacking compressor alerts
os:enable ObjectStore::statfs() api to return OS alert list.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #25773 into master
Sage Weil [Fri, 1 Feb 2019 18:42:38 +0000 (12:42 -0600)]
Merge PR #25773 into master

* refs/pull/25773/head:
common: Use OpenSSL for cryptographic hashing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge PR #26067 into master
Sage Weil [Fri, 1 Feb 2019 18:41:25 +0000 (12:41 -0600)]
Merge PR #26067 into master

* refs/pull/26067/head:
pybind/rados: fix application metadata list

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge PR #26112 into master
Sage Weil [Fri, 1 Feb 2019 18:40:55 +0000 (12:40 -0600)]
Merge PR #26112 into master

* refs/pull/26112/head:
mgr: load modules in finisher to avoid potential lock cycles

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoMerge PR #26164 into master
Sage Weil [Fri, 1 Feb 2019 18:40:12 +0000 (12:40 -0600)]
Merge PR #26164 into master

* refs/pull/26164/head:
mon/LogMonitor: lower logging level for check_sub

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoos/bluestore/KernelDevice: use flock(2) for block device lock 26245/head
Sage Weil [Fri, 1 Feb 2019 17:39:41 +0000 (11:39 -0600)]
os/bluestore/KernelDevice: use flock(2) for block device lock

The fcntl locks fail due to the classic posix lock gotcha: if you close
*any* fd to the same inode from the process, the lock(s) go away.

Use flock(2) instead.  We have to be careful because we open the main
bluestore device via two KernelDevice instances: one for bluestore and
one for bluefs.  Add a no-lock flag so that the bluefs instance does not
try to lock and does not conflict with bluestore's.

Fixes: http://tracker.ceph.com/issues/38150
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agorbd: recognize alloc_size map option
Ilya Dryomov [Thu, 31 Jan 2019 15:59:11 +0000 (16:59 +0100)]
rbd: recognize alloc_size map option

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agoMerge pull request #26224 from tchaikov/radek-lru-cleanup
Kefu Chai [Fri, 1 Feb 2019 16:01:58 +0000 (00:01 +0800)]
Merge pull request #26224 from tchaikov/radek-lru-cleanup

common: drop the unused methods from SharedLRU.

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26171 from sebastian-philipp/orchestrator-merge-create-add
Sebastian Wagner [Fri, 1 Feb 2019 15:42:36 +0000 (16:42 +0100)]
Merge pull request #26171 from sebastian-philipp/orchestrator-merge-create-add

mgr/orchestrator: Unify `osd create` and `osd add`

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
6 years agoMerge pull request #26151 from nathan-weinberg/cluster-tests
Patrick Nawracay [Fri, 1 Feb 2019 15:09:11 +0000 (16:09 +0100)]
Merge pull request #26151 from nathan-weinberg/cluster-tests

mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #26231 from ivancich/wip-infinite-bucket-rm
J. Eric Ivancich [Fri, 1 Feb 2019 14:08:06 +0000 (09:08 -0500)]
Merge pull request #26231 from ivancich/wip-infinite-bucket-rm

rgw: `radosgw-admin bucket rm ... --purge-objects` can hang...

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agomgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu 26151/head
Nathan Weinberg [Fri, 1 Feb 2019 13:55:37 +0000 (08:55 -0500)]
mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu

Fixes: https://tracker.ceph.com/issues/38050
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
6 years agoMerge pull request #26203 from rhcs-dashboard/updated-pg-status-chart-colors
Lenz Grimmer [Fri, 1 Feb 2019 11:29:21 +0000 (12:29 +0100)]
Merge pull request #26203 from rhcs-dashboard/updated-pg-status-chart-colors

mgr/dashboard: Updated colors in PG Status chart

Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agomgr: Use Py_BuildValue to create the argument tuple 26240/head
Volker Theile [Fri, 1 Feb 2019 10:12:34 +0000 (11:12 +0100)]
mgr: Use Py_BuildValue to create the argument tuple

Reduce the complexity of the code by using the generic function, Py_BuildValue(), that can create most common objects from C values, directed by a format string.

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #25929 from falcon78921/wip-doc-37880
Kefu Chai [Fri, 1 Feb 2019 09:21:54 +0000 (17:21 +0800)]
Merge pull request #25929 from falcon78921/wip-doc-37880

doc: updated rgw multitenancy link

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/orchestrator: Unify `osd create` and `osd add` 26171/head
Sebastian Wagner [Mon, 28 Jan 2019 15:57:38 +0000 (16:57 +0100)]
mgr/orchestrator: Unify `osd create` and `osd add`

Also:

* Added some more tests
* Better validation of drive Groups
* Simplified `TestWriteCompletion`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #26228 from theanalyst/doc/releases/12.2.11
Abhishek L [Fri, 1 Feb 2019 07:46:53 +0000 (08:46 +0100)]
Merge pull request #26228 from theanalyst/doc/releases/12.2.11

doc: add release notes for 12.2.11 luminous

Reviewed-By: Sage Weil <sage@redhat.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-By: Eric Ivanvich <ivanvich@redhat.com>
6 years agoos/bluestore: add bluestore_ignore_data_csum option 26233/head
Sage Weil [Thu, 31 Jan 2019 23:33:57 +0000 (17:33 -0600)]
os/bluestore: add bluestore_ignore_data_csum option

This option just suppresses the EIO errors.  We still get the messages
in the logs, though.  This can be useful when you are in dire straights
and prefer some data to no data.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agorgw: `radosgw-admin bucket rm ... --purge-objects` can hang... 26231/head
J. Eric Ivancich [Thu, 31 Jan 2019 19:21:07 +0000 (14:21 -0500)]
rgw: `radosgw-admin bucket rm ... --purge-objects` can hang...

This command can hang (i.e., enter an infinite loop) due to
problematic bucket index entries left as a result of bug
https://tracker.ceph.com/issues/38007 .

The fix is to ignore the false bucket index entries -- since they do
not represent actual objects -- and remove all actual objects in the
bucket, so that bucket itself can be removed.

This fixes the both code paths whether `--bypass-gc` is specified or
not.

Furthermore, to made these operations more efficient, the internal
listing of the bucket is done unordered. This would improve behavior
when removing buckets with a large number of objects.

Fixes: http://tracker.ceph.com/issues/38134
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agodoc: add release notes for 12.2.11 luminous 26228/head
Abhishek Lekshmanan [Thu, 31 Jan 2019 15:55:31 +0000 (16:55 +0100)]
doc: add release notes for 12.2.11 luminous

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge PR #26193 into master
Patrick Donnelly [Thu, 31 Jan 2019 20:35:36 +0000 (12:35 -0800)]
Merge PR #26193 into master

* refs/pull/26193/head:
mds: move session setup to ms_handle_accept
common: add method to get StackStringStream ptr

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26038 into master
Patrick Donnelly [Thu, 31 Jan 2019 20:08:26 +0000 (12:08 -0800)]
Merge PR #26038 into master

* refs/pull/26038/head:
mds: simplify recall warnings
mds: add extra details for cache drop output
qa: test mds_max_caps_per_client conf
mds: limit maximum number of caps held by session
mds: adapt drop cache for incremental recall
mds: recall caps incrementally
mds: adapt drop cache for incremental trim
mds: add throttle for trimming MDCache
mds: cleanup SessionMap init
mds: cleanup Session init

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agomds: simplify recall warnings 26038/head
Patrick Donnelly [Mon, 28 Jan 2019 23:48:38 +0000 (15:48 -0800)]
mds: simplify recall warnings

Instead of a timeout and complicated decisions about whether the client is
releasing caps in an expeditious fashion, just use a DecayCounter that tracks
the number of caps we've recalled. This counter is decremented whenever the
client releases caps. If the counter passes a threshold, then we raise the
warning.

Similar reworking is done for the steady-state recall of client caps. Another
release DecayCounter is added so we can tell when the client is not releasing
any more caps.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: move session setup to ms_handle_accept 26193/head
Patrick Donnelly [Wed, 30 Jan 2019 23:52:06 +0000 (15:52 -0800)]
mds: move session setup to ms_handle_accept

Session setup in ms_handle_authentication is (historically) racy where multiple
connections from the same client can come in before one is finally accepted.  A
session should only be created after ms_handle_accept. The MDS did some
backflips before this commit to ensure this.

Moreover, with the msgr2 changes, it is even more necessary since the address
nonce is not set until before ms_handle_accept is called.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #26190 from cbodley/wip-rgw-datalog-last-trim
Casey Bodley [Thu, 31 Jan 2019 17:37:09 +0000 (12:37 -0500)]
Merge pull request #26190 from cbodley/wip-rgw-datalog-last-trim

rgw multisite: only update last_trim marker on ENODATA

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agocommon: drop the unused reset_comparator() from SharedLRU. 26224/head
Radoslaw Zarzynski [Wed, 12 Sep 2018 21:28:27 +0000 (23:28 +0200)]
common: drop the unused reset_comparator() from SharedLRU.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: drop the unused get_comparator() from SharedLRU.
Radoslaw Zarzynski [Wed, 12 Sep 2018 21:08:50 +0000 (23:08 +0200)]
common: drop the unused get_comparator() from SharedLRU.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoosd: remove unused function. 26223/head
Jianpeng Ma [Thu, 31 Jan 2019 11:57:27 +0000 (19:57 +0800)]
osd: remove unused function.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
6 years agoMerge pull request #26188 from Exotelis/tracker-37916
Lenz Grimmer [Thu, 31 Jan 2019 09:59:06 +0000 (10:59 +0100)]
Merge pull request #26188 from Exotelis/tracker-37916

mgr/dashboard: Cleanup of the cluster and audit log

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agorgw: es: use default request headers for query requests 26106/head
Yehuda Sadeh [Wed, 30 Jan 2019 23:15:56 +0000 (15:15 -0800)]
rgw: es: use default request headers for query requests

Needed for sending auth headers.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agocommon: add method to get StackStringStream ptr
Patrick Donnelly [Wed, 30 Jan 2019 22:23:53 +0000 (14:23 -0800)]
common: add method to get StackStringStream ptr

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #25542 from jan--f/c-v-extend-batch
Andrew Schoen [Wed, 30 Jan 2019 19:29:40 +0000 (13:29 -0600)]
Merge pull request #25542 from jan--f/c-v-extend-batch

Extend batch to accept explicit device lists

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #26205 from cbodley/wip-38115
Casey Bodley [Wed, 30 Jan 2019 18:55:52 +0000 (13:55 -0500)]
Merge pull request #26205 from cbodley/wip-38115

qa/mon: fix cluster support for monmap bootstrap

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26204 from pritha-srivastava/wip-rgw-signature-mismatch
Casey Bodley [Wed, 30 Jan 2019 17:39:39 +0000 (12:39 -0500)]
Merge pull request #26204 from pritha-srivastava/wip-rgw-signature-mismatch

rgw: Fix for SignatureMismatchError in s3 commands.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #25403 from liyichao/rdigest
David Zafman [Wed, 30 Jan 2019 17:30:23 +0000 (09:30 -0800)]
Merge pull request #25403 from liyichao/rdigest

tools: Add clear-data-digest command to objectstore tool.

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #26158 from dzafman/wip-38053
David Zafman [Wed, 30 Jan 2019 17:29:01 +0000 (09:29 -0800)]
Merge pull request #26158 from dzafman/wip-38053

Add hashinfo testing for dump command of ceph-objectstore-tool

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoqa/mon: fix cluster support for monmap bootstrap 26205/head
Casey Bodley [Wed, 30 Jan 2019 17:23:10 +0000 (12:23 -0500)]
qa/mon: fix cluster support for monmap bootstrap

-filter out mons from other clusters
-fix parsing of mon name from role

Fixes: http://tracker.ceph.com/issues/38115
Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agomgr: load modules in finisher to avoid potential lock cycles 26112/head
Mykola Golub [Thu, 24 Jan 2019 09:04:24 +0000 (11:04 +0200)]
mgr: load modules in finisher to avoid potential lock cycles

Fixes: https://tracker.ceph.com/issues/37997
Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agomgr/dashboard: Updated messages.xlf 25309/head
Stephan Müller [Fri, 25 Jan 2019 13:22:08 +0000 (14:22 +0100)]
mgr/dashboard: Updated messages.xlf

Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agomgr/dashboard: Application icons in notifications
Stephan Müller [Thu, 17 Jan 2019 11:37:12 +0000 (12:37 +0100)]
mgr/dashboard: Application icons in notifications

Now notifications and alerts show an application icon, that gives a hint
about their origin.

Fixes: https://tracker.ceph.com/issues/37950
Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agomgr/dashboard: Provide values with different style in KV-table
Stephan Müller [Fri, 11 Jan 2019 11:53:34 +0000 (12:53 +0100)]
mgr/dashboard: Provide values with different style in KV-table

Now it's possible to style values inside the KV-table based on the
values.

Fixes: https://tracker.ceph.com/issues/37951
Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agomgr/dashboard: Add the Prometheus alerts
Stephan Müller [Tue, 6 Nov 2018 12:43:03 +0000 (13:43 +0100)]
mgr/dashboard: Add the Prometheus alerts

The backend is now capable of receiving alert notifications from
the Prometheus alertmanager and it can get all alerts with all kinds of
parameters from the API of the same.

In the frontend Prometheus alerts can be found in "Cluster > Alerts". Incoming
notifications can be seen as usual in the notifications popover.

To clarify:
Prometheus alerts are received from the alertmanager API.
Prometheus alert notification are send from the alertmanager to the
backend receiver. An alert notification can have multiple alerts, but
these alerts differ from the prometheus alerts.

To clarify that, I've added some models and services.

If one of the methods to get alerts contains changes the user will be
notified.

The documentation explains how to configure the alertmanager to use the
dashboard receiver and how to connect the use of the alertmanager API.
Further it explains where to find the alerts and what happens if they
are configured and something is happening.

Fixes: https://tracker.ceph.com/issues/36721
Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agorgw: Fix for SignatureMismatchError in s3 commands. 26204/head
Pritha Srivastava [Wed, 30 Jan 2019 15:39:34 +0000 (21:09 +0530)]
rgw: Fix for SignatureMismatchError in s3 commands.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
6 years agoMerge pull request #25638 from ricardoasmarques/iscsi-management-w
Lenz Grimmer [Wed, 30 Jan 2019 14:56:48 +0000 (15:56 +0100)]
Merge pull request #25638 from ricardoasmarques/iscsi-management-w

mgr/dashboard: iSCSI management API

Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26172 from rhcs-dashboard/fix-skipped-api-tests
Lenz Grimmer [Wed, 30 Jan 2019 14:49:06 +0000 (15:49 +0100)]
Merge pull request #26172 from rhcs-dashboard/fix-skipped-api-tests

mgr/dashboard: fix skipped backend API tests

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoceph-volume: don't crash on unusable data devices 25542/head
Jan Fajerski [Sat, 26 Jan 2019 10:08:01 +0000 (11:08 +0100)]
ceph-volume: don't crash on unusable data devices

Also add test case for a MixedStrategy with unusable data devices.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agoceph-volume: add a wal device specific unit test and size validator
Jan Fajerski [Thu, 24 Jan 2019 17:10:45 +0000 (18:10 +0100)]
ceph-volume: add a wal device specific unit test and size validator

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agoceph-volume: add osd_ids argument
Jan Fajerski [Wed, 23 Jan 2019 14:04:29 +0000 (15:04 +0100)]
ceph-volume: add osd_ids argument

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agomgr/dashboard: Updated colors in PG Status chart 26203/head
alfonsomthd [Wed, 30 Jan 2019 14:27:47 +0000 (15:27 +0100)]
mgr/dashboard: Updated colors in PG Status chart

* For consistency:
  Set 'Clean' status color to 'HEALTH_OK' color
  (Cluster Status card).

  Set 'Warning' status color to 'HEALTH_WARN' color.

  'Working' (blue) & 'Unknown' (red) are kept due to
  previous consensus about these complementary colors
  in doughnut/pie charts.

* Renamed Health Pie colors for the sake of clarity.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
6 years agoMerge pull request #26091 from tchaikov/wip-36737
Kefu Chai [Wed, 30 Jan 2019 13:35:52 +0000 (21:35 +0800)]
Merge pull request #26091 from tchaikov/wip-36737

cmake: use $CMAKE_BINARY_DIR for default $CEPH_BUILD_VIRTUALENV

Tested-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge PR #26142 into master
Sage Weil [Wed, 30 Jan 2019 13:06:42 +0000 (07:06 -0600)]
Merge PR #26142 into master

* refs/pull/26142/head:
doc/dev/cephx: document current implementation of cephx

Reviewed-by: Alfredo Deza <adeza@redhat.com>