]> git.apps.os.sepia.ceph.com Git - ceph-ci.git/log
ceph-ci.git
6 years agotest/rgw: fix race in test_rgw_reshard_wait
Casey Bodley [Mon, 4 Mar 2019 14:44:24 +0000 (09:44 -0500)]
test/rgw: fix race in test_rgw_reshard_wait

start the timer before scheduling the wait

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge PR #26696 into master
Sage Weil [Mon, 4 Mar 2019 14:32:18 +0000 (08:32 -0600)]
Merge PR #26696 into master

* refs/pull/26696/head:
osdc/Objecter: preserve read-into-existing-buffer behavior
osdc/Objecter: don't use post_rx_buffer or revoke_rx_buffer at all
msg/Connection: disable {post,revoke}_rx_buffer
msg/async/ProtocolV1: disable rx_buffers behavior
msg/simple/Pipe: disable rx_buffer code

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge PR #26727 into master
Sage Weil [Mon, 4 Mar 2019 14:13:34 +0000 (08:13 -0600)]
Merge PR #26727 into master

* refs/pull/26727/head:
qa/standalone/osd/pg-split-merge: fix import_after_merge_and_gap
osd: add 'send_beacon' tell/asok command(s)

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26683 from dillaman/wip-38500
Mykola Golub [Mon, 4 Mar 2019 08:43:35 +0000 (10:43 +0200)]
Merge pull request #26683 from dillaman/wip-38500

librbd: race condition possible when validating RBD pool

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge PR #26698 into master
Sage Weil [Sun, 3 Mar 2019 17:39:52 +0000 (11:39 -0600)]
Merge PR #26698 into master

* refs/pull/26698/head:
common/str_map: better trim() impl using boost
common/str_map: fix trim() on empty string

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoosdc/Objecter: preserve read-into-existing-buffer behavior
Sage Weil [Fri, 1 Mar 2019 20:12:42 +0000 (14:12 -0600)]
osdc/Objecter: preserve read-into-existing-buffer behavior

The libradosstriper::RadosStriperImpl::aio_read populates the target
outbl with a static buffer and relies on us reading into it.  This was
actually not reliable in the past (it could fail if the rx_buffers
optimization failed due to a retransmit or something else) but nevertheless
libradosstriper requires it to work *at all*.

Resolve this by modifying Objecter to copy the result into any provided
buffer at the lowest layer.  This should capture any other such user who
needed this behavior.

On the other hand, it will break any user who inadvertantly reads into a
non-empty bufferlist.  Given that any such user would already previously
have seen bad behavior due to the rx_buffers optimization, we expect
there to be 0 such instances.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/standalone/osd/pg-split-merge: fix import_after_merge_and_gap
Sage Weil [Fri, 1 Mar 2019 21:48:24 +0000 (15:48 -0600)]
qa/standalone/osd/pg-split-merge: fix import_after_merge_and_gap

This test introduces a map gap.  What *should* happen is that when there is
such a gap, we cannot import.  Previously, the test didn't reliably produce
a map gap at all, and didn't check that import failed--it verified that it
passed.

Fix the test so that it reliably produces a gap *and* reports
min_last_epoch_clean to the mon so we can trim.  Then verify we fail to
import, but can with --force.  But remove the pg again, because if we
force an import with a map gap the osd will refuse to start.

Fixes: http://tracker.ceph.com/issues/38525
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoosd: add 'send_beacon' tell/asok command(s)
Sage Weil [Fri, 1 Mar 2019 21:47:17 +0000 (15:47 -0600)]
osd: add 'send_beacon' tell/asok command(s)

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #25538 from mkogan1/wip-rgw-reshard-status
J. Eric Ivancich [Sun, 3 Mar 2019 13:58:20 +0000 (08:58 -0500)]
Merge pull request #25538 from mkogan1/wip-rgw-reshard-status

rgw: change the "rgw admin status" 'num_shards' output to signed int

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agoMerge pull request #26668 from xiexingguo/wip-38493
Xie Xingguo [Sun, 3 Mar 2019 06:43:15 +0000 (14:43 +0800)]
Merge pull request #26668 from xiexingguo/wip-38493

msg/async/Protocol*: send keep alive if existing wins

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26723 from liewegas/wip-38537
Kefu Chai [Sun, 3 Mar 2019 02:09:14 +0000 (10:09 +0800)]
Merge pull request #26723 from liewegas/wip-38537

mgr/BaseMgrModule: drop GIL for ceph_send_command

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #26726 into master
Patrick Donnelly [Sat, 2 Mar 2019 19:24:22 +0000 (11:24 -0800)]
Merge PR #26726 into master

* refs/pull/26726/head:
mds: Fix use of auto prototype, it is a non std extension

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #26720 into master
Sage Weil [Sat, 2 Mar 2019 14:31:54 +0000 (08:31 -0600)]
Merge PR #26720 into master

* refs/pull/26720/head:
ceph-osd: infer objectstore type of 'type' file is missing

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26705 from dzafman/wip-23999
Xie Xingguo [Sat, 2 Mar 2019 01:43:33 +0000 (09:43 +0800)]
Merge pull request #26705 from dzafman/wip-23999

Improve docs osd_recovery_priority, osd_recovery_op_priority and related

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #26666 from badone/wip-kvstore_tool-ice
Brad Hubbard [Fri, 1 Mar 2019 23:13:58 +0000 (09:13 +1000)]
Merge pull request #26666 from badone/wip-kvstore_tool-ice

tools/ceph_kvstore_tool: Move summary output to print_summary

Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agocommon, doc: Improve docs osd_recovery_priority, osd_recovery_op_priority and related
David Zafman [Wed, 6 Feb 2019 01:05:18 +0000 (17:05 -0800)]
common, doc: Improve docs osd_recovery_priority, osd_recovery_op_priority and related

Add option desciptions for osd_recovery_priority and osd_recovery_op_priority

Fixes: https://tracker.ceph.com/issues/23999
Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agoceph-osd: infer objectstore type of 'type' file is missing
Sage Weil [Fri, 1 Mar 2019 14:57:36 +0000 (08:57 -0600)]
ceph-osd: infer objectstore type of 'type' file is missing

The current value of osd_objectstore should have no bearing--we should
rely on the state in front of us.

- If there is a directory called current/, assume filestore.
- If there is a symlink called block, assume bluestore.
- If we see none of those, fail.

Fixes: http://tracker.ceph.com/issues/38517
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26692 into master
Sage Weil [Fri, 1 Mar 2019 20:36:35 +0000 (14:36 -0600)]
Merge PR #26692 into master

* refs/pull/26692/head:
test/test_ipaddr: added test for pick_address when ipv4 and ipv6 are enabled
common/pick_address: improves log message when no IP is found
pick_address: error out in dual stack mode if both addr types cannot be provided

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agomds: Fix use of auto prototype, it is a non std extension
Willem Jan Withagen [Fri, 1 Mar 2019 20:36:26 +0000 (21:36 +0100)]
mds: Fix use of auto prototype, it is a non std extension

Clang complains:
In file included from /home/jenkins/workspace/ceph-master/src/msg/Message.cc:128:
In file included from /home/jenkins/workspace/ceph-master/src/messages/MFSMap.h:20:
/home/jenkins/workspace/ceph-master/src/mds/FSMap.h:330:49: error: 'auto' not allowed in function prototype
  void modify_filesystem(fs_cluster_id_t fscid, auto&& fn)
                                                ^~~~
/home/jenkins/workspace/ceph-master/src/mds/FSMap.h:341:37: error: 'auto' not allowed in function prototype
  void modify_daemon(mds_gid_t who, auto&& fn)
                                    ^~~~

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoosdc/Objecter: don't use post_rx_buffer or revoke_rx_buffer at all
Sage Weil [Fri, 1 Mar 2019 20:09:16 +0000 (14:09 -0600)]
osdc/Objecter: don't use post_rx_buffer or revoke_rx_buffer at all

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/BaseMgrModule: drop GIL for ceph_send_command
Sage Weil [Fri, 1 Mar 2019 17:00:55 +0000 (11:00 -0600)]
mgr/BaseMgrModule: drop GIL for ceph_send_command

Otherwise, we can easily deadlock, since other bits of the code hold the
objecter lock and then take the GIL.

Fixes: http://tracker.ceph.com/issues/38537
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26688 from yangdongsheng/librbd_fix_all_throttled
Jason Dillaman [Fri, 1 Mar 2019 15:43:36 +0000 (10:43 -0500)]
Merge pull request #26688 from yangdongsheng/librbd_fix_all_throttled

librbd: fix were_all_throttled() to avoid incorrect ret-value

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge PR #26659 into master
Patrick Donnelly [Fri, 1 Mar 2019 14:53:20 +0000 (06:53 -0800)]
Merge PR #26659 into master

* refs/pull/26659/head:
qa: remove libcephfs-java tests

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
6 years agoMerge pull request #26695 from smithfarm/wip-make-check-amqp-endpoint
Nathan Cutler [Fri, 1 Mar 2019 14:49:41 +0000 (15:49 +0100)]
Merge pull request #26695 from smithfarm/wip-make-check-amqp-endpoint

do_cmake.sh: SUSE builds need WITH_RADOSGW_AMQP_ENDPOINT=OFF

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.de>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoMerge PR #26699 into master
Patrick Donnelly [Fri, 1 Mar 2019 14:46:46 +0000 (06:46 -0800)]
Merge PR #26699 into master

* refs/pull/26699/head:
qa: unmount clients before deleting fs

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge PR #26700 into master
Patrick Donnelly [Fri, 1 Mar 2019 14:44:36 +0000 (06:44 -0800)]
Merge PR #26700 into master

* refs/pull/26700/head:
qa: bump fsstress timeout to 6h

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agolibrbd: fix were_all_throttled() to avoid incorrect ret-value
Dongsheng Yang [Thu, 28 Feb 2019 08:12:17 +0000 (03:12 -0500)]
librbd: fix were_all_throttled() to avoid incorrect ret-value

Fixes: http://tracker.ceph.com/issues/38504
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
6 years agolibrbd: pool_init API now validates the pool
Jason Dillaman [Wed, 27 Feb 2019 19:13:16 +0000 (14:13 -0500)]
librbd: pool_init API now validates the pool

This offloads the validation process from the image creation
state machine under normal conditions.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: create state machine uses new validate pool state machine
Jason Dillaman [Wed, 27 Feb 2019 19:08:04 +0000 (14:08 -0500)]
librbd: create state machine uses new validate pool state machine

Fixes: http://tracker.ceph.com/issues/38500
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: separate pool validation into a standalone state machine
Jason Dillaman [Wed, 27 Feb 2019 18:50:29 +0000 (13:50 -0500)]
librbd: separate pool validation into a standalone state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #26482 from votdev/show_success_notification_rgw
Lenz Grimmer [Fri, 1 Mar 2019 11:02:15 +0000 (12:02 +0100)]
Merge pull request #26482 from votdev/show_success_notification_rgw

mgr/dashboard: Show success notification in RGW forms

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26507 from votdev/yesno_pipe
Lenz Grimmer [Fri, 1 Mar 2019 10:46:33 +0000 (11:46 +0100)]
Merge pull request #26507 from votdev/yesno_pipe

mgr/dashboard: Introduce pipe to convert bool to text

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Introduce pipe to convert bool to text
Volker Theile [Fri, 1 Mar 2019 09:27:13 +0000 (10:27 +0100)]
mgr/dashboard: Introduce pipe to convert bool to text

Convert boolean values to 'Yes' or 'No' or any other value.

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #26714 from cyx1231st/wip-async-bannercheck
Ricardo Dias [Fri, 1 Mar 2019 09:24:48 +0000 (09:24 +0000)]
Merge pull request #26714 from cyx1231st/wip-async-bannercheck

msg/async: fix banner_v1 check in ProtocolV2

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26626 from LenzGr/master-documentation
Lenz Grimmer [Fri, 1 Mar 2019 09:00:01 +0000 (10:00 +0100)]
Merge pull request #26626 from LenzGr/master-documentation

doc: Updated Ceph Dashboard documentation

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #26711 from cyx1231st/wip-async-frame-header
Ricardo Dias [Fri, 1 Mar 2019 08:03:16 +0000 (08:03 +0000)]
Merge pull request #26711 from cyx1231st/wip-async-frame-header

msg/async: fix include in frames_v2.h

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agomsg/async: fix banner_v1 check in ProtocolV2
Yingxin Cheng [Fri, 1 Mar 2019 07:46:36 +0000 (15:46 +0800)]
msg/async: fix banner_v1 check in ProtocolV2

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocommon/str_map: better trim() impl using boost
Sage Weil [Fri, 1 Mar 2019 05:41:59 +0000 (23:41 -0600)]
common/str_map: better trim() impl using boost

Thanks Kefu!

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agocommon/str_map: fix trim() on empty string
Sage Weil [Thu, 28 Feb 2019 16:38:54 +0000 (10:38 -0600)]
common/str_map: fix trim() on empty string

If was pass an empty string (e.g., with something like
get_str_map("M= T= P=")) we end up with a (size_t)-1 for end.

Fixes: http://tracker.ceph.com/issues/38329
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomsg/async: fix include in frames_v2.h
Yingxin Cheng [Fri, 1 Mar 2019 02:36:57 +0000 (10:36 +0800)]
msg/async: fix include in frames_v2.h

`ceph_clock_now()` needs to include common/Clock.h.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agoMerge PR #26638 into master
Patrick Donnelly [Fri, 1 Mar 2019 04:37:13 +0000 (20:37 -0800)]
Merge PR #26638 into master

* refs/pull/26638/head:
doc: update documentation for standby-replay
qa: update discontinous map test to use mds freezing
mon: add freeze MDS command
qa: update testing for standby-replay
mon: add setting for fs to enable standby-replay
ceph-mds: obsolete hot-standby option
fs: obsolete standby_for config options
messages/MMDSBeacon: use inline init
mds: avoid unnecessary copy of entity_addrvec_t
mds: use inline init for mds_info_t
mds: use rank from MDSMap always
mds: remove obsolete comment
qa: use SIGTERM when stopping vstart service

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge pull request #26605 from xiexingguo/wip-misc-cleanups
Xie Xingguo [Fri, 1 Mar 2019 03:23:16 +0000 (11:23 +0800)]
Merge pull request #26605 from xiexingguo/wip-misc-cleanups

osd/OSDMap: drop local pool filter in calc_pg_upmaps

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agomsg/async/ProtocolV2: send_keepalive under the scope of lock
xie xingguo [Fri, 1 Mar 2019 01:33:14 +0000 (09:33 +0800)]
msg/async/ProtocolV2: send_keepalive under the scope of lock

Dropping lock is dangerous and could be race-prone.
Any time the lock is dropped we need to reverify the connection state.

send_keepalive under the scope of lock should be just fine since
it does not introduce any extra lock dependencies.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agomsg/async/Protocol*: send keep alive if existing wins
xie xingguo [Wed, 27 Feb 2019 07:34:46 +0000 (15:34 +0800)]
msg/async/Protocol*: send keep alive if existing wins

This is a follow-up fix of https://github.com/ceph/ceph/pull/25754.

It turns out the existing connection would win the connection race
and then be stuck in the __replacing__ stage forever without being
aware of that the underlying Pipe is actually broken.

Fix by forcing existing sending keepalive periodically __too__.

Fixes: http://tracker.ceph.com/issues/38493
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge PR #26614 into master
Sage Weil [Fri, 1 Mar 2019 00:08:29 +0000 (18:08 -0600)]
Merge PR #26614 into master

* refs/pull/26614/head:
osd: Implement lazy omap usage statistics

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26453 into master
Sage Weil [Fri, 1 Mar 2019 00:07:59 +0000 (18:07 -0600)]
Merge PR #26453 into master

* refs/pull/26453/head:
rpm: build with lttng on ppc64le (SUSE)
rpm: no lttng build on openSUSE s390x

Reviewed-by: Tim Serong <tserong@suse.com>
6 years agoMerge PR #26667 into master
Sage Weil [Fri, 1 Mar 2019 00:07:25 +0000 (18:07 -0600)]
Merge PR #26667 into master

* refs/pull/26667/head:
cmake: link rgw tests with ${rgw_libs}
cmake: link ${rgw_libs} not rgw_a and rabbitmq
cmake: move rgw tests targets down to end

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge PR #26681 into master
Sage Weil [Fri, 1 Mar 2019 00:05:28 +0000 (18:05 -0600)]
Merge PR #26681 into master

* refs/pull/26681/head:
mon/ConfigMonitor: add 'config ls'

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
6 years agoMerge pull request #26693 from trociny/wip-rbd-bench-interrupt
Jason Dillaman [Thu, 28 Feb 2019 22:31:45 +0000 (17:31 -0500)]
Merge pull request #26693 from trociny/wip-rbd-bench-interrupt

rbd: close image when bench is interrupted

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #26639 from cbodley/wip-38479
Matt Benjamin [Thu, 28 Feb 2019 21:58:34 +0000 (16:58 -0500)]
Merge pull request #26639 from cbodley/wip-38479

rgw: data sync drains lease stack on lease failure

6 years agoqa: remove libcephfs-java tests
Patrick Donnelly [Tue, 26 Feb 2019 18:50:01 +0000 (10:50 -0800)]
qa: remove libcephfs-java tests

These have bit-rotted and no longer work. No cycles from interested parties
available to fix.

Fixes: https://tracker.ceph.com/issues/38487
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agodoc: Update some of the priority item descriptions
David Zafman [Fri, 8 Feb 2019 01:13:05 +0000 (17:13 -0800)]
doc: Update some of the priority item descriptions

Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agodoc: Minor fixes to monitoring-osd-pg.rst
David Zafman [Thu, 21 Feb 2019 00:54:01 +0000 (16:54 -0800)]
doc: Minor fixes to monitoring-osd-pg.rst

Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agodoc: Remove osd disk thread items that no longer exist
David Zafman [Fri, 8 Feb 2019 01:20:11 +0000 (17:20 -0800)]
doc: Remove osd disk thread items that no longer exist

Caused by: 35a4b5072f36df92391b7514eafdea498e42f1dd

Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agocommon: Fix typo in description
David Zafman [Thu, 28 Feb 2019 20:28:31 +0000 (12:28 -0800)]
common: Fix typo in description

Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agomsg/Connection: disable {post,revoke}_rx_buffer
Sage Weil [Thu, 28 Feb 2019 14:40:52 +0000 (08:40 -0600)]
msg/Connection: disable {post,revoke}_rx_buffer

Broken by design.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomsg/async/ProtocolV1: disable rx_buffers behavior
Sage Weil [Thu, 28 Feb 2019 14:39:54 +0000 (08:39 -0600)]
msg/async/ProtocolV1: disable rx_buffers behavior

This is broken by design.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomsg/simple/Pipe: disable rx_buffer code
Sage Weil [Thu, 28 Feb 2019 01:54:16 +0000 (19:54 -0600)]
msg/simple/Pipe: disable rx_buffer code

This reproducibly crashes. Although we don't have a complete understanding
of the exact sequence leading to the crash, we can reproduce, and we have
multiple theoretical cases where it appears to be broken by design.

Fixes: http://tracker.ceph.com/issues/22480
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26685 from ceph/wip-testinfra-ceph-volume
Alfredo Deza [Thu, 28 Feb 2019 18:01:22 +0000 (13:01 -0500)]
Merge pull request #26685 from ceph/wip-testinfra-ceph-volume

ceph-volume: use our own testinfra suite for functional testing

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #26650 from LenzGr/typo-fix
Lenz Grimmer [Thu, 28 Feb 2019 17:42:10 +0000 (18:42 +0100)]
Merge pull request #26650 from LenzGr/typo-fix

mgr/dashboard: Fixed typos in environment.build.js

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26588 from votdev/relocate_empty_pipe
Lenz Grimmer [Thu, 28 Feb 2019 17:40:49 +0000 (18:40 +0100)]
Merge pull request #26588 from votdev/relocate_empty_pipe

mgr/dashboard: Relocate empty pipe

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26447 from votdev/fix_notify_show
Lenz Grimmer [Thu, 28 Feb 2019 17:39:28 +0000 (18:39 +0100)]
Merge pull request #26447 from votdev/fix_notify_show

mgr/dashboard: Remove param when calling notificationService.show

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoqa: bump fsstress timeout to 6h
Patrick Donnelly [Thu, 28 Feb 2019 17:35:53 +0000 (09:35 -0800)]
qa: bump fsstress timeout to 6h

When run with valgrind, it takes a significant amount of time to complete.

Fixes: http://tracker.ceph.com/issues/38520
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: unmount clients before deleting fs
Patrick Donnelly [Thu, 28 Feb 2019 17:02:33 +0000 (09:02 -0800)]
qa: unmount clients before deleting fs

Client unmount during test cleanup will hang if the file system was deleted.

Fixes: http://tracker.ceph.com/issues/38518
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agotest/test_ipaddr: added test for pick_address when ipv4 and ipv6 are enabled
Ricardo Dias [Thu, 28 Feb 2019 11:08:45 +0000 (11:08 +0000)]
test/test_ipaddr: added test for pick_address when ipv4 and ipv6 are enabled

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agocommon/pick_address: improves log message when no IP is found
Ricardo Dias [Thu, 28 Feb 2019 11:07:55 +0000 (11:07 +0000)]
common/pick_address: improves log message when no IP is found

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agomgr/dashboard: Fixed typo in environment.build.js
Lenz Grimmer [Thu, 28 Feb 2019 16:21:38 +0000 (17:21 +0100)]
mgr/dashboard: Fixed typo in environment.build.js

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agopick_address: error out in dual stack mode if both addr types cannot be provided
Ricardo Dias [Thu, 28 Feb 2019 11:02:04 +0000 (11:02 +0000)]
pick_address: error out in dual stack mode if both addr types cannot be provided

When ms_bind_ipv4 and ms_bind_ipv6 options are enabled, if the
public_network or cluster_network settings only contain networks of a
single type (either IPv4 or IPv6) then pick_addresses function must
fail.

Fixes: http://tracker.ceph.com/issues/38307
Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agodoc: Updated Ceph Dashboard documentation
Lenz Grimmer [Thu, 28 Feb 2019 14:10:42 +0000 (15:10 +0100)]
doc: Updated Ceph Dashboard documentation

Renamed "Ceph Manager Dashboard" to "Ceph Dashboard" in
various locations, replaced "plugin" with "module".
Overhauled the feature list, added more references to configuration
instructions and related components.
Fixed capitalization of subchapters.
Added note about mixed content blocking to the Grafana section.
Removed duplicate content from the dashboard's `README.rst`,
moved some parts (supported browser list) into the documentation
instead.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agodo_cmake.sh: SUSE builds need WITH_RADOSGW_AMQP_ENDPOINT=OFF
Nathan Cutler [Thu, 28 Feb 2019 13:49:45 +0000 (14:49 +0100)]
do_cmake.sh: SUSE builds need WITH_RADOSGW_AMQP_ENDPOINT=OFF

Without this patch, "make check" fails on SUSE systems because
WITH_RADOS_AMQP_ENDPOINT defaults to "ON".

Signed-off-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #26630 from sebastian-philipp/ssh-simple-type-error
Sebastian Wagner [Thu, 28 Feb 2019 13:22:50 +0000 (14:22 +0100)]
Merge pull request #26630 from sebastian-philipp/ssh-simple-type-error

mgr/ssh: fix type and doc errors

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
6 years agorbd: close image when bench is interrupted
Mykola Golub [Thu, 28 Feb 2019 12:48:00 +0000 (12:48 +0000)]
rbd: close image when bench is interrupted

Previously when `rbd bench` was interrupted it left the lock and
watcher and one had to wait for them to expire before reusing or
removing the image.

As a bonus now it prints the benchmark summary on exit even if it
is interrupted.

Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #26596 from smithfarm/wip-release-notes-12_2_11
Nathan Cutler [Thu, 28 Feb 2019 11:57:59 +0000 (12:57 +0100)]
Merge pull request #26596 from smithfarm/wip-release-notes-12_2_11

doc: add missing 12.2.11 release note

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agodoc: update documentation for standby-replay
Patrick Donnelly [Fri, 22 Feb 2019 04:23:13 +0000 (20:23 -0800)]
doc: update documentation for standby-replay

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: update discontinous map test to use mds freezing
Patrick Donnelly [Mon, 25 Feb 2019 19:10:26 +0000 (11:10 -0800)]
qa: update discontinous map test to use mds freezing

and stop using standby_for_*.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomon: add freeze MDS command
Patrick Donnelly [Sun, 24 Feb 2019 18:52:05 +0000 (10:52 -0800)]
mon: add freeze MDS command

This is a new hidden command that allows us to do certain testing for race
conditions. A frozen MDS cannot change change state or be replaced by a
standby.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: update testing for standby-replay
Patrick Donnelly [Mon, 25 Feb 2019 19:10:01 +0000 (11:10 -0800)]
qa: update testing for standby-replay

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomon: add setting for fs to enable standby-replay
Patrick Donnelly [Fri, 22 Feb 2019 00:39:57 +0000 (16:39 -0800)]
mon: add setting for fs to enable standby-replay

Operators now simply mark a file system as enabling standby-replay via

    ceph fs set <name> allow_standby_replay true

The MDSMonitor will assign available standbys to take on this role.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoceph-mds: obsolete hot-standby option
Patrick Donnelly [Fri, 22 Feb 2019 20:00:18 +0000 (12:00 -0800)]
ceph-mds: obsolete hot-standby option

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agofs: obsolete standby_for config options
Patrick Donnelly [Fri, 22 Feb 2019 00:34:07 +0000 (16:34 -0800)]
fs: obsolete standby_for config options

The operator can no longer configure which rank/fscid/name an MDS wants to
follow or standby for. This was an unfortunately confusing set of config
options as ultimately the MDSMonitor (by default) would set a standby to follow
any fscid/rank if no standby is available that explicitly follows the failed
rank. It is suggested that operators instead use the `standby_count_wanted`
setting on each fs to ensure that sufficient standbys are available.

The temporary effect of this commit is that the MDSMonitor no longer assigns
any standby to standby-replay, to be fixed in the following commits.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomessages/MMDSBeacon: use inline init
Patrick Donnelly [Fri, 22 Feb 2019 00:20:23 +0000 (16:20 -0800)]
messages/MMDSBeacon: use inline init

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: avoid unnecessary copy of entity_addrvec_t
Patrick Donnelly [Fri, 22 Feb 2019 00:11:55 +0000 (16:11 -0800)]
mds: avoid unnecessary copy of entity_addrvec_t

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: use inline init for mds_info_t
Patrick Donnelly [Fri, 22 Feb 2019 00:11:27 +0000 (16:11 -0800)]
mds: use inline init for mds_info_t

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: use rank from MDSMap always
Patrick Donnelly [Fri, 22 Feb 2019 00:05:55 +0000 (16:05 -0800)]
mds: use rank from MDSMap always

This old bit of code was using standby_for_rank to determine what rank it
should follow but, for the last few releases, the Monitor always sets the the
rank to follow.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: remove obsolete comment
Patrick Donnelly [Fri, 22 Feb 2019 00:03:34 +0000 (16:03 -0800)]
mds: remove obsolete comment

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: use SIGTERM when stopping vstart service
Patrick Donnelly [Mon, 25 Feb 2019 19:10:51 +0000 (11:10 -0800)]
qa: use SIGTERM when stopping vstart service

Otherwise MDS will not send down:dne to mons when restarting.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #26663 into master
Sage Weil [Wed, 27 Feb 2019 23:23:25 +0000 (17:23 -0600)]
Merge PR #26663 into master

* refs/pull/26663/head:
doc: change ruleset to id in crush map file

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26595 into master
Sage Weil [Wed, 27 Feb 2019 22:59:47 +0000 (16:59 -0600)]
Merge PR #26595 into master

* refs/pull/26595/head:
osd/PG: log tracked pg refs under debug_refs
osd/PG: include tag in get/put debug lines
osd: clean up oncommit contexts in _process shutdown

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26637 into master
Sage Weil [Wed, 27 Feb 2019 22:59:32 +0000 (16:59 -0600)]
Merge PR #26637 into master

* refs/pull/26637/head:
common/ceph_context: experimental kludge for crimson
auth/AuthRegistry: mark 'secure' con mode experimental for now
msg/async: set ms_*_mode to crc only (no secure)

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26640 into master
Sage Weil [Wed, 27 Feb 2019 22:59:04 +0000 (16:59 -0600)]
Merge PR #26640 into master

* refs/pull/26640/head:
mon/OSDMonitor: remove old v1 addrs when converting blacklist to new TYPE_ANY form

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26645 into master
Sage Weil [Wed, 27 Feb 2019 22:58:47 +0000 (16:58 -0600)]
Merge PR #26645 into master

* refs/pull/26645/head:
rpm: use %_python_buildid to specify python-remoto dep

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #26678 into master
Sage Weil [Wed, 27 Feb 2019 22:58:31 +0000 (16:58 -0600)]
Merge PR #26678 into master

* refs/pull/26678/head:
mon: handle racing ms_handle_reset and handle_auth_request

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoceph-volume: use our own testinfra suite for functional testing
Andrew Schoen [Wed, 27 Feb 2019 21:14:03 +0000 (15:14 -0600)]
ceph-volume: use our own testinfra suite for functional testing

This allows us to run a smaller subset of tests from the ones provided
by ceph-ansible and test only the things that pertain to ceph-volume.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge PR #26648 into master
Sage Weil [Wed, 27 Feb 2019 20:15:08 +0000 (14:15 -0600)]
Merge PR #26648 into master

* refs/pull/26648/head:
msg/async: msgr2: cleanup frame classes hacks

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #26523 from dillaman/wip-38387
Mykola Golub [Wed, 27 Feb 2019 18:49:09 +0000 (20:49 +0200)]
Merge pull request #26523 from dillaman/wip-38387

librbd: add missing shutdown states to managed lock helper

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge PR #26598 into master
Sage Weil [Wed, 27 Feb 2019 18:26:27 +0000 (12:26 -0600)]
Merge PR #26598 into master

* refs/pull/26598/head:
doc/releases/nautilus: dashboard tweaks
doc/releases/nautilus: more rados highlights
doc/release/nautilus: added RBD major features
doc/releases/nautilus: add msgr2 enablement steps
doc/releases/nautilus: add dashboard items

Reviewed-by: Kai Wagner <kwagner@suse.com>
6 years agoMerge pull request #26570 from jtlayton/wip-rook
Sebastian Wagner [Wed, 27 Feb 2019 18:24:43 +0000 (19:24 +0100)]
Merge pull request #26570 from jtlayton/wip-rook

mgr/orchestrator/rook: allow the creation of OSDs in directories

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
6 years agodoc/releases/nautilus: dashboard tweaks
Sage Weil [Wed, 27 Feb 2019 17:43:52 +0000 (11:43 -0600)]
doc/releases/nautilus: dashboard tweaks

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26671 into master
Sage Weil [Wed, 27 Feb 2019 17:40:50 +0000 (11:40 -0600)]
Merge PR #26671 into master

* refs/pull/26671/head:
doc: Replaced "plugin" with "module" in the Mgr documentation

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agomon/ConfigMonitor: add 'config ls'
Sage Weil [Wed, 27 Feb 2019 17:37:47 +0000 (11:37 -0600)]
mon/ConfigMonitor: add 'config ls'

Signed-off-by: Sage Weil <sage@redhat.com>