]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoceph-daemon: fix firewalld error case 32096/head
Sage Weil [Fri, 6 Dec 2019 20:20:07 +0000 (14:20 -0600)]
ceph-daemon: fix firewalld error case

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32021 from falcon78921/wip-doc-43130
Neha Ojha [Fri, 6 Dec 2019 19:52:05 +0000 (11:52 -0800)]
Merge pull request #32021 from falcon78921/wip-doc-43130

doc: fixed broken reference link for Graphviz

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32017 from dzafman/wip-revert-verify-upmap
David Zafman [Fri, 6 Dec 2019 17:29:40 +0000 (09:29 -0800)]
Merge pull request #32017 from dzafman/wip-revert-verify-upmap

Revert "crush: remove invalid upmap items"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31589 from zhengchengyao/mv_snapshot
Jason Dillaman [Fri, 6 Dec 2019 15:22:22 +0000 (10:22 -0500)]
Merge pull request #31589 from zhengchengyao/mv_snapshot

librbd:move all snapshot API functions in internal.cc over to api/Snapshot.cc

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #31767 from pritha-srivastava/wip-rgw-mfa-set-versioning
Casey Bodley [Fri, 6 Dec 2019 15:18:56 +0000 (10:18 -0500)]
Merge pull request #31767 from pritha-srivastava/wip-rgw-mfa-set-versioning

rgw: adding mfa code validation when bucket versioning status is changed

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
5 years agomgr/dashboard: adapt to create_osds parameters change (#31928)
Lenz Grimmer [Fri, 6 Dec 2019 14:57:27 +0000 (14:57 +0000)]
mgr/dashboard: adapt to create_osds parameters change (#31928)

mgr/dashboard: adapt to create_osds parameters change

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge pull request #31062 from dillaman/wip-42355
Laura Paduano [Fri, 6 Dec 2019 09:42:03 +0000 (10:42 +0100)]
Merge pull request #31062 from dillaman/wip-42355

mgr/dashboard: support RBD mirroring bootstrap create/import

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agomgr/dashboard: Cleanup code (#32031)
Lenz Grimmer [Fri, 6 Dec 2019 08:57:49 +0000 (08:57 +0000)]
mgr/dashboard: Cleanup code (#32031)

mgr/dashboard: Cleanup code

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
5 years agoMerge pull request #31949 from dillaman/wip-42748
Mykola Golub [Fri, 6 Dec 2019 08:43:47 +0000 (10:43 +0200)]
Merge pull request #31949 from dillaman/wip-42748

rbd: incorporate rbd-mirror daemon status in mirror pool status

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge PR #29964 into master
Patrick Donnelly [Fri, 6 Dec 2019 05:42:12 +0000 (21:42 -0800)]
Merge PR #29964 into master

* refs/pull/29964/head:
qa/cephfs: test conf file reading for CephFS shell
qa/cephfs: allow passing conf to methods that runs shell command
qa/vstart_runner: add a method to create temporary file
test_cephfs_shell: update test since shell can now read ceph.conf
src/vstart.sh: add cephfs-shell section to ceph.conf
cephfs-shell: read shell variables from ceph.conf

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa/cephfs: test conf file reading for CephFS shell 29964/head
Rishabh Dave [Sat, 7 Sep 2019 16:37:40 +0000 (22:07 +0530)]
qa/cephfs: test conf file reading for CephFS shell

Adds tests that checks -
* reading conf option
* reading conf option after setting it twice
* reading conf option after setting it after a reset

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/cephfs: allow passing conf to methods that runs shell command
Rishabh Dave [Tue, 10 Sep 2019 12:04:21 +0000 (17:34 +0530)]
qa/cephfs: allow passing conf to methods that runs shell command

Add an argument to the methods that issues CephFS shell command to
accept path to the ceph.conf file.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner: add a method to create temporary file
Rishabh Dave [Tue, 10 Sep 2019 11:27:53 +0000 (16:57 +0530)]
qa/vstart_runner: add a method to create temporary file

The method's signature is kept identical to the method in teuthology.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agotest_cephfs_shell: update test since shell can now read ceph.conf
Rishabh Dave [Wed, 13 Nov 2019 12:42:13 +0000 (18:12 +0530)]
test_cephfs_shell: update test since shell can now read ceph.conf

In the test
test_cephfs_shell.TestMisc.test_issue_cephfs_shell_cmd_at_invocation,
don't set the shell option with in the command to be tested since
CephFS shell can now read it's value from ceph.conf.

Also, add methods to set config options for vstart as well teuthology
testing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agosrc/vstart.sh: add cephfs-shell section to ceph.conf
Rishabh Dave [Wed, 28 Aug 2019 14:47:22 +0000 (20:17 +0530)]
src/vstart.sh: add cephfs-shell section to ceph.conf

And set "debug" to true, so that developers can see tracebacks in case
cephfs-shell crashes.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agocephfs-shell: read shell variables from ceph.conf
Rishabh Dave [Wed, 28 Aug 2019 13:57:29 +0000 (19:27 +0530)]
cephfs-shell: read shell variables from ceph.conf

Read ceph.conf and initialize shell variables by reading options set
under section cephfs-shell. If there are sections/options that are
duplicated in ceph.conf, CephFS shell overrides the options with the
values last.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge PR #31897 into master
Patrick Donnelly [Fri, 6 Dec 2019 00:05:59 +0000 (16:05 -0800)]
Merge PR #31897 into master

* refs/pull/31897/head:
doc: obsolete entries for allow_standby_replay
wip-doc: entries obsoleted by allow_standby_replay

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31403 into master
Patrick Donnelly [Thu, 5 Dec 2019 23:58:26 +0000 (15:58 -0800)]
Merge PR #31403 into master

* refs/pull/31403/head:
vstart.sh: highlight presence of stray conf

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #29421 into master
Patrick Donnelly [Thu, 5 Dec 2019 21:18:49 +0000 (13:18 -0800)]
Merge PR #29421 into master

* refs/pull/29421/head:
qa/cephfs: add tests for ACLs
qa/cephfs: allow running tests from xfstests-dev
qa/tasks: add methods to get monitor's sockets
qa/cephfs: don't crash if mountpoint dir is already deleted
vstart_runner.py: set omit_sudo's default value to False
qa/vstart_runner.py: fix get_keyring_path()
qa/cephfs: don't abort if mountpoint is already present
qa/cephfs: allow specifying mountpoint for kernel mounts
qa/cephfs: allow specifying mountpoints for FUSE mounts
qa/vstart_runner.py: allow specifying mountpoint for local FUSE mounts
qa/mount.py: allow setting mountpoint
qa/vstart_runner.py: add a method to create a temporary directory

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31926 from yuvalif/wip-yuval-fix-pubsub-record-format
Casey Bodley [Thu, 5 Dec 2019 18:55:31 +0000 (13:55 -0500)]
Merge pull request #31926 from yuvalif/wip-yuval-fix-pubsub-record-format

rgw/pubsub: fix records/event json format to match documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32036 from zdover23/wip-doc-troubleshooting-pg-verb-fix
Kefu Chai [Thu, 5 Dec 2019 17:45:36 +0000 (01:45 +0800)]
Merge pull request #32036 from zdover23/wip-doc-troubleshooting-pg-verb-fix

doc: s/achieve/achieves/ (Fixed a verb disagreement)

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agodoc: obsolete entries for allow_standby_replay 31897/head
Rodrigo Severo [Thu, 5 Dec 2019 16:41:33 +0000 (13:41 -0300)]
doc: obsolete entries for allow_standby_replay

Nautilus release presented the allow_standby_replay fs setting that obsdoleted
several MDS config entries:  mds_standby_for_*, mon_force_standby_active, and
mds_standby_replay.

Removing entries instead of just marking them as "Obsolete' as per batrick
suggestion.

Signed-off-by: Rodrigo Severo <rodrigo@fabricadeideias.com>
5 years agodoc: s/achieve/achieves (Fixed a verb disagreement) 32036/head
Zac Dover [Thu, 5 Dec 2019 16:16:01 +0000 (02:16 +1000)]
doc: s/achieve/achieves (Fixed a verb disagreement)

This bug changes a clause of the form "When x remains in y status
and never achieve a z status" to a clause of the form "When x remains
in y status and never achieves a  z status".

The change is one of "achieve" to "achieves".

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #31830 from joke-lee/rgw-sts-crash-token-not-base64
Casey Bodley [Thu, 5 Dec 2019 15:41:45 +0000 (10:41 -0500)]
Merge pull request #31830 from joke-lee/rgw-sts-crash-token-not-base64

rgw: fix rgw crash when token is not base64 encode

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31483 from zhangsw/fix-rgw-reshard-left
Casey Bodley [Thu, 5 Dec 2019 15:34:31 +0000 (10:34 -0500)]
Merge pull request #31483 from zhangsw/fix-rgw-reshard-left

rgw: fix a bug that bucket instance obj can't be removed after resharding completed

Reviewed-by: Eric J. Ivancich <ivancich@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
5 years agoMerge PR #31989 into master
Sage Weil [Thu, 5 Dec 2019 15:33:52 +0000 (09:33 -0600)]
Merge PR #31989 into master

* refs/pull/31989/head:
mgr/MgrClient: fix 'tell mgr.x ...'

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30878 from zhangsw/fix-rgw-lc-zerodays
Daniel Gryniewicz [Thu, 5 Dec 2019 15:31:40 +0000 (10:31 -0500)]
Merge pull request #30878 from zhangsw/fix-rgw-lc-zerodays

rgw: Expiration days can't be zero and  transition days can be zero

5 years agoMerge PR #31795 into master
Sage Weil [Thu, 5 Dec 2019 15:09:07 +0000 (09:09 -0600)]
Merge PR #31795 into master

* refs/pull/31795/head:
mgr/ssh: 'ssh {check,prepare}-host <host>'
mgr/ssh: return err from _run_ceph_daemon
ceph-daemon: add check-host and prepare-host

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32004 into master
Sage Weil [Thu, 5 Dec 2019 15:05:11 +0000 (09:05 -0600)]
Merge PR #32004 into master

* refs/pull/32004/head:
mgr/restful: allow shutdown before we've fully started up

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30498 from jecluis/wip-mon-no-config
Kefu Chai [Thu, 5 Dec 2019 14:59:56 +0000 (22:59 +0800)]
Merge pull request #30498 from jecluis/wip-mon-no-config

mon: allow running without a config file

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: block mirroring bootstrap UI 31062/head
Jason Dillaman [Wed, 30 Oct 2019 18:55:41 +0000 (14:55 -0400)]
mgr/dashboard: block mirroring bootstrap UI

Two new modal windows allow an admin to create a base64-encoded bootstrap token
which can then be imported into dashboard on another cluster. The bootstrap
token embeds all the necessary data required to connect to a peer cluster for
RBD mirroring.

Fixes: http://tracker.ceph.com/issues/42355
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: integrate site name into block mirroring overview
Jason Dillaman [Tue, 22 Oct 2019 17:58:31 +0000 (13:58 -0400)]
mgr/dashboard: integrate site name into block mirroring overview

The site name is used to differentiate clusters for RBD mirroring.
The local site name is now displayed on the block mirroring
overview page. It also includes a new modal window to edit the site
name.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: mirror site name and bootstrap service methods
Jason Dillaman [Tue, 22 Oct 2019 17:57:58 +0000 (13:57 -0400)]
mgr/dashboard: mirror site name and bootstrap service methods

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: add site name to mirroring summary collection
Jason Dillaman [Tue, 22 Oct 2019 18:29:45 +0000 (14:29 -0400)]
mgr/dashboard: add site name to mirroring summary collection

The summary is periodically polled by the UI so it can now
reflect changes to the site name w/o specifically needing to poll
just the site name.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: new controller for RBD mirroring peer bootstrapping
Jason Dillaman [Thu, 17 Oct 2019 19:10:21 +0000 (15:10 -0400)]
mgr/dashboard: new controller for RBD mirroring peer bootstrapping

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: new controller for RBD mirroring site name
Jason Dillaman [Thu, 17 Oct 2019 18:01:11 +0000 (14:01 -0400)]
mgr/dashboard: new controller for RBD mirroring site name

This allows setting and retrieving the current site name for
RBD mirroring. This is a global property of the cluster.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: fix broken rbd-mirror dashboard API test case
Jason Dillaman [Wed, 30 Oct 2019 20:42:16 +0000 (16:42 -0400)]
mgr/dashboard: fix broken rbd-mirror dashboard API test case

Fixes: https://tracker.ceph.com/issues/42512
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: Cleanup code 32031/head
Volker Theile [Thu, 5 Dec 2019 14:06:54 +0000 (15:06 +0100)]
mgr/dashboard: Cleanup code

Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agoMerge PR #31988 into master
Sage Weil [Thu, 5 Dec 2019 13:19:27 +0000 (07:19 -0600)]
Merge PR #31988 into master

* refs/pull/31988/head:
common/config: less noise about configs from mon we can't apply

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: list configured prometheus alerts (#31937)
Lenz Grimmer [Thu, 5 Dec 2019 12:25:33 +0000 (12:25 +0000)]
mgr/dashboard: list configured prometheus alerts (#31937)

mgr/dashboard: list configured prometheus alerts

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Check password complexity in Dashboard CLI comm… (#31916)
Lenz Grimmer [Thu, 5 Dec 2019 09:46:14 +0000 (09:46 +0000)]
mgr/dashboard: Check password complexity in Dashboard CLI comm… (#31916)

mgr/dashboard: Check password complexity in Dashboard CLI commands

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #31732 from aclamk/wip-vstart-osds-parallel
Kefu Chai [Thu, 5 Dec 2019 07:54:23 +0000 (15:54 +0800)]
Merge pull request #31732 from aclamk/wip-vstart-osds-parallel

vstart: Now all OSDs are starting in parallel. Use --no-parallel to revert to sequential.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31765 from rjfd/wip-fix-mon-public-addr
Kefu Chai [Thu, 5 Dec 2019 07:51:53 +0000 (15:51 +0800)]
Merge pull request #31765 from rjfd/wip-fix-mon-public-addr

ceph-mon: keep v1 address type when explicitly set

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
5 years agoMerge pull request #31876 from rosinL/wip-fix-dpdk-zero-length
Kefu Chai [Thu, 5 Dec 2019 07:43:50 +0000 (15:43 +0800)]
Merge pull request #31876 from rosinL/wip-fix-dpdk-zero-length

msg/async/dpdk: fix SEGV caused by zero length packet

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31932 from tchaikov/wip-pr-29610
Kefu Chai [Thu, 5 Dec 2019 07:42:52 +0000 (15:42 +0800)]
Merge pull request #31932 from tchaikov/wip-pr-29610

os/bluestore: print error if spdk_nvme_ns_cmd_writev() fails

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agodoc: fixed broken reference link for Graphviz 32021/head
James McClune [Thu, 5 Dec 2019 03:03:43 +0000 (22:03 -0500)]
doc: fixed broken reference link for Graphviz

Fixes: https://tracker.ceph.com/issues/43130
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
5 years agoRevert "crush: remove invalid upmap items" 32017/head
David Zafman [Thu, 5 Dec 2019 00:06:03 +0000 (16:06 -0800)]
Revert "crush: remove invalid upmap items"

This reverts commit 712a39e5c9d9848f618ad55a768103d84c0a460f.

Signed-off-by: David Zafman <dzafman@redhat.com>
5 years agoMerge PR #31715 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:56:05 +0000 (14:56 -0800)]
Merge PR #31715 into master

* refs/pull/31715/head:
mds: initialize the monc later in init()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31428 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:55:17 +0000 (14:55 -0800)]
Merge PR #31428 into master

* refs/pull/31428/head:
qa/tasks: Fixed AttributeError: can't set attribute
qa/tasks: drop/update name from Thrasher

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31898 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:51:04 +0000 (14:51 -0800)]
Merge PR #31898 into master

* refs/pull/31898/head:
mds: remove unnecessary debug warning

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31455 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:17:40 +0000 (14:17 -0800)]
Merge PR #31455 into master

* refs/pull/31455/head:
mds: tolerate no snaprealm encoded in on-disk root inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31680 into master
Patrick Donnelly [Wed, 4 Dec 2019 21:57:42 +0000 (13:57 -0800)]
Merge PR #31680 into master

* refs/pull/31680/head:
tools/cephfs: make 'cephfs-data-scan scan_links' fix dentry's first

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31712 into master
Patrick Donnelly [Wed, 4 Dec 2019 21:54:29 +0000 (13:54 -0800)]
Merge PR #31712 into master

* refs/pull/31712/head:
fs/ceph_mds: set ceph_mds cpu affinity

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31986 into master
Patrick Donnelly [Wed, 4 Dec 2019 21:45:11 +0000 (13:45 -0800)]
Merge PR #31986 into master

* refs/pull/31986/head:
qa: test volumes plugin mount cleanup
pybind/mgr/volumes: use py3 items iterator
pybind/mgr/volumes: print errors in cleanup timer
qa: improve variable name

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #31998 from yuvalif/kafka_spins_on_cpu
Casey Bodley [Wed, 4 Dec 2019 20:36:52 +0000 (15:36 -0500)]
Merge pull request #31998 from yuvalif/kafka_spins_on_cpu

rgw/pubsub: prevent kafka thread from spinning when there are no messages

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #31975 into master
Sage Weil [Wed, 4 Dec 2019 20:11:50 +0000 (14:11 -0600)]
Merge PR #31975 into master

* refs/pull/31975/head:
doc/install/containers: note vX.Y.Z[-YYYYMMDD] tags

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
5 years agoMerge PR #31955 into master
Sage Weil [Wed, 4 Dec 2019 19:49:58 +0000 (13:49 -0600)]
Merge PR #31955 into master

* refs/pull/31955/head:
doc/foundation: add ceph foundation info here

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31893 from fghaas/doc-rbd-exclusive-locks
Jason Dillaman [Wed, 4 Dec 2019 18:38:38 +0000 (13:38 -0500)]
Merge pull request #31893 from fghaas/doc-rbd-exclusive-locks

doc: RBD exclusive locks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: show alert panel if prometheus/alertmanager is unconfigured 31937/head
Patrick Seidensal [Tue, 3 Dec 2019 19:46:17 +0000 (20:46 +0100)]
mgr/dashboard: show alert panel if prometheus/alertmanager is unconfigured

If the tabs under the "Monitoring" page aren't properly configured, a
notification is shown which explains the user which setting needs to be
enabled and also provides a link to the corresponding documentation.

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge PR #31902 into master
Patrick Donnelly [Wed, 4 Dec 2019 15:57:21 +0000 (07:57 -0800)]
Merge PR #31902 into master

* refs/pull/31902/head:
doc: add description for fuse_disable_pagecache

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31948 from zdover23/wip-doc-ntp-ubuntu-chrony2
Kefu Chai [Wed, 4 Dec 2019 15:49:58 +0000 (23:49 +0800)]
Merge pull request #31948 from zdover23/wip-doc-ntp-ubuntu-chrony2

doc: add "chrony" to preflight checklist for Ubuntu 18.04

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/ssh: 'ssh {check,prepare}-host <host>' 31795/head
Sage Weil [Mon, 25 Nov 2019 17:18:09 +0000 (11:18 -0600)]
mgr/ssh: 'ssh {check,prepare}-host <host>'

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: return err from _run_ceph_daemon
Sage Weil [Mon, 25 Nov 2019 17:17:53 +0000 (11:17 -0600)]
mgr/ssh: return err from _run_ceph_daemon

Sometimes callers will want to see this.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-daemon: add check-host and prepare-host
Sage Weil [Thu, 21 Nov 2019 20:41:51 +0000 (14:41 -0600)]
ceph-daemon: add check-host and prepare-host

Check for (and/or install/configure):

- podman | docker
- systemctl
- LVM2
- chrony (or ntp or timesyncd)

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31967 from sebastian-philipp/ssh-understanding-async
Sebastian Wagner [Wed, 4 Dec 2019 15:20:01 +0000 (16:20 +0100)]
Merge pull request #31967 from sebastian-philipp/ssh-understanding-async

mgr/ssh: HACKING.rst: Add Understanding `AsyncCompletion`

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agodoc: RBD exclusive locks 31893/head
Florian Haas [Tue, 26 Nov 2019 17:25:12 +0000 (18:25 +0100)]
doc: RBD exclusive locks

A discussion on the ceph-users list uncovered a bit of uncertainty
about how exclusive locking works:

https://www.mail-archive.com/ceph-users@lists.ceph.com/msg56910.html

Add a bit of background information about exclusive locks, and
cross-reference the documentatation on OpenStack, and on CephX.

Signed-off-by: Florian Haas <florian@citynetwork.eu>
5 years agoqa: test volumes plugin mount cleanup 31986/head
Patrick Donnelly [Tue, 3 Dec 2019 23:14:49 +0000 (15:14 -0800)]
qa: test volumes plugin mount cleanup

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agopybind/mgr/volumes: use py3 items iterator
Patrick Donnelly [Tue, 3 Dec 2019 22:33:07 +0000 (14:33 -0800)]
pybind/mgr/volumes: use py3 items iterator

Otherwise this raises an exception.

Fixes: https://tracker.ceph.com/issues/43113
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agopybind/mgr/volumes: print errors in cleanup timer
Patrick Donnelly [Tue, 3 Dec 2019 22:32:24 +0000 (14:32 -0800)]
pybind/mgr/volumes: print errors in cleanup timer

The squelched error prevented us from knowing connection cleanup doesn't
work on py3.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: improve variable name
Patrick Donnelly [Wed, 4 Dec 2019 14:50:56 +0000 (06:50 -0800)]
qa: improve variable name

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agodoc/install/containers: note vX.Y.Z[-YYYYMMDD] tags 31975/head
Sage Weil [Tue, 3 Dec 2019 13:33:47 +0000 (07:33 -0600)]
doc/install/containers: note vX.Y.Z[-YYYYMMDD] tags

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc: add "chrony" to preflight checklist for Ubuntu 18.04 31948/head
Zac Dover [Mon, 2 Dec 2019 15:40:03 +0000 (01:40 +1000)]
doc: add "chrony" to preflight checklist for Ubuntu 18.04

This commit updates the "Install NTP" section of the preflight
checklist, instructing readers who are using Ubuntu 18.04 to
use the package name "chrony" where elsewhere the package name
"ntp" would be used. "chrony" has replaced "ntp" in Ubnutu 18.04.

This commit fixes Bug number 8 in the list here:
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #31972 from clwluvw/patch-1
Casey Bodley [Wed, 4 Dec 2019 13:32:00 +0000 (08:32 -0500)]
Merge pull request #31972 from clwluvw/patch-1

doc: rgw: Fixed bug on wrong name for user_id for OPA

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31906 from s0nea/wip-dashboard-fix-pg-num-warning
Laura Paduano [Wed, 4 Dec 2019 13:20:39 +0000 (14:20 +0100)]
Merge pull request #31906 from s0nea/wip-dashboard-fix-pg-num-warning

mgr/dashboard: fix tests in order to match pg num conventions

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agorbd: incorporate rbd-mirror daemon status in mirror pool status 31949/head
Jason Dillaman [Mon, 2 Dec 2019 20:02:49 +0000 (15:02 -0500)]
rbd: incorporate rbd-mirror daemon status in mirror pool status

This will ensure that the Ceph dashbord's block mirroring page and
the CLI's 'mirror pool status' have matching health indications.

Fixes: https://tracker.ceph.com/issues/42748
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/restful: allow shutdown before we've fully started up 32004/head
Sage Weil [Wed, 4 Dec 2019 13:13:44 +0000 (07:13 -0600)]
mgr/restful: allow shutdown before we've fully started up

Sometimes we get shutdown() before self.server has been assigned.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31797 into master
Sage Weil [Wed, 4 Dec 2019 13:10:49 +0000 (07:10 -0600)]
Merge PR #31797 into master

* refs/pull/31797/head:
qa: test mgr cephfs mount blacklist
mgr: forward RADOS client instances for potential blacklist
mon/MgrMonitor: blacklist previous instance
mon: set RUNTIME flag on mon_mds_blacklist_interval
mgr: use more efficient data structure

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31950 from dillaman/wip-mirror-peer-fsid
Mykola Golub [Wed, 4 Dec 2019 13:08:23 +0000 (15:08 +0200)]
Merge pull request #31950 from dillaman/wip-mirror-peer-fsid

rbd-mirror: peer_ping should send the local fsid to the remote

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge PR #31908 into master
Sage Weil [Wed, 4 Dec 2019 13:06:34 +0000 (07:06 -0600)]
Merge PR #31908 into master

* refs/pull/31908/head:
ceph-daemon: use uid/gid 0 when creating tempfiles
ceph-daemon: drop unneeded `mode` during tmpfile create
ceph-daemon: consolidate NamedTemporaryFile logic
ceph-daemon: chown uid/gid `ceph-volume` tmpfiles

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #31940 into master
Sage Weil [Wed, 4 Dec 2019 13:06:13 +0000 (07:06 -0600)]
Merge PR #31940 into master

* refs/pull/31940/head:
mgr/ssh: Port raising exceptions from completion handlers to Py2

Reviewed-by: Joshua Schmid <jschmid@suse.de>
5 years agomgr/dashboard: extend dashboard documentation
Patrick Seidensal [Mon, 2 Dec 2019 13:30:30 +0000 (14:30 +0100)]
mgr/dashboard: extend dashboard documentation

by adding the previously added monitoring related features as well as
the newest feature addition. Extends the documentation where necessary
to describe the Prometheus' alert configuration.

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge pull request #31990 from dzafman/wip-43084
Kefu Chai [Wed, 4 Dec 2019 04:30:11 +0000 (12:30 +0800)]
Merge pull request #31990 from dzafman/wip-43084

tools/osdmaptool.cc: do not use deprecated std::random_shuffle()

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agoqa: test mgr cephfs mount blacklist 31797/head
Patrick Donnelly [Tue, 3 Dec 2019 23:02:19 +0000 (15:02 -0800)]
qa: test mgr cephfs mount blacklist

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr: forward RADOS client instances for potential blacklist
Patrick Donnelly [Tue, 3 Dec 2019 04:27:44 +0000 (20:27 -0800)]
mgr: forward RADOS client instances for potential blacklist

The mgr creates a per-module RADOS client connection for modules which
interact with RADOS (e.g. the volumes module). These clients should also
be blacklisted when the active mgr is failed; we don't want the former
active mgr to continue interacting with RADOS when the new one takes
over. This is particularly impactful for avoiding extraneous
"unresponsive client" warnings from the MDS when the mgr switches
(especially in testing). The MDS will pickup the new OSD blacklists
which include's the old mgr's libcephfs instance and blacklist/evict
that session quietly.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomon/MgrMonitor: blacklist previous instance
Patrick Donnelly [Thu, 21 Nov 2019 20:31:16 +0000 (12:31 -0800)]
mon/MgrMonitor: blacklist previous instance

This wasn't realized as necessary early on in the ceph-mgr development
because the mgr didn't interact with RADOS. However, now it is becoming
common for plugins to store data there. It's important that the previous
instance can no longer interact with RADOS while the new mgr takes over.

In particular, this means that the mgr's client sessions with the MDS
are automatically evicted once the MDS receives the new OSDMap. This
avoids a pesky "unresponsive client" warning in the cluster logs.

Fixes: https://tracker.ceph.com/issues/42939
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomon: set RUNTIME flag on mon_mds_blacklist_interval
Patrick Donnelly [Thu, 21 Nov 2019 21:01:07 +0000 (13:01 -0800)]
mon: set RUNTIME flag on mon_mds_blacklist_interval

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr: use more efficient data structure
Patrick Donnelly [Tue, 3 Dec 2019 01:57:48 +0000 (17:57 -0800)]
mgr: use more efficient data structure

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agotools/osdmaptool.cc: do not use deprecated std::random_shuffle() 31990/head
Kefu Chai [Wed, 4 Dec 2019 00:06:40 +0000 (16:06 -0800)]
tools/osdmaptool.cc: do not use deprecated std::random_shuffle()
the use of `std::random_shuffle()` was introduced by
b946308 .

in this change, it is replaced using `std::shuffle()`.

Fixes: https://tracker.ceph.com/issues/43084
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/MgrClient: fix 'tell mgr.x ...' 31989/head
Sage Weil [Tue, 3 Dec 2019 23:56:46 +0000 (17:56 -0600)]
mgr/MgrClient: fix 'tell mgr.x ...'

If we start the command before we get the mgrmap at the client, we
will send MCommand via a different code path; make sure it behaves
correctly too.

Missed this in 6f35d2835268eade059535b62378d6d407ef9e87

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocommon/config: less noise about configs from mon we can't apply 31988/head
Sage Weil [Tue, 3 Dec 2019 23:54:44 +0000 (17:54 -0600)]
common/config: less noise about configs from mon we can't apply

It is normal to set things in teh mon config database that can't be absorbed
by clients/daemons at runtime.  Things like ms_type can/should be set there
(so that they, for instance, help produce the 'config minimal-conf') but
we don't need daemons to spit out error messages every time they get a config
update.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31891 into master
Sage Weil [Tue, 3 Dec 2019 22:49:28 +0000 (16:49 -0600)]
Merge PR #31891 into master

* refs/pull/31891/head:
qa/suites/rados/ssh: only install ceph-daemon for packaged mode
tasks/ceph2: add support for packaged ceph-daemon
qa/tasks/ceph2: make image cluster-private
qa/tasks/ceph2: add 'shell' command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #31984 into master
Sage Weil [Tue, 3 Dec 2019 22:11:21 +0000 (16:11 -0600)]
Merge PR #31984 into master

* refs/pull/31984/head:
mgr/telemetry: fix log typo

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31869 into master
Sage Weil [Tue, 3 Dec 2019 22:00:14 +0000 (16:00 -0600)]
Merge PR #31869 into master

* refs/pull/31869/head:
ceph-daemon: bootstrap: deploy initial mon via deploy_daemon()
qa/standalone/test_ceph_daemon.sh: more $SUDO
ceph-daemon: configure firewalld for new daemon deploys
ceph-daemon: name mgr the same way mgr/ssh does

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #31930 into master
Sage Weil [Tue, 3 Dec 2019 21:59:16 +0000 (15:59 -0600)]
Merge PR #31930 into master

* refs/pull/31930/head:
mgr/orchestrator: add optional "format" param for "orchestrator host ls"

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31968 from idryomov/wip-krbd-python3
Ilya Dryomov [Tue, 3 Dec 2019 20:54:41 +0000 (21:54 +0100)]
Merge pull request #31968 from idryomov/wip-krbd-python3

qa: update krbd tests for python3

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/telemetry: fix log typo 31984/head
Sage Weil [Tue, 3 Dec 2019 19:38:50 +0000 (13:38 -0600)]
mgr/telemetry: fix log typo

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31983 into master
Sage Weil [Tue, 3 Dec 2019 19:20:16 +0000 (13:20 -0600)]
Merge PR #31983 into master

* refs/pull/31983/head:
mgr/ssh/tests: fix RGWSpec test

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agorgw/pubsub: support eventId in push mode 31926/head
Yuval Lifshitz [Sun, 1 Dec 2019 18:08:12 +0000 (20:08 +0200)]
rgw/pubsub: support eventId in push mode

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agorgw/pubsub: prevent kafka thread from spinning when there are no 31998/head
Yuval Lifshitz [Tue, 3 Dec 2019 18:16:25 +0000 (20:16 +0200)]
rgw/pubsub: prevent kafka thread from spinning when there are no
messages

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agomgr/ssh/tests: fix RGWSpec test 31983/head
Sage Weil [Tue, 3 Dec 2019 18:14:47 +0000 (12:14 -0600)]
mgr/ssh/tests: fix RGWSpec test

Signed-off-by: Sage Weil <sage@redhat.com>