]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoqa/cephfs: test conf file reading for CephFS shell 29964/head
Rishabh Dave [Sat, 7 Sep 2019 16:37:40 +0000 (22:07 +0530)]
qa/cephfs: test conf file reading for CephFS shell

Adds tests that checks -
* reading conf option
* reading conf option after setting it twice
* reading conf option after setting it after a reset

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/cephfs: allow passing conf to methods that runs shell command
Rishabh Dave [Tue, 10 Sep 2019 12:04:21 +0000 (17:34 +0530)]
qa/cephfs: allow passing conf to methods that runs shell command

Add an argument to the methods that issues CephFS shell command to
accept path to the ceph.conf file.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner: add a method to create temporary file
Rishabh Dave [Tue, 10 Sep 2019 11:27:53 +0000 (16:57 +0530)]
qa/vstart_runner: add a method to create temporary file

The method's signature is kept identical to the method in teuthology.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agotest_cephfs_shell: update test since shell can now read ceph.conf
Rishabh Dave [Wed, 13 Nov 2019 12:42:13 +0000 (18:12 +0530)]
test_cephfs_shell: update test since shell can now read ceph.conf

In the test
test_cephfs_shell.TestMisc.test_issue_cephfs_shell_cmd_at_invocation,
don't set the shell option with in the command to be tested since
CephFS shell can now read it's value from ceph.conf.

Also, add methods to set config options for vstart as well teuthology
testing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agosrc/vstart.sh: add cephfs-shell section to ceph.conf
Rishabh Dave [Wed, 28 Aug 2019 14:47:22 +0000 (20:17 +0530)]
src/vstart.sh: add cephfs-shell section to ceph.conf

And set "debug" to true, so that developers can see tracebacks in case
cephfs-shell crashes.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agocephfs-shell: read shell variables from ceph.conf
Rishabh Dave [Wed, 28 Aug 2019 13:57:29 +0000 (19:27 +0530)]
cephfs-shell: read shell variables from ceph.conf

Read ceph.conf and initialize shell variables by reading options set
under section cephfs-shell. If there are sections/options that are
duplicated in ceph.conf, CephFS shell overrides the options with the
values last.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge PR #31897 into master
Patrick Donnelly [Fri, 6 Dec 2019 00:05:59 +0000 (16:05 -0800)]
Merge PR #31897 into master

* refs/pull/31897/head:
doc: obsolete entries for allow_standby_replay
wip-doc: entries obsoleted by allow_standby_replay

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31403 into master
Patrick Donnelly [Thu, 5 Dec 2019 23:58:26 +0000 (15:58 -0800)]
Merge PR #31403 into master

* refs/pull/31403/head:
vstart.sh: highlight presence of stray conf

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #29421 into master
Patrick Donnelly [Thu, 5 Dec 2019 21:18:49 +0000 (13:18 -0800)]
Merge PR #29421 into master

* refs/pull/29421/head:
qa/cephfs: add tests for ACLs
qa/cephfs: allow running tests from xfstests-dev
qa/tasks: add methods to get monitor's sockets
qa/cephfs: don't crash if mountpoint dir is already deleted
vstart_runner.py: set omit_sudo's default value to False
qa/vstart_runner.py: fix get_keyring_path()
qa/cephfs: don't abort if mountpoint is already present
qa/cephfs: allow specifying mountpoint for kernel mounts
qa/cephfs: allow specifying mountpoints for FUSE mounts
qa/vstart_runner.py: allow specifying mountpoint for local FUSE mounts
qa/mount.py: allow setting mountpoint
qa/vstart_runner.py: add a method to create a temporary directory

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31926 from yuvalif/wip-yuval-fix-pubsub-record-format
Casey Bodley [Thu, 5 Dec 2019 18:55:31 +0000 (13:55 -0500)]
Merge pull request #31926 from yuvalif/wip-yuval-fix-pubsub-record-format

rgw/pubsub: fix records/event json format to match documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32036 from zdover23/wip-doc-troubleshooting-pg-verb-fix
Kefu Chai [Thu, 5 Dec 2019 17:45:36 +0000 (01:45 +0800)]
Merge pull request #32036 from zdover23/wip-doc-troubleshooting-pg-verb-fix

doc: s/achieve/achieves/ (Fixed a verb disagreement)

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agodoc: obsolete entries for allow_standby_replay 31897/head
Rodrigo Severo [Thu, 5 Dec 2019 16:41:33 +0000 (13:41 -0300)]
doc: obsolete entries for allow_standby_replay

Nautilus release presented the allow_standby_replay fs setting that obsdoleted
several MDS config entries:  mds_standby_for_*, mon_force_standby_active, and
mds_standby_replay.

Removing entries instead of just marking them as "Obsolete' as per batrick
suggestion.

Signed-off-by: Rodrigo Severo <rodrigo@fabricadeideias.com>
5 years agodoc: s/achieve/achieves (Fixed a verb disagreement) 32036/head
Zac Dover [Thu, 5 Dec 2019 16:16:01 +0000 (02:16 +1000)]
doc: s/achieve/achieves (Fixed a verb disagreement)

This bug changes a clause of the form "When x remains in y status
and never achieve a z status" to a clause of the form "When x remains
in y status and never achieves a  z status".

The change is one of "achieve" to "achieves".

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #31830 from joke-lee/rgw-sts-crash-token-not-base64
Casey Bodley [Thu, 5 Dec 2019 15:41:45 +0000 (10:41 -0500)]
Merge pull request #31830 from joke-lee/rgw-sts-crash-token-not-base64

rgw: fix rgw crash when token is not base64 encode

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31483 from zhangsw/fix-rgw-reshard-left
Casey Bodley [Thu, 5 Dec 2019 15:34:31 +0000 (10:34 -0500)]
Merge pull request #31483 from zhangsw/fix-rgw-reshard-left

rgw: fix a bug that bucket instance obj can't be removed after resharding completed

Reviewed-by: Eric J. Ivancich <ivancich@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
5 years agoMerge PR #31989 into master
Sage Weil [Thu, 5 Dec 2019 15:33:52 +0000 (09:33 -0600)]
Merge PR #31989 into master

* refs/pull/31989/head:
mgr/MgrClient: fix 'tell mgr.x ...'

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30878 from zhangsw/fix-rgw-lc-zerodays
Daniel Gryniewicz [Thu, 5 Dec 2019 15:31:40 +0000 (10:31 -0500)]
Merge pull request #30878 from zhangsw/fix-rgw-lc-zerodays

rgw: Expiration days can't be zero and  transition days can be zero

5 years agoMerge PR #31795 into master
Sage Weil [Thu, 5 Dec 2019 15:09:07 +0000 (09:09 -0600)]
Merge PR #31795 into master

* refs/pull/31795/head:
mgr/ssh: 'ssh {check,prepare}-host <host>'
mgr/ssh: return err from _run_ceph_daemon
ceph-daemon: add check-host and prepare-host

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32004 into master
Sage Weil [Thu, 5 Dec 2019 15:05:11 +0000 (09:05 -0600)]
Merge PR #32004 into master

* refs/pull/32004/head:
mgr/restful: allow shutdown before we've fully started up

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30498 from jecluis/wip-mon-no-config
Kefu Chai [Thu, 5 Dec 2019 14:59:56 +0000 (22:59 +0800)]
Merge pull request #30498 from jecluis/wip-mon-no-config

mon: allow running without a config file

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31988 into master
Sage Weil [Thu, 5 Dec 2019 13:19:27 +0000 (07:19 -0600)]
Merge PR #31988 into master

* refs/pull/31988/head:
common/config: less noise about configs from mon we can't apply

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: list configured prometheus alerts (#31937)
Lenz Grimmer [Thu, 5 Dec 2019 12:25:33 +0000 (12:25 +0000)]
mgr/dashboard: list configured prometheus alerts (#31937)

mgr/dashboard: list configured prometheus alerts

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Check password complexity in Dashboard CLI comm… (#31916)
Lenz Grimmer [Thu, 5 Dec 2019 09:46:14 +0000 (09:46 +0000)]
mgr/dashboard: Check password complexity in Dashboard CLI comm… (#31916)

mgr/dashboard: Check password complexity in Dashboard CLI commands

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #31732 from aclamk/wip-vstart-osds-parallel
Kefu Chai [Thu, 5 Dec 2019 07:54:23 +0000 (15:54 +0800)]
Merge pull request #31732 from aclamk/wip-vstart-osds-parallel

vstart: Now all OSDs are starting in parallel. Use --no-parallel to revert to sequential.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31765 from rjfd/wip-fix-mon-public-addr
Kefu Chai [Thu, 5 Dec 2019 07:51:53 +0000 (15:51 +0800)]
Merge pull request #31765 from rjfd/wip-fix-mon-public-addr

ceph-mon: keep v1 address type when explicitly set

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
5 years agoMerge pull request #31876 from rosinL/wip-fix-dpdk-zero-length
Kefu Chai [Thu, 5 Dec 2019 07:43:50 +0000 (15:43 +0800)]
Merge pull request #31876 from rosinL/wip-fix-dpdk-zero-length

msg/async/dpdk: fix SEGV caused by zero length packet

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31932 from tchaikov/wip-pr-29610
Kefu Chai [Thu, 5 Dec 2019 07:42:52 +0000 (15:42 +0800)]
Merge pull request #31932 from tchaikov/wip-pr-29610

os/bluestore: print error if spdk_nvme_ns_cmd_writev() fails

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31715 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:56:05 +0000 (14:56 -0800)]
Merge PR #31715 into master

* refs/pull/31715/head:
mds: initialize the monc later in init()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31428 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:55:17 +0000 (14:55 -0800)]
Merge PR #31428 into master

* refs/pull/31428/head:
qa/tasks: Fixed AttributeError: can't set attribute
qa/tasks: drop/update name from Thrasher

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31898 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:51:04 +0000 (14:51 -0800)]
Merge PR #31898 into master

* refs/pull/31898/head:
mds: remove unnecessary debug warning

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31455 into master
Patrick Donnelly [Wed, 4 Dec 2019 22:17:40 +0000 (14:17 -0800)]
Merge PR #31455 into master

* refs/pull/31455/head:
mds: tolerate no snaprealm encoded in on-disk root inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31680 into master
Patrick Donnelly [Wed, 4 Dec 2019 21:57:42 +0000 (13:57 -0800)]
Merge PR #31680 into master

* refs/pull/31680/head:
tools/cephfs: make 'cephfs-data-scan scan_links' fix dentry's first

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31712 into master
Patrick Donnelly [Wed, 4 Dec 2019 21:54:29 +0000 (13:54 -0800)]
Merge PR #31712 into master

* refs/pull/31712/head:
fs/ceph_mds: set ceph_mds cpu affinity

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31986 into master
Patrick Donnelly [Wed, 4 Dec 2019 21:45:11 +0000 (13:45 -0800)]
Merge PR #31986 into master

* refs/pull/31986/head:
qa: test volumes plugin mount cleanup
pybind/mgr/volumes: use py3 items iterator
pybind/mgr/volumes: print errors in cleanup timer
qa: improve variable name

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #31998 from yuvalif/kafka_spins_on_cpu
Casey Bodley [Wed, 4 Dec 2019 20:36:52 +0000 (15:36 -0500)]
Merge pull request #31998 from yuvalif/kafka_spins_on_cpu

rgw/pubsub: prevent kafka thread from spinning when there are no messages

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #31975 into master
Sage Weil [Wed, 4 Dec 2019 20:11:50 +0000 (14:11 -0600)]
Merge PR #31975 into master

* refs/pull/31975/head:
doc/install/containers: note vX.Y.Z[-YYYYMMDD] tags

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
5 years agoMerge PR #31955 into master
Sage Weil [Wed, 4 Dec 2019 19:49:58 +0000 (13:49 -0600)]
Merge PR #31955 into master

* refs/pull/31955/head:
doc/foundation: add ceph foundation info here

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31893 from fghaas/doc-rbd-exclusive-locks
Jason Dillaman [Wed, 4 Dec 2019 18:38:38 +0000 (13:38 -0500)]
Merge pull request #31893 from fghaas/doc-rbd-exclusive-locks

doc: RBD exclusive locks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashboard: show alert panel if prometheus/alertmanager is unconfigured 31937/head
Patrick Seidensal [Tue, 3 Dec 2019 19:46:17 +0000 (20:46 +0100)]
mgr/dashboard: show alert panel if prometheus/alertmanager is unconfigured

If the tabs under the "Monitoring" page aren't properly configured, a
notification is shown which explains the user which setting needs to be
enabled and also provides a link to the corresponding documentation.

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge PR #31902 into master
Patrick Donnelly [Wed, 4 Dec 2019 15:57:21 +0000 (07:57 -0800)]
Merge PR #31902 into master

* refs/pull/31902/head:
doc: add description for fuse_disable_pagecache

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31948 from zdover23/wip-doc-ntp-ubuntu-chrony2
Kefu Chai [Wed, 4 Dec 2019 15:49:58 +0000 (23:49 +0800)]
Merge pull request #31948 from zdover23/wip-doc-ntp-ubuntu-chrony2

doc: add "chrony" to preflight checklist for Ubuntu 18.04

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/ssh: 'ssh {check,prepare}-host <host>' 31795/head
Sage Weil [Mon, 25 Nov 2019 17:18:09 +0000 (11:18 -0600)]
mgr/ssh: 'ssh {check,prepare}-host <host>'

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: return err from _run_ceph_daemon
Sage Weil [Mon, 25 Nov 2019 17:17:53 +0000 (11:17 -0600)]
mgr/ssh: return err from _run_ceph_daemon

Sometimes callers will want to see this.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-daemon: add check-host and prepare-host
Sage Weil [Thu, 21 Nov 2019 20:41:51 +0000 (14:41 -0600)]
ceph-daemon: add check-host and prepare-host

Check for (and/or install/configure):

- podman | docker
- systemctl
- LVM2
- chrony (or ntp or timesyncd)

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31967 from sebastian-philipp/ssh-understanding-async
Sebastian Wagner [Wed, 4 Dec 2019 15:20:01 +0000 (16:20 +0100)]
Merge pull request #31967 from sebastian-philipp/ssh-understanding-async

mgr/ssh: HACKING.rst: Add Understanding `AsyncCompletion`

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agodoc: RBD exclusive locks 31893/head
Florian Haas [Tue, 26 Nov 2019 17:25:12 +0000 (18:25 +0100)]
doc: RBD exclusive locks

A discussion on the ceph-users list uncovered a bit of uncertainty
about how exclusive locking works:

https://www.mail-archive.com/ceph-users@lists.ceph.com/msg56910.html

Add a bit of background information about exclusive locks, and
cross-reference the documentatation on OpenStack, and on CephX.

Signed-off-by: Florian Haas <florian@citynetwork.eu>
5 years agoqa: test volumes plugin mount cleanup 31986/head
Patrick Donnelly [Tue, 3 Dec 2019 23:14:49 +0000 (15:14 -0800)]
qa: test volumes plugin mount cleanup

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agopybind/mgr/volumes: use py3 items iterator
Patrick Donnelly [Tue, 3 Dec 2019 22:33:07 +0000 (14:33 -0800)]
pybind/mgr/volumes: use py3 items iterator

Otherwise this raises an exception.

Fixes: https://tracker.ceph.com/issues/43113
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agopybind/mgr/volumes: print errors in cleanup timer
Patrick Donnelly [Tue, 3 Dec 2019 22:32:24 +0000 (14:32 -0800)]
pybind/mgr/volumes: print errors in cleanup timer

The squelched error prevented us from knowing connection cleanup doesn't
work on py3.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: improve variable name
Patrick Donnelly [Wed, 4 Dec 2019 14:50:56 +0000 (06:50 -0800)]
qa: improve variable name

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agodoc/install/containers: note vX.Y.Z[-YYYYMMDD] tags 31975/head
Sage Weil [Tue, 3 Dec 2019 13:33:47 +0000 (07:33 -0600)]
doc/install/containers: note vX.Y.Z[-YYYYMMDD] tags

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc: add "chrony" to preflight checklist for Ubuntu 18.04 31948/head
Zac Dover [Mon, 2 Dec 2019 15:40:03 +0000 (01:40 +1000)]
doc: add "chrony" to preflight checklist for Ubuntu 18.04

This commit updates the "Install NTP" section of the preflight
checklist, instructing readers who are using Ubuntu 18.04 to
use the package name "chrony" where elsewhere the package name
"ntp" would be used. "chrony" has replaced "ntp" in Ubnutu 18.04.

This commit fixes Bug number 8 in the list here:
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #31972 from clwluvw/patch-1
Casey Bodley [Wed, 4 Dec 2019 13:32:00 +0000 (08:32 -0500)]
Merge pull request #31972 from clwluvw/patch-1

doc: rgw: Fixed bug on wrong name for user_id for OPA

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31906 from s0nea/wip-dashboard-fix-pg-num-warning
Laura Paduano [Wed, 4 Dec 2019 13:20:39 +0000 (14:20 +0100)]
Merge pull request #31906 from s0nea/wip-dashboard-fix-pg-num-warning

mgr/dashboard: fix tests in order to match pg num conventions

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agomgr/restful: allow shutdown before we've fully started up 32004/head
Sage Weil [Wed, 4 Dec 2019 13:13:44 +0000 (07:13 -0600)]
mgr/restful: allow shutdown before we've fully started up

Sometimes we get shutdown() before self.server has been assigned.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31797 into master
Sage Weil [Wed, 4 Dec 2019 13:10:49 +0000 (07:10 -0600)]
Merge PR #31797 into master

* refs/pull/31797/head:
qa: test mgr cephfs mount blacklist
mgr: forward RADOS client instances for potential blacklist
mon/MgrMonitor: blacklist previous instance
mon: set RUNTIME flag on mon_mds_blacklist_interval
mgr: use more efficient data structure

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31950 from dillaman/wip-mirror-peer-fsid
Mykola Golub [Wed, 4 Dec 2019 13:08:23 +0000 (15:08 +0200)]
Merge pull request #31950 from dillaman/wip-mirror-peer-fsid

rbd-mirror: peer_ping should send the local fsid to the remote

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge PR #31908 into master
Sage Weil [Wed, 4 Dec 2019 13:06:34 +0000 (07:06 -0600)]
Merge PR #31908 into master

* refs/pull/31908/head:
ceph-daemon: use uid/gid 0 when creating tempfiles
ceph-daemon: drop unneeded `mode` during tmpfile create
ceph-daemon: consolidate NamedTemporaryFile logic
ceph-daemon: chown uid/gid `ceph-volume` tmpfiles

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #31940 into master
Sage Weil [Wed, 4 Dec 2019 13:06:13 +0000 (07:06 -0600)]
Merge PR #31940 into master

* refs/pull/31940/head:
mgr/ssh: Port raising exceptions from completion handlers to Py2

Reviewed-by: Joshua Schmid <jschmid@suse.de>
5 years agomgr/dashboard: extend dashboard documentation
Patrick Seidensal [Mon, 2 Dec 2019 13:30:30 +0000 (14:30 +0100)]
mgr/dashboard: extend dashboard documentation

by adding the previously added monitoring related features as well as
the newest feature addition. Extends the documentation where necessary
to describe the Prometheus' alert configuration.

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge pull request #31990 from dzafman/wip-43084
Kefu Chai [Wed, 4 Dec 2019 04:30:11 +0000 (12:30 +0800)]
Merge pull request #31990 from dzafman/wip-43084

tools/osdmaptool.cc: do not use deprecated std::random_shuffle()

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agoqa: test mgr cephfs mount blacklist 31797/head
Patrick Donnelly [Tue, 3 Dec 2019 23:02:19 +0000 (15:02 -0800)]
qa: test mgr cephfs mount blacklist

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr: forward RADOS client instances for potential blacklist
Patrick Donnelly [Tue, 3 Dec 2019 04:27:44 +0000 (20:27 -0800)]
mgr: forward RADOS client instances for potential blacklist

The mgr creates a per-module RADOS client connection for modules which
interact with RADOS (e.g. the volumes module). These clients should also
be blacklisted when the active mgr is failed; we don't want the former
active mgr to continue interacting with RADOS when the new one takes
over. This is particularly impactful for avoiding extraneous
"unresponsive client" warnings from the MDS when the mgr switches
(especially in testing). The MDS will pickup the new OSD blacklists
which include's the old mgr's libcephfs instance and blacklist/evict
that session quietly.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomon/MgrMonitor: blacklist previous instance
Patrick Donnelly [Thu, 21 Nov 2019 20:31:16 +0000 (12:31 -0800)]
mon/MgrMonitor: blacklist previous instance

This wasn't realized as necessary early on in the ceph-mgr development
because the mgr didn't interact with RADOS. However, now it is becoming
common for plugins to store data there. It's important that the previous
instance can no longer interact with RADOS while the new mgr takes over.

In particular, this means that the mgr's client sessions with the MDS
are automatically evicted once the MDS receives the new OSDMap. This
avoids a pesky "unresponsive client" warning in the cluster logs.

Fixes: https://tracker.ceph.com/issues/42939
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomon: set RUNTIME flag on mon_mds_blacklist_interval
Patrick Donnelly [Thu, 21 Nov 2019 21:01:07 +0000 (13:01 -0800)]
mon: set RUNTIME flag on mon_mds_blacklist_interval

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr: use more efficient data structure
Patrick Donnelly [Tue, 3 Dec 2019 01:57:48 +0000 (17:57 -0800)]
mgr: use more efficient data structure

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agotools/osdmaptool.cc: do not use deprecated std::random_shuffle() 31990/head
Kefu Chai [Wed, 4 Dec 2019 00:06:40 +0000 (16:06 -0800)]
tools/osdmaptool.cc: do not use deprecated std::random_shuffle()
the use of `std::random_shuffle()` was introduced by
b946308 .

in this change, it is replaced using `std::shuffle()`.

Fixes: https://tracker.ceph.com/issues/43084
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/MgrClient: fix 'tell mgr.x ...' 31989/head
Sage Weil [Tue, 3 Dec 2019 23:56:46 +0000 (17:56 -0600)]
mgr/MgrClient: fix 'tell mgr.x ...'

If we start the command before we get the mgrmap at the client, we
will send MCommand via a different code path; make sure it behaves
correctly too.

Missed this in 6f35d2835268eade059535b62378d6d407ef9e87

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocommon/config: less noise about configs from mon we can't apply 31988/head
Sage Weil [Tue, 3 Dec 2019 23:54:44 +0000 (17:54 -0600)]
common/config: less noise about configs from mon we can't apply

It is normal to set things in teh mon config database that can't be absorbed
by clients/daemons at runtime.  Things like ms_type can/should be set there
(so that they, for instance, help produce the 'config minimal-conf') but
we don't need daemons to spit out error messages every time they get a config
update.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31891 into master
Sage Weil [Tue, 3 Dec 2019 22:49:28 +0000 (16:49 -0600)]
Merge PR #31891 into master

* refs/pull/31891/head:
qa/suites/rados/ssh: only install ceph-daemon for packaged mode
tasks/ceph2: add support for packaged ceph-daemon
qa/tasks/ceph2: make image cluster-private
qa/tasks/ceph2: add 'shell' command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #31984 into master
Sage Weil [Tue, 3 Dec 2019 22:11:21 +0000 (16:11 -0600)]
Merge PR #31984 into master

* refs/pull/31984/head:
mgr/telemetry: fix log typo

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31869 into master
Sage Weil [Tue, 3 Dec 2019 22:00:14 +0000 (16:00 -0600)]
Merge PR #31869 into master

* refs/pull/31869/head:
ceph-daemon: bootstrap: deploy initial mon via deploy_daemon()
qa/standalone/test_ceph_daemon.sh: more $SUDO
ceph-daemon: configure firewalld for new daemon deploys
ceph-daemon: name mgr the same way mgr/ssh does

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #31930 into master
Sage Weil [Tue, 3 Dec 2019 21:59:16 +0000 (15:59 -0600)]
Merge PR #31930 into master

* refs/pull/31930/head:
mgr/orchestrator: add optional "format" param for "orchestrator host ls"

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31968 from idryomov/wip-krbd-python3
Ilya Dryomov [Tue, 3 Dec 2019 20:54:41 +0000 (21:54 +0100)]
Merge pull request #31968 from idryomov/wip-krbd-python3

qa: update krbd tests for python3

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/telemetry: fix log typo 31984/head
Sage Weil [Tue, 3 Dec 2019 19:38:50 +0000 (13:38 -0600)]
mgr/telemetry: fix log typo

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31983 into master
Sage Weil [Tue, 3 Dec 2019 19:20:16 +0000 (13:20 -0600)]
Merge PR #31983 into master

* refs/pull/31983/head:
mgr/ssh/tests: fix RGWSpec test

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agorgw/pubsub: support eventId in push mode 31926/head
Yuval Lifshitz [Sun, 1 Dec 2019 18:08:12 +0000 (20:08 +0200)]
rgw/pubsub: support eventId in push mode

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agorgw/pubsub: prevent kafka thread from spinning when there are no 31998/head
Yuval Lifshitz [Tue, 3 Dec 2019 18:16:25 +0000 (20:16 +0200)]
rgw/pubsub: prevent kafka thread from spinning when there are no
messages

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agomgr/ssh/tests: fix RGWSpec test 31983/head
Sage Weil [Tue, 3 Dec 2019 18:14:47 +0000 (12:14 -0600)]
mgr/ssh/tests: fix RGWSpec test

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31973 into master
Sage Weil [Tue, 3 Dec 2019 17:32:55 +0000 (11:32 -0600)]
Merge PR #31973 into master

* refs/pull/31973/head:
mgr/crash: fix 'crash ls[-new]' sorting

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agomgr/dashboard: grafana charts match time picker selection. (#31964)
Lenz Grimmer [Tue, 3 Dec 2019 17:09:00 +0000 (17:09 +0000)]
mgr/dashboard: grafana charts match time picker selection. (#31964)

mgr/dashboard: grafana charts match time picker selection.

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
5 years agodoc/foundation: add ceph foundation info here 31955/head
Sage Weil [Mon, 2 Dec 2019 23:43:26 +0000 (17:43 -0600)]
doc/foundation: add ceph foundation info here

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31890 into master
Sage Weil [Tue, 3 Dec 2019 16:38:28 +0000 (10:38 -0600)]
Merge PR #31890 into master

* refs/pull/31890/head:
mgr/orchestrator: name rgw by client.rgw.$realm.$zone[.$id]

Reviewed-by: Ali Maredia <amaredia@redhat.com>
5 years agoMerge PR #31952 into master
Sage Weil [Tue, 3 Dec 2019 16:33:44 +0000 (10:33 -0600)]
Merge PR #31952 into master

* refs/pull/31952/head:
mgr/ssh: fix remove_osds
mgr/ssh: fix service_action

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoceph-daemon: bootstrap: deploy initial mon via deploy_daemon() 31869/head
Sage Weil [Mon, 2 Dec 2019 19:32:03 +0000 (13:32 -0600)]
ceph-daemon: bootstrap: deploy initial mon via deploy_daemon()

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/standalone/test_ceph_daemon.sh: more $SUDO
Sage Weil [Mon, 2 Dec 2019 19:33:27 +0000 (13:33 -0600)]
qa/standalone/test_ceph_daemon.sh: more $SUDO

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-daemon: configure firewalld for new daemon deploys
Sage Weil [Mon, 25 Nov 2019 23:59:40 +0000 (17:59 -0600)]
ceph-daemon: configure firewalld for new daemon deploys

Note that we only open firewalld ports; we never close them.

We could conceivably do that from rm-cluster, but that might also interfere
with something else on the host...

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoFixed bug on wrong name for user_id 31972/head
Seena Fallah [Tue, 3 Dec 2019 12:55:32 +0000 (16:25 +0330)]
Fixed bug on wrong name for user_id

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
5 years agoMerge pull request #31202 from athanatos/sjust/wip-crimson-obc
Kefu Chai [Tue, 3 Dec 2019 16:04:20 +0000 (00:04 +0800)]
Merge pull request #31202 from athanatos/sjust/wip-crimson-obc

crimson, common: Add ephemeral ObjectContext state to crimson

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: move monitoring tabs to a single page
Patrick Seidensal [Wed, 27 Nov 2019 20:34:12 +0000 (20:34 +0000)]
mgr/dashboard: move monitoring tabs to a single page

with a tab for 'active alerts', 'all alerts' and 'silences'. Due to
ambiguity with existing names, `AlertListComponent` has been renamed to
`ActiveAlertListComponent`. Introduces `MonitoringListComponent` as
first page for monitoring concerns, using path `/monitoring`.

Keeps the activated tab open, independent of the way that's used to go
back to the previous page, be it the cancel button or submit button or
the link on the breadcrumb. Also keeps the active tab open even when the
page is reloaded.

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agomgr/dashboard: refactor test of Prometheus alert service
Patrick Seidensal [Wed, 27 Nov 2019 08:14:13 +0000 (09:14 +0100)]
mgr/dashboard: refactor test of Prometheus alert service

Mocking the test the way it was removed the asynchronous nature of the
test. By using an Observable the test can stay asynchronous and be
tested as well.

Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agomgr/dashboard: list configured Prometheus alerts
Patrick Seidensal [Mon, 25 Nov 2019 12:37:50 +0000 (13:37 +0100)]
mgr/dashboard: list configured Prometheus alerts

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agomgr/dashboard: return Prometheus alert groups, too
Patrick Seidensal [Tue, 19 Nov 2019 15:45:52 +0000 (16:45 +0100)]
mgr/dashboard: return Prometheus alert groups, too

Fixes: https://tracker.ceph.com/issues/42877
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agomgr/ssh: HACKING.rst: Add Understanding `AsyncCompletion` 31967/head
Sebastian Wagner [Tue, 3 Dec 2019 09:59:43 +0000 (10:59 +0100)]
mgr/ssh: HACKING.rst: Add Understanding `AsyncCompletion`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoceph-daemon: use uid/gid 0 when creating tempfiles 31908/head
Michael Fritch [Tue, 3 Dec 2019 14:41:59 +0000 (07:41 -0700)]
ceph-daemon: use uid/gid 0 when creating tempfiles

skip extraction of the uid/gid since `ceph-volume` runs as root

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #31473 from ifed01/wip-ifed-smplify-fsck
Kefu Chai [Tue, 3 Dec 2019 14:32:25 +0000 (22:32 +0800)]
Merge pull request #31473 from ifed01/wip-ifed-smplify-fsck

os/bluestore: simplify multithreaded shallow fsck.

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31969 from sebastian-philipp/mgr-fix-mocking
Sebastian Wagner [Tue, 3 Dec 2019 14:26:23 +0000 (15:26 +0100)]
Merge pull request #31969 from sebastian-philipp/mgr-fix-mocking

pybind/mgr: Make it easier to create a Module instance without the mgr

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomgr/dashboard,grafana: remove shortcut menu (#31951)
Lenz Grimmer [Tue, 3 Dec 2019 13:56:00 +0000 (13:56 +0000)]
mgr/dashboard,grafana: remove shortcut menu (#31951)

mgr/dashboard,grafana: remove shortcut menu

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
5 years agomgr/dashboard: grafana charts match time picker selection. 31964/head
Alfonso Martínez [Tue, 3 Dec 2019 13:15:10 +0000 (14:15 +0100)]
mgr/dashboard: grafana charts match time picker selection.

Fixes: https://tracker.ceph.com/issues/43097
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
5 years agomgr/crash: fix 'crash ls[-new]' sorting 31973/head
Sage Weil [Tue, 3 Dec 2019 13:12:26 +0000 (07:12 -0600)]
mgr/crash: fix 'crash ls[-new]' sorting

Broken by c691f2f8763a9db081a0b61294c5eedf4e9c2cee

Signed-off-by: Sage Weil <sage@redhat.com>