]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agodoc/start: Update hardware recommendations. 34225/head
Mark Nelson [Thu, 26 Mar 2020 20:07:50 +0000 (15:07 -0500)]
doc/start: Update hardware recommendations.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
(cherry picked from commit 3305a0732403ba7fe58fe6248868b7711bbccc72)

5 years agoMerge PR #33939 into octopus
Sage Weil [Thu, 26 Mar 2020 14:59:31 +0000 (09:59 -0500)]
Merge PR #33939 into octopus

* refs/pull/33939/head:
mgr/dashboard: NoRebalance flag is added to the Dashboard

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge PR #34163 into octopus
Sage Weil [Thu, 26 Mar 2020 14:59:19 +0000 (09:59 -0500)]
Merge PR #34163 into octopus

* refs/pull/34163/head:
mgr: ceph_pg_* metrics contains last value instead of sum all of them

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #34185 into octopus
Sage Weil [Thu, 26 Mar 2020 14:59:07 +0000 (09:59 -0500)]
Merge PR #34185 into octopus

* refs/pull/34185/head:
mgr/cephadm: DriveGroupSpec needs to know about unmanaged attribute
mgr/cephadm: DriveGroupSpec needs to support/ignore _unmanaged_

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
5 years agoMerge PR #34186 into octopus
Sage Weil [Thu, 26 Mar 2020 14:58:55 +0000 (09:58 -0500)]
Merge PR #34186 into octopus

* refs/pull/34186/head:
mgr/cephadm: use docker.io in default container image name
mgr/cephadm: fix 'upgrade start' message when specifying a version

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34190 into octopus
Sage Weil [Thu, 26 Mar 2020 14:58:42 +0000 (09:58 -0500)]
Merge PR #34190 into octopus

* refs/pull/34190/head:
mgr/cephadm: fix 'orch ps --refresh'

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34191 into octopus
Sage Weil [Thu, 26 Mar 2020 14:58:29 +0000 (09:58 -0500)]
Merge PR #34191 into octopus

* refs/pull/34191/head:
mgr/cephadm: bind grafana to all interfaces

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #34176 from theanalyst/backports/oct-distro-fix
Abhishek L [Thu, 26 Mar 2020 12:10:46 +0000 (13:10 +0100)]
Merge pull request #34176 from theanalyst/backports/oct-distro-fix

octopus: doc: releases: add a note on debian packages & those built by the community

Reviewed-By: Sage Weil <sweil@redhat.com>
5 years agomgr/cephadm: bind grafana to all interfaces 34191/head
Sage Weil [Wed, 25 Mar 2020 15:34:21 +0000 (10:34 -0500)]
mgr/cephadm: bind grafana to all interfaces

Fixes: https://tracker.ceph.com/issues/44608
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 5f4fedbd5beeccc4792241bcfd2b81bdeb4c7d57)

5 years agomgr/cephadm: fix 'orch ps --refresh' 34190/head
Sage Weil [Wed, 25 Mar 2020 15:39:59 +0000 (10:39 -0500)]
mgr/cephadm: fix 'orch ps --refresh'

The use of host in the refresh loop was clobbering the argument value.

Fixes: https://tracker.ceph.com/issues/44513
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 764ce71bd202315fdf4403d9e1e8ae55ef849a90)

5 years agoMerge PR #34154 into octopus
Sage Weil [Thu, 26 Mar 2020 01:26:52 +0000 (20:26 -0500)]
Merge PR #34154 into octopus

* refs/pull/34154/head:
mgr/cephadm: point alertmanager at all mgr/dashboard URLs

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34155 into octopus
Sage Weil [Thu, 26 Mar 2020 01:26:39 +0000 (20:26 -0500)]
Merge PR #34155 into octopus

* refs/pull/34155/head:
debian: add ceph-grafana-dashboards package
ceph.spec: put prometheus alerts in vendor-neutral location
mgr/cephadm: include prom alerts, if present in the container

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34157 into octopus
Sage Weil [Thu, 26 Mar 2020 01:26:27 +0000 (20:26 -0500)]
Merge PR #34157 into octopus

* refs/pull/34157/head:
Add alertmanager adopt

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34158 into octopus
Sage Weil [Thu, 26 Mar 2020 01:26:11 +0000 (20:26 -0500)]
Merge PR #34158 into octopus

* refs/pull/34158/head:
Add alertmanager sample

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34160 into octopus
Sage Weil [Thu, 26 Mar 2020 01:25:58 +0000 (20:25 -0500)]
Merge PR #34160 into octopus

* refs/pull/34160/head:
mgr/orch: allow list daemons by service_name

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34153 into octopus
Sage Weil [Thu, 26 Mar 2020 01:20:26 +0000 (20:20 -0500)]
Merge PR #34153 into octopus

* refs/pull/34153/head:
mgr/cephadm: Add example to run when debugging ssh failures

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #34156 into octopus
Sage Weil [Thu, 26 Mar 2020 01:19:46 +0000 (20:19 -0500)]
Merge PR #34156 into octopus

* refs/pull/34156/head:
cephadm: init config and keyring with None
cephadm: allow config and keyring args for ceph-volume
qa/workunits/cephadm: create lvs before calling cephadm
qa/workunits/cephadm/test_cephadm.sh: move osd test to ceph-volume
qa/workunits/cephadm/test_cephadm.sh: fix mon.b failure

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agomgr/cephadm: use docker.io in default container image name 34186/head
Sage Weil [Tue, 24 Mar 2020 16:46:30 +0000 (11:46 -0500)]
mgr/cephadm: use docker.io in default container image name

Not all hosts have docker.io configured as a default registry.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit d4f367a7ea96c97c7aa437f79a1c2dabb2c7caf8)

5 years agomgr/cephadm: fix 'upgrade start' message when specifying a version
Sage Weil [Tue, 24 Mar 2020 16:07:12 +0000 (11:07 -0500)]
mgr/cephadm: fix 'upgrade start' message when specifying a version

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c6b0c28d748f7eec1455d00be15ab7f0b985ecf5)

5 years agomgr/cephadm: DriveGroupSpec needs to know about unmanaged attribute 34185/head
Joshua Schmid [Wed, 25 Mar 2020 09:53:06 +0000 (10:53 +0100)]
mgr/cephadm: DriveGroupSpec needs to know about unmanaged attribute

Signed-off-by: Joshua Schmid <jschmid@suse.de>
(cherry picked from commit f7bb0236aa601e5439875a97c2250be20956a4e7)

5 years agomgr/cephadm: DriveGroupSpec needs to support/ignore _unmanaged_
Joshua Schmid [Wed, 25 Mar 2020 08:34:06 +0000 (09:34 +0100)]
mgr/cephadm: DriveGroupSpec needs to support/ignore _unmanaged_

Signed-off-by: Joshua Schmid <jschmid@suse.de>
(cherry picked from commit bda6a47aac0d5db6a5b07c50e7ac45c4682a9d0d)

5 years agocephadm: init config and keyring with None 34156/head
Kefu Chai [Sat, 21 Mar 2020 06:07:40 +0000 (14:07 +0800)]
cephadm: init config and keyring with None

and we should not assume that both `config` and `keying` are specified
when calling this method. because, for instance, `create_daemon_dirs()`
does handle the case where `config` and/or `keyring` is not specified.

this is a follow-up fix of 245d6a5cec9cc0f299613b8cc0415e494a4c3ac5

Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 86de901d89b26920c1493e3867ddfafa9f9c95cd)

5 years agocephadm: allow config and keyring args for ceph-volume
Michael Fritch [Wed, 11 Mar 2020 00:38:29 +0000 (18:38 -0600)]
cephadm: allow config and keyring args for ceph-volume

easier to script via the cephadm tests

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit bac530f06a60d96259376cd19224bdbffce1bdc4)

5 years agodoc: releases: add a note on debian packages & those built by the community 34176/head
Abhishek Lekshmanan [Tue, 24 Mar 2020 10:49:56 +0000 (11:49 +0100)]
doc: releases: add a note on debian packages & those built by the community

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit 2cdca1ff6def0da2b6e6c67b276eaf964b02a010)

5 years agomgr: ceph_pg_* metrics contains last value instead of sum all of them 34163/head
Jacek Suchenia [Sat, 14 Mar 2020 13:12:10 +0000 (14:12 +0100)]
mgr: ceph_pg_* metrics contains last value instead of sum all of them

During evaluation of pool stats metrics contains last reported value instead of sum

Fixes: https://tracker.ceph.com/issues/44590
Signed-off-by: Jacek Suchenia <jacek.suchenia@gmail.com>
(cherry picked from commit ad4d790a35af483f3a240f247cda5754301a9199)

5 years agomgr/orch: allow list daemons by service_name 34160/head
Kiefer Chang [Tue, 10 Mar 2020 11:43:42 +0000 (19:43 +0800)]
mgr/orch: allow list daemons by service_name

Services like rgw and mds are differentiated by service_name. For
example: mds.xyz vs. mds.abc. With current interface, we can't list all
daemons belonged to mds.xyz only. Add service_name as a new argument to
filter daemons by it.

Fixes: https://tracker.ceph.com/issues/44541
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit 079c9fd7718ceb17660da61d46019c53012e0f0c)

5 years agoAdd alertmanager sample 34158/head
Eric Jackson [Fri, 13 Mar 2020 18:42:57 +0000 (14:42 -0400)]
Add alertmanager sample

Default contents of alertmanager.yml with additional peers key

Signed-off-by: Eric Jackson <swiftgist@gmail.com>
(cherry picked from commit 5cbe0c4f8fc9b7ca24a140643237e13df6851463)

5 years agoAdd alertmanager adopt 34157/head
Eric Jackson [Fri, 13 Mar 2020 18:35:54 +0000 (14:35 -0400)]
Add alertmanager adopt

Signed-off-by: Eric Jackson <swiftgist@gmail.com>
(cherry picked from commit 354d9d2d58b3991c73eb0fb9b58fcfaf9436afba)

5 years agoqa/workunits/cephadm: create lvs before calling cephadm
Jan Fajerski [Tue, 24 Mar 2020 13:53:26 +0000 (14:53 +0100)]
qa/workunits/cephadm: create lvs before calling cephadm

Fixes: https://tracker.ceph.com/issues/44682
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit ed0db2445f0de91b2ce53fd133cc8381cb234d1e)

5 years agoqa/workunits/cephadm/test_cephadm.sh: move osd test to ceph-volume
Michael Fritch [Wed, 11 Mar 2020 00:40:07 +0000 (18:40 -0600)]
qa/workunits/cephadm/test_cephadm.sh: move osd test to ceph-volume

instead of via the orchestrator

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 26b7a3f8192abbd20563bd8280f17744b64f79e8)

5 years agoqa/workunits/cephadm/test_cephadm.sh: fix mon.b failure
Michael Fritch [Thu, 19 Mar 2020 19:43:56 +0000 (13:43 -0600)]
qa/workunits/cephadm/test_cephadm.sh: fix mon.b failure

and is_available check to ensure quorum

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 90cb2feec3165817f5041a6bdc26aa0073a90e00)

5 years agodebian: add ceph-grafana-dashboards package 34155/head
Sage Weil [Fri, 20 Mar 2020 16:36:10 +0000 (11:36 -0500)]
debian: add ceph-grafana-dashboards package

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 01015f8ca320e2eab089741e5a8871a4d78c2fc2)

5 years agoceph.spec: put prometheus alerts in vendor-neutral location
Sage Weil [Fri, 20 Mar 2020 15:15:54 +0000 (10:15 -0500)]
ceph.spec: put prometheus alerts in vendor-neutral location

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f1b516d1bf44f2236c22d5a36f0363f4768e4a6b)

5 years agomgr/cephadm: include prom alerts, if present in the container
Sage Weil [Fri, 20 Mar 2020 14:27:28 +0000 (09:27 -0500)]
mgr/cephadm: include prom alerts, if present in the container

The prometheus config already looks in/etc/prometheus/alerting/*, so drop
this file into position.

Note that the file is currently only present in SUSE builds, so that needs
to be fixed still.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b1463998bddb67973b59930cc73901143d0961f8)

5 years agomgr/cephadm: point alertmanager at all mgr/dashboard URLs 34154/head
Sage Weil [Fri, 20 Mar 2020 16:12:06 +0000 (11:12 -0500)]
mgr/cephadm: point alertmanager at all mgr/dashboard URLs

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 41d0966b72b52a78aa63cb8776b07d23668526d9)

5 years agomgr/cephadm: Add example to run when debugging ssh failures 34153/head
Sebastian Wagner [Mon, 23 Mar 2020 13:27:51 +0000 (14:27 +0100)]
mgr/cephadm: Add example to run when debugging ssh failures

```
$ ceph orch host add foobar
Error ENOENT: Failed to connect to foobar (foobar).  Check that the host is reachable and accepts connections using the cephadm SSH key
you may want to run:
> ssh -F =(ceph cephadm get-ssh-config) -i =(ceph config-key get mgr/cephadm/ssh_identity_key) rook@foobar
$  ssh -F =(ceph cephadm get-ssh-config) -i =(ceph config-key get mgr/cephadm/ssh_identity_key) rook@foobar
ssh: Could not resolve hostname foobar: Temporary failure in name resolution
```

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit c840dd2204e9a419c28875ace18d33ad6f87500f)

5 years agoMerge pull request #34125 from smithfarm/wip-cbs-deprecate-octopus
Nathan Cutler [Tue, 24 Mar 2020 16:16:45 +0000 (17:16 +0100)]
Merge pull request #34125 from smithfarm/wip-cbs-deprecate-octopus

octopus: ceph-backport.sh: add deprecation warning

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #34137 from theanalyst/octopus-changelog-1
Nathan Cutler [Tue, 24 Mar 2020 15:46:10 +0000 (16:46 +0100)]
Merge pull request #34137 from theanalyst/octopus-changelog-1

octopus: doc: add changelog for octopus release

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc: add changelog for octopus release 34137/head
Abhishek Lekshmanan [Tue, 24 Mar 2020 09:29:23 +0000 (10:29 +0100)]
doc: add changelog for octopus release

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit dc7cf3fe8986de7b3e245ea04084eef51c7a0cdf)

5 years agoMerge PR #34100 into octopus 34135/head
Sage Weil [Tue, 24 Mar 2020 01:01:12 +0000 (20:01 -0500)]
Merge PR #34100 into octopus

* refs/pull/34100/head:
doc/cephadm: notes on status/stability
doc/cephadm: some troubleshooting tips

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #34115 into octopus
Sage Weil [Tue, 24 Mar 2020 01:00:58 +0000 (20:00 -0500)]
Merge PR #34115 into octopus

* refs/pull/34115/head:
doc/releases/octopus: drop stray line
doc/releases/octopus: note about repository locations
doc/releases: include octopus in index
doc/install/get-packages: update package install instructions
doc/releases/octopus: final notes

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
5 years agodoc/releases/octopus: drop stray line 34115/head
Sage Weil [Mon, 23 Mar 2020 18:54:12 +0000 (13:54 -0500)]
doc/releases/octopus: drop stray line

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc/releases/octopus: note about repository locations
Sage Weil [Mon, 23 Mar 2020 14:11:10 +0000 (09:11 -0500)]
doc/releases/octopus: note about repository locations

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc/releases: include octopus in index
Sage Weil [Mon, 23 Mar 2020 13:50:14 +0000 (08:50 -0500)]
doc/releases: include octopus in index

Signed-off-by: Sage Weil <sage@redhat.com>
5 years ago15.2.0 v15.2.0
Jenkins Build Slave User [Mon, 23 Mar 2020 17:47:45 +0000 (17:47 +0000)]
15.2.0

5 years agodoc/install/get-packages: update package install instructions
Sage Weil [Mon, 23 Mar 2020 13:49:09 +0000 (08:49 -0500)]
doc/install/get-packages: update package install instructions

- include cephadm method
- update to include new version URLs

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34119 into octopus
Sage Weil [Mon, 23 Mar 2020 17:38:24 +0000 (12:38 -0500)]
Merge PR #34119 into octopus

* refs/pull/34119/head:
doc: update octopus release notes for rgw

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
5 years agoMerge PR #34122 into octopus
Sage Weil [Mon, 23 Mar 2020 17:38:12 +0000 (12:38 -0500)]
Merge PR #34122 into octopus

* refs/pull/34122/head:
cephadm: default to v15 tag for octopus

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoceph-backport.sh: add deprecation warning 34125/head
Nathan Cutler [Mon, 7 Oct 2019 10:49:33 +0000 (12:49 +0200)]
ceph-backport.sh: add deprecation warning

The script is not maintained in the stable versions of Ceph.

This commit is not a cherry-pick from master, because the script is maintained
in master. It is unmaintained only in the stable versions, like
"octopus".

Fixes: https://tracker.ceph.com/issues/42194
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(manual cherry pick of commit 365a93bd3fe62369d33d07993dd246e9b4dd63fd)

Conflicts:
    src/script/ceph-backport.sh

5 years agocephadm: default to v15 tag for octopus 34122/head
Sage Weil [Mon, 23 Mar 2020 15:34:16 +0000 (10:34 -0500)]
cephadm: default to v15 tag for octopus

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc: update octopus release notes for rgw 34119/head
Casey Bodley [Wed, 18 Mar 2020 15:13:30 +0000 (11:13 -0400)]
doc: update octopus release notes for rgw

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 984f3ff7e0fe10f1b54da4271a2a0879ffea0ddb)

5 years agodoc/releases/octopus: final notes
Sage Weil [Mon, 23 Mar 2020 13:20:57 +0000 (08:20 -0500)]
doc/releases/octopus: final notes

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc/cephadm: notes on status/stability 34100/head
Sage Weil [Fri, 20 Mar 2020 16:40:56 +0000 (11:40 -0500)]
doc/cephadm: notes on status/stability

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34042 into octopus 34105/head
Sage Weil [Sun, 22 Mar 2020 23:32:11 +0000 (18:32 -0500)]
Merge PR #34042 into octopus

* refs/pull/34042/head:
mgr/rook: list rgw services
mgr/rook: tolerate timestamps that are None
mgr/orch: add 'subcluster' property to RGWSpec
mgr/rook: do not create radosgw pools
mgr/rook: refactor apply/add for rgw
mgr/cephadm: configure rgw_frontends for rgw service
mgr/orch: accept port and ssl flags to 'apply rgw'
python-common/ceph/deployment/service_spec: add ssl to RGWSpec
mgr/rook: fix 'orch ps' for osds

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
5 years agoMerge PR #33959 into octopus
Sage Weil [Sun, 22 Mar 2020 15:56:31 +0000 (10:56 -0500)]
Merge PR #33959 into octopus

* refs/pull/33959/head:
qa: fix all the fsx.sh-invoking yaml files to install dependencies

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34067 into octopus
Sage Weil [Sun, 22 Mar 2020 15:55:54 +0000 (10:55 -0500)]
Merge PR #34067 into octopus

* refs/pull/34067/head:
mgr/DaemonServer: add explicit check that acting matches for merge

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agomgr/DaemonServer: add explicit check that acting matches for merge 34067/head
Sage Weil [Thu, 19 Mar 2020 21:52:01 +0000 (16:52 -0500)]
mgr/DaemonServer: add explicit check that acting matches for merge

Add an explicit check that the PG acting for the source and target
match before merging.

Fixes: https://tracker.ceph.com/issues/44684
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #34040 from dillaman/wip-44396-partial-fix
Mykola Golub [Sat, 21 Mar 2020 08:22:45 +0000 (10:22 +0200)]
Merge pull request #34040 from dillaman/wip-44396-partial-fix

rbd-mirror: snapshot-based mirroring should use image sync throttler

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge PR #34098 into octopus
Sage Weil [Sat, 21 Mar 2020 02:15:23 +0000 (21:15 -0500)]
Merge PR #34098 into octopus

* refs/pull/34098/head:
cephadm: relabel /etc/ganesha mount

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agomgr/rook: list rgw services 34042/head
Sage Weil [Fri, 20 Mar 2020 21:11:24 +0000 (17:11 -0400)]
mgr/rook: list rgw services

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/rook: tolerate timestamps that are None
Sage Weil [Fri, 20 Mar 2020 21:03:57 +0000 (17:03 -0400)]
mgr/rook: tolerate timestamps that are None

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/orch: add 'subcluster' property to RGWSpec
Sage Weil [Thu, 19 Mar 2020 20:13:07 +0000 (16:13 -0400)]
mgr/orch: add 'subcluster' property to RGWSpec

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/rook: do not create radosgw pools
Sage Weil [Fri, 20 Mar 2020 18:56:47 +0000 (14:56 -0400)]
mgr/rook: do not create radosgw pools

First, we don't know how big they should be or what they should look like.
The caller should already know that, and/or radosgw can create the pools
itself.

This depends on https://github.com/rook/rook/pull/5058

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/rook: refactor apply/add for rgw
Sage Weil [Wed, 18 Mar 2020 21:20:12 +0000 (17:20 -0400)]
mgr/rook: refactor apply/add for rgw

A few caveats here:

- enforce that realm == zone, since that is all rook does at the moment.
- we force a (bad!) pool configuration, since rook requires that these
be present (instead of allowing radosgw or the caller to create the pools)

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34082 into octopus
Sage Weil [Fri, 20 Mar 2020 20:35:17 +0000 (15:35 -0500)]
Merge PR #34082 into octopus

* refs/pull/34082/head:
cephadm: switch grafana image to the ceph repo

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #34068 into octopus
Sage Weil [Fri, 20 Mar 2020 20:31:32 +0000 (15:31 -0500)]
Merge PR #34068 into octopus

* refs/pull/34068/head:
mgr/cephadm: clean up client.crash.* container_image settings after upgrade

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agocephadm: relabel /etc/ganesha mount 34098/head
Sage Weil [Fri, 20 Mar 2020 20:30:11 +0000 (15:30 -0500)]
cephadm: relabel /etc/ganesha mount

Fixes: https://tracker.ceph.com/issues/44701
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34046 into octopus
Sage Weil [Fri, 20 Mar 2020 19:50:42 +0000 (14:50 -0500)]
Merge PR #34046 into octopus

* refs/pull/34046/head:
qa/suites/rados/cephadm/upgrade: update starting version
mgr/orch: 'ceph upgrade ...' -> 'ceph orch upgrade ...'

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #34092 into octopus
Sage Weil [Fri, 20 Mar 2020 18:14:25 +0000 (13:14 -0500)]
Merge PR #34092 into octopus

* refs/pull/34092/head:
doc/releases/octopus.rst: add note about ec recovery below min_size

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #33719 from ukernel/wip-44416
Gregory Farnum [Fri, 20 Mar 2020 17:25:15 +0000 (10:25 -0700)]
Merge pull request #33719 from ukernel/wip-44416

mds: pass proper MutationImpl::LockOp to Locker::wrlock_start()

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agorbd-mirror: leader watcher should not cancel get locker if locker is invalid 34040/head
Jason Dillaman [Fri, 20 Mar 2020 16:59:14 +0000 (12:59 -0400)]
rbd-mirror: leader watcher should not cancel get locker if locker is invalid

When a new leader acquires the lock, it will send out a lock acquired
notification along with periodic heartbeats. The get locker will attempt to
run immediately, but if a heartbeat arrives before it executes the heartbeat
will cancel the timer and reschedule it for the future. This process repeats
for each periodic heartbeat and the locker is never re-read from the OSD.

This is an issue only for namespace replayers due to the delayed fashion in
which the leader instance id is retrieved.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agorbd-mirror: snapshot sync request needs to check for interruption
Jason Dillaman [Fri, 20 Mar 2020 14:54:43 +0000 (10:54 -0400)]
rbd-mirror: snapshot sync request needs to check for interruption

If the sync request was locally canceled, we need to resume the paused
shut down logic instead of just notifying the image replayer state
machine of the change -- since it had already requested a shut down and
will not re-request it.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agolibrbd: request exclusive lock when moving to trash
Jason Dillaman [Thu, 19 Mar 2020 14:57:03 +0000 (10:57 -0400)]
librbd: request exclusive lock when moving to trash

Even if the image is in-use, moving it to the trash does not
remove any data. This also solves a race between snapshot-based
mirroring shutting down and being able to move a mirrored image
to the trash.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agorbd-mirror: basic integration with sync throttling
Jason Dillaman [Wed, 18 Mar 2020 19:01:32 +0000 (15:01 -0400)]
rbd-mirror: basic integration with sync throttling

snapshot-based mirroring did not have any throttling to prevent
too many concurrent syncs from running. Since each sync might need
to iterate over every object of an image, that could potentially
put an extreme burden on the remote cluster.

A future PR will add a more intelligent throttle based on the actual
number of objects needed to be scanned.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agorbd-mirror: don't prematurely finish snapshot replay loop
Jason Dillaman [Wed, 18 Mar 2020 18:47:50 +0000 (14:47 -0400)]
rbd-mirror: don't prematurely finish snapshot replay loop

The unlink step was being incorrectly skipped if a state machine
shut down was requested.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agorbd-mirror: pass InstanceWatcher to snapshot Replayer
Jason Dillaman [Fri, 13 Mar 2020 19:52:56 +0000 (15:52 -0400)]
rbd-mirror: pass InstanceWatcher to snapshot Replayer

The replayer will request image syncs via the instance watcher in the next
commit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agodoc/releases/octopus.rst: add note about ec recovery below min_size 34092/head
Neha [Fri, 20 Mar 2020 17:13:56 +0000 (17:13 +0000)]
doc/releases/octopus.rst: add note about ec recovery below min_size

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agomgr/cephadm: configure rgw_frontends for rgw service
Sage Weil [Wed, 18 Mar 2020 21:18:46 +0000 (17:18 -0400)]
mgr/cephadm: configure rgw_frontends for rgw service

This assumes the beast frontend.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: switch grafana image to the ceph repo 34082/head
Paul Cuzner [Fri, 20 Mar 2020 02:22:31 +0000 (15:22 +1300)]
cephadm: switch grafana image to the ceph repo

Pull the pre-built grafana image from the ceph org on
docker.io

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
5 years agoMerge PR #34034 into octopus
Sage Weil [Fri, 20 Mar 2020 13:12:50 +0000 (08:12 -0500)]
Merge PR #34034 into octopus

* refs/pull/34034/head:
cephadm: make add-repo --release and --version independent

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoqa/suites/rados/cephadm/upgrade: update starting version 34046/head
Sage Weil [Thu, 19 Mar 2020 13:29:25 +0000 (08:29 -0500)]
qa/suites/rados/cephadm/upgrade: update starting version

Need upgrade command to match!

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc/cephadm: some troubleshooting tips
Sage Weil [Thu, 19 Mar 2020 20:51:08 +0000 (15:51 -0500)]
doc/cephadm: some troubleshooting tips

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #33540 into octopus
Sage Weil [Thu, 19 Mar 2020 19:56:27 +0000 (14:56 -0500)]
Merge PR #33540 into octopus

* refs/pull/33540/head:
doc/orchestrator: update rgw creation

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #34023 into octopus
Sage Weil [Thu, 19 Mar 2020 19:33:35 +0000 (14:33 -0500)]
Merge PR #34023 into octopus

* refs/pull/34023/head:
mgr/test_orchestrator: fix service filtering when using dummy data
mgr/dashboard: fix adding/removing host errors

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge PR #34044 into octopus
Sage Weil [Thu, 19 Mar 2020 18:47:29 +0000 (13:47 -0500)]
Merge PR #34044 into octopus

* refs/pull/34044/head:
remove ceph_test_rados_watch_notify

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #34030 into octopus
Sage Weil [Thu, 19 Mar 2020 17:21:52 +0000 (12:21 -0500)]
Merge PR #34030 into octopus

* refs/pull/34030/head:
cephadm: env over last used
cephadm: fall back to default for infer_image
cephadm: remove outdated check
cephadm: consolidate default image logic
cephadm: only infer image for shell, run, inspect-image, pull, ceph-volume

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
5 years agodoc/orchestrator: update rgw creation 33540/head
Yehuda Sadeh [Tue, 25 Feb 2020 00:35:52 +0000 (16:35 -0800)]
doc/orchestrator: update rgw creation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
5 years agomgr/cephadm: clean up client.crash.* container_image settings after upgrade 34068/head
Sage Weil [Thu, 19 Mar 2020 14:29:20 +0000 (09:29 -0500)]
mgr/cephadm: clean up client.crash.* container_image settings after upgrade

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34027 into octopus 34060/head
Sage Weil [Thu, 19 Mar 2020 13:22:40 +0000 (08:22 -0500)]
Merge PR #34027 into octopus

* refs/pull/34027/head:
qa/workunits/cephadm/test_cephadm: mark services unmanaged for test
mgr/cephadm: do not reconfig unmanaged services
qa/workunits/cephadm/test_cephadm: output file for pub key

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agocephadm: make add-repo --release and --version independent 34034/head
Sage Weil [Wed, 18 Mar 2020 16:40:33 +0000 (11:40 -0500)]
cephadm: make add-repo --release and --version independent

Specify either --release name (to get the latest) or --version x.y.z to
get a specific version.

Adapt to updated locations on download.ceph.com so that we don't need to
know the release name for a specific x.y.z release.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #34045 into octopus
Sage Weil [Thu, 19 Mar 2020 13:07:05 +0000 (08:07 -0500)]
Merge PR #34045 into octopus

* refs/pull/34045/head:
mgr/progress: fix duration strings

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agocephadm: env over last used 34030/head
Sage Weil [Thu, 19 Mar 2020 12:54:34 +0000 (07:54 -0500)]
cephadm: env over last used

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #34035 from dillaman/wip-rbd-permissions
Mykola Golub [Thu, 19 Mar 2020 08:43:57 +0000 (10:43 +0200)]
Merge pull request #34035 from dillaman/wip-rbd-permissions

qa/workunits/rbd: use context managers to control Rados lifespan

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agomgr/orch: accept port and ssl flags to 'apply rgw'
Sage Weil [Mon, 16 Mar 2020 20:40:59 +0000 (16:40 -0400)]
mgr/orch: accept port and ssl flags to 'apply rgw'

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/orch: 'ceph upgrade ...' -> 'ceph orch upgrade ...'
Sage Weil [Thu, 19 Mar 2020 01:56:44 +0000 (20:56 -0500)]
mgr/orch: 'ceph upgrade ...' -> 'ceph orch upgrade ...'

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: fall back to default for infer_image
Sage Weil [Wed, 18 Mar 2020 22:41:36 +0000 (17:41 -0500)]
cephadm: fall back to default for infer_image

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: remove outdated check
Sage Weil [Wed, 18 Mar 2020 20:09:41 +0000 (15:09 -0500)]
cephadm: remove outdated check

Either the user passed their own image or we filled in the (monitoring)
default--no need for this check.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: consolidate default image logic
Sage Weil [Wed, 18 Mar 2020 20:04:01 +0000 (15:04 -0500)]
cephadm: consolidate default image logic

Merge the _parse_args() logic into @default_image.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/progress: fix duration strings 34045/head
Sage Weil [Thu, 19 Mar 2020 00:04:14 +0000 (19:04 -0500)]
mgr/progress: fix duration strings

- simplify the code to just calculate the durations when we need them
(I'm not sure why we had those temporary strings!)
- use a nicer time delta format

Fixes: https://tracker.ceph.com/issues/44672
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoremove ceph_test_rados_watch_notify 34044/head
Sage Weil [Wed, 18 Mar 2020 21:29:55 +0000 (16:29 -0500)]
remove ceph_test_rados_watch_notify

This is an old test, we have good watch/notify coverage in the newer
tests, and it is buggy.

Fixes: https://tracker.ceph.com/issues/43861
Signed-off-by: Sage Weil <sage@redhat.com>