]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agomgr/cephadm: show failure cause during placement 38155/head
Michael Fritch [Thu, 12 Nov 2020 22:09:42 +0000 (15:09 -0700)]
mgr/cephadm: show failure cause during placement

the host and exception cause are not shown in the event log when a
daemon placement failure occurs

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit d0c779007d1ef0f93b376e9c0f852d62301e876e)

4 years agoqa/task/cephadm: run cephadm only on bootstrap_remote
Kyr Shatskyy [Wed, 11 Nov 2020 15:18:56 +0000 (16:18 +0100)]
qa/task/cephadm: run cephadm only on bootstrap_remote

Because not all the node in teuthology config might
have any cephadm related role we should not execute
cephadm on random node.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
(cherry picked from commit f75b00984e17a08087f41e7110fe64d4872d3200)

4 years agomgr/cephadm: validate user provided ssh_config
Michael Fritch [Thu, 12 Nov 2020 23:21:40 +0000 (16:21 -0700)]
mgr/cephadm: validate user provided ssh_config

ensure the user provided ssh_config contains a valid
`StrictHostKeyChecking` setting

Fixes: https://tracker.ceph.com/issues/48158
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 69f2f4fbd92679a8576b68ba6b3e07d215a25eae)

4 years agocephadm: install podman from the Kubic project
Michael Fritch [Mon, 2 Nov 2020 15:54:53 +0000 (08:54 -0700)]
cephadm: install podman from the Kubic project

ppa:projectatomic is no longer maintained, updates are now provided via
the Kubic project

Fixes: https://tracker.ceph.com/issues/48072
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 26937aad69b9e476f6a8d476ba4e56913e3df5d6)

4 years agoqa/suites/rados/cephadm: install podman from the Kubic project
Michael Fritch [Mon, 2 Nov 2020 15:54:35 +0000 (08:54 -0700)]
qa/suites/rados/cephadm: install podman from the Kubic project

ppa:projectatomic is no longer maintained, updates are now provided via
the Kubic project

Fixes: https://tracker.ceph.com/issues/48072
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 22605b7e98b2e9fef261d8ba111f9ebfc20590c6)

4 years agomgr/cephadm: mon to mgr service type in scheduler tests
Adam King [Mon, 5 Oct 2020 12:07:00 +0000 (08:07 -0400)]
mgr/cephadm: mon to mgr service type in scheduler tests

now that we're not deploying even number of mons, need
to use different service type for scheduler tests

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit bff5d01d0727a1c5fe21fb9041f39f750a5a9499)

4 years agomgr/cephadm: only deploy 3 mons by default when there are 4 hosts
Adam King [Wed, 30 Sep 2020 13:44:36 +0000 (09:44 -0400)]
mgr/cephadm: only deploy 3 mons by default when there are 4 hosts

Fixes: https://tracker.ceph.com/issues/47234
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 89eece8c141c4664f4f4ad066455b45afe523bc5)

4 years agocephadm: verify root privileges before log dir create
Michael Fritch [Tue, 10 Nov 2020 01:07:15 +0000 (18:07 -0700)]
cephadm: verify root privileges before log dir create

root privileges need to be verified before creating the log dir

introduced by 81a7df0

Fixes: https://tracker.ceph.com/issues/48166
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 3817c6e258f2368bdf31d4ce9eab86c682c11d6d)

4 years agomgr/cephadm: add NFS RGW keyring application tag
Michael Fritch [Wed, 28 Oct 2020 19:26:29 +0000 (13:26 -0600)]
mgr/cephadm: add NFS RGW keyring application tag

restrict the OSD keyring caps to the `rgw` application

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit d400677765b05777ad4f482919f62e4ec4e13cbf)

4 years agomgr/cephadm: clean-up NFS rgw keyring
Michael Fritch [Wed, 7 Oct 2020 19:53:01 +0000 (13:53 -0600)]
mgr/cephadm: clean-up NFS rgw keyring

remove RGW keyring during NFS daemon `post_remove`

Fixes: https://tracker.ceph.com/issues/43686
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 219c0c3d1b7f21b9bf1969b3311d313844bdd1e3)

4 years agomgr/cephadm: add RGW support for NFS ganesha
Michael Fritch [Wed, 7 Oct 2020 19:38:10 +0000 (13:38 -0600)]
mgr/cephadm: add RGW support for NFS ganesha

- create an RGW keyring for NFS daemon access
- generate RGW FSAL in ganesha.conf

Fixes: https://tracker.ceph.com/issues/43686
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 5a2ffc3dba52b9ebb55a10ed8f8dd6cc9febd1a3)

4 years agocephadm: mount RGW keyring in NFS container
Michael Fritch [Wed, 7 Oct 2020 19:37:59 +0000 (13:37 -0600)]
cephadm: mount RGW keyring in NFS container

Fixes: https://tracker.ceph.com/issues/43686
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 53c6388c5774a2fd10e2ab5a23963698a5a0e336)

4 years agomgr/cephadm: many-to-many Prometheus error
Patrick Seidensal [Mon, 26 Oct 2020 11:53:17 +0000 (12:53 +0100)]
mgr/cephadm: many-to-many Prometheus error

Fix configuration created by cephadm to prevent any "many-to-many
matching not allowed: matching labels must be unique on one side"
issues. The mgr/prometheus exporter exports suitable instance labels
itself, which can be taken over when `honor_labels` in Prometheus is set
to `true`.

Fixes: https://tracker.ceph.com/issues/47997
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
(cherry picked from commit ea8a3aca02f2adc1e68a055ab95ced207da1561a)

4 years agomgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd per host
Volker Theile [Fri, 30 Oct 2020 08:22:30 +0000 (09:22 +0100)]
mgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd per host

* Rename key name from 'lsmcli_blink_lights_cmd' to 'blink_device_light_cmd'
* Refactor TemplateMgr::render() method to use the Ceph common behavior how to name store/module option keys. The old implementation required a key like 'mgr/cephadm/services_nfs_ganesha.conf' instead of 'mgr/cephadm/services/nfs/ganesha.conf' or 'mgr/cephadm/mgr0_blink_device_light_cmd' instead of 'mgr/cephadm/mgr0/blink_device_light_cmd'.

Fixes: https://tracker.ceph.com/issues/48041
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit cd79c9912ab35ee6296d613edc7830410a141e05)

Conflicts:
doc/rados/operations/devices.rst

4 years agodoc/mgr/orchestrator: Update about "{mds, rgw} add" status in rook
Varsha Rao [Wed, 28 Oct 2020 13:37:35 +0000 (19:07 +0530)]
doc/mgr/orchestrator: Update about "{mds, rgw} add" status in rook

"mds add" and "rgw add" are no longer supported in rook. Their implementation
was removed by commits 56cfeb6 and 0580297. Instead "apply mds" and "apply rgw"
is preferred.

Signed-off-by: Varsha Rao <varao@redhat.com>
(cherry picked from commit 23b9fb6456eab167719d653402f59126a12b261b)

4 years agocephadm: Set listen-addresses on alertmanager container
diwilli [Wed, 28 Oct 2020 17:43:05 +0000 (17:43 +0000)]
cephadm: Set listen-addresses on alertmanager container

This explicitly passes web.listen-address and cluster.listen-address to the alertmanager container allowing the use of public IP addresses.

Fixes: https://tracker.ceph.com/issues/48031
Signed-off-by: Dan Williams <dw@adventsol.co.uk>
(cherry picked from commit 29730a4bc168913d5dad6d9e487d2dc58a0e3c86)

4 years agodoc: document additional journal args in cephadm logs command
Adam King [Tue, 20 Oct 2020 20:08:28 +0000 (16:08 -0400)]
doc: document additional journal args in cephadm logs command

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 5224c5baf43d057ba54d5cfcb7efdfad91efa3fa)

4 years agomgr/orchestrator: set `lsm_data` to default of Dict type
Michael Fritch [Tue, 13 Oct 2020 00:56:34 +0000 (18:56 -0600)]
mgr/orchestrator: set `lsm_data` to default of Dict type

similar to handling of `sys_api`, convert a NoneType to a Dict

Fixes: https://tracker.ceph.com/issues/47841
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 39512f9f9aa8ad6f0dab31e249ff563003c0befe)

4 years agocephadm: allow ntpsec service
Dimitri Savineau [Fri, 9 Oct 2020 17:44:32 +0000 (13:44 -0400)]
cephadm: allow ntpsec service

ntpsec is available starting Ubuntu Focal (20.04) and Debian Buster (10)
as an alternate NTP daemon.

Fixes: https://tracker.ceph.com/issues/47525
Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
(cherry picked from commit a8a64d5417d6f9ad977ea685eb74d564b1344cf3)

4 years agomgr/cephadm: adapt <placement> usage string
Joshua Schmid [Tue, 13 Oct 2020 10:48:32 +0000 (12:48 +0200)]
mgr/cephadm: adapt <placement> usage string

Signed-off-by: Joshua Schmid <jschmid@suse.de>
(cherry picked from commit 86d226471113736e864328eece5e9e34b3ae3696)

4 years agocephadm: allow uid/gid == 0 in copy_tree, copy_files, move_files
Tim Serong [Mon, 5 Oct 2020 09:14:42 +0000 (20:14 +1100)]
cephadm: allow uid/gid == 0 in copy_tree, copy_files, move_files

If the uid or gid passed to copy_tree(), copy_files() or
move_files() is 0 (the root user), the current check for
`if not uid or not gid` does the wrong thing, i.e. it
thinks the uid and/or gid aren't set, then calls out to
extract_uid_gid(), which fails when run against
prometheus/grafana/alertmanager containers.

Fixes: https://tracker.ceph.com/issues/47745
Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 768e89d9ae733c88a9e85b71b5432f8d6f511f43)

4 years agomgr/cepahdm: move convert_tags_to_repo_digest to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:44:54 +0000 (13:44 +0200)]
mgr/cepahdm: move convert_tags_to_repo_digest to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 86f5b1f16c2e859087ba5a50e9124617721ae10a)

4 years agomgr/cephadm: move _check_daemons to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:36:25 +0000 (13:36 +0200)]
mgr/cephadm: move _check_daemons to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 972feac4a9bdad5e3a10554aeb17be34bf0dedce)

4 years agomgr/cephadm: move _apply_service to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:26:46 +0000 (13:26 +0200)]
mgr/cephadm: move _apply_service to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 6b2664a9e3dd531d99b5cc7f01384298e0bdc055)

4 years agomgr/cephadm: move _apply_all_services to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:21:29 +0000 (13:21 +0200)]
mgr/cephadm: move _apply_all_services to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 3ff6a38c48aa5a113148f682af92389b13bd42aa)

4 years agomgr/cephadm: move _update_paused_health to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:14:13 +0000 (13:14 +0200)]
mgr/cephadm: move _update_paused_health to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit e927ccfdde6f90b893c8cbd73e17fad50a7d76d9)

4 years agomgr/cephadm: move _check_for_strays to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:12:21 +0000 (13:12 +0200)]
mgr/cephadm: move _check_for_strays to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 1601b699b36350f5ff21169add6c48e66c61c7eb)

4 years agomgr/cephadm: move _deploy_etc_ceph_ceph_conf to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:09:28 +0000 (13:09 +0200)]
mgr/cephadm: move _deploy_etc_ceph_ceph_conf to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 7fd92ec68065ff0e219ec7f55d6fbe41dd053835)

4 years agomgr/cephadm: move _refresh_host_osdspec_previews to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:07:36 +0000 (13:07 +0200)]
mgr/cephadm: move _refresh_host_osdspec_previews to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit d9811c3d85468dde63cb33cff6bc81334fcbb792)

4 years agomgr/cephadm: move _refresh_host_devices to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 11:05:06 +0000 (13:05 +0200)]
mgr/cephadm: move _refresh_host_devices to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit f674fa22a78e84bf573b9c7f2846e7032a1621f3)

4 years agomgr/cephadm: move _refresh_host_daemons to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 10:59:12 +0000 (12:59 +0200)]
mgr/cephadm: move _refresh_host_daemons to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 698ae220e16d97293823a45cf4fc8a7a58e5904f)

4 years agomgr/cephadm: move _check_host to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 10:54:55 +0000 (12:54 +0200)]
mgr/cephadm: move _check_host to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit d6914694003cc4de3c01d8ec7d4b05c14e8bc67f)

4 years agomgr/cephadm: move _refresh_hosts_and_daemons to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 10:49:39 +0000 (12:49 +0200)]
mgr/cephadm: move _refresh_hosts_and_daemons to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit d73dc54e4ee9150e750afe779546d0242ad176c2)

4 years agomgr/cephadm: move _serve_sleep to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 10:49:02 +0000 (12:49 +0200)]
mgr/cephadm: move _serve_sleep to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 776fd78f67b1a01c641de4c93f9a1c67e870295d)

4 years agomgr/cephadm: move serve() to serve.py
Sebastian Wagner [Fri, 11 Sep 2020 10:42:40 +0000 (12:42 +0200)]
mgr/cephadm: move serve() to serve.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 2228d59229bff1aef4ef7f8e18b9d5f6c395a51d)

4 years agomgr/cephadm: add serve.py
Sebastian Wagner [Fri, 11 Sep 2020 10:39:01 +0000 (12:39 +0200)]
mgr/cephadm: add serve.py

This module contains functions that are executed in the
serve() thread.
Meaning they don't block the CLI

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit acd6854bbc8985f8b2f6f2bfaa84f7e4c31d6660)

4 years agocephadm: Fix error setting 'mgr/cephadm/container_init' config
Ricardo Marques [Wed, 30 Sep 2020 15:32:57 +0000 (16:32 +0100)]
cephadm: Fix error setting 'mgr/cephadm/container_init' config

Fixes: https://tracker.ceph.com/issues/47501
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit cce937a599ebaf37fc0b35de19ed44afa80d1f06)

4 years agodocs: <orch osd spec> is no longer present
Joshua Schmid [Fri, 2 Oct 2020 08:22:23 +0000 (10:22 +0200)]
docs: <orch osd spec> is no longer present

Signed-off-by: Joshua Schmid <jschmid@suse.de>
(cherry picked from commit b38bc14525460e0bec7829774d2385b62d6c8742)

4 years agomgr/cephadm: do not escape HTML for custom templates
Patrick Seidensal [Fri, 25 Sep 2020 12:05:17 +0000 (14:05 +0200)]
mgr/cephadm: do not escape HTML for custom templates

Fixes: https://tracker.ceph.com/issues/47648
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
(cherry picked from commit ae9cab58e24389ded885561a763e9826cfa5c645)

4 years agomgr/cephadm: continue trying all hosts for service deployment
Dan Mick [Thu, 6 Aug 2020 02:00:57 +0000 (02:00 +0000)]
mgr/cephadm: continue trying all hosts for service deployment

One failure should not stop the attempt to start all instances.

Fixes: https://tracker.ceph.com/issues/46665
Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit dd7bd4807a1668e1fb91581c69bb549ae62611db)

4 years agomgr/cephadm: Make type annotnations for cephadm.services mandatory
Sebastian Wagner [Fri, 11 Sep 2020 15:42:44 +0000 (17:42 +0200)]
mgr/cephadm: Make type annotnations for cephadm.services mandatory

* Found a wrong default for `OSDService.create_single_host`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit fa034736b1871e637e65392921626aab049c032c)

Conflicts:
src/mypy.ini
src/pybind/mgr/cephadm/services/nfs.py

4 years agomgr/cephadm: get rbd-mirror daemon-id when checking for strays
Adam King [Wed, 23 Sep 2020 16:52:37 +0000 (12:52 -0400)]
mgr/cephadm: get rbd-mirror daemon-id when checking for strays

Currently, list_servers() gets the rbd-mirror service-id instead
of the daemon-id so the daemon is marked as stray. This PR uses
that service-id to find the daemon-id and uses that to check if
the daemon is stray.

Fixes: https://tracker.ceph.com/issues/47639
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 83d878f3d94a31c03ce94788236bd584c878a89c)

4 years agomgr/cephadm: upgrade_state can be literally "null"
Sebastian Wagner [Mon, 28 Sep 2020 13:09:16 +0000 (15:09 +0200)]
mgr/cephadm: upgrade_state can be literally "null"

Fixes: https://tracker.ceph.com/issues/47580
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 155fd9800211cf4c90cecae59b5f332ecdd665e8)

4 years agoMerge pull request #38045 from dsavineau/wip-48184-octopus
Yuri Weinstein [Fri, 13 Nov 2020 20:01:34 +0000 (12:01 -0800)]
Merge pull request #38045 from dsavineau/wip-48184-octopus

octopus: ceph-volume: fix lvm batch auto with full SSDs

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
4 years agoceph-volume: add a unit tests to lvm batch 38045/head
Guillaume Abrioux [Wed, 4 Nov 2020 14:11:58 +0000 (15:11 +0100)]
ceph-volume: add a unit tests to lvm batch

This commit adds unit tests in order to cover `_sort_rotational_disks()`
call when deploying with full hdd/ssd or mixed hdd/sdd scenarios.

Fixes: https://tracker.ceph.com/issues/48150
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
Co-authored-by: Dimitri Savineau <dsavinea@redhat.com>
(cherry picked from commit 13514a24cfdc32d67cfbc1201aa427168a926978)

4 years agoceph-volume: fix lvm batch auto with full SSDs
Dimitri Savineau [Tue, 3 Nov 2020 23:21:35 +0000 (18:21 -0500)]
ceph-volume: fix lvm batch auto with full SSDs

The ceph-volume lvm batch --auto introduced by [1] breaks the backward
compatibility when using non rotational devices only (SSD and/or NVMe).
Those devices are reaffected as bluestore db or filestore journal
devices while we want them as data devices.

Fixes: https://tracker.ceph.com/issues/48106
[1] https://github.com/ceph/ceph/pull/34740

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
(cherry picked from commit 2a854ca373fadef099a1d037930eb241e757b2c3)

4 years agoMerge pull request #37553 from Vicente-Cheng/wip-47747-octopus
Yuri Weinstein [Tue, 10 Nov 2020 19:32:18 +0000 (11:32 -0800)]
Merge pull request #37553 from Vicente-Cheng/wip-47747-octopus

octopus: mon: set session_timeout when adding to session_map

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
4 years agoMerge pull request #37885 from bk201/wip-47944-octopus
Lenz Grimmer [Mon, 9 Nov 2020 09:47:59 +0000 (10:47 +0100)]
Merge pull request #37885 from bk201/wip-47944-octopus

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
4 years agoMerge pull request #37962 from votdev/custom_container_docs
Lenz Grimmer [Mon, 9 Nov 2020 08:15:08 +0000 (09:15 +0100)]
Merge pull request #37962 from votdev/custom_container_docs

octopus: doc/mgr/orchestrator: Add hints related to custom containers to the docs

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
4 years agoMerge pull request #37857 from smithfarm/wip-47940-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:06:38 +0000 (11:06 -0800)]
Merge pull request #37857 from smithfarm/wip-47940-octopus

octopus: mon/MDSMonitor: divide mds identifier and mds real name with dot

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37856 from smithfarm/wip-47936-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:06:00 +0000 (11:06 -0800)]
Merge pull request #37856 from smithfarm/wip-47936-octopus

octopus: mds: account for closing sessions in hit_session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37855 from smithfarm/wip-47891-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:05:32 +0000 (11:05 -0800)]
Merge pull request #37855 from smithfarm/wip-47891-octopus

octopus: mgr/volumes/nfs: Fix wrong error message for pseudo path

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37854 from smithfarm/wip-46959-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:05:01 +0000 (11:05 -0800)]
Merge pull request #37854 from smithfarm/wip-46959-octopus

octopus: cephfs-journal-tool: fix incorrect read_offset when finding missing objects

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37841 from smithfarm/wip-47991-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:04:33 +0000 (11:04 -0800)]
Merge pull request #37841 from smithfarm/wip-47991-octopus

octopus: qa/cephfs: add session_timeout option support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37839 from smithfarm/wip-47989-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:04:01 +0000 (11:04 -0800)]
Merge pull request #37839 from smithfarm/wip-47989-octopus

octopus: cephfs: client: fix inode ll_ref reference count leak

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
4 years agoMerge pull request #37837 from smithfarm/wip-47954-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:03:04 +0000 (11:03 -0800)]
Merge pull request #37837 from smithfarm/wip-47954-octopus

octopus: vstart.sh: fix fs set max_mds bug

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #37724 from rishabh-d-dave/wip-46610-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:02:22 +0000 (11:02 -0800)]
Merge pull request #37724 from rishabh-d-dave/wip-46610-octopus

octopus: pybind/cephfs: add special values for not reading conffile

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37671 from Vicente-Cheng/wip-47824-octopus
Yuri Weinstein [Fri, 6 Nov 2020 19:01:36 +0000 (11:01 -0800)]
Merge pull request #37671 from Vicente-Cheng/wip-47824-octopus

octopus: mgr/volumes: Make number of cloner threads configurable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37620 from rhcs-dashboard/wip-47811-octopus
Laura Paduano [Fri, 6 Nov 2020 09:57:30 +0000 (10:57 +0100)]
Merge pull request #37620 from rhcs-dashboard/wip-47811-octopus

octopus: mgr/dashboard: get rgw daemon zonegroup name from mgr

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
4 years agoMerge pull request #37858 from smithfarm/wip-47958-octopus
Yuri Weinstein [Thu, 5 Nov 2020 16:31:28 +0000 (08:31 -0800)]
Merge pull request #37858 from smithfarm/wip-47958-octopus

octopus: mon/MDSMonitor do not ignore mds's down:dne request

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
4 years agoMerge pull request #37853 from smithfarm/wip-47826-octopus
Yuri Weinstein [Thu, 5 Nov 2020 16:27:09 +0000 (08:27 -0800)]
Merge pull request #37853 from smithfarm/wip-47826-octopus

octopus: osd/osd-rep-recov-eio.sh: TEST_rados_repair_warning:  return 1

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
4 years agoMerge pull request #37835 from smithfarm/wip-47934-octopus
Yuri Weinstein [Thu, 5 Nov 2020 16:24:10 +0000 (08:24 -0800)]
Merge pull request #37835 from smithfarm/wip-47934-octopus

octopus: tools/rados: flush formatter periodically during json output of "rados ls"

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
4 years agoMerge pull request #37819 from smithfarm/wip-47994-octopus
Yuri Weinstein [Thu, 5 Nov 2020 16:22:47 +0000 (08:22 -0800)]
Merge pull request #37819 from smithfarm/wip-47994-octopus

octopus: test/store_test: use 'threadsafe' style for death tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #37817 from smithfarm/wip-47987-octopus
Yuri Weinstein [Thu, 5 Nov 2020 16:21:55 +0000 (08:21 -0800)]
Merge pull request #37817 from smithfarm/wip-47987-octopus

octopus: mon/MonMap: fix unconditional failure for init_with_hosts

Reviewed-by: Wido den Hollander <wido@widodh.nl>
4 years agoMerge pull request #37784 from bk201/wip-47657-octopus
Lenz Grimmer [Thu, 5 Nov 2020 10:52:54 +0000 (11:52 +0100)]
Merge pull request #37784 from bk201/wip-47657-octopus

octopus: mgr/dashboard: display devices' health information within a tabset

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
4 years agodoc/mgr/orchestrator: Add hints related to custom containers to the docs 37962/head
Volker Theile [Thu, 5 Nov 2020 10:16:35 +0000 (11:16 +0100)]
doc/mgr/orchestrator: Add hints related to custom containers to the docs

Fixes: https://tracker.ceph.com/issues/48113
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 1927809b0b58243dbe84756b9cec7c29bd0a7494)

4 years agoMerge pull request #37239 from rhcs-dashboard/read_only_backport
Lenz Grimmer [Tue, 3 Nov 2020 12:59:36 +0000 (13:59 +0100)]
Merge pull request #37239 from rhcs-dashboard/read_only_backport

octopus: mgr/dashboard: Disabling the form inputs for the read_only modals

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
4 years agoMerge pull request #37530 from batrick/i47734-octopus
Yuri Weinstein [Thu, 29 Oct 2020 20:08:37 +0000 (13:08 -0700)]
Merge pull request #37530 from batrick/i47734-octopus

octopus: osdc: add timeout configs for mons/osds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37256 from batrick/i47249
Yuri Weinstein [Thu, 29 Oct 2020 20:05:53 +0000 (13:05 -0700)]
Merge pull request #37256 from batrick/i47249

octopus: mon: deleting a CephFS and its pools causes MONs to crash

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #37852 from smithfarm/wip-47889-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:50:05 +0000 (11:50 -0700)]
Merge pull request #37852 from smithfarm/wip-47889-octopus

octopus: rbd: librbd: ignore -ENOENT error when disabling object-map

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #37851 from smithfarm/wip-47888-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:49:42 +0000 (11:49 -0700)]
Merge pull request #37851 from smithfarm/wip-47888-octopus

octopus: rbd: librbd: update AioCompletion return value before evaluating pending count

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #37850 from smithfarm/wip-47886-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:49:13 +0000 (11:49 -0700)]
Merge pull request #37850 from smithfarm/wip-47886-octopus

octopus: rbd: journal: possible race condition between flush and append callback

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #37849 from smithfarm/wip-48003-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:48:31 +0000 (11:48 -0700)]
Merge pull request #37849 from smithfarm/wip-48003-octopus

octopus: rgw: fix: S3 API KeyCount incorrect return.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #37847 from smithfarm/wip-47956-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:48:02 +0000 (11:48 -0700)]
Merge pull request #37847 from smithfarm/wip-47956-octopus

octopus: rgw/gc: fix for incrementing the perf counter 'gc_retire_object'

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #37846 from smithfarm/wip-47955-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:47:19 +0000 (11:47 -0700)]
Merge pull request #37846 from smithfarm/wip-47955-octopus

octopus: rgw/gc: fixing the condition when marker for a queue is

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #37845 from smithfarm/wip-47896-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:46:49 +0000 (11:46 -0700)]
Merge pull request #37845 from smithfarm/wip-47896-octopus

octopus: rgw: use yum rather than dnf for teuthology testing of rgw-orphan-list

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
4 years agoMerge pull request #37812 from smithfarm/wip-48007-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:46:11 +0000 (11:46 -0700)]
Merge pull request #37812 from smithfarm/wip-48007-octopus

octopus: rbd: rbd-nbd: don't ignore namespace when unmapping by image spec

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
4 years agoMerge pull request #37809 from smithfarm/wip-47962-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:45:23 +0000 (11:45 -0700)]
Merge pull request #37809 from smithfarm/wip-47962-octopus

octopus: rgw: Add request timeout to beast

Reviewed-by: Friedmann <ofriedma@redhat.com>
4 years agoMerge pull request #37807 from smithfarm/wip-47960-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:44:45 +0000 (11:44 -0700)]
Merge pull request #37807 from smithfarm/wip-47960-octopus

octopus: rgw: fix expiration header returned even if there is only one tag in the object the same as the rule

Reviewed-by: Friedmann <ofriedma@redhat.com>
4 years agoMerge pull request #37803 from smithfarm/wip-47819-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:43:55 +0000 (11:43 -0700)]
Merge pull request #37803 from smithfarm/wip-47819-octopus

octopus: rgw: radosgw-admin should paginate internally when listing bucket

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #37800 from smithfarm/wip-47817-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:42:22 +0000 (11:42 -0700)]
Merge pull request #37800 from smithfarm/wip-47817-octopus

octopus: rgw: allow rgw-orphan-list to note when rados objects are in namespace

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
4 years agoMerge pull request #37779 from smithfarm/wip-47037-octopus
Yuri Weinstein [Thu, 29 Oct 2020 18:40:50 +0000 (11:40 -0700)]
Merge pull request #37779 from smithfarm/wip-47037-octopus

octopus: rgw: fix user stats iterative increment

Reviewed-by: Mark Kogan <mkogan@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agomgr/cephadm: do not configure Dashboard Ganesha settings 37885/head
Kiefer Chang [Wed, 2 Sep 2020 12:48:02 +0000 (20:48 +0800)]
mgr/cephadm: do not configure Dashboard Ganesha settings

The Dashboard can get cluster information from the Orchestrator.
For settings that are set by previous revisions, the Dashboard will
check them and ask user to remove them.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit 99e421065748c03da1fc468b2a09bf22f7bc31b0)

Conflicts:
      src/pybind/mgr/cephadm/services/nfs.py

4 years agodoc/dashboard: add information for Orchestrator NFS-Ganesha clusters
Kiefer Chang [Thu, 3 Sep 2020 14:32:12 +0000 (22:32 +0800)]
doc/dashboard: add information for Orchestrator NFS-Ganesha clusters

Fixes: https://tracker.ceph.com/issues/46492
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit a5aaaa69cc82af2a6f4b7f0bd60ce2da5015c8c2)

4 years agomgr/dashboard: support Orchestrator and user-defined Ganesha clusters
Kiefer Chang [Wed, 2 Sep 2020 12:28:36 +0000 (20:28 +0800)]
mgr/dashboard: support Orchestrator and user-defined Ganesha clusters

This change make the Dashboard support two types of Ganesha clusters:

- Orchestrator clusters (Since Octopus)
  - Deployed by the Orchestrator.
  - The Dashboard gets the pool/namespace that stores Ganesha
    configuration objects from the Orchestrator.
  - The Dashboard gets the daemons in a cluster from the Orchestrator.

- User-defined clusters (Since Nautilus)
  - Clusters defined by using `ceph dashboard
    set-ganesha-clusters-rados-pool-namespace` command is treated as
    user-defined clusters.
  - Each daemon has its own RADOS configuration objects. The
    Dashboard uses these objects to deduce daemons.

Fixes: https://tracker.ceph.com/issues/46492
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit a9accaeccf88e1b0ee4688ef2ae9ddbd3bd3dc5e)

Conflicts:
      src/pybind/mgr/dashboard/openapi.yaml
          - We don't have openapi-check feature in the Octopus. The file
            is removed in the backport.
      src/pybind/mgr/dashboard/services/ganesha.py
      src/pybind/mgr/dashboard/tests/test_ganesha.py
          - The conflicts are mainly caused by code re-format in the
    master.

4 years agomgr/dashboard: refator orchestrator service and daemon APIs
Kiefer Chang [Wed, 2 Sep 2020 12:25:52 +0000 (20:25 +0800)]
mgr/dashboard: refator orchestrator service and daemon APIs

- Allow listing services by service_type.
- Allow listing daemons by daemon_type.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit b88638873bd738af1ce258549abb6c25e0683907)

4 years agoMerge pull request #37551 from Vicente-Cheng/wip-47736-octopus
Yuri Weinstein [Wed, 28 Oct 2020 19:41:53 +0000 (12:41 -0700)]
Merge pull request #37551 from Vicente-Cheng/wip-47736-octopus

octopus: rgw: rgw_file: avoid long-ish delay on shutdown

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #37688 from bk201/wip-47822-octopus
Lenz Grimmer [Wed, 28 Oct 2020 14:56:50 +0000 (15:56 +0100)]
Merge pull request #37688 from bk201/wip-47822-octopus

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #37597 from rhcs-dashboard/wip-47792-octopus
Lenz Grimmer [Wed, 28 Oct 2020 14:54:22 +0000 (15:54 +0100)]
Merge pull request #37597 from rhcs-dashboard/wip-47792-octopus

octopus: mgr/dashboard: Add short descriptions to the telemetry report preview

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
4 years agodoc/PendingReleaseNotes: clean up for 15.2.6 37817/head
Nathan Cutler [Tue, 27 Oct 2020 20:40:38 +0000 (21:40 +0100)]
doc/PendingReleaseNotes: clean up for 15.2.6

This commit drops release notes that have already been published and
organizes the remaining release notes under a heading so it is clear
they are targeting the 15.2.6 release.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
4 years agomon/MonMap: fix unconditional failure for init_with_hosts
Patrick Donnelly [Thu, 22 Oct 2020 17:08:26 +0000 (10:08 -0700)]
mon/MonMap: fix unconditional failure for init_with_hosts

This bug prevents setting mon_host to a DNS name.

Fixes: https://tracker.ceph.com/issues/47951
Fixes: 7a1f02acfe6b5d8a760efd16bb594a0656b39eac
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 21d9f8333b8c76979bbe90d60a8ad6ebb5e36c76)

4 years agotest/mon: add tests for mon_host build by hostname
Patrick Donnelly [Fri, 23 Oct 2020 23:33:23 +0000 (16:33 -0700)]
test/mon: add tests for mon_host build by hostname

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 4022c1f1fb4c37e63bf884e36a2b533735c56f94)

Conflicts:
    src/test/mon/MonMap.cc
- do not attempt to introduce boost::intrusive_ptr into Nautilus
- monmap.build_initial takes bare cct in nautilus (master: cct.get())

4 years agotest/mon: fix compiler errors in MonMap unittest
Patrick Donnelly [Fri, 23 Oct 2020 23:28:08 +0000 (16:28 -0700)]
test/mon: fix compiler errors in MonMap unittest

The code atrophied. Clean this up.

The tests are disabled because they SIGSEGV during SetUp.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 06f44cbf12c20ce8f1862111340f3b3f132577d0)

Conflicts:
    src/test/mon/MonMap.cc
- do not attempt to introduce boost::intrusive_ptr into nautilus
- monmap.build_initial takes bare cct in nautilus (master: cct.get())

4 years agoMerge pull request #37691 from smithfarm/wip-47877-octopus
Nathan Cutler [Tue, 27 Oct 2020 16:58:32 +0000 (17:58 +0100)]
Merge pull request #37691 from smithfarm/wip-47877-octopus

octopus: doc: cephfs: improve documentation of "ceph nfs cluster create" and "ceph fs volume create" commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agostrtol: Add parse/consume for string_view friendly interface 37809/head
Adam C. Emerson [Fri, 6 Mar 2020 04:13:47 +0000 (23:13 -0500)]
strtol: Add parse/consume for string_view friendly interface

Also these don't have the stringstream overhead.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
(cherry picked from commit a29695e82ec8a93b000322773949f30694abf3d3)

4 years agomon/MDSMonitor: do not ignore mds's down:dne request 37858/head
chencan [Sat, 17 Oct 2020 07:26:51 +0000 (15:26 +0800)]
mon/MDSMonitor: do not ignore mds's down:dne request

Fixes: https://tracker.ceph.com/issues/47881
Signed-off-by: chencan <chen.can2@zte.com.cn>
(cherry picked from commit 768d7fc4e8b74c88ea2a623ee4d21ac1f20d8c7a)

4 years agomon/MDSMonitor: divide mds identifier and mds real name with dot 37857/head
Zhi Zhang [Fri, 9 Oct 2020 03:02:44 +0000 (11:02 +0800)]
mon/MDSMonitor: divide mds identifier and mds real name with dot

Fixes: https://tracker.ceph.com/issues/47806
Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
(cherry picked from commit 4400d70c15e8fb4f013ca22db9fd5fe60c99dc32)

4 years agomds: account for closing sessions in hit_session 37856/head
Dan van der Ster [Tue, 13 Oct 2020 07:08:12 +0000 (09:08 +0200)]
mds: account for closing sessions in hit_session

While stopping an mds we can reply to a request while all client
sessions are closing. We shouldn't assert in this case.

Fixes: https://tracker.ceph.com/issues/47833
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
(cherry picked from commit 6823d8fb619c07b4e749ae564df565eadc59c187)

4 years agomgr/volumes/nfs: Fix wrong error message for pseudo path 37855/head
Varsha Rao [Wed, 7 Oct 2020 17:01:01 +0000 (22:31 +0530)]
mgr/volumes/nfs: Fix wrong error message for pseudo path

Fixes: https://tracker.ceph.com/issues/47783
Signed-off-by: Varsha Rao <varao@redhat.com>
(cherry picked from commit 1552f7239c0e2dc4f661cd80f17369422c919c50)

4 years agocephfs-journal-tool: fix wrong read_offset when get missing objects 37854/head
jhonxue [Thu, 30 Jul 2020 06:40:16 +0000 (14:40 +0800)]
cephfs-journal-tool: fix wrong read_offset when get missing objects

Fixes: https://tracker.ceph.com/issues/45575
Signed-off-by: Xue Yantao <jhonxue@tencent.com>
(cherry picked from commit bfa63666bb40c7939aa4da3c2c8f43a7022a78e8)