rpm, debian: move smartmontools and nvme-cli to ceph-base

We wish to be able to scrape SMART and NVMe metrics from OSD and MON
nodes. For this we require / recommend smartmontools and nvme-cli
dependencies for both the ceph-osd and ceph-mon packages.  However, the
sudoers file (which is required for invoking `smartctl` by user 'ceph')
was installed only in the ceph-osd package.  Since different packages
cannot own the same file, and because we want to be able to scrape from
every daemon, we move the dependencies and the sudoers installation to
ceph-base. For generalization, we rename:
sudoers.d/ceph-osd-smartctl -> sudoers.d/ceph-smartctl

Fixes: https://tracker.ceph.com/issues/50657
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
(cherry picked from commit 7ca39fa92b47427af2f1c6000c653bb4dffc47fe)

Conflicts:
ceph.spec.in

Cherry-pick notes:
- Conflict in ceph.spec.in because setuptools not required for OSD in pacific

Merge pull request #44047 from rhcs-dashboard/wip-53343-pacific

pacific: mgr/dashboard: rgw daemon list: add realm column

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #44077 from rhcs-dashboard/wip-53377-pacific

pacific: mgr/dashboard: Predefine labels in create host form

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #44051 from rhcs-dashboard/wip-53364-pacific

pacific: mgr/dashboard: provisioned values is misleading in RBD image table

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #43811 from liewegas/pr-53134-pacific

pacific: backport mgr/nfs bits

Reviewed-by: Neha Ojha <nojha@redhat.com>

mgr/dashboard: Predfine labels in create host form

Also retains the previously created labels by user in the form

Fixes: https://tracker.ceph.com/issues/53315
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit e228bf7563a13cc9f0f49a086c5df391c74002b1)

Merge pull request #43931 from rhcs-dashboard/wip-52528-pacific

pacific: mgr/prometheus: offer ability to disable cache

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>

Merge pull request #44057 from rhcs-dashboard/wip-53363-pacific

pacific: mgr/dashboard: Daemon Events listing using bootstrap class

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43960 from guits/wip-53284-pacific

pacific: ceph-volume: `get_first_lv()` refactor

Merge pull request #44056 from rhcs-dashboard/wip-53366-pacific

pacific: mgr/dashboard: fix flaky inventory e2e test

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #44053 from rhcs-dashboard/wip-53297-pacific

pacific: mgr/dashboard: Device health status is not getting listed under hosts section

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: Daemon Events listing using bootstrap class

Fixes: https://tracker.ceph.com/issues/53282
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 1bad306efd628dd4940b1082c08199bbbaf0b581)

mgr/dashboard: fix flaky inventory e2e test

When `inventory.getTableCount('total').should('be.eq', totalDiskCount);`
this line is executed the table was not loaded properly and hence the
getTableCount returns 0 on the first try but on second try it passes
since the table is loaded. But in orch e2es the retries are set to 0. I
am not sure if it makes sense to set it to 1. Anyway I am adapting the
test a bit to expect the count to be equal to totalDiskCount so that the
test will wait a bit.

Fixes: https://tracker.ceph.com/issues/53353
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit cdce5f78ad4a9f4a91837322b83cee89a393a0ca)

mgr/dashboard: Device health status is not getting listed under hosts section

Device health is shown as failed to retrieve data under Hosts > Device Health section. This PR intends to fix this issue.

Fixes: https://tracker.ceph.com/issues/53209
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 8b868d20c470289c2f23049ac5dbbd2ba0307385)

Merge pull request #43972 from gregsfortytwo/wip-53259-pacific

pacific: mon: MonMap: display disallowed_leaders whenever they're set

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43971 from gregsfortytwo/wip-53239-pacific

pacific: mon: MonMap: do not increase mon_info_t's compatv in stretch mode, really

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

mgr/dashboard: provisioned values is misleading in RBD image table

Fixes: https://tracker.ceph.com/issues/46617
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Adding hint in image table similar to the one in rbd-details.

(cherry picked from commit 4ee2f2a9b79e246dfa56ad371b0718f0171eee3e)

Merge pull request #44032 from kamoltat/wip-ksirivad-backport-43999

pacific: pybind/mgr/pg_autoscale: revert to default profile scale-up

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #43925 into pacific

* refs/pull/43925/head:
doc: document subvolume (group) pins

Reviewed-by: Yuri Weinstein <yweins@redhat.com>

mgr/dashboard: rgw daemon list: add realm column

- Some refactoring and cleanup.

Fixes: https://tracker.ceph.com/issues/53301
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 8319165e9da19f885ab0cec7a578796bf831e2f8)

Merge pull request #43784 from lxbsz/wip-531121

Pacific: mds: add read/write io size metrics support

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43315 from idryomov/wip-rbd-mirror-snapshot-rx-only-pacific

pacific: rbd-mirror: unbreak one-way snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #44034 from batrick/i53347

pacific: qa: disable metrics on kernel client during upgrade

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

qa: disable metrics on kernel client during upgrade

v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit dcda5cb9ce52a1d194a461d332f6ce497ef19586)

Backport note: dropped pacific.yaml which would result in no upgrade.

PendingReleaseNotes: update release notes

Update the pending release notes explaining
why we are making the autoscaler profile
`scale-up` by default.

Signed-off-by: Kamoltat <ksirivad@redhat.com>

Merge pull request #43922 from aclamk/wip-aclamk-fix-omap-upgrade-fix-pac

Pacific: BlueStore: Omap upgrade to per-pg fix fix

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

pybind/mgr/pg_autoscale: revert to default profile scale-up

pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit a9f9f7b3fd813d429c4a539edf560d3fb6eb553b)

Conflicts:
src/pybind/mgr/pg_autoscaler/module.py - trivial fix

os/bluestore: Fix omap upgrade to per-pg scheme

This is fix to regression introduced by fix to omap upgrade: https://github.com/ceph/ceph/pull/43687
The problem was that we always skipped first omap entry.
This worked fine with objects having omap header key.
For objects without header key we skipped first actual omap key.

Fixes: https://tracker.ceph.com/issues/53307
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 65a3f374aa1c57c5bb9401e57dab98a643b4360a)

os/bluestore: Add more legacy -> per PG upgrade tests

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 0d13d64e0543ffbb95cbb0a2b00843ee0ec98331)

 Conflicts:
src/test/objectstore/store_test.cc

Merge pull request #43930 from rhcs-dashboard/wip-53092-pacific

pacific: mgr/dashboard: all pyfakefs must be pinned on same version

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: rishabh-d-dave <NOT@FOUND>

Merge pull request #43973 from rhcs-dashboard/wip-53253-pacific

pacific: mgr/dashboard: Spelling mistake in host-form Network address field

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43893 from rhcs-dashboard/wip-53221-pacific

pacific: mgr/dashboard: include mfa_ids in rgw user-details section

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43970 from ifed01/wip-ifed-fix-vol-select

pacific: os/bluestore: do not select absent device in volume selector

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>

Merge pull request #43939 from rhcs-dashboard/wip-53270-pacific

pacific: mgr/dashboard: Edit a service feature

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43975 from ivancich/wip-53291-pacific

pacific: rgw: remove prefix & delim params for bucket removal & mp upload abort

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #43805 from sunnyku/wip-53028-pacific

pacific: librbd/object_map: rbd diff between two snapshots lists entire image content

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #43924 from vshankar/wip-53217

pacific: cephfs-mirror, test: add thrasher for cephfs mirror daemon, HA test yamls

Reviewed-by: Kotresh HR khiremat@redhat.com

Merge pull request #43815 from lxbsz/wip-53164

pacific: mds: do not trim stray dentries during opening the root

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43782 from lxbsz/wip-53120

Pacific: client: do not defer releasing caps when revoking

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43702 from cfsnyder/wip-52678-pacific

pacific: qa: lengthen grace for fs map showing dead MDS

Reviewed-by: Kotresh HR khiremat@redhat.com

Merge pull request #43434 from callithea/wip-52412-pacific

pacific: snap-schedule: count retained snapshots per retention policy

Reviewed-by: Kotresh HR khiremat@redhat.com
Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43906 from sebastian-philipp/pacific-backport-43376-43602-43654-43734-42838-43454-43628-43762-43790-43737-

pacific: cephadm: November batch

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #43948 from guits/wip-53278-pacific

pacific: ceph-volume: fix bug with miscalculation of required db/wal slot size for VGs with multiple PVs

Merge pull request #43949 from guits/wip-53188-pacific

pacific: ceph-volume: fix a typo causing AttributeError

rgw: remove prefix & delim params for bucket removal & mp upload abort

The calls to remove a bucket had parameters to specify a prefix and
delimiter, which does not make sense. This was precipitated due to some
existing Swift protocol logic, but buckets are removed irrespective of
prefix and delimiter. So the functions and calls are adjusted to
remove those parameters. Additionally, those same parameters were
removed for aborting incomplete multipart uploads.

Additionally a bug is fixed in which during bucket removal, multipart
uploads were only removed if the prefix was non-empty.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry-picked from 5156e4e7ce307f8ac6ee6dc36f7e546c93d17d55)

Conflicts:
        src/rgw/rgw_sal_rados.cc
        src/rgw/rgw_sal.h
        src/rgw/rgw_sal_rados.h
  - Alterations due to Zipper 7 code refactoring
        src/rgw/rgw_sal_dbstore.cc
        src/rgw/rgw_sal_dbstore.h
  - Did not exist before Zipper 7 code refactoring

ceph-volume/tests: update setup_mixed_type playbook

we need to create a file with a larger size.
see https://github.com/ceph/ceph/pull/43300#issuecomment-951961243

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
(cherry picked from commit 8af00e25aa4ab60d0309e31f6c20edd6cd5be1ee)

ceph-volume: fix bug with miscalculation of required db/wal slot size for VGs with multiple PVs

Previous logic for calculating db/wal slot sizes made the assumption that there would only be
a single PV backing each db/wal VG. This wasn't the case for OSDs deployed prior to v15.2.8,
since ceph-volume previously deployed multiple SSDs in the same VG. This fix removes the
assumption and does the correct calculation in either case.

Fixes: https://tracker.ceph.com/issues/52730
Signed-off-by: Cory Snyder <csnyder@iland.com>
(cherry picked from commit cd6aa1329f70f89338757ba295e279ecfdbc2d07)

Merge pull request #43890 from batrick/i53231

pacific: MDSMonitor: assertion during upgrade to v16.2.5+

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43841 from vshankar/wip-52952

pacific: mds: skip journaling blocklisted clients when in `replay` state

Reviewed-by: Venky Shankar vshankar@redhat.com
Reviewed-by: Kotresh HR khiremat@redhat.com

Merge pull request #43891 from batrick/i53232

pacific: MDSMonitor: no active MDS after cluster deployment

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43828 from batrick/i53006

pacific: qa: reduce frag split confs for dir_split counter test

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #43941 from sebastian-philipp/backport-43780

pacific: doc/radosgw/nfs: add note about NFSv3 deprecation

Reviewed-by: Michael Fritch <mfritch@suse.com>

qa/suites/orch/cephadm/dashboard: Add centos_8.3_container_tools_3.0.yaml

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>

qa/suites/orch/cephadm: add 8.stream + container_tools

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit eb43f2be9c326a522946bb9ebafc9a016828a41b)

Conflicts:
qa/suites/orch/cephadm/dashboard/0-distro/centos_8.2_container_tools_3.0.yaml

cephadm: Avoid "Could not locate podman: podman not found"

Right now, we're spamming the cephadm.log on docker deployments

Fixes: https://tracker.ceph.com/issues/52869
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
(cherry picked from commit 2767766ed970bf541400e62e6216f4ac29798d43)

cephadm: fix upgrade name already in use

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
(cherry picked from commit eece84dada04b99ea5debc694e0bb3452bf94093)

mgr/cephadm: allow osd spec removal

OSD specs/drivegroups are essentially templates for OSD creation but do
not map to the full lifecycle of the OSDs that they create.  When a spec
is removed, remove it immediately.

If no --force is provided, the error lists which OSDs will be left behind.
If --force is passed, the service is removed.

This leaves behind a few oddities:

- When you list services, OSDs that were created by the drivegroup may
  still exist, causing the drivegroup to appear in the list as
  unmanaged services.
- If you create a new drivegroup with the same name, the prior OSDs will
  appear to belong to the new spec instance, regardless of whether the
  spec/drivegroup parameters are the same.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit bda5c304f33cb7a401a289d92f35b5d15f2fce15)

mgr/orchestrator: pass 'force' flag down for remove_service

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 575b7c9a98608c4f266d8e406118544916f1b8d6)

Conflicts:
src/pybind/mgr/rook/module.py

mgr/cephadm/services/osd: less noisy

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 8c1e9c05f76c43466269518a9798fe6a3b944a3e)

mgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures

These failures are normal and expected; they should not pollute the log.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 5426f6b2a4da743aeb3c3a446fbfbb69c71f6870)

mgr/orchestrator: clean up 'orch osd rm status'

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit d507e5479f6be2510e1edcab03b238ced6b41aa6)

mgr/cephadm: Fixed spawning ip addresses list for public network interface.

Eevery call of find_ip_on_host() actually  duplicates the list of public ip
addresses in self.networks, while it should NOT change it. As the result
value of key mgr/cephadm/host.<hostname> in kv store becomes very large
and may cause crash of ceph mgr.

Signed-off-by: Andrew Sharapov <andrewshar@gmail.com>
(cherry picked from commit b605b786a2ec95606a2c2791cc643dda3fbe24cc)

doc/cephadm: purge

Fixes: https://tracker.ceph.com/issues/50534
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
(cherry picked from commit ecf8b8ebde3bcb8353dd59a4abfccab86502eb39)

doc/cephadm: Calling miscellaneous ceph tools

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
(cherry picked from commit 4ac06bc9befb476cbc0350a0e1d40a9cf25af198)

cephadm: exclude zram and cdrom from device list

When compiling eligible block devices, we need to
exclude zram* and cdrom (srX) devices.

Fixes: https://tracker.ceph.com/issues/52905
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 3e7d474e1ae6eb8029a6a7d6c3f6322c4908911e)

mgr/cephadm: unit test for daemon post actions missing in cache

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
(cherry picked from commit afb7736e677daa3f65890a9dc2d5e46e9b60d71b)

mgr/cephadm: track daemon deployment post actions by daemon name instead of type

in rare cases tracking by type can cause a daemon to be missed when doing post actions if it is not in the cache yet

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
(cherry picked from commit 008b41bfc7a80d215314ece61af9291094e3f274)

cephadm: fix tracebacks that could occur during apply spec

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
(cherry picked from commit d546498bc9ab5c44ce9e90d71ee4f69fed2b8429)

cephadm: --config-json overrides --config or --keyring args

These args aren't normally combined, but if --fsid and --name are
provided, they may be inferred.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit f68f9dd7c389cbd7846c366cd528769f382c0217)

mgr/cephadm: unit test for osd preview limit warning

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 70c9c3d341f168e491d5aed22c95fade7f0067f4)

mgr/cephadm: inform users if limit set for data devices is not met

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 212f88cbbc2b4edb7976a2abff27ed9b45c5ae3b)

mgr/cephadm: Fix RGW ipv6 frontend configuration

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
(cherry picked from commit f127e0829b3c512a380bedca46b868fc0c0c7f56)

Conflicts:

  src/pybind/mgr/cephadm/tests/test_services.py

  fix tox test: AttributeError: 'HostCache' object has no
  attribute 'update_host_networks' which was introduced in
  78983ad0d0cce422da32dc4876ac186f6d32c3f5 (not yet in pacific)

mgr/cephadm: set health check warning for apply spec failures and daemon place failures in serve

Fixes: https://tracker.ceph.com/issues/44414
Signed-off-by: Melissa Li <li.melissa.kun@gmail.com>
(cherry picked from commit 1ccdd941c938d6fc3cd8996353495b28545427b1)

Conflicts:
src/pybind/mgr/cephadm/module.py
src/pybind/mgr/cephadm/serve.py

mgr/dashboard: Spelling mistake in host-form Network address field

Fixes: https://tracker.ceph.com/issues/53215
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 14b62820371a2e031937443b2b6fb49c2b8cb30b)

Merge pull request #43937 from neha-ojha/wip-42709-pacific

pacific: qa/tasks/kubeadm: force docker cgroup engine to systemd

Reviewed-by: Joseph Sawaya <jsawaya@redhat.com>

mon: MonMap: display disallowed_leaders whenever they're set

In c59a6f89465e3933631afa2ba92e8c1ae1c31c06, I erroneously changed
the CLI display output so it would only dump disallowed_leaders in
stretch mode. But they can also be set in connectivity or disallow
election modes and we want users to be able to see them then as well.

Fixes: https://tracker.ceph.com/issues/53258
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 1e34788f9af6fd02288daddc659e24834299bafd)

mon: MonMap: do not increase mon_info_t's compatv in stretch mode, for real

This was supposed to be fixed a year ago in commit
2e3643647bfbe955b54c62c8aaf114744dedb86e, but it set compat_v to 4 instead of all
the way back to 1 as it should have.

Our testing for stretch mode in these areas is just not very thorough -- the
kernel only supports compat_v 1 and apparently nobody's noticed the issue
since then? :/
As the prior commit says, you can't set locations without being gated on a
server feature bit, so simply cancelling this enforcement is completely safe.

Fixes: https://tracker.ceph.com/issues/53237
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit ccb1b7eb8baf5f222109e77c168db39e699b6934)

os/bluestore: do not select absent device in volume selector

Fixes: ttps://tracker.ceph.com/issues/53139
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 39132b0e460d2d667f02019335dced50d5db641d)

doc: document subvolume (group) pins

Fixes: https://tracker.ceph.com/issues/53236
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 6e569bfd1407fb16b66c2b5a758ba6456b9661e2)

ceph-volume: `get_first_*()` refactor

As indicated by commit 17957d9beb42a04b8f180ccb7ba07d43179a41d3 those
fuctions were meant to avoid writing something like following:

```
lvs = get_lvs()
if len(lvs) >= 1:
lvs = lv[0]
```

Those functions should return `None` if 0 or more than 1 item is returned.
The current name of these functions are confusing and can lead to thinking that
we just want the first item returned, even though it returns more than 1
item, let's rename them to `get_single_pv()`, `get_single_vg()` and
`get_single_lv()`

Closes: https://tracker.ceph.com/issues/49643
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
(cherry picked from commit a5e4216b49704783c55fb83b3ae6dde35b0082ad)

ceph-volume: fix a typo causing AttributeError

Signed-off-by: Taha Jahangir <mtjahangir@gmail.com>
(cherry picked from commit 4cdbba3344fe26b6351e88ce00a8655890a02115)

doc/radosgw/nfs: add note about NFSv3 deprecation

cephadm and rook based deployments have deprecated
the NFSv3 deprecated in favor of NFSv4

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit a4fa3dd71474f48e898ae604fd398154ce91b49c)

mgr/dashboard: Edit a service feature

Fixes: https://tracker.ceph.com/issues/53077
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 3c3d8822d432186f6be9cb2d2603de7611aa0abb)

Merge pull request #43731 from ifed01/wip-ifed-multiple-backports-pac

pacific: os/bluestore: multiple repair fixes

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #43697 from cfsnyder/wip-52844-pacific

pacific: mon,auth: fix proposal (and mon db rebuild) of rotating secrets

Reviewed-by: Neha Ojha <nojha@redhat.com>

qa/tasks/kubeadm: force docker cgroup engine to systemd

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 517b7759b3ab2b84b2a4ddace411e6ac7599eddd)

mgr/prometheus: offer ability to disable cache

Fixes: https://tracker.ceph.com/issues/52414
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
(cherry picked from commit df7d30ca5b7965f8ea8e617ef682e9a1168c6ec3)

Conflicts:
doc/mgr/prometheus.rst
        - Ignore missing commit f2750a7912a3af22ad35e223006827f2871903c4

mgr/dashboard: all pyfakefs must be pinned on same version

Without this patch execution of install-deps.sh fails with an error.

Fixes: https://tracker.ceph.com/issues/53088
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 24d3a01a3019d30fc1d4dc4963a3942665243a48)

Merge pull request #43756 from ifed01/wip-ifed-fix-write-small-head-pad-pac

pacific: os/bluestore: _do_write_small fix head_pad

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

test: add cephfs-mirror HA active/active workunit and test yamls

Fixes: http://tracker.ceph.com/issues/50372
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit e7bdf7fb35e57c01e05d24e2f3ec6d6c7fcdcf0a)

test: add cephfs_mirror thrasher

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 3a4dd30a1e385039c01675bd3fa8c785ebc66286)

tasks/cephfs_mirror: optionally run in foreground

cephfs mirror damon thrasher needs to send SIGTERM to mirror
daemons. The mirror daemon needs to run in foreground for
it to receive signal via `daemon.signal`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 087d7aa8ca4de05cf5162be54996aec90724a540)

mgr/mirroring: throttle directory reassigment to mirror daemons

This is to avoid over-shuffling directories when lots of mirror
daemons come and go.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit e253f685382efd7fa82849fb5eb4ad803099ca73)

Merge pull request #43918 from ideepika/wip-remain-ssd-cache-pacific

pacific: librbd/cache/pwl: SSD caching backports

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>

qa/suites/rbd/persistent-writeback-cache: add test case

Add the test case which size is 8GB, So that some problems that occur
only in test scenarios above 4GB may be found in this test. For example,
the variables of 32-bit may be unexpected value when it operates with
a 64 bit value.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
(cherry picked from commit 3da4a9401c887f9fa92d090786c5ef2121665bd2)

librbd/cache/pwl/ssd: add layout version control

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
(cherry picked from commit dc566a3cd30d91ecbe87cb049df5e9462a526b6d)

librbd/cache/pwl/ssd: make log entry pointers 64 bit (on-disk format change)

Fixes: https://tracker.ceph.com/issues/50675
Signed-off-by: Yin Congmin <congmin.yin@intel.com>
(cherry picked from commit c091ec3471973f41717b237d500b8e4374af660f)

librbd/cache/pwl: fix reorder issue between func process_writeback_dirty_entries

In fact, we not only make sure ops in order in func process_writeback_dirty_entries,
but also make sure ops in order between func process_writeback_dirty_entries.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 76f4d29d92be3f9f45767cb1ac6cc50da528ecec)

Merge pull request #43823 from adamemerson/wip-53160-pacific

pacific: rgw: Ensure buckets too old to decode a layout have layout logs

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: include mfa_ids in rgw user-details section

Fixes: https://tracker.ceph.com/issues/53193
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Introducing mfa_ids in user details section.

(cherry picked from commit 6a2234cd6b68adaa0b855219c411eb95eb2ff9be)