mgr/dashboard: Downstream branding

Adds the downstream branding to the ceph dashboard.

- New sign in page
- New about dialog
- Changed color scheme
- Replaced logos

Update on 04.09.2020 - Fixed bz:1175169, bz:1175161
Update on 25.09.2020 - Fixed bz:1175120

Signed-off-by: Sebastian Krah <skrah@suse.com>
(cherry picked from commit 7563f3305a12f155c5d171e93434f1372b977ae9)

Conflicts:
  src/pybind/mgr/dashboard/frontend/src/app/shared/services/doc.service.ts
  src/pybind/mgr/dashboard/frontend/src/app/shared/services/doc.service.spec.ts
  src/pybind/mgr/dashboard/frontend/src/styles/vendor.overrides.scss
  src/pybind/mgr/dashboard/frontend/src/styles/vendor.variables.scss

qa/tasks/cep_salt: Fix timeserver path

Change timeserver path in ceph-salt as per changes on https://github.com/ceph/ceph-salt/pull/439

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

qa/ceph_salt: Fix ceph image path config

The ceph image path config node was renamed in ceph-salt 15.2.11.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

qa/tasks/ceph_salt: gather /var/log/ceph/cephadm.out

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

qa/tasks/salt_manager: allow gatherlogs for files in subdir

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

qa/ceph_salt: add opensuse and sle 15.3 distro

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

mgr/zabbix: adapt zabbix_sender default path

Adapt zabbix_sender default path in Ceph to work for SUSE built container
images, where the `zabbix-agent` package installs `zabbix_sender` to
`/usr/sbin/zabbix_sender`.

Fixes: https://bugzilla.suse.com/show_bug.cgi?id=1186348
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>

qa/tasks/ceph_salt.py: Fix ceph-salt registries

Fixing the path for adding the registry on ceph-salt that was introduced
by MR #262
(https://github.com/ceph/ceph-salt/commit/407853ad5367d79c4378e19e29b31d13f938f306)

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

qa/tasks/ceph_salt: Add Containers as parameters

Add registries and containers via yaml files in order to be able to have
different ones for each case.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

qa/tasks/salt: fix module path for py3

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

qa/tasks/salt_manager: Change Salt master role

Adding as optional  parameter in the constructor the teuthology role that will be
used as the salt master.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

qa: Cleaning deepsea from ses7

Removing all deepsea related files from ses7.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

tasks/util: add exception on remote_exec

Adding currently unhandled NoValidConnectionsError exception

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

qa: Ceph-salt task + suite

Adding Ceph-salt task and a basic suite under qa/suites/ceph_salt.
Also changed suse suite to point to ceph-salt instead of deepsea.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>

Revert "qa/suites/suse: delete link to tier1"

This reverts commit f2237253cd4d2801388d10910b9d1ddd005c9c14.

qa/suites/suse: delete link to tier1

Signed-off-by: Nathan Cutler <ncutler@suse.com>

qa/caasp: switch to sle_15.2

qa/tasks: add caasp deployement support

qa/deepsea/distros: Switch to sle_15.2 and opensuse_15.2

SES7 will be based on SLE 15 SP2 so we want to test on that
version. Also when testing on openSUSE Leap, use the corresponding
version which is 15.2

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>

qa/deepsea/boilerplate: drop "ceph_cm: salt"

This was deprecated long ago in favor of "ceph_cm_ansible: disable".

Signed-off-by: Nathan Cutler <ncutler@suse.com>

qa/tasks/scripts: forward-port dump_drive_groups_yml.sh

Signed-off-by: Nathan Cutler <ncutler@suse.com>

qa/deepsea: forward-port basic (tier{0,1}) tests from SES6

Fixes: https://jira.suse.com/browse/SES-1049
Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph.spec.in: reinstate minimal_debugging_information bcond

This bcond was in our downstream builds up until SES5, but somehow
got dropped in SES6.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

rpm: drop Provides: libradosstriper1

The "Obsoletes: libradosstriper1" should be enough for the SES5->6
dist-upgrade to complete.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

build/ops: rpm: make ceph-common provide/obsolete libradosstriper1

The purpose of this commit is to address package conflict issues
with the luminous->nautilus upgrade.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph.spec.in: instrument RPM_LD_FLAGS to see its value

Signed-off-by: Nathan Cutler <ncutler@suse.com>

make-dist: respect Factory rules downstream

In Tumbleweed and SLE, it is not allowed to use <B_CI> and <B_CNT>. The
Release field must be populated exclusively by the OBS.

Use "opensuse*" to support Tumbleweed and newer versions of Leap.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
Conflicts:
make-dist

ceph.spec.in: remove hard versioned dependency of ceph-test on ceph-common

OBS builds the ceph-test RPM separately from the normal Ceph RPMs, and
ceph-test is shipped on the Internal Media. I also found that OBS has no
problem producing ceph-test RPM with a slightly different version number than
the Ceph RPMs, with the result that it cannot be installed due to this hard
versioned dependency in the spec file.

Upstream doesn't have this problem because they always build ceph-test along
with the other RPMs.

We don't really need the hard versioned dependency. It's convenient to have,
but not absolutely necessary. I would rather add version sanity-checking code
to the test cases that use the ceph-test RPM, than to have all test cases
fail because ceph-test cannot be installed.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph.spec.in: move ceph-dencoder to ceph-base

ceph-dencoder introduces a librgw2 runtime dependency that is undesirable in
SLES.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 19e510cb37551765c5f8c5c90fd56edf9a283499)

Conflicts:
ceph.spec.in

ceph.spec.in: replace pwdutils dependency with shadow

pwdutils has been deprecated for a long time, apparently

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 798d60f2a1a60b5651b0c210d5a5db6de4ea199c)
(cherry picked from commit 6f3754df99e21b8a6074315dd166f52f99adec9e)

ceph.spec.in: add Prereq: permissions to radosgw package

To eliminate an RPMLINT warning.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 7f66c619fd1e746a608168ac234a1cfef9dd7c53)
(cherry picked from commit bfa77ed09a10a2d7ac9d13b96592f5e0886a4c2c)

ceph.spec.in: move cephfs-* fsck tools to ceph-base

cephfs fsck should not be run from SLES clients, as they might be outdated.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit d0f3107d9f586b4a177bc940c0629fedc3978c93)

Conflicts:
ceph.spec.in

ceph.spec.in: drop ceph-brag and ceph-post-file

ceph-brag is unmaintained

ceph-post-file uses sftp to upload logfiles to an inktank server

Neither are appropriate for SUSE.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit e60792a1006179adc39ce55f9b78ee5bca0b1bf2)

16.2.7

Merge pull request #44201 from sebastian-philipp/qa-suites-orch-cephadm-mgr-nfs-upgrade-0-distro-pacific

qa/suites/orch/cephadm: mgr-nfs-upgrade: add missing 0-distro dir

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #44164 from cfsnyder/wip-52450-pacific

pacific: rpm, debian: move smartmontools and nvme-cli to ceph-base

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>

Merge pull request #44154 from neha-ojha/wip-perf-pacific

pacific: qa: miscellaneous perf suite fixes

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>

rpm, debian: move smartmontools and nvme-cli to ceph-base

We wish to be able to scrape SMART and NVMe metrics from OSD and MON
nodes. For this we require / recommend smartmontools and nvme-cli
dependencies for both the ceph-osd and ceph-mon packages.  However, the
sudoers file (which is required for invoking `smartctl` by user 'ceph')
was installed only in the ceph-osd package.  Since different packages
cannot own the same file, and because we want to be able to scrape from
every daemon, we move the dependencies and the sudoers installation to
ceph-base. For generalization, we rename:
sudoers.d/ceph-osd-smartctl -> sudoers.d/ceph-smartctl

Fixes: https://tracker.ceph.com/issues/50657
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
(cherry picked from commit 7ca39fa92b47427af2f1c6000c653bb4dffc47fe)

Conflicts:
ceph.spec.in

Cherry-pick notes:
- Conflict in ceph.spec.in because setuptools not required for OSD in pacific

qa/suites/orch/cephadm: mgr-nfs-upgrade: add missing 0-distro dir

move qa/suites/orch/cephadm/mgr-nfs-upgrade/0-*

to qa/suites/orch/cephadm/mgr-nfs-upgrade/0-distro/*

Fixes: https://tracker.ceph.com/issues/53365
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>

qa/suites/rados/perf/ceph.yaml: remove rgw

This is no longer required because we removed cosbench workloads in
fd350fd0150a2d4072f055658c20314a435a19ba. This is also required to prevent
failures like the following or any other changes that break the rgw task:

```
2021-08-06T20:13:25.812 INFO:teuthology.orchestra.run.smithi060.stderr:curl: (7) Failed to connect to smithi060.front.sepia.ceph.com port 80: Connection refused
2021-08-06T20:15:33.813 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/contextutil.py", line 31, in nested
    vars.append(enter())
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_3c0f8c8164075af7aac4d1f2805d3f4580709461/qa/tasks/rgw.py", line 191, in start_rgw
    wait_for_radosgw(url, remote)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_3c0f8c8164075af7aac4d1f2805d3f4580709461/qa/tasks/util/rgw.py", line 94, in wait_for_radosgw
    assert exit_status == 0
AssertionError
```

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 119544bb29e253322af33e593ffd09e325c2af8a)

qa: remove cosbench workloads from perf suites

Due to https://tracker.ceph.com/issues/49139

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit fd350fd0150a2d4072f055658c20314a435a19ba)

qa: use ubuntu_latest for perf suites

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 5957d1797a4f67b4545c2554dff240463af87359)

Merge pull request #44047 from rhcs-dashboard/wip-53343-pacific

pacific: mgr/dashboard: rgw daemon list: add realm column

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #44077 from rhcs-dashboard/wip-53377-pacific

pacific: mgr/dashboard: Predefine labels in create host form

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #44051 from rhcs-dashboard/wip-53364-pacific

pacific: mgr/dashboard: provisioned values is misleading in RBD image table

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #43811 from liewegas/pr-53134-pacific

pacific: backport mgr/nfs bits

Reviewed-by: Neha Ojha <nojha@redhat.com>

mgr/dashboard: Predfine labels in create host form

Also retains the previously created labels by user in the form

Fixes: https://tracker.ceph.com/issues/53315
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit e228bf7563a13cc9f0f49a086c5df391c74002b1)

Merge pull request #43931 from rhcs-dashboard/wip-52528-pacific

pacific: mgr/prometheus: offer ability to disable cache

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>

Merge pull request #44057 from rhcs-dashboard/wip-53363-pacific

pacific: mgr/dashboard: Daemon Events listing using bootstrap class

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43960 from guits/wip-53284-pacific

pacific: ceph-volume: `get_first_lv()` refactor

Merge pull request #44056 from rhcs-dashboard/wip-53366-pacific

pacific: mgr/dashboard: fix flaky inventory e2e test

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #44053 from rhcs-dashboard/wip-53297-pacific

pacific: mgr/dashboard: Device health status is not getting listed under hosts section

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: Daemon Events listing using bootstrap class

Fixes: https://tracker.ceph.com/issues/53282
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 1bad306efd628dd4940b1082c08199bbbaf0b581)

mgr/dashboard: fix flaky inventory e2e test

When `inventory.getTableCount('total').should('be.eq', totalDiskCount);`
this line is executed the table was not loaded properly and hence the
getTableCount returns 0 on the first try but on second try it passes
since the table is loaded. But in orch e2es the retries are set to 0. I
am not sure if it makes sense to set it to 1. Anyway I am adapting the
test a bit to expect the count to be equal to totalDiskCount so that the
test will wait a bit.

Fixes: https://tracker.ceph.com/issues/53353
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit cdce5f78ad4a9f4a91837322b83cee89a393a0ca)

mgr/dashboard: Device health status is not getting listed under hosts section

Device health is shown as failed to retrieve data under Hosts > Device Health section. This PR intends to fix this issue.

Fixes: https://tracker.ceph.com/issues/53209
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 8b868d20c470289c2f23049ac5dbbd2ba0307385)

Merge pull request #43972 from gregsfortytwo/wip-53259-pacific

pacific: mon: MonMap: display disallowed_leaders whenever they're set

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43971 from gregsfortytwo/wip-53239-pacific

pacific: mon: MonMap: do not increase mon_info_t's compatv in stretch mode, really

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

mgr/dashboard: provisioned values is misleading in RBD image table

Fixes: https://tracker.ceph.com/issues/46617
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Adding hint in image table similar to the one in rbd-details.

(cherry picked from commit 4ee2f2a9b79e246dfa56ad371b0718f0171eee3e)

Merge pull request #44032 from kamoltat/wip-ksirivad-backport-43999

pacific: pybind/mgr/pg_autoscale: revert to default profile scale-up

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #43925 into pacific

* refs/pull/43925/head:
doc: document subvolume (group) pins

Reviewed-by: Yuri Weinstein <yweins@redhat.com>

mgr/dashboard: rgw daemon list: add realm column

- Some refactoring and cleanup.

Fixes: https://tracker.ceph.com/issues/53301
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 8319165e9da19f885ab0cec7a578796bf831e2f8)

Merge pull request #43784 from lxbsz/wip-531121

Pacific: mds: add read/write io size metrics support

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43315 from idryomov/wip-rbd-mirror-snapshot-rx-only-pacific

pacific: rbd-mirror: unbreak one-way snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #44034 from batrick/i53347

pacific: qa: disable metrics on kernel client during upgrade

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

qa: disable metrics on kernel client during upgrade

v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit dcda5cb9ce52a1d194a461d332f6ce497ef19586)

Backport note: dropped pacific.yaml which would result in no upgrade.

PendingReleaseNotes: update release notes

Update the pending release notes explaining
why we are making the autoscaler profile
`scale-up` by default.

Signed-off-by: Kamoltat <ksirivad@redhat.com>

Merge pull request #43922 from aclamk/wip-aclamk-fix-omap-upgrade-fix-pac

Pacific: BlueStore: Omap upgrade to per-pg fix fix

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

pybind/mgr/pg_autoscale: revert to default profile scale-up

pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit a9f9f7b3fd813d429c4a539edf560d3fb6eb553b)

Conflicts:
src/pybind/mgr/pg_autoscaler/module.py - trivial fix

os/bluestore: Fix omap upgrade to per-pg scheme

This is fix to regression introduced by fix to omap upgrade: https://github.com/ceph/ceph/pull/43687
The problem was that we always skipped first omap entry.
This worked fine with objects having omap header key.
For objects without header key we skipped first actual omap key.

Fixes: https://tracker.ceph.com/issues/53307
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 65a3f374aa1c57c5bb9401e57dab98a643b4360a)

os/bluestore: Add more legacy -> per PG upgrade tests

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 0d13d64e0543ffbb95cbb0a2b00843ee0ec98331)

 Conflicts:
src/test/objectstore/store_test.cc

Merge pull request #43930 from rhcs-dashboard/wip-53092-pacific

pacific: mgr/dashboard: all pyfakefs must be pinned on same version

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: rishabh-d-dave <NOT@FOUND>

Merge pull request #43973 from rhcs-dashboard/wip-53253-pacific

pacific: mgr/dashboard: Spelling mistake in host-form Network address field

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43893 from rhcs-dashboard/wip-53221-pacific

pacific: mgr/dashboard: include mfa_ids in rgw user-details section

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43970 from ifed01/wip-ifed-fix-vol-select

pacific: os/bluestore: do not select absent device in volume selector

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>

Merge pull request #43939 from rhcs-dashboard/wip-53270-pacific

pacific: mgr/dashboard: Edit a service feature

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #43975 from ivancich/wip-53291-pacific

pacific: rgw: remove prefix & delim params for bucket removal & mp upload abort

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #43805 from sunnyku/wip-53028-pacific

pacific: librbd/object_map: rbd diff between two snapshots lists entire image content

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #43924 from vshankar/wip-53217

pacific: cephfs-mirror, test: add thrasher for cephfs mirror daemon, HA test yamls

Reviewed-by: Kotresh HR khiremat@redhat.com

Merge pull request #43815 from lxbsz/wip-53164

pacific: mds: do not trim stray dentries during opening the root

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43782 from lxbsz/wip-53120

Pacific: client: do not defer releasing caps when revoking

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43702 from cfsnyder/wip-52678-pacific

pacific: qa: lengthen grace for fs map showing dead MDS

Reviewed-by: Kotresh HR khiremat@redhat.com

Merge pull request #43434 from callithea/wip-52412-pacific

pacific: snap-schedule: count retained snapshots per retention policy

Reviewed-by: Kotresh HR khiremat@redhat.com
Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43906 from sebastian-philipp/pacific-backport-43376-43602-43654-43734-42838-43454-43628-43762-43790-43737-

pacific: cephadm: November batch

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #43948 from guits/wip-53278-pacific

pacific: ceph-volume: fix bug with miscalculation of required db/wal slot size for VGs with multiple PVs

Merge pull request #43949 from guits/wip-53188-pacific

pacific: ceph-volume: fix a typo causing AttributeError

rgw: remove prefix & delim params for bucket removal & mp upload abort

The calls to remove a bucket had parameters to specify a prefix and
delimiter, which does not make sense. This was precipitated due to some
existing Swift protocol logic, but buckets are removed irrespective of
prefix and delimiter. So the functions and calls are adjusted to
remove those parameters. Additionally, those same parameters were
removed for aborting incomplete multipart uploads.

Additionally a bug is fixed in which during bucket removal, multipart
uploads were only removed if the prefix was non-empty.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry-picked from 5156e4e7ce307f8ac6ee6dc36f7e546c93d17d55)

Conflicts:
        src/rgw/rgw_sal_rados.cc
        src/rgw/rgw_sal.h
        src/rgw/rgw_sal_rados.h
  - Alterations due to Zipper 7 code refactoring
        src/rgw/rgw_sal_dbstore.cc
        src/rgw/rgw_sal_dbstore.h
  - Did not exist before Zipper 7 code refactoring

ceph-volume/tests: update setup_mixed_type playbook

we need to create a file with a larger size.
see https://github.com/ceph/ceph/pull/43300#issuecomment-951961243

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
(cherry picked from commit 8af00e25aa4ab60d0309e31f6c20edd6cd5be1ee)

ceph-volume: fix bug with miscalculation of required db/wal slot size for VGs with multiple PVs

Previous logic for calculating db/wal slot sizes made the assumption that there would only be
a single PV backing each db/wal VG. This wasn't the case for OSDs deployed prior to v15.2.8,
since ceph-volume previously deployed multiple SSDs in the same VG. This fix removes the
assumption and does the correct calculation in either case.

Fixes: https://tracker.ceph.com/issues/52730
Signed-off-by: Cory Snyder <csnyder@iland.com>
(cherry picked from commit cd6aa1329f70f89338757ba295e279ecfdbc2d07)

Merge pull request #43890 from batrick/i53231

pacific: MDSMonitor: assertion during upgrade to v16.2.5+

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43841 from vshankar/wip-52952

pacific: mds: skip journaling blocklisted clients when in `replay` state

Reviewed-by: Venky Shankar vshankar@redhat.com
Reviewed-by: Kotresh HR khiremat@redhat.com

Merge pull request #43891 from batrick/i53232

pacific: MDSMonitor: no active MDS after cluster deployment

Reviewed-by: Venky Shankar vshankar@redhat.com

Merge pull request #43828 from batrick/i53006

pacific: qa: reduce frag split confs for dir_split counter test

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #43941 from sebastian-philipp/backport-43780

pacific: doc/radosgw/nfs: add note about NFSv3 deprecation

Reviewed-by: Michael Fritch <mfritch@suse.com>

qa/suites/orch/cephadm/dashboard: Add centos_8.3_container_tools_3.0.yaml

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>

qa/suites/orch/cephadm: add 8.stream + container_tools

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit eb43f2be9c326a522946bb9ebafc9a016828a41b)

Conflicts:
qa/suites/orch/cephadm/dashboard/0-distro/centos_8.2_container_tools_3.0.yaml

cephadm: Avoid "Could not locate podman: podman not found"

Right now, we're spamming the cephadm.log on docker deployments

Fixes: https://tracker.ceph.com/issues/52869
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
(cherry picked from commit 2767766ed970bf541400e62e6216f4ac29798d43)

cephadm: fix upgrade name already in use

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
(cherry picked from commit eece84dada04b99ea5debc694e0bb3452bf94093)

mgr/cephadm: allow osd spec removal

OSD specs/drivegroups are essentially templates for OSD creation but do
not map to the full lifecycle of the OSDs that they create.  When a spec
is removed, remove it immediately.

If no --force is provided, the error lists which OSDs will be left behind.
If --force is passed, the service is removed.

This leaves behind a few oddities:

- When you list services, OSDs that were created by the drivegroup may
  still exist, causing the drivegroup to appear in the list as
  unmanaged services.
- If you create a new drivegroup with the same name, the prior OSDs will
  appear to belong to the new spec instance, regardless of whether the
  spec/drivegroup parameters are the same.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit bda5c304f33cb7a401a289d92f35b5d15f2fce15)

mgr/orchestrator: pass 'force' flag down for remove_service

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 575b7c9a98608c4f266d8e406118544916f1b8d6)

Conflicts:
src/pybind/mgr/rook/module.py

mgr/cephadm/services/osd: less noisy

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 8c1e9c05f76c43466269518a9798fe6a3b944a3e)