src/test/crimson/seastore/nvmedevice: update a test case based on rbm multi shard change

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
(cherry picked from commit 7a15d484c552a177585954cdb4e2e226a43c1035)

crimson/os/seastore/rbm: make rbm support multiple shards

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
(cherry picked from commit 1d6beef975144210ae29626e61aeb284aff30d53)

Merge pull request #53932 from zdover23/wip-doc-2023-10-11-backport-53908-to-reef

reef: doc/rados: edit memory-profiling.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: edit memory-profiling.rst

Edit doc/rados/troubleshooting/memory-profiling.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3be932425e3020085db5abff6f914938015d8590)

Merge pull request #53786 from idryomov/wip-63010-reef

reef: qa/suites/krbd: stress test for recovering from watch errors

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #53870 from adk3798/wip-63114-reef

reef: mgr/cephadm: ceph orch add fails when ipv6 address is surrounded by square brackets.

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #53866 from adk3798/wip-62801-reef

reef: cephadm: run tcmu-runner through script to do restart on failure

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #53865 from adk3798/wip-62795-reef

reef: mgr/cephadm: don't use image tag in orch upgrade ls

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #53404 from adk3798/reef-tcmu-custom-configs

reef: cephadm: make custom_configs work for tcmu-runner container

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #52819 from rishabh-d-dave/wip-62335-reef

reef: mds: use variable g_ceph_context directly in MDSAuthCaps

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #53033 from rhcs-dashboard/wip-62025-reef

reef: msgr: AsyncMessenger add faulted connections metrics

Merge pull request #53897 from zdover23/wip-doc-2023-10-10-backport-53890-to-reef

reef: doc/rados: edit troubleshooting-mon.rst (4 of x)

Merge pull request #53868 from adk3798/wip-62960-reef

reef: mgr/cephadm: removing double quotes from the generated nvmeof config

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #53867 from adk3798/wip-62910-reef

reef: mgr/cephadm: Adding sort-by support for ceph orch ps

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #53751 from adk3798/reef-haproxy-version

reef: cephadm: fix haproxy version with certain containers

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #53741 from adk3798/wip-63032-reef

reef: mgr/cephadm: fix REFRESHED column of orch ps being unpopulated

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #53159 from ljflores/wip-62590-reef

reef: python-common: drive_selection: fix KeyError when osdspec_affinity is not set

Reviewed-by: Adam King <adking@redhat.com>

doc/rados: edit troubleshooting-mon.rst (4 of x)

Edit doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/53875

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 99e92fb94b2c29e565e3f4e04658e103a09ef125)

Merge pull request #53820 from ljflores/wip-63083-reef

reef: osd: fix read balancer logic to avoid redundant primary assignment

Reviewed-by: Josh Salomon <josh.salomon@gmail.com>

Merge pull request #52767 from kamoltat/wip-ksirivad-backport-reef-52633

reef: pybind/mgr/pg_autoscaler: Cut back osdmap.get_pools calls

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #52737 from ljflores/wip-62275-reef

reef: test/TestOSDMap: don't use the deprecated std::random_shuffle method

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Leonid Usov <leonid.usov@ibm.com>

Merge pull request #52721 from NitzanMordhai/wip-62251-reef

reef: qa/standalone/osd/divergent-prior.sh: Divergent test 3 with pg_autoscale_mode on pick divergent osd

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>

Merge pull request #52466 from k0ste/wip-62029-reef

reef: mon/ConfigMonitor: update crush_location from osd entity

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

mgr/cephadm: add unit test for _process_ls_output

This is a weird function to make a unit test for
since it's essentially just moving data from a
list of dicts into a list of DaemonDescriptions,
but wanted to have some coverage to lower the
chance of breaking something again.

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 47c8ad452423f4bf78885ec911c3b21a52cd90ae)

Conflicts:
src/pybind/mgr/cephadm/tests/test_cephadm.py

mgr/cephadm: fix REFRESHED column of orch ps being unpopulated

The way the daemon ls data was processed was changed in
https://github.com/ceph/ceph/commit/1fd4132c7c03602719f29230732b12c8afa04779
and it seems that commit removed a line that set the
last_refresh field. This commit just adds it back
in the new location after the change.

Without this in "ceph orch ps" the REFRESHED column
for every daemon just reports "-"

Fixes: https://tracker.ceph.com/issues/62954
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 06cf5bb95205965ab6b625b9069a11fa89ed4fb9)

Merge pull request #53879 from zdover23/wip-doc-2023-10-08-backport-53875-to-reef

reef: doc/rados: edit troubleshooting-mon.rst (3 of x)

Merge pull request #53881 from zdover23/wip-doc-2023-10-08-backport-53874-to-reef

reef: doc/rados: edit troubleshooting/community.rst

doc/rados: edit troubleshooting/community.rst

Edit doc/rados/troubleshooting/community.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fabfec273474a85cf3687ddf89183f0607c2ad71)

doc/rados: edit troubleshooting-mon.rst (3 of x)

Edit doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/52827

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fc45a0c4dd0247f472a940d6c92e7acdb0cdc354)

Merge pull request #53877 from zdover23/wip-doc-2023-10-08-backport-53876-to-reef

reef: doc/architecture: repair RBD sentence

doc/architecture: repair RBD sentence

Improve an ambiguous sentence in doc/architecture.rst.

The problem presented by the original sentence is that the phrasal verb
"to provide with" is implicated in one of its possible readings.
Interpreted in that way, the sentence seems to express the incorrect
idea that RBD furnishes block devices with snapshotting and cloning, as
though snapshotting and cloning are being delivered to the block
devices. In fact, snapshotting and cloning are just features of RBD, and
are features that are described on this page:
https://docs.ceph.com/en/quincy/rbd/rbd-snapshot/.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5abd530460e3d5a60142d9350d93544402b6dec4)

Merge pull request #53871 from zdover23/wip-doc-2023-10-07-backport-53790-to-reef

reef: doc/architecture: edit "Peering and Sets"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>

doc/architecture: edit "Peering and Sets"

Edit the English in the section "Peering and Sets" in the file
doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c69b111966f190ac4a1ebd5244a9cf9f61970dd7)

Merge pull request #53837 from zdover23/wip-doc-2023-10-05-backport-53819-to-reef

reef: doc/rados: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #53869 from adk3798/wip-62973-reef

reef: mgr/cephadm: add ability to zap OSDs' devices while draining host

ceph orch add fails when ipv6 address is surrounded by square brackets.

fixes: https://tracker.ceph.com/issues/61885
fixes: https://bugzilla.redhat.com/show_bug.cgi?id=2153448

Signed-off-by: Teoman ONAY <tonay@ibm.com>
(cherry picked from commit 1ea71bee6197ed0357b586498a43d9d726160a43)

mgr/cephadm: add ability to zap OSDs' devices while draining host

Currently, when cephadm drains a host, it will remove all OSDs on
the host, but provides no option to zap the OSD's devices afterwards.
Given users are draining the host likely to remove it from the cluster,
it makes sense some users would want to clean up the devices on the
host that were being used for OSDs. Cephadm already supports zapping
devices outside of host draining, so it makes shouldn't take much to
add that functionality to the host drain as well.

Fixes: https://tracker.ceph.com/issues/61593
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 85043ff4cee108c152f5aa8af267c85e353c475a)

mgr/cephadm: removing double quotes from the generated nvmeof config
Fixes: https://tracker.ceph.com/issues/62838
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit 6b8187b2ec8a3bf9092da72c7a8b00dc7e5e1ce3)

Adding service_name and daemon_type and fixing mypy issues

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit 72e9345faa725bd2aaba41e06ed34927badd7622)

mgr/cephadm: Adding sort-by support for ceph orch ps
Fixes: https://tracker.ceph.com/issues/61856
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit b347106af329e238a927f47436acd54999c4d9af)

cephadm: run tcmu-runner through script to do restart on failure

Currently, cephadm runs tcmu-runner as a background
process inside the unit file deployed for iscsi
(rbd-target-api is the primary process). This means
if tcmu-runner crashes for whatever reason, systemd
will not attempt to restart it. This commits sets
up a script to serve as the container entrypoint
for the tcmu-runner container that will run
tcmu-runner and also restart it on failure
(unless there are too many failures in a short
period, at which point it gives up).

The hope is to eventually drop use of this script
for a better solution in squid onward, but this
should be helpful on older releases (quincy and
pacific at least) where we won't be able to
bring that better solution

Fixes: https://tracker.ceph.com/issues/61667
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 47eb6b3f62afe993073429b02051ae0343d7aea3)

Conflicts:
src/cephadm/tests/test_cephadm.py

mgr/cephadm: don't use image tag in orch upgrade ls

Using the tag seems to screw up the auth URL generated
and is unnecessary since we're trying to get a list
of tags for the image anyway.

Fixes: https://tracker.ceph.com/issues/62679
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 0f4426d3a085fc2f5137593029469c3b20ace77e)

Merge pull request #53835 from rhcs-dashboard/wip-63074-reef

reef: mgr/dashboard: fix the landing page layout issues

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #53853 from zdover23/wip-doc-2023-10-06-backport-53834-to-reef

reef: doc: remove egg fragment from dev/developer_guide/running-tests-locally

doc: remove egg fragment from dev/developer_guide/running-tests-locally

DEPRECATION: git+https://github.com/ceph/teuthology#egg=teuthology
[test] contains an egg fragment with a non-PEP 508 name pip 25.0 will enforce
this behaviour change. A possible replacement is to use the req @ url syntax,
and remove the egg fragment. Discussion can be found at
https://github.com/pypa/pip/issues/11617

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
(cherry picked from commit 1f78a32a1822fea1a56a88215e452b730b7672c7)

Merge pull request #53412 from trociny/wip-62352-reef

reef: qa: fix keystone in rgw/crypt/barbican.yaml

doc/rados: edit troubleshooting.rst

Edit doc/rads/troubleshooting.rst to remove some language that sounds
quite close to marketing language.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9d9d92837e44e3af233bc228850be09e8f64eb7c)

Merge pull request #53811 from zdover23/wip-doc-2023-10-04-backport-53791-to-reef

reef: doc/rados: edit ops/control.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

mgr/dashboard: fix rgw inventory card and broken shadows

Mess up of the dashboard landing page layout fixes PR

Fixes: http://tracker.ceph.com/issues/62961
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 4c6c5787cb338995955b4a30fed9c348337e721c)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard/rgw-overview-dashboard.component.html
  - Accept incoming changes
src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-row/card-row.component.html
  - Accept incoming changes

mgr/dashboard: fix the landing page layout issues

We were following a row-col grid layout for the landing page.
First row includes Details, Status and Capacity
Second row for Inventory and Cluster Utilization

So if one of the item in the first row increases, it pushes the entire
second row downwards.

To fix this, I made a col-row grid.

First col has Details and Inventory in two rows.
Second col has Status and Capacity as a col and Cluster Utilization as a
single row

Fixes: https://tracker.ceph.com/issues/62961
Signed-off-by: Nizamudeen A <nia@redhat.com>
Co-authored-by: cloudbehl <cloudbehl@gmail.com>
(cherry picked from commit 3f904b0a658e3759ef00fdd5a95f6ecf5ba76718)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard/dashboard-v3.component.html
  - Accept the incoming change

Merge pull request #53831 from rhcs-dashboard/wip-62999-reef

reef: mgr/dashboard: fix cephfs forms validations

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: fix cephfs forms validations

1. CephFS Edit Form didnt had any validation for name eventhough the
   create had. So reused the Create form to display the Edit as well

2. Add Name Validations to Subvoume and Subvolume group forms

3. Removed the datePipe from the cephfs list template since we are using
   the relativeDate.

Fixes: https://tracker.ceph.com/issues/62939
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit cd617a3bd28b0aedd03505314509f0c00391bc39)

Merge pull request #53818 from aaSharma14/wip-63098-reef

reef: mgr/dashboard: Fix user/bucket count in rgw overview dashboard

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #53780 from rhcs-dashboard/wip-63069-reef

reef: mgr/dashboard: allow tls 1.2 with a config option

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #53646 from vshankar/wip-61805-reef

reef: cephfs-journal-tool: disambiguate usage of all keyword (in tool help).

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #53638 from vshankar/wip-62950-reef

reef: cephfs-mirror: do not run concurrent C_RestartMirroring context

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #53627 from lxbsz/wip-62947

reef: qa: descrease pgbench scale factor to 32 for postgresql database test

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #52843 from lxbsz/wip-62271

reef: xfstests_dev: install extra packages from powertools repo for xfsprogs

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge branch 'reef' into wip-doc-2023-10-04-backport-53791-to-reef

Signed-off-by: zdover23 <zac.dover@proton.me>

osd: fix read balancer logic to avoid redundant primary assignment

Fixes: https://tracker.ceph.com/issues/62833
Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 47c5ba25ed0db0fd307f0d4a1717ff8418004b8e)

Merge pull request #53810 from rhcs-dashboard/wip-63091-reef

reef: mgr/dashboard: rbd image hide usage bar when disk usage is not provided

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #53815 from zdover23/wip-doc-2023-10-04-backport-53792-to-reef

reef: doc/rados: edit ops/control.rst (2 of x)

mgr/dashboard: Fix user/bucket count in rgw overview dashboard

Donot consider buckets/users count from daemons that have similar realm
name

Fixes: https://tracker.ceph.com/issues/62964
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit bfdcabe9d967ab28040173107bfd3f94235e3921)

doc/rados: edit ops/control.rst (2 of x)

Edit doc/rados/operations/control.rst (2 of x).

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 03ed13930661628c10f185af1a3949548bdc8288)

Merge pull request #53806 from aaSharma14/wip-63087-reef

reef: mgr/dashboard: Rgw Multi-site naming improvements

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

doc/rados: edit ops/control.rst (1 of x)

Edit doc/rados/operations/control.rst (1 of x).

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 89c9584f8a1633b5ad1936af09529657d81b7134)

mgr/dashboard: rbd image hide usage bar when disk usage is not provided

Fixes: https://tracker.ceph.com/issues/63037
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 17d87af98a60471fc72cab4e6d5a53caf1847842)

Merge pull request #52662 from rhcs-dashboard/wip-62184-reef

reef: mgr/dashboard: upgrade angular v14 and v15

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #53805 from aaSharma14/wip-63079-reef

reef: mgr/dashboard: show a message to restart the rgw daemons after moving from single-site to multi-site

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #53795 from rhcs-dashboard/wip-63077-reef

reef: mgr/dashboard: enable protect option if layering enabled

Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: Rgw Multi-site naming improvements

Fixes: https://tracker.ceph.com/issues/62721
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit e3d8ac03c343f98b43f8a009cb2a26fc913ad12d)

Merge pull request #53778 from rhcs-dashboard/wip-63067-reef

reef: mgr/dashboard: fix cephfs form validator

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

mgr/dashboard: show a message to restart the rgw daemons after moving from single-site to multi-site

Fixes: https://tracker.ceph.com/issues/62984
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit ab06466aa2bb7ddc97ccc33acb3aa6ce35582f05)

Merge pull request #53515 from yuvalif/wip-61642-reef

reef: rgw/kafka: make sure that destroy is called after connection is removed

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #53599 from idryomov/wip-62711-reef

reef: qa/suites/{rbd,krbd}: disable POOL_APP_NOT_ENABLED health check

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #53590 from cbodley/wip-62935-reef

reef: rgw/crypt: don't deref null manifest_bl

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53584 from cbodley/wip-62924-reef

reef: rgw/sal: get_placement_target_names() returns void

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #53514 from yuvalif/wip-61535-reef

reef: RGW:notifications: persistent topics are not deleted via radosgw-admin

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53513 from yuvalif/wip-59496-reef

reef: rgw/kafka: failed to reconnect to broker after idle timeout

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53510 from yuvalif/wip-62803-reef

reef: rgw/notifications: allow cross tenant notification management

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #53509 from yuvalif/wip-62831-reef

reef: RGW: add admin interfaces to get and delete notifications by bucket

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #53507 from yuvalif/wip-61484-reef

reef: RGW: bucket notification - hide auto generated topics when listing topics

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #53466 from k0ste/wip-61439-reef

reef: rgw/multisite[archive zone]: fix storing of bucket instance info in the new bucket entrypoint

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53440 from trociny/wip-61871-reef

reef: rgw: pick http_date in case of http_x_amz_date absence

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53437 from k0ste/wip-62825-reef

reef: RadosGW API: incorrect bucket quota in response to HEAD /{bucket}/?usage

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53398 from trociny/wip-62752-reef

reef: rgw: fix 2 null versionID after convert_plain_entry_to_versioned

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #53395 from trociny/wip-62306-reef

reef: rgw/sync-policy: Correct "sync status" & "sync group" commands

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #53377 from jzhu116-bloomberg/wip-59646-reef

reef: rgw/notification: pass in bytes_transferred to populate object_size in sync notification

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #53375 from jzhu116-bloomberg/wip-59693-reef

reef: rgw/notification: remove non x-amz-meta-* attributes from bucket notifications

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #53034 from galsalomon66/wip-62466-reef

reef: rgw/s3select: s3select fixes related to Trino/TPCDS benchmark and QE tests

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #53293 from ajarr/wip-62687-reef

reef: librbd: kick ExclusiveLock state machine on client being blocklisted when waiting for lock

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

Merge pull request #53276 from idryomov/wip-61707-reef

reef: librbd: make CreatePrimaryRequest remove any unlinked mirror snapshots

Reviewed-by: Ramana Raja <rraja@redhat.com>

mgr/dashboard: enable protect option if layering enabled

Fixes: https://tracker.ceph.com/issues/63076
Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit 91be9ecdf519df18e564c79681f6275376f786e6)

qa/suites/krbd: stress test for recovering from watch errors

Fixes: https://tracker.ceph.com/issues/63010
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 237aa221ebad429457a621d2e38cfdf0025e38f9)

qa/suites/krbd: rename singleton to singleton-msgr-failures

A "singleton without msgr-failures" is wanted in the next commit.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2094a0450d071ed5fc430a5cdfa524a69098fbd4)

mgr/dashboard: allow tls 1.2 with a config option

Provide the option to allow tls1.2

`ceph dashboard set-enable-unsafe-tls-v1-2 True` followed with a mgr
restart will enable tls 1.2.

With tls1.2 enabled
```
╰─$ nmap -sV --script ssl-enum-ciphers -p 11000 127.0.0.1
Starting Nmap 7.93 ( https://nmap.org ) at 2023-09-27 16:56 IST
Nmap scan report for localhost (127.0.0.1)
Host is up (0.00018s latency).

PORT      STATE SERVICE  VERSION
11000/tcp open  ssl/http CherryPy wsgiserver
|_http-server-header: Ceph-Dashboard
| ssl-enum-ciphers:
|   TLSv1.2:
|     ciphers:
|       TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (ecdh_x25519) - A
|       TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256 (ecdh_x25519) - A
|       TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (ecdh_x25519) - A
|       TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 (ecdh_x25519) - A
|       TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA (ecdh_x25519) - A
|       TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA (ecdh_x25519) - A
|       TLS_RSA_WITH_AES_256_GCM_SHA384 (rsa 2048) - A
|       TLS_RSA_WITH_AES_256_CCM (rsa 2048) - A
|       TLS_RSA_WITH_AES_128_GCM_SHA256 (rsa 2048) - A
|       TLS_RSA_WITH_AES_128_CCM (rsa 2048) - A
|       TLS_RSA_WITH_AES_256_CBC_SHA256 (rsa 2048) - A
|       TLS_RSA_WITH_AES_128_CBC_SHA256 (rsa 2048) - A
|       TLS_RSA_WITH_AES_256_CBC_SHA (rsa 2048) - A
|       TLS_RSA_WITH_AES_128_CBC_SHA (rsa 2048) - A
|     compressors:
|       NULL
|     cipher preference: server
|   TLSv1.3:
|     ciphers:
|       TLS_AKE_WITH_AES_256_GCM_SHA384 (ecdh_x25519) - A
|       TLS_AKE_WITH_CHACHA20_POLY1305_SHA256 (ecdh_x25519) - A
|       TLS_AKE_WITH_AES_128_GCM_SHA256 (ecdh_x25519) - A
|       TLS_AKE_WITH_AES_128_CCM_SHA256 (ecdh_x25519) - A
|     cipher preference: server
|_  least strength: A

Service detection performed. Please report any incorrect results at https://nmap.org/submit/ .
Nmap done: 1 IP address (1 host up) scanned in 16.55 seconds
```

Without tls1.2 enabled (which defaults to tls 1.3)
```
╰─$ nmap -sV --script ssl-enum-ciphers -p 11000 127.0.0.1
Starting Nmap 7.93 ( https://nmap.org ) at 2023-09-27 16:54 IST
Nmap scan report for localhost (127.0.0.1)
Host is up (0.000075s latency).

PORT      STATE SERVICE  VERSION
11000/tcp open  ssl/http CherryPy wsgiserver
| ssl-enum-ciphers:
|   TLSv1.3:
|     ciphers:
|       TLS_AKE_WITH_AES_256_GCM_SHA384 (ecdh_x25519) - A
|       TLS_AKE_WITH_CHACHA20_POLY1305_SHA256 (ecdh_x25519) - A
|       TLS_AKE_WITH_AES_128_GCM_SHA256 (ecdh_x25519) - A
|       TLS_AKE_WITH_AES_128_CCM_SHA256 (ecdh_x25519) - A
|     cipher preference: server
|_  least strength: A
|_http-server-header: Ceph-Dashboard
```

Fixes: https://tracker.ceph.com/issues/62940
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 219c62bea60083c0e59a86454b0cecf8afaf9780)

mgr/dashboard: fix cephfs form validator

Number is not allowed as the starting character of the mds service

Fixes: https://tracker.ceph.com/issues/63005
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit fe8fa180d323500303f449be537ec2b7eae1a64a)

mgr/dashboard: upgrade to cypress 12

Looks like chrome 117 will need cypress >=12.15.0
https://github.com/cypress-io/cypress-documentation/issues/5479

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 630ba3ab379439c1faab176532e489d5a67ac1c4)

mgr/dashboard: adapt and refactor jest test files

Use the `configureTestBed` as the placeholder for adding the
declarations, imports... that is required for the unit tests to run

Fixes: https://tracker.ceph.com/issues/62844
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit e2626fb63ca568b053cd97d30b398ed38446b5a4)

mgr/dashboard: update nodejs to 18.17.0

the latest npm doesn't support setting python as a config like `npm
config set python3` instead it needs to be either set in the node-gyp
explicitly using the node-gyp command or through an environment
variable.
Since we are calling the node-gyp through npm, we need to set the
environment variable which is documented here: https://github.com/nodejs/node-gyp?tab=readme-ov-file#configuring-python-dependency

Accordingly the CMakeLists.txt for dashboard is adapted

Fixes: https://tracker.ceph.com/issues/62844
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 47f49e5b1ae2e5bf7aad5df23d877ae5df00210c)