Merge pull request #61341 from vshankar/wip-68923-reef

reef: qa/cephfs: randomize configs in `fs:thrash:workloads`

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>

Merge pull request #61410 from rishabh-d-dave/wip-67976-reef

reef: cephfs,mon: fs rename must require FS to be offline and refuse_client_session to be set

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #61514 from mchangir/wip-68955-reef

reef: mds: session in the importing state cannot be cleared if an export subtree task is interrupted while the state of importer is acking

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #61519 from mchangir/wip-68248-reef

reef: client: fix d_reclen for readdir

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #62109 from neesingh-rh/wip-70232-reef

reef: mgr/volumes: fix dangling symlink in clone index

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #65078 from zdover23/wip-doc-2025-08-18-backport-64939-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65083 from zdover23/wip-doc-2025-08-18-backport-65051-to-reef

reef: doc/cephfs: Update quota.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65088 from zdover23/wip-doc-2025-08-18-backport-64921-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: edit troubleshooting.rst

Edit the section "Slow Requests (MDS)" in
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit edb3d2be60fd38a1957878bdfa9a9d9d415cc94c)

Merge pull request #65047 from zdover23/wip-doc-2024-08-14-backport-64981-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65044 from zdover23/wip-doc-2024-08-14-backport-64930-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65041 from zdover23/wip-doc-2025-08-14-backport-64923-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65037 from zdover23/wip-doc-2025-08-14-backport-64922-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65026 from zdover23/wip-doc-2025-08-14-backport-64982-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: Update quota.rst

Make the user aware to adapt the client capabilities to enable the configuration of quotas.

Signed-off-by: Jannis Speer <Jannis.speer@tutanota.com>
doc/cephfs: fix broken link

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 99fe86670fc23dd98b6e583ac4de6a5dcd8f8e28)

Merge branch 'reef' into wip-doc-2025-08-14-backport-64922-to-reef

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/cephfs: edit troubleshooting.rst

Edit the section "Slow requests" in the file
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 07372f1f6275f87aebe31132e5ce43705b24aefd)

Merge pull request #65058 from zdover23/wip-doc-2025-08-15-backport-64787-to-reef

reef: doc/cephfs: add a note about estimated replay completion time

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: add a note about estimated replay completion time

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit d471748aa0ccd2041a8a4ac5af059009597b5b53)

doc/cephfs: update cephfs disaster recovery procedure

Fixes: http://tracker.ceph.com/issues/71629
Signed-off-by: Venky Shankar <vshankar@redhat.com>
fixup

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit bf46093470068d6ec4d168c1b24e886f4344b7fc)

doc/cephfs: edit troubleshooting.rst

Edit the "Mount 5 Error" and "Mount 12 Error" sections of
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit bcb542fde53275566e52c832ab74fa324920e715)

doc/cephfs: edit troubleshooting.rst

Edit the section "debug output" in the file
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6f62b74b04da92845274cf786bf970f1e13aea3c)

doc/cephfs: edit troubleshooting.rst

Edit the section "RADOS Health" in the file
doc/cephfs/troubleshooting.rst. Add a Sphinx directive to the
doc/rados/troubleshooting/index.rst file that directs to the index of
the RADOS troubleshooting documentation.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 46f119716f6dfad20b906426c94915dd2c3e9f32)

doc/cephfs: edit troubleshooting.rst

Edit the section "Expediting MDS Journal Trim" in
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b627eb4995ef1ea5bd0329915567a620ecd907ac)

doc/cephfs: edit troubleshooting.rst

Edit the "Dynamic Debugging" section of doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
doc/cephfs: improve dynamic debugging section

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit a15653a2fbb385aae4cfa5245728b3e14e705bfe)

Merge pull request #64761 from ceph/wip-yuri-client-upgrade-reef-tentacle

qa/tests: added initial test for `client-upgrade-reef-tentacle`

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

qa/tests: added initial test for `client-upgrade-reef-tentacle`

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
qa/tests: removed RBD_DISABLE_UPDATE_FEATURES: "1"

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #64918 from idryomov/wip-krbd-unmap-fixed-1-reef

reef: qa/suites/krbd: use a standard fixed-1 cluster in unmap subsuite

Reviewed-by: Ramana Raja <rraja@redhat.com>

qa/suites/krbd: use a standard fixed-1 cluster in unmap subsuite

A custom "fixed-1, but with the client on a separate node" cluster was
needed only for pre-single-major.yaml kernel which is no longer around.
This can be a single-node job now -- see commits 311a450163cf
("krbd/unmap: put client.0 on a separate remote") and 39a579144cd8
("qa/suites/krbd: drop pre-single-major test").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9bfd67974462f4c53610d286862a046d8cb07984)

Merge pull request #64904 from zdover23/wip-doc-2025-08-08-backport-64876-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

doc/cephfs: edit troubleshooting.rst

Edit "Avoiding Recovery Roadblocks" in the "Stuck During Recovery"
section of doc/cephfs/troubleshooting.rst.

This commit follows https://github.com/ceph/ceph/pull/64854.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c55eb8ad52bbfd3a9264d2f72abc0694c6183799)

Merge pull request #64901 from zdover23/wip-doc-2025-08-08-backport-64881-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64879 from zdover23/wip-doc-2025-08-07-backport-64869-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64872 from zdover23/wip-doc-2025-08-07-backport-64854-to-reef

reef: doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64868 from zdover23/wip-doc-2025-08-07-reef-rados-ops-erasure-code

reef: doc/rados: document section absent in release < T

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>

doc/cephfs: edit troubleshooting.rst

Edit the section "Slow/Stuck Operations" in
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 57e7be73d8c121a3a06155217bb6f850faa4293f)

doc/cephfs: edit troubleshooting.rst

Follow up on comments made by Anthony D'Atri in
https://github.com/ceph/ceph/pull/64832 and make other small changes to
increase the ease of reading this text.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7c8e38155d62a3826a205c367931d9713b83f695)

doc/cephfs: edit troubleshooting.rst

Edit "Avoiding Recovery Roadblocks" in the "Stuck During Recovery"
section of doc/cephfs/troubleshooting.rst.

This commit follows https://github.com/ceph/ceph/pull/64832.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d67639986d72aa5723f39073053f701601d9b053)

doc/rados: document section absent in release < T

Add a note to doc/rados/operations/erasure-code.rst to warn future
backporters against adding the section "Erasure Coding Optimizations" to
versions of the documentation prior to the Tentacle release.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #64853 from zdover23/wip-doc-2025-08-06-backport-64832-to-reef

reef: doc/cephfs: edit troubleshooting.rst

doc/cephfs: edit troubleshooting.rst

Edit "Stuck in up:replay" under the "Stuck During Recovery" section of
doc/cephfs/troubleshooting.rst. I had planned to edit the entire "Stuck
During Recovery" section in a single commit, but I think that the
material is too involved for that.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 969c01fd54741679ec52e081e99ca523bf83ec88)

Merge pull request #62473 from badone/wip-trackers-50371-67352-67489-69639-reef

reef: Wip trackers 50371 67352 67489 69639 reef

Merge pull request #60566 from k0ste/wip-68780-reef

reef: osd: add clear_shards_repaired command

Merge pull request #64786 from zdover23/wip-doc-2025-08-01-backport-64766-to-reef

reef: doc/cephfs: edit ceph-dokan.rst (3 of x)

Merge pull request #64798 from stackhpc/doc-fix-mclock-links-reef

reef: doc: Fix links to mClock config reference

Merge pull request #64620 from idryomov/wip-71961-reef

reef: librbd: images aren't closed in group_snap_*_by_record() on error

Reviewed-by: Miki Patel <miki.patel132@gmail.com>

doc: Fix links to mClock config reference

Signed-off-by: Pierre Riteau <pierre@stackhpc.com>
(cherry picked from commit 0a2d4b096af168b6646e54a1a5772ad8b6a3c8d6)

doc/cephfs: edit ceph-dokan.rst (3 of x)

Incorporate into doc/cephfs/ceph-dokan.rst the suggestions made by
Anthony D'Atri in https://github.com/ceph/ceph/pull/64737, and make a
few other small improvements to the English language in that file.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c7f418eecbfa6209cc38e7107905ae503cd28f82)

Merge pull request #64658 from ceph/wip-reef-rocky9

reef: Rocky 9/10 support backports

Merge pull request #64669 from cbodley/wip-72256-reef

reef: qa/rgw: remove hadoop-s3a subsuite

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #64622 from ivancich/wip-64772-reef

reef: rgw: make rgw-restore-bucket-index more robust

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #64464 from ivancich/wip-65893-reef

reef: rgw: make incomplete multipart upload part of bucket check efficient

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #64514 from ivancich/wip-64908-reef

reef: rgw: bring rgw-restore-bucket-index up to current version

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #64760 from zdover23/wip-doc-2025-07-30-backport-64737-to-reef

reef: doc/cephfs: edit ceph-dokan.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64488 from soumyakoduri/wip-skoduri-reef

[reef] rgw/dbstore: Update bucket attrs as part of put_info()

Merge pull request #64411 from cbodley/wip-72032-reef

reef: rgw: don't use merge_and_store_attrs() when recreating a bucket

Reviewed-by: Adam Emerson <aemerson@redhat.com>

doc/cephfs: edit ceph-dokan.rst (2 of x)

Edit the last half of doc/cephfs/ceph-dokan.rst. This is part of a
larger project whose goal is the improvement of the CephFS
documentation.

Follows https://github.com/ceph/ceph/pull/64690.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9dc57f9e2da72c6de92fc0e3bb52ddc8f4a50f65)

Merge pull request #64736 from zdover23/wip-doc-2025-07-29-backport-64690-to-reef

reef: doc/cephfs: edit ceph-dokan.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64666 from rhcs-dashboard/add-nvmrc-in-reef

reef: mgr/dashboard: add .nvmrc so ci can pick the node version

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60657 from mchangir/wip-68815-reef

reef: client: return EOPNOTSUPP for fallocate with mode 0

Merge pull request #60563 from rishabh-d-dave/wip-68679-reef

reef: mgr: allow disabling always-on modules

Merge pull request #60695 from vshankar/wip-68693-reef

reef: client: fixed a bug that read operation hung

Merge pull request #61839 from vshankar/wip-69682

reef: mds: prevent duplicate wrlock acquisition for a single request

doc/cephfs: edit ceph-dokan.rst (1 of x)

Edit the first 62 lines of doc/cephfs/ceph-dokan. This is part of a
larger project whose goal is the improvement of the CephFS
documentation.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 803140e92113ee7919b8188ea3677b472d91ac48)

build-with-container.py: Add --rpmbuild-extra-args

Signed-off-by: Zack Cerza <zack@cerza.org>
(cherry picked from commit fd75679cf4b93d3605a25af7a08e00be9aca48f6)

build-with-container.py: Add --ceph-version

So that we can build from an extracted tarball, as opposed to a git repo.

Signed-off-by: Zack Cerza <zack@cerza.org>
(cherry picked from commit 800f5c2924dfd88292fbd483b881f25d15bbc928)

build-with-container.py: Add --env-file

Signed-off-by: Zack Cerza <zack@cerza.org>
(cherry picked from commit 8e9544fed3dc70ac91f995aacb3aed2edbd45554)

Merge pull request #64200 from ideepika/wip-71153-reef

reef: rgw: make keystone work without admin token(service ac requirement)

buildcontainer-setup.sh: allow testing with various ELish bases

Allow testing with more RPM-based/EL style distros.
Simplify the centos selection as centos8 ought to always
be matched by the earlier block.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 7975c52e81bb3062831615be9d0ce94e2b074281)

script/buildcontainer-setup: set WITH_CRIMSON to support crimson builds

Set the WITH_CRIMSON env var so that crimson related dependencies are
installed and the build image can build crimson flavored ceph.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 8f6bcce1676f510c27130c35c7464c6a63175fd7)

buildcontainer-setup.sh: Fix curl package conflict

It looks like at some point the centos9 image started shipping with
curl-minimal, which conflicts with the regular curl package. Asking dnf to find
the binary avoids this, since both packages provide it. Since we were already
doing this with rpmbuild, we can go ahead and loop wget into that in case
something similar happens there.

Signed-off-by: Zack Cerza <zack@cerza.org>
(cherry picked from commit 8964380cbbf6c64eb8342b55bc7078f5617560b8)

src/script: add seastar deps to ubuntu container image

Add some dependencies that are needed to build with seastar enabled on
ubuntu (22.04). These deps apparently don't get installed via
install-deps.sh - possibly because ubuntu packages never enable
seastar/crimson?

Signed-off-by: John Mulligan <phlogistonjohn@asynchrono.us>
(cherry picked from commit 6acd8f039ee56cfe0ad70d6c80cbcabe25984ac3)

script/buildcontainer-setup: set JENKINS_HOME while building image

Set the JENKINS_HOME environment variable while building the builder
image. This is needed because parts of scripts like run-make.sh and
install-deps.sh key off of this variable. Since we want to be able to
use the build container to build, run "make check" and the like, we want
that environment to be as similar to the jenkins CI environment as we
can make it.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit f026709b1f7e323908eaf8f4582ae1bd1ed7a323)

script/buildcontainer-setup: add dependency for llvm.sh to buildcontainer script

The container environment will need this additional dependency to
execute the llvm.sh installer script.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit a1a98e3e2107b9ffa8897ae40c98562a7a131693)

qa/rgw: remove hadoop-s3a subsuite

this suite hasn't provided much benefit since it was added, and is
becoming more of a maintenance burden recently:
* https://tracker.ceph.com/issues/71584
* https://tracker.ceph.com/issues/72179

remove the subsuite and its s3a_hadoop.py task

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit d713e9a583cbe449c6744532d038d503a7a71388)

mgr/dashboard: add .nvmrc so ci can pick the node version

already delivered in main and tentacle but missing in other branches

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #64645 from zdover23/wip-doc-2025-07-23-backport-64640-to-reef

reef: doc/cephfs: edit disaster-recovery.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

script/build-with-container: Add Rocky 9

Signed-off-by: David Galloway <david.galloway@ibm.com>
(cherry picked from commit 2996390144f7d0a0ea94edcf95ca7b89c6a62013)

script/build-with-container: add rocky10 to built-in distros

Add "rocky10" (also aliased to "rockylinux10") to the known distro bases
so that the team can begin to experiment with the Rocky Linux 10 distro
for containerized builds.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 33b33ff129011d71dcbe94fe4b2bb790f98301ad)

install-deps: Add Rocky 9, combine if statements

Signed-off-by: David Galloway <david.galloway@ibm.com>
(cherry picked from commit add0dc2c96038128c27031f708008ccc625859e9)

install-deps.sh: add a temporary repo for missing el10 deps

Add a new dnf/yum repository hosted in the ceph lab infra for providing
the last few dependencies missing from other el10 repos.
Hopefully we can remove this soon but it serves as a stopgap as we work
on getting el10 builds working in the ceph CI infra and tested.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit a2bc95c9c45512107d53397405a038df79ead234)

install-deps.sh: enable crb for rocky 10

Rocky Linux 10 has a CRB repo that must be enabled for a number of
Ceph's dependencies to be installed via dnf.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit ae7878d3c1aae010776ab7079afe213a9725fb1b)

install-deps.sh: enable crb repository for centos 10 stream

The centos 10 stream distribution is like centos 9 and needs the crb
repository enabled to even think about building ceph. Note that I made
it a separate block in case more stuff needs to be added for it later.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit de8b21d7bdfced09a0eec2a6002bb68748d96d2d)

build dependencies: centos9

- ceph.spec.in: declare git as build dependency
- install-deps.sh: enable CRB repo

Test procedure:
    docker run --rm -ti  -v /home/baum/ceph-ci:/home/ceph quay.io/centos/centos:stream9 bash
    [root@a3c4b1545e93 /]# cd /home/ceph/
    [root@a3c4b1545e93 ceph]# ./install-deps.sh 2>&1 tee install-deps.log

Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>
(cherry picked from commit 11a37da05305420ca37f5a3af5b8991e1e2967cb)

Merge pull request #64588 from idryomov/wip-70917-reef

reef: test/rbd: remove unit tests about cache tiering

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #64648 from zdover23/wip-doc-2025-07-23-backport-64639-to-reef

reef: doc/radosgw: edit config-ref.rst

Merge pull request #64596 from idryomov/wip-cephadm-rbd-iscsi-ignore-mon-down-reef

reef: qa/rbd/iscsi: ignore MON_DOWN warning in logs

Reviewed-by: Adam King <adking@redhat.com>

doc/radosgw: edit config-ref.rst

Follow up on the suggestions made by Anthony D'Atri in
https://github.com/ceph/ceph/pull/64532.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 18e9b08393cac7ed8fdb1c65021f74deba3dc44c)

doc/cephfs: edit disaster-recovery.rst

Follow up on the suggestions made by Anthony D'Atri in
https://github.com/ceph/ceph/pull/64604.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 37df8e43baa1e75587686fd661310dfb4ad30312)

Merge pull request #64609 from zdover23/wip-doc-2025-07-21-backport-64604-to-reef

reef: doc/cephfs: edit disaster-recovery.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64267 from zdover23/wip-doc-2025-06-30-backport-62785-to-reef

reef: pybind/mgr: Fix missing empty lines in mgr_module.py

Reviewed-by: Josh Durgin <jdurgin@ibm.com>

rgw: make keystone work without admin token(service ac requirement)

Ceph RGW admin credentials must not be a requirement.
Both ec2 auth and keystone token validation work without an admin token.

And the user token verification will use its own token. The only
requirement for the service admin user token is the allow_expired, but
in our case we don't use this parameter.

fixes: https://tracker.ceph.com/issues/68327

Co-authored-by: @kayrus
Signed-off-by: Deepika Upadhyay <deepika.upadhyay@clyso.com>
(cherry picked from commit 55ce1782e159190fd9202b6e270a1a2c470b0626)

Merge pull request #64195 from idryomov/wip-71838-reef

reef: librbd/migration/QCOWFormat: don't complete read_clusters() inline

Reviewed-by: Ramana Raja <rraja@redhat.com>

rgw: make rgw-restore-bucket-index more robust

This experimental tool write a series of temporary files, the combined
size of which is roughly proportional to some combination of the
number of objects in the bucket and their respective sizes. Previously
the script stored all temporary files in /tmp, which may not be
sufficiently large in many cases.

There are now two enhancements. First, using the "-t" command-line
argument, the directory for temporary files can be specified. Second,
if the script consumes all available space on the file system
containing the temporary directory, an error message to that effect is
displayed, so the user understands what corrective action to take.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit a8cf37b6e8e33c53d9be4cc1998d3b2f80700fbd)

Merge pull request #64311 from ivancich/wip-70824-reef

reef: rgw: add force option to `radosgw-admin object rm ...`

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

librbd: Clean up usage of IoCtx

Clean up of librbd::IoCtx to librados::IoCtx in Group.cc

Signed-off-by: Miki Patel <miki.patel132@gmail.com>
(cherry picked from commit ac14330994f42e92ed54e0a8857fea4f775c4fe5)

Conflicts:
src/librbd/api/Group.cc [ commit e5ccce14c4b0 ("rbd: add group
  snap info command") not in reef ]

librbd: images aren't closed in group_snap_*_by_record() on error

Fixes memory leak and handles resource leak scenario when at leat one IoCtx is not
created successfully. This is done by returning error before opening any image.
Changes are made in group_snap_remove_by_record and group_snap_rollback_by_record

Fixes: https://tracker.ceph.com/issues/71961
Signed-off-by: Miki Patel <miki.patel132@gmail.com>
(cherry picked from commit 693eabf58cc19eba4c21e2ea7c0011643659b3c3)

Merge pull request #64612 from rhcs-dashboard/sys-packages-dashboard-reef

reef: mgr/dashboard: use system packages when running tox

mgr/dashboard: sitepackages only for py3

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 6985ed15ce20c24f7fa87c23ac65b28cf544c9b7)

Revert "mgr/dashboard: pin lxml to fix run-dashboard-tox-make-check failure"

This reverts commit 1f84505f1232dd8445df1a2a819fa000062d3934.

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 8e6b6cdd5c302577c81aa041ef4b3f494ed717a7)

 Conflicts:
src/pybind/mgr/dashboard/requirements.txt
 - only removed the lxml pinning

mgr/dashboard: disable saml2 tests when the dep is not there

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 8acf8f7e4fe6d283212154857abd97b6e641de4d)
(cherry picked from commit 740df4666545c1e358757beeceba4bfbeed76e7c)

 Conflicts:
src/pybind/mgr/dashboard/controllers/saml2.py
 - kept the config options as it is in reef
src/pybind/mgr/dashboard/tox.ini
 - kept the file as is in reef