doc/radosgw: Improve formatting in layout.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit a7dcc3cf24239a9728d9622e4a980894e7741e48)

Merge pull request #62995 from ronen-fr/wip-rf-qa71099-squid

squid: osd/scrub: always round up reported scrub duration

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #62956 from ronen-fr/wip-rf-62692-squid

squid: osd/scrub: additional configuration parameters to trigger scrub reschedule

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #62974 from ronen-fr/wip-rf-24647e8-qatarget-squid

squid: qa/standalone/scrub: fix osd-scrub-test.sh

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

osd/scrub: always round up reported scrub duration

as expected by some tests, and clearer for the user.

Fixes: https://tracker.ceph.com/issues/71099
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

qa/standalone/scrub: fix osd-scrub-test.sh

following changes in scrub code

(cherry picked from commit 24647e87e8fba9b16d81730662b22798ed1885cb)
Conflict resolved by:
- electing to keep the up-to-date order between 'set noscrub' and 'set ..chunk_max'
in 'step 2'

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #62989 from zdover23/wip-doc-2025-04-26-backport-62988-to-squid

squid: doc/radosgw: Fix RST syntax rendeded as text in oidc.rst

doc/radosgw: Fix RST syntax rendeded as text in oidc.rst

Empty line after starting a pre-formatted block with the double-colon
syntax is required, otherwise the double-colon does nothing and is just
rendered as-is as "::" and there would be no following pre-formatted
block.

Add empty lines after the double-colon syntax so that the following
block is rendered pre-formatted.

Also add bash privileged prompts to a block with 2 example CLI commands.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit b4fb5dc4030b4de477942630ebe3b98b882ae978)

Merge pull request #62748 from ivancich/wip-70825-squid

squid: rgw: add force option to radosgw-admin object rm ...

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62741 from jzhu116-bloomberg/wip-70741-squid

squid: rgw: cleanup orphaned bucket entry in <user>.buckets OMAP

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62559 from cbodley/wip-70517-squid

squid: rgw: rgw_init_ioctx() adds set_pool_full_try()

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62356 from cbodley/wip-70528-squid

squid: rgw: sync fairness watcher reconnects on any error

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Oguzhan Ozmen <oozmen@bloomberg.net>

Merge pull request #62034 from kchheda3/wip-70210-squid

squid: rgw:lua: Skip the healthchecks and system requests from going to backend storage

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #62752 from idryomov/wip-70831-squid

squid: test/librbd/test_notify.py: force line-buffered output

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #62337 from yuvalif/wip-67309-squid

squid: rgw/async/notifications: use common async waiter in pubsub push

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #61546 from aiivashchenko/wip-69588-squid

squid: rgw: add missing last_modified field to swift API

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Tobias Urdin <tobias.urdin@binero.com>

Merge pull request #61995 from cbodley/wip-70170-squid

squid: rgw: fix to correctly store updated attrs in backend store after erasing an attr/attrs for delete ops on a bucket.

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #61532 from soumyakoduri/wip-skoduri-squid

squid: rgw: Fix a bug in LCOpAction_Transition::check()

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

osd/scrub: additional configuration params to trigger scrub reschedule

Adding the following parameters to the (small) set of configuration
options that, if changed, trigger re-computation of the next scrub
schedule:
- osd_scrub_interval_randomize_ratio,
(not cherry-picked) - osd_deep_scrub_interval_cv, and
- osd_deep_scrub_interval (which was missing in the list of
  parameters watched by the OSD).

Fixes: https://tracker.ceph.com/issues/70909
Original tracker: https://tracker.ceph.com/issues/70806
(cherry picked from commit d56f613d5a69797e727938f04b66aed747cfb6b1)
Conflicts resolved by removing refs to the deep_scrub_interval_cv
parameter, which does not yet exist in this version.
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #61782 from cbodley/wip-69933-squid

squid: rgw: allow management of `accounts` user caps

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #61242 from kchheda3/wip-69410-squid

squid: rgw/notification: Forward Topic & Notification creation request to master when notification_v2 enabled

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #61161 from ivancich/wip-69136-squid

squid: rgw: relax RGWPutACLs_ObjStore::get_params read data log

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #61840 from vshankar/wip-69683

squid: mds: prevent duplicate wrlock acquisition for a single request

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #62531 from aaSharma14/wip-70686-squid

squid: mgr/dashboard: fix image filter's query on rbd-details grafana panel

Reviewed-by: Afreen Misbah <afreen@ibm.com>

common: missing std include with GCC 14

In file included from src/rgw/driver/posix/bucket_cache.h:19,
                 from src/test/rgw/test_posix_bucket_cache.cc:4:
src/common/cohort_lru.h: In member function _void cohort::lru::TreeX<T, TTree, CLT, CEQ, K, LK>::lock()_:
src/common/cohort_lru.h:334:14: error: _for_each_ is not a member of _std_
  334 |         std::for_each(locks.begin(), locks.end(),
      |              ^~~~~~~~
src/common/cohort_lru.h: In member function _void cohort::lru::TreeX<T, TTree, CLT, CEQ, K, LK>::unlock()_:
/home/yuvalif/ceph5/src/common/cohort_lru.h:339:14: error: _for_each_ is not a member of _std_
  339 |         std::for_each(locks.begin(), locks.end(),
      |              ^~~~~~~~

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

rgw/async/notifications: use common async waiter in pubsub push

* use the "yield_waiter" and "waiter" from common/async insteasd of the "waiter"
  implemented inside the bucket notification code (this is so we don't
  need separate investigations for 2 implementations)
* added a unit test that simulate how a separate thread (kafka or amqp) is
resuming a coroutine which is created by either the frontend or the
notification manager.

before using "defer" the unit test is passing, however,
when executed under thread sanitizer (using the WITH_TSAN cmake flag)
the following errors are observed: https://0x0.st/Xp4P.txt
after using "defer" the unit test passes under TSAN without errors.

Fixes: https://tracker.ceph.com/issues/64184
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
(cherry picked from commit 2872c75f184c9e715219dfa9ad44f5b6cfe4e1fe)

common/async: add yield_waiter template

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit dd779c74e1eebaf888d95b2329c7d5ead176f0a9)

Merge pull request #62386 from pritha-srivastava/wip-70535-squid

squid: rgw/sts: replacing load_stats with list_buckets

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #61062 from k0ste/wip-69218-squid

squid: rgw: Delete stale entries in bucket indexes while deleting obj

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #62586 from cbodley/wip-70738-squid

squid: rgw: fixing tempest ObjectTestACLs and ObjectACLsNegativeTest cases

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62590 from cbodley/wip-70739-squid

squid: cls/rgw: non-versioned listings skip past version suffix

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62365 from cbodley/wip-70538-squid

squid: qa/rgw: fix user cleanup in s3tests task

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62623 from rhcs-dashboard/wip-70762-squid

squid: mgr/dashboard: enable ha by default on subsystem POST API

Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #62495 from kchheda3/wip-66805-squid

squid: rgw/notification: For kafka include user-id & password as part of the key along with endpoint for connection pooling.

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62881 from cbodley/wip-doc-rgw-user-admin-system-squid

squid: doc/rgw: document Admin and System Users

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw: document Admin and System Users

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit dc93b888f16793b00390b32d6814f9243b6808e2)

doc/rgw: Admin Capabilities section links to Admin Ops API

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cdc04b87842e02f81add403c8843b77e56cb3ef4)

Merge pull request #62874 from zdover23/wip-doc-2025-04-18-backport-62300-to-squid

squid: doc/cephfs: link section for pausing async threads in section for...

doc/cephfs: link section for pausing async threads in section for...

disabling volumes plugin part.

Fixes: https://tracker.ceph.com/issues/70479
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 36cfbfb0eacbfbd459558d1bdff699daf8fae575)

rgw: metadata and data sync fairness notifications to retry upon any error case

This is a complementary fix to the earlier one described at #62156.
When the sync shard notification fails due to any failures including timeout,
this change keeps the loop going for both metadata and data sync.

Fixes https://tracker.ceph.com/issues/70270

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>
(cherry picked from commit 766b7a14315ae7ca9645b462ee774570caeff64c)

Merge pull request #60978 from cbodley/wip-69148-squid

squid: test/rgw/multisite: add meta checkpoint after bucket creation

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62856 from zdover23/wip-doc-2025-04-17-backport-62763-to-squid

squid: doc/radosgw: Promptify CLI, cosmetic fixes

doc/radosgw: Promptify CLI, cosmetic fixes

Use the more modern prompt block for CLI commands
and use right one $ vs #.
Fix indentation on JSON example outputs and
some CLI command switches.
Add some arguably missing comma in JSON example output.
Add a full stop at the end of a one-sentence paragraph.
Remove extra comma mid-sentence in another.
Fix missing backslashes or typo at end of multiline commands.
Lines under section headings as long as heading text.
Fix hyperlinks. Fix list items prefixed with - insted of *.
Format configuration syntax in the middle of text as code.
Fix typo "PI" to "API" and remove extra space.
Remove colons at the end of section headers in a few places.
Use Title Case in section titles consistently with short words lowercase.
Possibly controversial: don't add whitespace before and
after main title section header text.
Possibly controversial: don't indent line continuation
backslashes, leave only 1 space before them.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit 7fdaa94181c6fca7d4db0b6f4ee6646528121d43)

Merge pull request #58285 from pponnuvel/wip-66701-squid

squid: mgr/nfs: Don't crash ceph-mgr if NFS clusters are unavailable.
Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>

Merge pull request #62834 from zdover23/wip-doc-2025-04-16-backport-62795-to-squid

squid: doc/radosgw/cloud-transition: fix details

doc/radosgw/cloud-transition: fix details

Fix documentation on Ceph cloud storage transitions - broken link urls, returning back reStructuredText and some other details.

Signed-off-by: Laimis Juzeliunas <laimis.juzeliunas@oxylabs.io>
Co-authored-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit c47b559547326f837dde9dfed9eef526e275fa8e)

Merge pull request #62202 from ifed01/wip-ifed-fix-expand-squi

squid: os/bluestore: fix bdev expansion and more

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

tool/ceph-bluestore-tool: Make bluefs-bdev-expand command output nicer.

Here is a sample output:

inferring bluefs devices from bluestore path
0 : device size 0x4049c000(1.0 GiB) : using 0x1801000(24 MiB)
1 : device size 0x140000000(5 GiB) : using 0x1502000(21 MiB)
2 : device size 0x8c0000000(35 GiB) : using 0x40014000(1.0 GiB)
Expanding DB/WAL...
0 : nothing to do, skipped
1 : Expanding to 0x140000000(5 GiB)
1 : size updated to 0x140000000(5 GiB)
2 : Expanding to 0x8c0000000(35 GiB)
2 : size updated to 0x8c0000000(35 GiB)

Fixes: https://tracker.ceph.com/issues/67966
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit ac7789139e3d4ba3bfd69ddcd4fe504c35b42bc3)

os/bluestore: do not log undecodable bdev label as an error

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit a70a3ced7e1f4ba0d124550d053e54d3a320f782)

doc/ceph-bluestore-tool: add description for show-label-at command.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 4f5f8483444e4fa16939d917ca5e42120e7ccbc9)

os/bluestore: fix alloc update after bdev expansion in NCB mode.

Fixes: https://tracker.ceph.com/issues/69997
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit bd7764bc699b4cc6b3edaf99369e40b59f335b21)

os/bluestore: be less strict in main bdev label validation.

This eliminates treating as an error the case when valid bdev label(s)
exists at location(s)  beyond the size in bdev label.
This is effectively not an error but _check_main_bdev_label() returns an
error in this case. Which is undetectable by fsck and unrecoverable by repair.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 2a9c776f6aa39e8f73ed0159f3c58ad2522a114a)

os/bluestore: use proper device when updating DB/WAL label while
expanding.

Fixes: https://tracker.ceph.com/issues/69999
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit ba3e4d2c9daf6b3af8340607e722f31b83e69db8)

os/bluestore: don't use bdev.size() when dealing with bdev labels in fsck.

This might cause assertions after incomplete volume expansion
(expand-device cmd hasn't been called) as allocmap bitmaps are initialized with
bdev label.size not bdev.size() and hence they are accessed
out-of-bound.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 173bbe7dba7f0b835246fab9ecdba1f13c544460)

os/bluestore: fix bdev label.size update when expanding device.

Fixes: https://tracker.ceph.com/issues/69981
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit c06ccf57de36d8485754a9e65ce2ce997dbe7c5c)

tools/bluestore-tool: add "show-label-at" command

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 19788291c991d11313fb2bebce48dcb7354b882e)

tools/bluestore-tool: dump label locations with "show-label" cmd

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 97bbbb11b3b4c5e5c69059f3c07a3d026efc8261)

Merge pull request #62151 from YiteGu/wip-70148-squid

squid: blk/kerneldevice: notify_all only required when discard_drain wait for condition

Merge pull request #62576 from YiteGu/wip-70671-squid

squid: blk/kerneldevice: fix invalid iterator usage after erase in discard_q…

Merge pull request #62810 from zdover23/wip-doc-2025-04-15-backport-62799-to-squid

squid: doc/cephadm/services: Fix formatting in osd.rst

doc/cephadm/services: Fix formatting in osd.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit c56d2a5aaf79a3440607946a55b9e59ca8a6de5b)

Merge pull request #61323 from ljflores/wip-69493-squid

squid: common/pick_address: Add IPv6 support to is_addr_in_subnet

Merge pull request #62796 from zdover23/wip-doc-2025-04-14-backport-62784-to-squid

squid: doc/cephadm: Add admonition re restarting an OSD service

doc/cephadm: Add admonition re restarting an OSD service

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 524db4609f5f0b4639828b327cfc972243e08ce7)

Merge pull request #62711 from cbodley/wip-70783-squid

squid: rgw: keep the tails when copying object to itself

Reviewed-by: Jane Zhu <jzhu116@bloomberg.net>

Merge pull request #62739 from ceph/squid-release

v19.2.2

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #62311 from adamemerson/wip-63786-squid

squid: test/cls_2pc_queue: fix multi-threaded access to non-atomic variables

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #62307 from adamemerson/wip-63378-squid

squid: rgw/multisite: handle errors properly in RGWDataFullSyncSingleEntryCR()

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #60785 from awojno-bloomberg/wip-68995-squid

squid: rgw: implement x-amz-replication-status for PENDING & COMPLETED

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #62731 from afreen23/wip-70836-squid

squid: mgr/dashboard: Fix empty ceph version in GET api/hosts

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #62395 from shraddhaag/wip-70135-squid

squid: rados/test_crash.sh: add PG_DEGRADED to ignorelist

Merge pull request #62402 from adamemerson/wip-70422-squid

squid: rgw: Try to handle unwatch errors sensibly

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #61986 from zdover23/wip-doc-2025-02-25-backport-61984-to-squid

squid: doc/rgw: clarify path-style vs virtual-hosted-style access

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

test/librbd/test_notify.py: drop RBD_DISABLE_UPDATE_FEATURES

This was put in place in commit 9c0b239d70cd ("qa/upgrade:
conditionally disable update_features tests") to paper over a backwards
compatibility issue that arose from commit 01ff1530544c ("librbd: make
all maintenance op notifications async").  It's not needed in squid or
later because upgrades from octopus are tested only until reef.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit bfc0b4f3015ec79c00a0ab684a4b7d58cb667e86)

test/librbd/test_notify.py: force line-buffered output

"master" and "slave" invocations are intended to run in parallel and
coordinate between themselves.  Ensure that their respective output is
properly timestamped and ordered in teuthology.log file.

Fixes: https://tracker.ceph.com/issues/70831
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 49dbabcecec7c458a6d2ddfbd8e14a6ec419b953)

Merge pull request #62540 from jbaergen-do/btree2-backport-upstream-squid

squid: Backport the hybrid_btree2 allocator and prereqs

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>

rgw: clean-up of some code

Comments added and formatting adjusted.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit a84f984d0324e9abc060f166dd626063361a7ab0)

rgw: add doc & doc testing for force option on `radosgw-admin object rm ...`

Subject says it all.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 333b5cd1e36c53b69462961046199e69e906f1cc)

rgw: add force option to `radosgw-admin object rm ...`

The `radosgw-admin object rm ...` sub-command will give up if it
determines that there's an issue with the head object. This can make
it difficult for an admin to clean up a bucket index when there's a
damaged or missing head object.

When the user adds the "--yes-i-really-mean-it" command-line option,
it enables the "force mode". The bucket index entry(ies) will be
removed. If the object being removed is the current version in a
versioned bucket, the appropriate changes to the OLH will take place.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 7e1ac21069e14a4d6c4d4748971943b7c8b8137c)

blk/kerneldevice: notify_all only required when discard_drain wait for condition

This will cause discard threads to wake up each other
if bdev_async_discard_threads >= 2.

Fixes: https://tracker.ceph.com/issues/67835
Signed-off-by: Yite Gu <yitegu0@gmail.com>
(cherry picked from commit cec2e4550fe520fa60445678934c04ba605913be)

Merge pull request #62143 from ifed01/wip-ifed-no-compression-plugin-reload-squid

squid: os/bluestore: do cache locally compressor engines ever used

Merge pull request #61854 from batrick/wip-69960-squid

squid: pybind/mgr/mgr_module: turn off all automatic transactions

Merge pull request #62221 from ifed01/wip-ifed-limit-discard-qlen-squid

squid: blk/KernelDevice: Introduce a cap on the number of pending discards

rgw: CreateBucket returns success even if a racing DeleteBucket succeeds too

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit 68c674ad48beb23e5cfd4eedabe53c880aeb45a5)

rgw: cleanup orphaned bucket entry in <user>.buckets OMAP

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit 8fdf4431dc98ee3735dde9121501fedb9835bb71)

Merge pull request #60562 from rishabh-d-dave/wip-68678-squid

squid: mgr: allow disabling always-on modules

Merge pull request #62211 from NitzanMordhai/wip-70383-squid

squid: suites/rados: cache tier deprecated, no need to keep the tests for it

19.2.2

Signed-off-by: Ceph Release Team <ceph-maintainers@ceph.io>

PendingReleaseNote: add release note that mgr/volumes plugin can be...

disabled now.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 3232f6b7af15c011774c3ff37c8a98e5cf7c4887)

qa/cephfs: test enable/disable of volumes plugin

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 0abc227131c3e16077013f25a7c0fcfe1b7285a1)

Conflicts:
qa/cephfs/overrides/ignorelist_health.yaml
- this file in main had more entries than on this (squid) branch,
  resulting in cherry-picking conflict.

qa/tasks/cephfs/test_admin.py
- this file in main had more tests and a new set of test adjacent to
  tests added by this patch-series, resulting in cherry-picking conflict.

mon/MgrMonitor: allow disabling always-on MGR modules

Add a new command ("ceph mgr module force disable <module>") that allows
forcibly disabling an always-on module. This command should ideally only
be used to for cluster recovery.

Fixes: https://tracker.ceph.com/issues/66005
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 9962772358048a98a6e871dccf1bfd0a15b4d791)

mon/MgrMontitor: add log entry to support debugging

It becomes easier to understand logs when whether command succeeded or
not are also logged.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 4374ac74d283ce1c50616330a0127a53623d96c3)

mon/MgrMonitor: improve a log message

Following log message has 3 distinct information (enabled modules,
modules that are alwats on and total number of commands enabled) printed
on the same line which makes it hard to find one of the information and
also makes it comparatively hard to read -

2024-07-17T17:21:16.609+0530 7f534ae006c0  0 mon.a@0(leader).mgr e0 create_initial initial modules iostat,nfs,volumes, always on modules balancer,crash,devicehealth,orchestrator,pg_autoscaler,progress,status,telemetry, 50 commands

With this commit it would be easier to read and find needed info -

2024-07-17T17:21:16.609+0530 7f534ae006c0  0 mon.a@0(leader).mgr e0 create_initial initial modules: iostat,nfs,volumes
2024-07-17T17:21:16.609+0530 7f534ae006c0  0 mon.a@0(leader).mgr e0 create_initial always on modules: balancer,crash,devicehealth,orchestrator,pg_autoscaler,progress,status,telemetry
2024-07-17T17:21:16.609+0530 7f534ae006c0  0 mon.a@0(leader).mgr e0 create_initial 50 commands

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit e830f89240e382fdf5da676437ff783c4ea6ae42)

Merge pull request #62270 from cybozu/wip-70445-squid

squid: debian: add ceph-exporter package

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

mgr/dashboard: Fix empty ceph version in GET api/hosts

Fixes https://tracker.ceph.com/issues/70821

Due to the pagination the host list is being fetched from orchestrator which caused a regression as via orchestrator list ceph version is always marked empty.
Caused by https://github.com/ceph/ceph/pull/52154

Also fixed tests , as the new version addition causing whole json object mock to fail in tests

Signed-off-by: Afreen Misbah <afreen@ibm.com>
(cherry picked from commit 1aa74cf3fce6394ad08e83e91a90923d983b03c5)

Merge pull request #61496 from ljflores/wip-69168-squid

squid: qa/workunits/mon: ensure election strategy is "connectivity" for stretch mode
Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>

rgw: remove keep_tail from RGWObjState

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit fd76b6466c298121994ba65cce3c0e76f8568841)

Conflicts:
src/rgw/rgw_sal_store.h RGWObjState is in rgw_sal.h on squid

rgw: keep the tails when copying object to itself

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit 333e4a9b0de745cf5be40c5f6c32df7a340b007a)

rgw: remove keep_tail from RGWObjState

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit fd76b6466c298121994ba65cce3c0e76f8568841)

Conflicts:
src/rgw/rgw_sal_store.h RGWObjState is in rgw_sal.h on squid

rgw: keep the tails when copying object to itself

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit 333e4a9b0de745cf5be40c5f6c32df7a340b007a)