Merge pull request #58385 from smanjara/wip-squid-pr-56874

[squid] qa/multisite: stabilize multisite testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58578 from zdover23/wip-doc-2024-07-15-backport-58574-to-squid

squid: doc/cephfs: edit "is mount helper present"

Merge pull request #58001 from amathuria/wip-66421-squid

squid: osd/scrub: Change scrub cost to average object size

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>

Merge pull request #57618 from sajibreadd/wip-66143-squid

squid: osd: CEPH_OSD_OP_FLAG_BYPASS_CLEAN_CACHE flag is passed from ECBackend

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #57195 from k0ste/wip-64591-squid

squid: os/bluestore: fix the problem of l_bluefs_log_compactions double recording

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

doc/cephfs: edit "is mount helper present"

Edit the section called "Is mount helper present?", the title of which
prior to this commit was "Is mount helper is present?". Other small
disambiguating improvements have been made to the text in the section.
An unselectable prompt has been added before a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0ebfb3eda8e2fc88662530bbddc84f2efcc4e13c)

Merge pull request #58071 from yuvalif/wip-66497-squid

squid: rgw/admin/notification: add command to dump notifications

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #58538 from cbodley/wip-66913-squid

squid: rgw/datalog: fix LazyFIFO race fix

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #58545 from smanjara/wip-66919-squid

squid: rgw/multisite: allow PutACL replication.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58550 from idryomov/wip-test-cookie-squid

squid: test/librbd: clean up unused TEST_COOKIE variable

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #58477 from afreen23/wip-backport-nvmeof-service

Batch backport of nvmeof service configuration

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #58521 from cbodley/wip-66897-squid

squid: install-deps.sh, do_cmake.sh: almalinux is another el flavour

Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
Reviewed-by: Dan van der Ster <dan.vanderster@clyso.com>

test/ librbd: clean up unused 'TEST_COOKIE'

Clean them up because
```
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/src/test/librbd/exclusive_lock/test_mock_PreAcquireRequest.cc:47:26: error: unused variable 'TEST_COOKIE' [-Werror,-Wunused-const-variable]
static const std::string TEST_COOKIE("auto 123");
                         ^
1 error generated.
```

Ref: https://jenkins.ceph.com/job/ceph-pull-requests-arm64/59242/consoleFull#-5120798632a811ea2-3e7b-466b-84b4-d13df7e35809

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
(cherry picked from commit 49869222c816023f696ff2a42898e2d9f3f54215)

qa/multisite: add object set acl test

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit d18b722557af8fc082d578547fa7be07a8ffc49e)

rgw/multisite: allow modified object acls to be replicated

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit f5f6194c07b40c50913e956e06aaa3709d4d53aa)

Merge pull request #58479 from afreen23/wip-backport-nfs

Batch backport NFS route separation for cephfs and rgw

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

rgw/datalog: fix LazyFIFO race fix

initialize `fifo_tmp` to prevent the race on member variable `fifo` that
was identified in 8fa844383f9c22e758f39ecdda74f70de054ad68

Fixes: https://tracker.ceph.com/issues/66880
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 5dfbaac15f0ffb3dfe84ae304643d1cf4eee892d)

Merge pull request #58255 from rhcs-dashboard/wip-66254-squid

squid: mgr/dashboard: rgw bucket replication management

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #58244 from rhcs-dashboard/wip-66425-squid

squid: mgr/dashboard: fix edit bucket failing in other selected gateways

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: nmunet <NOT@FOUND>

Merge pull request #58337 from rhcs-dashboard/wip-66737-squid

squid: mgr/dashboard: fix clone async validators with different groups

Reviewed-by: nmunet <NOT@FOUND>

Merge pull request #58436 from cbodley/wip-66839-squid

squid: doc/rgw: update s3 authentication

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

install-deps.sh, do_cmake.sh: almalinux is another el flavour

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
(cherry picked from commit 6e85f76385c3cffd860a8a3054bf14ce85a43b59)

Merge pull request #57971 from adk3798/squid-adjust-bootstrap-config-priorities

squid: cephadm: the user config is preferred during the bootstrap

Reviewed-by: John Mulligan <jmulligan@redhat.com>

mgr/dashboard: fix nav urls for cephfs and nfs

Fixes: https://tracker.ceph.com/issues/66697
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit e8d0e76b63079f8d16c470030bda105637e1bb1e)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

mgr/dashboard: Fix NFS routing

Fixes https://tracker.ceph.com/issues/65310

The NFS tab in object and File nav uses same route due to which both
gets activated when one of them is clicked.
Hence, this PR separates the routing for Object and File nav.
Object-> NFS: /rgw/nfs
File-> NFS: /cephfs/nfs

Both routes use same NFS List and Form component but under different
routes as mentioned above.

Changes summary
- updated route for File from "/fs" to "/cephfs/<any_other_sub_route>"
  to support both fs and nfs tabs. Since using `/fs` and `/fs/nfs` will
activate both paths and it will be an undesirable user experience.
- `getFsalRouteFromPath` helper function to set the storage backend from
  route.
- removed `stoarge-backend` field from nfs form as now route decides teh
  storage backend
- breadcrumbs redirect to respective navs
- updated e2e tests
- updated unit tests
- changes list page of object-> nfs page to say Bucket instead of Path

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 97359d6b1ee8133afcddf1f540b147c26723e24e)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

mgr/dashboard: fix service form count bugs

Fixes https://tracker.ceph.com/issues/66608

- for services which do not have a count set default count to be null, otherwise the previous selected service's count is used which is wrong
- make count null when label is selected for placement

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit 27a8b2f2883fcc1fc4128b3e8995a7819a5ae51e)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.html
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

mgr/dashboard: fix service page e2e tests

- service page now uses defaults value for the placement count due to which mds test failing
- in test we pass "1" while "2" which is the default count for mds is already populated, making it 21 and causing unable to create mds service

Fixes: https://tracker.ceph.com/issues/66540
Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit 5a718229dc43953f140a16342f19523a1c075863)
(cherry picked from commit 1da0a4f8cb234ef84729c24cc9a82397361e9534)

Conflicts:
src/pybind/mgr/dashboard/frontend/cypress/e2e/pools/pools.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/cypress/e2e/pools/pools.po.ts

mgr/dashboard: Configure NVMe/TCP

Fixes https://tracker.ceph.com/issues/63686

- creation of Nvme-oF/TCP service
- deletion of Nvme-oF/TCP service
- edit/update Nvme-oF/TCP service
- added unit tests for Nvme-oF/TCP service
- changed Id -> Service Name
- added prefix of service type in service name (similar to <client.> in
  fs access)
- service name and pool are required fields for nvmeof
- placement count now takes default value as mentioned in cephadm
- slight refactors
- prepopulate serviceId for each service type setServiceId()
- in case serviceId is same as servcie type then do not add create service name with<servicetype>.<setrviceid> format

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit c6cf91766c45cf766c1d5a3851c2e956a80ac9ee)

Merge pull request #58488 from zdover23/wip-doc-2024-07-10-backport-58484-to-squid

squid: doc: Correct link to "Device management"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58468 from zdover23/wip-doc-2024-07-09-backport-58454-to-squid

squid: doc/cephfs: fix typo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: Correct link to "Device management"

The current link goes to `cephadm/services/rados/operations/devices` which is a 404, it instead needs to be `rados/operations/devices/`.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit d1a7cc4978adacd4e11df2d3e0886b191b118cc1)

Merge pull request #58443 from cbodley/wip-66847-squid

squid: rgw: fix multipart get part when count==1

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #58089 from ronen-fr/wip-rf-57865-squid

squid: osd/scrub: allow new scrubs while reserving

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #57623 from sajibreadd/wip-65937-squid

squid: os/bluestore: set rocksdb iterator bounds for Bluestore::_collection_list()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #57382 from pdvian/wip-65890-squid

squid: mgr: integrate optracker in ceph-mgr

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Michael Kidd <linuxkidd@gmail.com>

Merge pull request #56200 from ifed01/wip-ifed-fix-64443-squi

squid: test/store_test: fix DeferredWrite test when prefer_deferred_size=0

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

doc/cephfs: fix typo

blanacer -> balancer

Signed-off-by: spdfnet <32593931+spdfnet@users.noreply.github.com>
(cherry picked from commit d94f90b757189e269882523178a401cd4411a946)

Merge pull request #58072 from yuvalif/wip-66499-squid

squid: rgw: do not assert on thread name setting failures

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #57784 from yuvalif/wip-66288-squid

squid: rgw/kafka: do not destroy the connection on errors

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw/admin/notification: add command to dump notifications

command will dump pending notifications from a persistent queue in JSON
format:

radosgw-admin topic dump --topic <name>

Fixes: https://tracker.ceph.com/issues/66404
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
(cherry picked from commit e63e663dc9095589f4fe28d541fd5178c033bffd)

Conflicts:
src/rgw/driver/rados/rgw_notify.cc
        src/test/rgw/bucket_notification/test_bn.py

Merge pull request #57996 from kchheda3/wip-66443-squid

squid:  rgw/notification: Store the value of `persistent_queue` for existing topics and continue commiting events for all topics subscribed to given bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw: fix multipart get part when count==1

the RGWObjManifest for multipart uploads is subtly different when
there's only a single part. in that case, get_cur_part_id() for the
final rule returns 1 where it otherwise returns (parts_count + 1)

this caused two problems:
* we returned a parts_count of 0 instead 1, and
* the do-while loop got stuck in an infinite loop expecting the last
  rule's part id to be higher than the requested part id

Fixes: https://tracker.ceph.com/issues/66705
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 562e0ce9baac53e714d91a46b4f0114b82827026)

Merge pull request #58420 from guits/wip-66830-squid

squid: qa: fix log errors for cephadm tests

doc/rgw: update s3 authentication

authentication.rst described the steps to generate a v2 signature,
without reference to aws docs. replace that with sections that reference
aws docs for v2 and v4 signatures. list which values of the request
header x-amz-content-sha256 are supported for v4

Fixes: https://tracker.ceph.com/issues/42888
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 05cab64b9ce3662f0d3e9673dfbbb5d42906caf7)

Merge pull request #58431 from zdover23/wip-doc-2024-07-05-backport-58368-to-squid

squid: doc/rados: document manually passing search domain

doc/rados: document manually passing search domain

Document how to manually pass the search domain to "mon_dns_srv_name" in
doc/rados/configuration/mon-lookup-dns.rst.

This commit is made in response to a request by Lander Duncan that was made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 98938a0312dd0c8e0b293ed9aa2e0760cc9619fa)

Merge pull request #58422 from AliMasarweh/wip-66772-squid

squid: RGW|Bucket notification: reload realm correctly

Reviewed-by: yuvalif<ylifshit@redhat.com>

Merge pull request #58246 from rhcs-dashboard/wip-66486-squid

squid: mgr/dashboard: add dueTime to rgw bucket validator

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

RGW|Bucket notification: disable notif v2 to reload realm correctly

Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
(cherry picked from commit cce9b3c63ff0d83b3ab337c7c64b140e007290e1)

qa: fix log errors for cephadm tests

This fixes a lot of errors induced by the log scrapper check.

Fixes: https://tracker.ceph.com/issues/66751
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 53b462764c6fe11282b6cdb21131c176c1ed2350)

qa/cephadm: fix ignorelist of CEPHADM_STRAY_DAEMON for rados_api_tests

Not every log with this error has the parentheses, so
these warnings were still causing the test to fail

[ERR] [WRN] CEPHADM_STRAY_DAEMON: 2 stray daemon(s)... in cluster log

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 0a67436e36289b2e1bcf0acf662214b9e659b0de)

Merge pull request #57224 from kotreshhr/wip-65404-squid

squid: mds: log at a lower level when stopping

Merge pull request #57981 from dparmar18/wip-66191-squid

squid: client: set LIBMOUNT_FORCE_MOUNT2=always

Merge pull request #58085 from rishabh-d-dave/wip-66500-squid

squid: cephfs-shell: prints warning, hangs and aborts when launched

Merge pull request #58389 from zdover23/wip-doc-2024-07-02-backport-58092-to-squid

squid: doc/start: remove mention of Centos 8 support

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

doc/start: remove mention of Centos 8 support

Remove information so that it is clear that Centos 8 will no longer be
supported by Ceph.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6b149e4f6ab2ac716e73f42b0d6c67482a768da9)

multisite/qa: resolve rebase conflicts

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 6753e27daab5135973fa45e5a45a4e8e5fbac101)

multisite/qa: disable sync error injection

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit da788bc28dbf19bbb54fa91b8c3867063b711551)

qa/multisite: disable two-zonegroup and three-zone configs.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit fb3186266ee52b352ebdf4ce394d3144a23db8f2)

qa/rgw/multisite: enable notification_v2 feature

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1e7fc66683e4dea7294f0ec95f47b22f48b33b7e)
(cherry picked from commit ca460de93f42398e2631ab504b141e11373af1fb)

qa/multisite: disable sync policy, endpoint and data_sync_init tests until fixed.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 79d520698d4dc3f06535d3c8fc7ad119fd52ada1)

qa/rgw/multisite: add two-zone configuration

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 14204442ac2eaaaa3f40a76403da49f0f4ed92c1)
(cherry picked from commit 627dd7b86d0c59768625b508b614fa35d008708b)

qa/rgw/multisite: double cluster nodes and osd count

> WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand.

give each cluster 2 nodes instead of 1, and 6 osds instead of 3

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a80cf4bf473c95c8d0b18fcdce88be20f74f973)
(cherry picked from commit a77c2d42277e44633643bcc1f8969f90724c49ef)

qa/rgw/multisite: reduce polling intervals from 20s to 5s

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit bc084c0ac64477abdbf54d96bc4981edf41e1343)
(cherry picked from commit 32fb2b923bc07b2228b8fe7d1c1f4bc2f3bf263b)

rgw/multisite: reconfigure checkpoint delay to 90s

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit af7c4d83c7f5b61e907a90622c082a373f3995d9)

Merge pull request #58266 from amathuria/wip-66694-squid

squid: osd/ECBackend.cc: Fix double increment of num_shards_repaired stat

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58341 from guits/wip-66746-squid

squid: tests: make sure nvmetcli and nvme-cli are up to date

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #58219 from guits/wip-66026-squid

squid: ceph-volume: create LVs when using partitions

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #58151 from guits/wip-66464-squid

squid: ceph-volume: fix set_dmcrypt_no_workqueue()

Reviewed-by: Teoman ONAY <tonay@ibm.com>

Merge pull request #58370 from zdover23/wip-doc-2024-07-01-backport-58366-to-squid

squid: doc/cephfs: update cephfs-shell link

Merge pull request #58198 from ljflores/wip-66605-squid

squid: Telemetry upgrade test fixes

doc/cephfs: update cephfs-shell link

Repair the link to cephfs-shell.rst in doc/cephfs/cephfs-shell.rst that
was broken in https://github.com/ceph/ceph/pull/41165/ when
doc/cephfs/cephfs-shell.rst was moved to doc/man/8/cephfs-shell.rst.

This commit is made in response to a request by Lander Duncan that was
made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4f8903cf80a94596a1b17b4a07affb874f21ae76)

Merge pull request #58359 from zdover23/wip-doc-2024-06-30-backport-58358-to-squid

squid: doc/cephfs: take Anthony's suggestion

doc/cephfs: take Anthony's suggestion

Incorporate Anthony's suggestion in
https://github.com/ceph/ceph/pull/57567#discussion_r1607016050 into
doc/cephfs/fs-volumes.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7a78dda0a92339db27359f91f0cb081703e2e7f9)

Merge pull request #58264 from amathuria/wip-66690-squid

squid: mon, qa: suites override ec profiles with --yes_i_really_mean_it; monitors accept that

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58262 from amathuria/wip-66688-squid

squid: qa/suites/rados/thrash/workloads: remove cache tiering workload

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #57589 from NitzanMordhai/wip-66142-squid

squid: common/pick_address: check if address in subnet all public address

Reviewed-by: Laura Flores <lflores@redhat.com>

tests: make sure nvmetcli and nvme-cli are up to date

Otherwise jobs end up with the following failure:

```
2024-06-25T14:22:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to write to /dev/nvme-fabrics: Invalid argument
```

Also, the output of nvme list has changed so we have to update
qa/tasks/nvme_loop.py accordingly.

Fixes: https://tracker.ceph.com/issues/66707
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d707c41eacb513bdcb9fec17c823bfbfdc182700)

mgr/dashboard: cephfs snapshot and clones e2e tests

Fixes: https://tracker.ceph.com/issues/65180
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 3d1a7c56ccb8eb6d988e034e99e199cd226b1704)
(cherry picked from commit 9fbcf8658863b5a03d7d8fbf0f3e5d23baf6dc59)

mgr/dashboard: fix clone async validators with different groups

Providing a way to dynamically update the async validator based on the
selector field so that when the selected value changes, the depended
field like the clone name gets validated again against the new value

Fixes: https://tracker.ceph.com/issues/66703
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 38bcce2346b3430e93d67a443a27ebdf9232fec9)

Merge pull request #58307 from zdover23/wip-doc-2024-06-27-backport-58287-to-squid

squid: doc/rados: update how to install c++ header files

Merge pull request #58304 from zdover23/wip-doc-2024-06-27-backport-58299-to-squid

squid: doc/dev: Fix typos in encoding.rst

Merge pull request #58090 from vshankar/wip-66519-squid

squid: qa: use centos9 for fs:upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

doc/rados: update how to install c++ header files

In this example librados2-devel only install C header files on fedora 40,
therefore I added libradospp-devel to the command to include C++ header files.

Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 7e87441601db2379488fab62e900cd834086f26d)

doc/dev: Fix typos in encoding.rst

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 9f43c67a639958a13fef198ffe62cf5241f1f53c)

Merge pull request #58271 from zdover23/wip-doc-2024-06-26-backport-58226-to-squid

squid: doc/rados: edit troubleshooting-osd.rst

doc/rados: edit troubleshooting-osd.rst

Make minor changes to the "Debugging Slow Requests" section of
doc/rados/troubleshooting/troubleshooting-osd.rst in preparation
for an expansion of this section in response to a reqeust from Joel
Davidow.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8b211b9c7f9b173bb12028eb7108d13867883d6e)

Merge pull request #58257 from zdover23/wip-doc-2024-06-25-backport-58243-to-squid

squid: doc/rados: credit Prashant for a procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

osd/ECBackend.cc: Fix double increment of num_shards_repaired stat

Commit https://github.com/ceph/ceph/commit/deffa8209f9c0bd300cfdb54d358402bfc6e41c6 refactored
ECBackend::handle_recovery_push for Crimson but accidentally duplicated the code that increments
the num_shards_repaired OSD statistic.

This caused one of the QA tests to fail because the stat reported twice as much repair work
had been completed than expected:

qa/standalone/scrub/osd-scrub-repair.sh: TEST_repair_stats_ec: test 26 = 13

Fixes: https://tracker.ceph.com/issues/64437
Signed-off-by: Bill Scales <bill_scales@uk.ibm.com>
(cherry picked from commit e618dc01a7a1bdfaa3e1a6fa2a9a9ac13eee11b8)

mon: settle erasure-code-profile --yes-i-really-mean-it in asok's schema

Fixes: https://tracker.ceph.com/issues/65183
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 0e70f679d0f32fafd7db39229325cf7db7f6eb05)

qa: tests override ec profiles with --yes-i-really-mean-it

This fixes a fallout from 629ba7bd349d48cdaa6d094751e7cfce651ba2bc.
The problem has been nailed down by Laura Flores.

Fixes: https://tracker.ceph.com/issues/65183
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
(cherry picked from commit 6f813236f8c617b3ff9517cf73ed256b5fede90e)

qa/suites/rados/thrash/workloads: remove cache tiering workload

Fixes: https://tracker.ceph.com/issues/65852
Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 35505a7f1fd8bcad2047426a4d641b4c016180af)

doc/rados: credit Prashant for a procedure

Credit Prashant D for creating the stretch-mode workaround procedure for
retrieving the correct size of datacenters.

Follows: https://github.com/ceph/ceph/pull/58109

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e777cb4f8bd682b807b97074f930826aa902db9)

mgr/dashboard: edit replication policy

Fixes: https://tracker.ceph.com/issues/66240
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit ae5ae5be6146a8254554fa9dcdd2322ea90d0d7b)

mgr/dashboard: get  bucket replication info

- Show bucket replication status and replication policy in the details
view

Fixes: https://tracker.ceph.com/issues/66241
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 9cdb55c2d2ed6f6ca4ab51d0cd40943107d90c0d)

mgr/dashboard: select default daemon based on the default zonegroup

if multisite is configured, the default daemon needs to be selected
based on the default zonegroup. Otherwise dashboard gives you incorrect
details when doing the period commit

The issue occurs when you do a period update --commit and you reload one
of the block page, the api assigns the zonegroup of the second gateway
because for a moment, the first gateway reflects the period changes...
This is not true because the default zonegroup is of the previous active
gateway but even though the back-end correctly says the active
zonegroup, the dashboard api says it wrongly.

Fixes: https://tracker.ceph.com/issues/66394
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 013d0826c12e4bfc9dc2b8984b1605694ac7d2ea)

mgr/dashboard: apply replication policy for a bucket

On a normal multisite configured cluster, you can create a bucket with
this replication enabled which will stop the normal syncing and starts
doing the granular bucket syncing; meaning only the bucket with the
replication enabled will be syncing to the secondary site.

To enable replication, there should be a group policy created in the
primary site. If no group policy is there, the dashboard will create
one with bidirectional rule and add all the zones in the zonegroup for
syncing.

Fixes: https://tracker.ceph.com/issues/66239
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 8ae20324b61d140204b15a23ccedab178c6dcc7c)

mgr/dashboard: manage flow and pipes apis

Fixes: https://tracker.ceph.com/issues/66238
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 73db54b35ff880ba3f710ad893dfffca98b81a06)

mgr/dashboard: rgw policy group management api

Fixes: https://tracker.ceph.com/issues/66238
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 73a7602806ccd8d6cf4131d1e683233352631713)

mgr/dashboard: add dueTime to rgw bucket validator

the unique async validator which checks if the typed bucket is existing
or not in the bucket creation form sends a request to the backend on
each keystroke. Each keystroke will raise an exception if the bucket is
not found.

Fixes: https://tracker.ceph.com/issues/66221
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit c053782cc5d7f3f4493094d37b164e0531f46caf)