doc/rados/operations: remove vanity cluster name reference from crush-map.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 62562ec65e3c1cc040a57ab77fc219e0aad25651)

Merge pull request #58940 from zdover23/wip-doc-2024-07-31-backport-58922-to-squid

squid: doc/cephadm: edit "Using Custom Images"

Merge pull request #58943 from zdover23/wip-doc-2024-07-31-backport-58908-to-squid

squid: doc/glossary: add "ceph-fuse" entry

Merge pull request #58937 from zdover23/wip-doc-2024-07-31-backport-58918-to-squid

squid: doc/dev: improve basic-workflow.rst

doc/glossary: add "ceph-fuse" entry

Add a "ceph-fuse" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d1c049d24befedc396221dafcc66db8c40acf5ab)

doc/cephadm: edit "Using Custom Images"

Edit the section "Using Custom Images" in
doc/cephadm/services/monitoring.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e99fc5c82fd698c222a489a1ebc26c8fcbca321d)

Merge pull request #58763 from smanjara/wip-67025-squid

squid: rgw/multisite: don't retain RGW_ATTR_OBJ_REPLICATION_TRACE attr on copy_object

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc/dev: improve basic-workflow.rst

Make various improvements to doc/dev/developer_guide/basic-workflow.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b81d6af1b488cdb87143e13da519d70c3a090679)

Merge pull request #58658 from rzarzynski/wip-bug-66268-squid

squid: mgr: Convert the last_event_detail data_type to std::string

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Saumay Agrawal <saumay.agrawal@gmail.com>

Merge pull request #57805 from rzarzynski/wip-bug-61948-squid

squid: mon, osd, *: expose upmap-primary in OSDMap::get_features()

Merge pull request #58829 from Matan-B/wip-57709-squid

squid: crimson/os/seastore: avoid getting wrong logical extents through "parent-invalid" lba mappings

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58827 from Matan-B/wip-56150-squid

squid: qa/suites/crimson-rados: add seastore

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58643 from hualongfeng/wip_qat_zlib_data_format_squid

Squid Compressor: Add data format(QZ_DEFLATE_GZIP_EXT) for QAT Zlib

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58906 from Matan-B/wip-58256-squid

squid: crimson/osd: adding osdmap subscribe

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58833 from Matan-B/wip-58225-squid

squid: crimson/osd/osd_operation: fix dump_historic_slow_ops command works

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58691 from ljflores/wip-67055-squid

squid: qa: suppress Leak_StillReachable mon leak in centos 9 jobs

Merge pull request #58803 from ljflores/wip-67160-squid

squid: mon: validate also mons and osds on {rm-,}pg-upmap-primary

Merge pull request #58909 from zdover23/wip-doc-2024-07-30-backport-58904-to-squid

squid: doc/cephfs: edit "Dynamic Subtree Partitioning"

Merge pull request #58851 from yuvalif/wip-66805-squid

squid: rgw/notification: Fix the caching issues of notification brokers, where the cache was not invalidated if topic attributes were changed

Merge pull request #58794 from ivancich/wip-67156-squid

squid: test/rgw: address potential race condition in reshard testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58854 from idryomov/wip-67051-squid

squid: qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #58801 from ljflores/wip-67128-squid

squid: osd: bump versions of decoders for upmap-primary

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58610 from adk3798/wip-66789-squid

squid: cephadm: disable ms_bind_ipv4 if we will enable ms_bind_ipv6

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #58609 from adk3798/wip-66787-squid

squid: mgr: excute cmd 'ceph orch apply osd' returned without error info

Reviewed-by: John Mulligan <jmulligan@redhat.com>

doc/cephfs: edit "Dynamic Subtree Partitioning"

Edit the section "Dynamic Subtree Partitioning" in
doc/cephfs/multimds.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d14119e37e01bd06eed668d9e3606a66ef205b30)

Merge pull request #58901 from zdover23/wip-doc-2024-07-29-backport-58554-to-squid

squid: docs: removed centos 8 and added squid to the build matrix

suites: crimson basic adding wait for test

Fixes: https://tracker.ceph.com/issues/66381
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit a9de8be0f4633ac825f364f8b7ddcd4c4d5b6a2c)

crimson/osd: adding osdmap subscribe

when committed osdmap is complete, it will check if should restart.
in case we shouldn't restart but we are still active, we need
the next osdmap to continue the process.

Fixes: https://tracker.ceph.com/issues/66381
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit 74297e6abac2868afc5edc6765c2284319091de2)

Merge pull request #58832 from Matan-B/wip-58396-squid

squid: suite/crimson: enable stats tests

Reviewed-by: NitzanMordhai <nmordech@redhat.com>

Merge pull request #58821 from Matan-B/wip-57359-squid-v2

squid: vstart.sh: add options to set number of alien threads, and number of cpu cores for alien threads

Reviewed-by: NitzanMordhai <nmordech@redhat.com>

Merge pull request #58886 from Matan-B/wip-58510-squid

squid: crimson: PG stats are not synced between osds after object update

Reviewed-by: NitzanMordhai <nmordech@redhat.com>

Merge pull request #58888 from Matan-B/wip-58694-squid

squid: crimson/osd/recovery_backend: cleanup PGBackend::temp_contents when pg interval changes

Reviewed-by: NitzanMordhai <nmordech@redhat.com>

Merge pull request #58702 from Matan-B/wip-66917-squid

squid: seastar: fix makecheck error: missing 'typename'

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58836 from Matan-B/wip-58357-squid

squid: crimson/os/seastore/btree: interrupt transactions immediately when getting children

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58834 from Matan-B/wip-58250-squid

squid: crimson/os/seastore: write ool extents without padding

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58831 from Matan-B/wip-57828-squid

squid: crimson/os/seastore/btree: improve lba pointer related UT checks

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58824 from Matan-B/wip-58099-squid

squid: crimson: fix ObjectContext::_with_lock to only unlock if lock is taken

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58823 from Matan-B/wip-57691-squid

squid: crimson/osd/osd_operations/client_request_common: `PeeringState::needs_recovery()` may fail if the object is under backfill

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58822 from Matan-B/wip-57147-squid

squid: crimson/osd/pg_recovery: skip unfound objects when recovering the primary

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #58819 from Matan-B/wip-57367-squid

squid: crimson/osd/osd_operations/client_request: check "can_serve_replica_reads" before getting obc

Reviewed-by: Samuel Just <sjust@redhat.com>

docs: removed centos 8 and added squid to the build matrix

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 8761bbe16c2a6d19e136254c26d1d67ebe839e3b)

rgw: fixup compressor_message didn't store in some cases

When I upload a object to RGW by multipart, the head object
xattr(user.rgw.compression) don't have compressor_message
when the value should be valid and part object xattr
have the value.

Signed-off-by: Feng,Hualong <hualong.feng@intel.com>
(cherry picked from commit 8a20dff09f9bba26ecbc7ae5d76a2f720d0746f2)

compressor: Change data formt to QZ_DEFLATE_GZIP_EXT for QAT zlib

QAT zlib 'QZ_DEFLATE_RAW' data format cannot decompress
by QAT hardware. So here we replace 'QZ_DEFLATE_GZIP_EXT' data
format with 'QZ_DEFLATE_RAW'.

'QZ_DEFLATE_GZIP_EXT' data format need to add gz_header
by deflateSetHeader() in QATzip. And it leads multi stream
in one compression for hardware buffer. So the windows bit
is important information for decompression, which related to
if the inflate remove header.

Add busy_polling setting for reducing latency

Signed-off-by: Feng,Hualong <hualong.feng@intel.com>
(cherry picked from commit 855c5d6826dabba0093e65e34be14a2fb1581dd0)

Merge pull request #58892 from zdover23/wip-doc-2024-07-28-backport-58884-to-squid

squid: doc/cephfs: fix "OSD capabilities" link

doc/cephfs: fix "OSD capabilities" link

Fix a broken link from the "OSD capabilites" reference on
doc/cephfs/client-auth.rst.

Fixes: https://tracker.ceph.com/issues/67218
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 74b03a8cb2f196171b10d8cbde27324240649e70)

crimson/osd/recovery_backend: fix RecoveryBackend::temp_contents usage

All temp objects are added *only* to PGBackend::temp_content.
cleaning RecoveryBackend::temp_contents (which is always empty) instead
of PGBackend::temp_contents is wrong.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 71ba42693e7334f3905fb7a45a29caa16e5e8a58)

crimson/osd/pg: update PG stats on handle_rep_op
Fixes: https://tracker.ceph.com/issues/61761
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
(cherry picked from commit 82ae96fa86b7f83067ec42538ac48da0a77afffd)

Merge pull request #58875 from zdover23/wip-doc-2024-07-27-backport-58867-to-squid

squid: doc/cephfs: fix "file layouts" link

Merge pull request #58782 from cbodley/wip-67098-squid

squid: rgw/iam: CreateRole ignores EEXIST after forwarded request

Merge pull request #58714 from Svelar/wip-67071-squid

squid: rgw/amqp: lock erase and create connection before emplace

Merge pull request #58197 from kchheda3/wip-66591-squid

squid: rgw/lifecycle-notification: Do not block lc processing for notification errors.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58873 from afreen23/wip-67202-squid

squid: mgr/dashboard: Add initiators

Reviewed-by: Nizamudeen A <nia@redhat.com>

doc/cephfs: fix "file layouts" link

Fix a broken link to the "File Layouts" page on
doc/cephfs/client-auth.rst.

Fixes: https://tracker.ceph.com/issues/67190
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6bb5ce94c6a2cbfdf978a66d00f428ad4cd4c312)

mgr/dashboard: Add initiators add/update in dashboard

Fixes  https://tracker.ceph.com/issues/66907

- add one or more initiators
- remove one or more initiators
- introduces two new UI routers for the above two

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit 1f82dc8b8f1b5ca17caa69fbbb99554b5a659591)

Merge pull request #58857 from idryomov/wip-67097-squid

squid: qa/suites/krbd: stress test for recovering from watch errors for -o exclusive

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #58779 from aaSharma14/wip-67101-squid

squid: mgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview grafana dashboard

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #58849 from rhcs-dashboard/squid-expand-cluster-navigation-fix

squid: mgr/dashboard: expand-cluster back navigation fix

Merge pull request #58848 from rhcs-dashboard/squid-multisite-e2e-fixes

squid: mgr/dashboard: multisite e2e test case fix

Merge pull request #58863 from zdover23/wip-doc-2024-07-26-backport-58838-to-squid

squid: doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks

doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks

This is due to both using the same name for the lock at the RADOS level
("rbd_lock").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2e83b77c9f610f42765266ff4d4d7bc2a635eac8)

Merge pull request #58418 from ceph/squid-release

v19.1.0

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/suites/krbd: override extra_system_packages directly on install task

Follow commit c61cb16223fa ("qa/suites/rbd: override
extra_system_packages directly on install task").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2a9f92f23472dfcb1cb0fabc8572a28e6e5dd91a)

qa/suites/krbd: stress test for recovering from watch errors for -o exclusive

This is based on a test added in commit 237aa221ebad ("qa/suites/krbd:
stress test for recovering from watch errors") for regular mappings.

Fixes: https://tracker.ceph.com/issues/67097
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8fee41da8b8cd250bbbd8490604193c0864c1295)

qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Commit 40f6f5224bce ("qa/workunits/rbd: fix issues in
luks-encryption.sh") did the right thing for reads, which solved
most of the issue.  However, it actually made a step in the opposite
direction for writes -- depending on the RBD cache settings, rbd-nbd
virtual devices can behave as physical devices with a volatile write
cache, so fsync is required.

While at it, involving O_DIRECT for reads isn't needed outside of
test_encryption_format().

Fixes: https://tracker.ceph.com/issues/67051
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9e1c0342e9931e898d795d47f923edd3b4324f4a)

rgw/notification doc: doc: Update pendingreleasenotes for notification.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit 85fc96b0cd271b6c1de6db2e406586a6dda05248)

rgw/notification: Use topic attributes from topic rados object to create Pushendpoint and stop calling RGWPubSubEndpoint::create for every event.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit c8f7d311ecc24befe985dd39391b38f5f1b60510)

 Conflicts:
src/rgw/driver/rados/rgw_notify.cc

Fixes: https://tracker.ceph.com/issues/67074
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit 6241be164dc1f764b66bf63ca4e42a4f3931c07a)

Merge pull request #58608 from adk3798/wip-66648-squid

squid: mgr/rgw: fix error handling in rgw zone create

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #58611 from adk3798/wip-66892-squid

squid: mgr/rgw: fix setting rgw realm token in secondary site rgw spec

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #58612 from adk3798/wip-66958-squid

squid: cephadm: turn off cgroups_split setting  when bootstrapping with --no-cgroups-split

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #58663 from adk3798/squid-cephadm-limit-shell-mounts

squid: cephadm: limit mounts for shell and ceph-volume commands

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Fixes: https://tracker.ceph.com/issues/67070
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit da784bc14ef6b68c35b02b6bf992d7546d1ec874)

crimson/os/seastore/btree: interrupt transactions immediately when
getting children

Fixes: https://tracker.ceph.com/issues/66851
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 5fc8b847c9b1705485b87af17d5af085a65eab04)

crimson/os/seastore: encode ool records without padding

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit 35085b94a1a7ca0af5f5088ecc73ebc9cafebb28)

crimson/os/seastore/seastore_types: introduce record_type_t::OOL

And adjust size calculations for record_type_t::OOL, should be no actual
impact yet.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit c837cd07428b082cbe2726995f0a672c07544a31)

crimson/os/seastore/seastore_types: rename record_t::type to trans_type

In order to introduce a different type.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit 927c29a177648c7e71fe5e78d34dc0b76343a09e)

crimson/osd/osd_operation: fix dump_historic_slow_ops command works

* Use two separate lists to store normal ops and slow ops, respectively

Fixes: https://tracker.ceph.com/issues/65531
Signed-off-by: junxiang Mu <1948535941@qq.com>
(cherry picked from commit 86ac61c68f2509c1df38016b26fb0174f5cfc9ad)

suite/crimson: enable stats tests

Fixes: https://tracker.ceph.com/issues/66382
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit d66d9f35d39174ac62450611fd8f9a15654ab99d)

crimson/os/seastore/btree: correct out-dated comments

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 0de50ca29e21d0e1e57df85316b231ac043ba8d5)

crimson/os/seastore/btree: improve lba pointer related UT checks

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 5d85dd225bba04dcff1970ddfa7d820cb5798c0d)

test/crimson/seastore/test_transaction_manager: add a UT case for
detecting invalid lba mappings

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 4ad6f865dcc6b034aab1762848340eef5973bd12)

crimson/os/seastore/transaction_manager: fix lba mappings before getting
logical extents through them

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 063e429501ec0de3a0f356b88fe946eeadcc55ab)

crimson/os/seastore/btree: add interfaces to check whether the mappings'
parents have been modified

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 10c0f2ab0af4aff8ef182b95830e25d036fe2e3f)

crimson/os/seastore/transaction: minor bug fix

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 3e1c083e4fb6a92e622fb5a635c175a6528e213d)

crimson/os/seastore/transaction_manager: assert that the parents of the
mappings following which logical extents are to be retrieved are valid

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit acfced0c71058ea9e985de048981479d643c5afc)

crimson/os/seastore/cache: add an efficient method to check if extents are
viewable to transactions

Instead of searching the transaction's retired_set to determine whether
an extent has been retired, we add the transaction that's retiring an
extent to that extent's retired_transactions field and search that field
to do the check. Since the probability of multiple transactions retiring
the same extent is very low, this approach should be more cpu efficient.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 2721169f3285eb132d4a6f2792ec490c72129dd3)

crimson/os/seastore/transaction: make Transaction::is_retired() an
accurate extent check

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 09e06b5769683c6f8652377e2337a928a624f272)

qa/suites/crimson-rados: disable seastore with default thrash

Currently we have 2 types of thrash tests: default and simple.
Seastore passes only the simple one.

The 2 types are seperated to diffrent dirs. `thrash` dir
will be tested with bluestore only.
`thrash_simple` will be tested with both backend.

Once Seastore passes default ones, we can merge back the two dirs

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 69b241a4629e458ad7ed7b643e42c7b44e18e9fd)

qa/suites/crimson-rados: add seastore

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 1ad78107b1f99c5271d0cb05ab3513a2a89c9a0a)

crimson: fix ObjectContext::_with_lock to only unlock if lock is taken

Fixes: https://tracker.ceph.com/issues/66461
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 9e0c518d37ce1ba17139629e75d780cc0f0f064f)

crimson/osd/osd_operations/client_request_common: `PeeringState::needs_recovery()`
may fail if the object is under backfill

Meanwhile, set the correct version for backfill:
From Classic:
```
    if (is_degraded_or_backfilling_object(head)) {
      if (can_backoff && g_conf()->osd_backoff_on_degraded) {
        add_backoff(session, head, head);
        maybe_kick_recovery(head);
      }
```

```
void PrimaryLogPG::maybe_kick_recovery(
  const hobject_t &soid)
{
  eversion_t v;
  bool work_started = false;
  if (!recovery_state.get_missing_loc().needs_recovery(soid, &v))
    return;
```

Fixes: https://tracker.ceph.com/issues/66216
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 5716f03eac0a9255fb2e8c402735453c2f72b56a)

crimson/osd/pg_recovery: skip unfound objects when recovering the
primary

Fixes: https://tracker.ceph.com/issues/65696
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 3d03ac21bd8de591e4d340e274863bca9d31b170)

crimson/osd/osd_operations/background_recovery: mark PGs as unfound when
necessary

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit c5886d926cac4abb6eb0ec328d78f5cbd42c8f4c)

vstart.sh: add options to set number of alien threads, and number of cpu cores for alien threads

Signed-off-by: Jose J Palacios-Perez <perezjos@uk.ibm.com>
(cherry picked from commit b1083a41c38764e6d280ba4945fcc03a110d7863)

crimson/osd/osd_operations/client_request: check "can_serve_replica_reads" before getting obc

Fixes: https://tracker.ceph.com/issues/65872
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 5d5ce176b3853284802e81e5743b55919c4c808d)

Merge pull request #58774 from zdover23/wip-doc-2024-07-24-backport-58524-to-squid

squid: doc/cephfs: streamline a paragraph

mon: validate also mons and osds on {rm-,}pg-upmap-primary

Fixes: https://tracker.ceph.com/issues/66329
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
(cherry picked from commit c3fd1deec2d20a18dcb0b3ec5ff89b0d22309672)

osd: bump versions of decoders for upmap-primary

In e9921ee76c06 new revisions for client-usable data of
`OSDMap` (rev 10) and `OSDMap::Incremental` (rev 9) have
been introduced. However, corresponding `DECODE_START` in
decoders haven't been bumped up.

The net effect is a blur between the schemas when somebody
would intentionally (with `malformed_input` being thrown)
want to break compatibility with decoders on those versions
(refer to `struct_compat`).

```
/**
 * start a decoding block
 *
 * @param v current version of the encoding that the code supports/encodes
 * @param bl bufferlist::iterator for the encoded data
 */
  __u8 struct_v, struct_compat; \
  using ::ceph::decode; \
  decode(struct_v, bl); \
  decode(struct_compat, bl); \
  if (v < struct_compat) \
    throw ::ceph::buffer::malformed_input(DECODE_ERR_OLDVERSION(__PRETTY_FUNCTION__, v, struct_compat)); \
  __u32 struct_len; \
  decode(struct_len, bl); \
  if (struct_len > bl.get_remaining()) \
    throw ::ceph::buffer::malformed_input(DECODE_ERR_PAST(__PRETTY_FUNCTION__)); \
  unsigned struct_end = bl.get_off() + struct_len; \
  do {
```

Fixes: https://tracker.ceph.com/issues/66285
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 0756b702e95d5f84ba7887e4d5d2552a1421827f)

test/rgw: address potential race condition in reshard testing

The testing code does a `reshard add` followed by a `reshard list`. On
the narrow chance that the reshard was completed between those two
commands, we need to be able to handle the case where the reshard list
is empty. In that case we'll do a `bucket stats` to verify the reshard
completed successfully.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit aeaeaae7f5b677951773a6d718f327a9a04d5d75)

rgw/iam: CreateRole ignores EEXIST after forwarded request

when issued against a secondary zone in multisite, the CreateRole
request is first forwarded to the metadata master zone and created there

once that forwarded request succeeds, the secondary zone creates the
same role. between these two events, metadata sync may race to replicate
that role from the master. this causes the local role creation to fail
with EEXIST

ignore EEXIST errors from local role creation if we know that our
forwarded request succeeded

Fixes: https://tracker.ceph.com/issues/67012
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cd2042b1ad097af81615b3e24ac9afe14819f436)