Merged branches prs/66245

DISTROS: centos9 rocky10 jammy noble
ARCHS: x86_64

Merge branch prs/66245

test/crimson/.../test_object_data_handler: add multiple clone/overwrite test case

Signed-off-by: Samuel Just <sjust@redhat.com>

test/crimson/.../test_object_data_handler.cc: add support for clones

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: add logging to remap_mappings

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: add formatter for remap_entry_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../object_data_handler: fix LOG_PREFIX for do_clone

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert remap_mappings to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert reserve_region to use cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: simplify _update_mapping_ret, remove update_mapping_ret_bare_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert _update_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: remove update_refcount, simplify _update_mapping return value

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert remap_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert remap_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert clone_mapping to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert clone_pin to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert clone_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_end_mapping to return LBACursorRef

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_end_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: remove LBAMapping update_mapping variant

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: remove get_mapping interfaces

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pins to use get_cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_extents_if_live and helpers to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_extents_if_live to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert alloc_extents_ret to use LBACursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert alloc_data_extents to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert alloc_extents to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert rewrite_logical_extent to use get_cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: switch alloc_extent_ret to LBACursorRef

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert reserve_region to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert reserve_region to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert alloc_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert rewrite_logical_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pin to use get_cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: remove remove_mappings

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: rework _remove in terms of LBACursor interfaces

Removes the need for _remove_direct_mapping and _remove_indirect_mapping.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: avoid using LBAManager::ref_update_result_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: replace LBAManager::complete_indirect_lba_mapping with TransactionManager::complete_mapping

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: simplify get_extent_if_linked

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert _remove_indirect_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert _remove_direct_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../remove: convert to use cursor interfaces

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert remove to use cursor interfaces

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_types: add LBACursor::is_direct

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert _remove_indirect_mapping_only to use new interfaces

Also removes now unused LBAMapping::remove_indirect_mapping_only.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: remove unused get_ref_update_result

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: replace unused incref_extent with update_mapping_refcount

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: remove unused _incref_extent

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert remove_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: switch update_mapping to take a cursor, add adapter

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert update_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: introduce resolve_cursor_to_mapping

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: add get_cursor interfaces

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_cursors to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../fixed_kv_btree: add get_btree helper

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert mkfs to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert remove to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert read_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pin to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_types: allow get_refcount() on indirect cursor

It should always be 1, but there's no reason not to allow it.

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #66643 from bluikko/wip-doc-mgr-telemetry-collection-desc

doc/mgr: Fix collection desc in telemetry.rst

Merge pull request #66576 from rhcs-dashboard/carbonized-multisite-realm-token-modal

mgr/dashboard: carbonized-multisite-export-realm-token-modal

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #66510 from rhcs-dashboard/manager-module-table-fix

mgr/dashboard: Fix table width expansion on manager module dropdown selection #74089

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #65324 from rishabh-d-dave/inode_t-fields

mds: compare all fields of inode_t

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #65496 from rishabh-d-dave/rmtree-enhancements

pybind,cephfs: enhancements for rmtree()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #65805 from rishabh-d-dave/qa-returns-unbound-var

qa/cephfs: don't return undefined variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

doc/mgr: Fix collection desc in telemetry.rst

Use correct desc taken from source file for basic channel in example CLI
output.

Also turn off syntax highlighting for the CLI outputs so that some
keywords do not get colored.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #66554 from NitzanMordhai/wip-nitzan-improve-corpus-import-script

script/gen-corpus: cleanup and improve readability and performance

Merge pull request #66232 from NitzanMordhai/wip-nitzan-add-rocky-test-rados-workunit

qa/workunits: add Rocky Linux support to librados tests

Merge pull request #66630 from rhcs-dashboard/copy2-clipboard-fix

mgr/dashboard: emit success and error on copy2cliboard

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #66631 from rhcs-dashboard/validator-js-bump

mgr/dashboard: bump validator.js to 13.15.23

Reviewed-by: Naman Munet <nmunet@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #66641 from datdenkikniet/document-msgr2-crc

doc/dev: document exact CRC parameters for crc32c used in msgr2

doc/dev: document exact CRC parameters for crc32c used in msgr2

The description of the CRC used by the msgr2 protocol as CRC32-C
can be ambiguous. Document the actual parameters that make up
the CRC that is used.

Signed-off-by: Johannes Cornelis Draaijer <jcdra1@gmail.com>

Merge pull request #66068 from timqn22/balancer-info-log-reduction

mgr/balancer: reduce info-level logs

Merge pull request #66129 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles

Mon: Add new health warning for non prime w+1 in blaum-roth EC profiles

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Anthony D'Atri <anthony.datri@ibm.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #66277 from NitzanMordhai/wip-nitzan-lazyomap-wait-active-clean-test

test/lazy-omap-stats: overload get_output() to accept both lvalue and…

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #66204 from apataki/73795-cephmon-cleanupmap

ceph-mon: Improve efficiency of upmap cleanup in osdmaps for large clusters

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #66542 from aainscow/ec_trunctate_bug

osd: Fix fast EC truncate to whole stripe

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Radosław Zarzyński <Radoslaw.Adam.Zarzynski@ibm.com>

Merge pull request #66579 from phlogistonjohn/jjm-smb-doc-fixes

doc: some small smb mgr module doc improvements

Merge pull request #66632 from bluikko/wip-doc-very-minor-fixes

doc: Fix minor formatting, typo etc issues

Merge pull request #66322 from phlogistonjohn/jjm-qa-workunits-smb

smb: qa workunit for smb

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@cryptolab.net>

Merge pull request #66497 from yielde/add-destractor-to-sahred_mutex_debug

src/common: Add a destructor to shared_mutex_debug

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #66617 from imran-imtiaz/dashboard

mgr/dashboard: add API endpoint to delete consistency group

Merge pull request #66441 from hasan4791/fix-install-deps

install-deps.sh: build without crimson when it is disabled

Reviewed-by: Kefu Chai <k.chai@proxmox.com>

script/gen-corpus: cleanup and improve readability and performance

- gen-corpus cleanup missed removing the temporary directory.
- improve it a bit for readability
- import.sh script was slow, improve performance by using less forks and
  batch processing

Signed-off-by: Nitzan Mordechai <nmordech@ibm.com>

Merge pull request #66602 from hasan4791/issue-74183

erasure-code: Enable isa for ppc64le target.

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Jamie Pryde <jamiepry@uk.ibm.com>
Reviewed-by: Kefu Chai <k.chai@proxmox.com>

doc: Fix minor formatting, typo etc issues

Remove formatting syntax from inside literal text in
cephadm/services/rgw.rst.
Use quotation marks similarly to other placement examples with only
parameter value quoted and not the whole parameter in
cephadm/services/rgw.rst.
Capitalize "YAML" in cephadm/services/rgw.rst.

Remove double space in the middle of a sentence in
rados/operations/erasure-code.rst.

Use double backticks consistently for default values in
radosgw/frontends.rst.
Capitalize "I/O", stylize as "OpenSSL" in radosgw/frontends.rst.

Fix typo "and object" to "an object" in radosgw/s3/bucketops.rst.

Stylize as "CentOS" in start/os-recommendations.rst.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #66507 from rhcs-dashboard/74046-QAT-configuration-through-RGW-service-on-Dashbard

mgr/dashboard: Adding QAT Compression dropdown on RGW Service form

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

mgr/dashboard: bump validator.js to 13.15.23

Fixes: https://github.com/advisories/GHSA-vghf-hv5q-vc2g
Fixes: https://tracker.ceph.com/issues/74214
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: emit success and error on copy2cliboard

This is needed since the notification service we have right now is
tightly coupled with the dashboard so toast won't show up in the
applications where this is being consumed. So emitting an output which
the application can use to show relavant toasts.

Fixes: https://tracker.ceph.com/issues/74213
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66629 from tokuhirom/wip-doc-orometheus-typo

doc/monitoring: fix typo s/Orometheus/Prometheus/

Merge pull request #66620 from bluikko/doc-notifications-formatting-radosgw

doc/radosgw: Update formatting in notifications.rst

Fixes: https://tracker.ceph.com/issues/74162
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

doc/monitoring: fix typo s/Orometheus/Prometheus/

Signed-off-by: Tokuhiro Matsuno <tokuhirom@gmail.com>

Merge pull request #66581 from idryomov/wip-74168

librbd: fix ExclusiveLock::accept_request() when !is_state_locked()

Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>

Merge pull request #66605 from ceph/fixes#2414677

Fix the prometheus module crash

doc/radosgw: Update formatting in notifications.rst

Change parameter list descriptions to start with capital case after
colon as discussed in #64768.

Remove a stray comma and end in full stop. Remove article from what
seems to be a plural. Hyphenation in "single-shard topics".

Change several same external links to use a single link definition
instead of repeating the destination URL each time.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #66621 from bluikko/wip-doc-start-documenting-formatting

doc/start: Fix stray RST syntax in documenting-ceph.rst

Merge pull request #66341 from cbodley/wip-73943

qa/rgw/upgrade: exclude ceph-osd-classic/crimson on squid and tentacle

Reviewed-by: Oguzhan Ozmen <oozmen@bloomberg.net>