Merged branches prs/66245

DISTROS: centos9 rocky10 jammy noble
ARCHS: x86_64

Merge branch prs/66245

Merge pull request #66643 from bluikko/wip-doc-mgr-telemetry-collection-desc

doc/mgr: Fix collection desc in telemetry.rst

Merge pull request #66576 from rhcs-dashboard/carbonized-multisite-realm-token-modal

mgr/dashboard: carbonized-multisite-export-realm-token-modal

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #66510 from rhcs-dashboard/manager-module-table-fix

mgr/dashboard: Fix table width expansion on manager module dropdown selection #74089

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #65324 from rishabh-d-dave/inode_t-fields

mds: compare all fields of inode_t

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #65496 from rishabh-d-dave/rmtree-enhancements

pybind,cephfs: enhancements for rmtree()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #65805 from rishabh-d-dave/qa-returns-unbound-var

qa/cephfs: don't return undefined variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

doc/mgr: Fix collection desc in telemetry.rst

Use correct desc taken from source file for basic channel in example CLI
output.

Also turn off syntax highlighting for the CLI outputs so that some
keywords do not get colored.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #66554 from NitzanMordhai/wip-nitzan-improve-corpus-import-script

script/gen-corpus: cleanup and improve readability and performance

Merge pull request #66232 from NitzanMordhai/wip-nitzan-add-rocky-test-rados-workunit

qa/workunits: add Rocky Linux support to librados tests

Merge pull request #66630 from rhcs-dashboard/copy2-clipboard-fix

mgr/dashboard: emit success and error on copy2cliboard

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #66631 from rhcs-dashboard/validator-js-bump

mgr/dashboard: bump validator.js to 13.15.23

Reviewed-by: Naman Munet <nmunet@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #66641 from datdenkikniet/document-msgr2-crc

doc/dev: document exact CRC parameters for crc32c used in msgr2

doc/dev: document exact CRC parameters for crc32c used in msgr2

The description of the CRC used by the msgr2 protocol as CRC32-C
can be ambiguous. Document the actual parameters that make up
the CRC that is used.

Signed-off-by: Johannes Cornelis Draaijer <jcdra1@gmail.com>

Merge pull request #66068 from timqn22/balancer-info-log-reduction

mgr/balancer: reduce info-level logs

Merge pull request #66129 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles

Mon: Add new health warning for non prime w+1 in blaum-roth EC profiles

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Anthony D'Atri <anthony.datri@ibm.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #66277 from NitzanMordhai/wip-nitzan-lazyomap-wait-active-clean-test

test/lazy-omap-stats: overload get_output() to accept both lvalue and…

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #66204 from apataki/73795-cephmon-cleanupmap

ceph-mon: Improve efficiency of upmap cleanup in osdmaps for large clusters

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #66542 from aainscow/ec_trunctate_bug

osd: Fix fast EC truncate to whole stripe

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Radosław Zarzyński <Radoslaw.Adam.Zarzynski@ibm.com>

Merge pull request #66579 from phlogistonjohn/jjm-smb-doc-fixes

doc: some small smb mgr module doc improvements

Merge pull request #66632 from bluikko/wip-doc-very-minor-fixes

doc: Fix minor formatting, typo etc issues

Merge pull request #66322 from phlogistonjohn/jjm-qa-workunits-smb

smb: qa workunit for smb

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@cryptolab.net>

Merge pull request #66497 from yielde/add-destractor-to-sahred_mutex_debug

src/common: Add a destructor to shared_mutex_debug

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #66617 from imran-imtiaz/dashboard

mgr/dashboard: add API endpoint to delete consistency group

Merge pull request #66441 from hasan4791/fix-install-deps

install-deps.sh: build without crimson when it is disabled

Reviewed-by: Kefu Chai <k.chai@proxmox.com>

script/gen-corpus: cleanup and improve readability and performance

- gen-corpus cleanup missed removing the temporary directory.
- improve it a bit for readability
- import.sh script was slow, improve performance by using less forks and
  batch processing

Signed-off-by: Nitzan Mordechai <nmordech@ibm.com>

Merge pull request #66602 from hasan4791/issue-74183

erasure-code: Enable isa for ppc64le target.

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Jamie Pryde <jamiepry@uk.ibm.com>
Reviewed-by: Kefu Chai <k.chai@proxmox.com>

doc: Fix minor formatting, typo etc issues

Remove formatting syntax from inside literal text in
cephadm/services/rgw.rst.
Use quotation marks similarly to other placement examples with only
parameter value quoted and not the whole parameter in
cephadm/services/rgw.rst.
Capitalize "YAML" in cephadm/services/rgw.rst.

Remove double space in the middle of a sentence in
rados/operations/erasure-code.rst.

Use double backticks consistently for default values in
radosgw/frontends.rst.
Capitalize "I/O", stylize as "OpenSSL" in radosgw/frontends.rst.

Fix typo "and object" to "an object" in radosgw/s3/bucketops.rst.

Stylize as "CentOS" in start/os-recommendations.rst.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #66507 from rhcs-dashboard/74046-QAT-configuration-through-RGW-service-on-Dashbard

mgr/dashboard: Adding QAT Compression dropdown on RGW Service form

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

mgr/dashboard: bump validator.js to 13.15.23

Fixes: https://github.com/advisories/GHSA-vghf-hv5q-vc2g
Fixes: https://tracker.ceph.com/issues/74214
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: emit success and error on copy2cliboard

This is needed since the notification service we have right now is
tightly coupled with the dashboard so toast won't show up in the
applications where this is being consumed. So emitting an output which
the application can use to show relavant toasts.

Fixes: https://tracker.ceph.com/issues/74213
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66629 from tokuhirom/wip-doc-orometheus-typo

doc/monitoring: fix typo s/Orometheus/Prometheus/

Merge pull request #66620 from bluikko/doc-notifications-formatting-radosgw

doc/radosgw: Update formatting in notifications.rst

Fixes: https://tracker.ceph.com/issues/74162
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

doc/monitoring: fix typo s/Orometheus/Prometheus/

Signed-off-by: Tokuhiro Matsuno <tokuhirom@gmail.com>

Merge pull request #66581 from idryomov/wip-74168

librbd: fix ExclusiveLock::accept_request() when !is_state_locked()

Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>

Merge pull request #66605 from ceph/fixes#2414677

Fix the prometheus module crash

doc/radosgw: Update formatting in notifications.rst

Change parameter list descriptions to start with capital case after
colon as discussed in #64768.

Remove a stray comma and end in full stop. Remove article from what
seems to be a plural. Hyphenation in "single-shard topics".

Change several same external links to use a single link definition
instead of repeating the destination URL each time.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #66621 from bluikko/wip-doc-start-documenting-formatting

doc/start: Fix stray RST syntax in documenting-ceph.rst

test/crimson/.../test_object_data_handler: add multiple clone/overwrite test case

Signed-off-by: Samuel Just <sjust@redhat.com>

test/crimson/.../test_object_data_handler.cc: add support for clones

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: add logging to remap_mappings

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: add formatter for remap_entry_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../object_data_handler: fix LOG_PREFIX for do_clone

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert remap_mappings to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert reserve_region to use cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: simplify _update_mapping_ret, remove update_mapping_ret_bare_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert _update_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: remove update_refcount, simplify _update_mapping return value

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert remap_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert remap_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert clone_mapping to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert clone_pin to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert clone_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_end_mapping to return LBACursorRef

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_end_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: remove LBAMapping update_mapping variant

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: remove get_mapping interfaces

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pins to use get_cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_extents_if_live and helpers to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_extents_if_live to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert alloc_extents_ret to use LBACursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert alloc_data_extents to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert alloc_extents to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert rewrite_logical_extent to use get_cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: switch alloc_extent_ret to LBACursorRef

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert reserve_region to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert reserve_region to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert alloc_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert rewrite_logical_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pin to use get_cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: remove remove_mappings

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: rework _remove in terms of LBACursor interfaces

Removes the need for _remove_direct_mapping and _remove_indirect_mapping.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: avoid using LBAManager::ref_update_result_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: replace LBAManager::complete_indirect_lba_mapping with TransactionManager::complete_mapping

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #66341 from cbodley/wip-73943

qa/rgw/upgrade: exclude ceph-osd-classic/crimson on squid and tentacle

Reviewed-by: Oguzhan Ozmen <oozmen@bloomberg.net>

doc/start: Fix stray RST syntax in documenting-ceph.rst

Remove stray single colons before literal text blocks.
Perhaps leftovers moving from :: to prompt blocks.

Remove double backticks used inside literal text.

Fix URL missing // in a link example and use HTTPS in it.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

qa/rgw/upgrade: don't randomize distros

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/rgw/upgrade: exclude ceph-osd-classic/crimson on squid and tentacle

split packages for ceph-osd-classic and ceph-osd-crimson were added on
main, but don't exist on squid and tentacle. exclude these packages from
their install tasks

Fixes: https://tracker.ceph.com/issues/73943
Signed-off-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: add API endpoint to delete consistency group

Signed-off-by: Imran Imtiaz <imran.imtiaz@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/74201
Add a dashboard API endpoint to delete a consistency group.

mgr/dashboard: Adding QAT Compression dropdown on RGW Service form
Fixes:https://tracker.ceph.com/issues/74046
Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com>

Merge pull request #66233 from benhanokh/dedup_ver

rgw/dedup: Add support for RGW versions.

Merge pull request #66188 from harriscr/ch_wip_qa_cbt_task

qa: Use a more pythonic way to install CBT python requirements

Fix the prometheus module crash

fixes: https://bugzilla.redhat.com/show_bug.cgi?id=2414677
Signed-off-by: Anmol Babu <Anmol.Babu@ibm.com>

src/common: Add a destructor to shared_mutex_debug

Signed-off-by: Hui Tong <th937013596@gmail.com>

erasure-code: Enable isa for ppc64le target.

Fixes: https://tracker.ceph.com/issues/74183
Signed-off-by: T K Chandra Hasan <t.k.chandra.hasan@ibm.com>

Merge pull request #66588 from rhcs-dashboard/task_74176

mgr/dashboard: where the alert page tag colors are not being applied

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #66547 from Hezko/fix-nvme-cert-name

mgr/dashboard: fix nvme certificate name

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66394 from elliotcourant/fix/debian-post-install-home

deb/cephadm: Don't assume a home directory is configured

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #66134 from rzarzynski/wip-pc-humanreadable-prio

common/perf_counters: don't use magics for add_u64_counter{,_histogram}

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

deb/cephadm: Don't assume a home directory is configured

cephadm.postinst can fail if cephadm was originally installed using a
version that didn't configure a home directory for the user at all.
Newer versions do configure a home directory (as either `/home/cephadm`
or `/var/lib/cephadm`) so if that is configured then nothing needs to be
done. But if the user was created with no home directory then one needs
to be added for the configure step to succeed.

Fixes: https://tracker.ceph.com/issues/72083
commit 90bc0369243077c2aaf67f0de2bab5810b217f4e added home directories
for new cephadm users created, but didn't add home directories to
cephadm users that already existed.

Signed-off-by: Elliot Courant <me@elliotcourant.dev>

Merge pull request #66574 from anoopcs9/whitespace-for-smb-login-names

mgr/smb: Allow whitespace in share login names

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

doc/mgr: fix some wording issues

Be more smarticle about the article.
Also banish a stray.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

doc/mgr: prefer the word interface over device

As per the suggestion in https://github.com/ceph/ceph/pull/66579#discussion_r2606834482

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/dashboard: where the alert page tag colors are not being applied

Fixes: https://tracker.ceph.com/issues/74176
Signed-off-by: pujashahu <pshahu@redhat.com>

Merge pull request #66516 from rhcs-dashboard/74078-host-labels-removed-fix

mgr/dashboard :  Fixed labels issue

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Fixes: https://tracker.ceph.com/issues/74089
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

Merge pull request #66528 from tchaikov/wip-debian-deps-c-v

debian/control: record python3-packaging dependency for ceph-volume

mgr/smb: Allow whitespace in share login names

Whitespaces are perfectly valid in Windows AD user or group names.

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>