Merge branch 'wip-rgw-sts-expired-creds' of https://github.com/pritha-srivastava/ceph into wip-anrao5-testing-2025-10-16-2222

Merge branch 'wip-73348' of https://github.com/cbodley/ceph into wip-anrao5-testing-2025-10-16-2222

Merge branch 'ceph-wip-72403' of https://github.com/edwinzrodriguez/ceph into wip-anrao5-testing-2025-10-16-2222

Merge pull request #65970 from cbodley/wip-cmake-arrow-thrift-boost-jammy

cmake: BuildArrow.cmake uses bundled thrift if system version < 0.17

Reviewed-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #64762 from mkogan1/wip-ratelim-list-v001

rgw: rate limit for LIST and DELETE ops

Merge pull request #65168 from stackhpc/swap-tip-fix-wording

doc/start: fix wording in swap tip

Merge pull request #65869 from tchaikov/wip-crimson-aligned-dma-write

crimson/seastore: use DMA alignment for block size instead of stat

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65973 from rhcs-dashboard/inline-edit-validator-fix

mgr/dashboard: fix generic form submit validator for inline edit

Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #65707 from a16bitsysop/crimson-gcc15

crimson: admin: fix FTBFS with gcc 15

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

mgr/dashboard: fix generic form submit validator for inline edit

currently the validation error is being applied generically to the
parent formgroup which will set the whole form into an error state when
one of the inline editing is failing on a validation. So just changing
that to a single control.

Fixes: https://tracker.ceph.com/issues/73558
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65954 from positiveEV/patch-2

doc/rados/operations: remove duplicate word

cmake: BuildArrow.cmake uses bundled thrift if system version < 0.17

the bump to arrow 17.0.0 broke the ubuntu jammy builds with:

In file included from /usr/include/thrift/transport/TTransport.h:25,
                 from /usr/include/thrift/protocol/TProtocol.h:28,
                 from /usr/include/thrift/TBase.h:24,
                 from /build/ceph-20.3.0-3599-g3d863d32/src/arrow/cpp/src/generated/parquet_types.h:14,
                 from /build/ceph-20.3.0-3599-g3d863d32/src/arrow/cpp/src/generated/parquet_constants.h:10,
                 from /build/ceph-20.3.0-3599-g3d863d32/src/arrow/cpp/src/generated/parquet_constants.cpp:7:
/usr/include/thrift/transport/TTransportException.h:23:10: fatal error: boost/numeric/conversion/cast.hpp: No such file or directory
   23 | #include <boost/numeric/conversion/cast.hpp>
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.

when comparing the gcc command line with arrow-15.0.0, the following argument
is no longer present:
> -isystem /build/ceph-20.3.0-3402-gb2db4947/obj-x86_64-linux-gnu/boost/include

arrow 17.0.0 seems to assume that thrift doesn't depend on boost anymore. a
comment in https://github.com/apache/arrow/issues/32266 claims that
> we don't need Boost with system Thrift 0.17.0 or later

but our jammy builds are stuck with libthrift-0.16.0. to reenable jammy builds,
instruct Arrow's cmake to use its bundled thrift dependency if our system thrift
version is < 0.17.0

Signed-off-by: Casey Bodley <cbodley@redhat.com>

cmake: Findthrift.cmake parses version string

when thrift headers are found, parse the version string into a
cmake variable and pass it to find_package_handle_standard_args

this will be needed by BuildArrow.cmake for some conditional logic

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65774 from ljflores/wip-add-telemetry-pool-flag

mgr/telemetry: add 'ec_optimizations' flag to 'basic_pool_flags' collection

Merge pull request #65955 from gbregman/main

mgr/cephadm: Increase the default expiration time for NVMEoF subsyste…

Merge pull request #65891 from kshtsk/wip-workunit-drop-pipes

qa/tasks/workunit: fix no module named 'pipes'

Merge pull request #65967 from jmundack/doc-sort-csc-memer-list

doc: Update governance.rst to have member names sorted

doc: Update governance.rst to have member names sorted

Originally this list was sorted by first name, overtime new members were added at the bottom. Resorting them again by first name

Signed-off-by: Joseph Mundackal <jmundackal@bloomberg.net>

Merge pull request #64359 from mkogan1/wip-d3n-stripe-gt-chunk-py

rgw/qa/d3n: improve D3N test robustness

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #65367 from myoungwon/wip-nvmedevice-coroutine

crimson/os/seastore/rbm: switch rbm to coroutine

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65935 from tchaikov/wip-debian-libxsimd-dev

debian/control: Add libxsimd-dev build dependency for vendored Arrow

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65664 from cbodley/wip-73240

rgw/lc: LCOpAction_CurrentExpiration checks mtime for delete markers

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

mgr/cephadm: Increase the default expiration time for NVMEoF subsystem cache

Fixes: https://tracker.ceph.com/issues/73542
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #65529 from mkogan1/wip-d4n-reserve

rgw/d4n: refactor unused conf rgw_d4n_l1_datacache_size

doc/rados/operations: remove duplicate word

Signed-off-by: positiveEV <50848762+positiveEV@users.noreply.github.com>

Merge pull request #65054 from BBoozmen/dequeue_op_latency_at_completion

OSD: add latency data to DEQUEUE_OP_END event

Merge pull request #64377 from ljflores/wip-tracker-70716

qa/tasks: Ignore expected `backfill_toofull` warning

Merge pull request #65616 from xxhdx1985126/wip-73159

crimson/osd/pg: create "submit_lock" unlocker before locking it

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #64756 from rzarzynski/wip-bug-67244

monc: synchronize tick() of MonClient with shutdown()

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #65578 from Matan-B/wip-matanb-crimson-seastore-should_block

crimson/os/seastore/epm: Verify available segments on mkfs/mount

Reviewed-by: Samuel Just <sjust@redhat.com>

debian/control: Add libxsimd-dev build dependency for vendored Arrow

In commit e8460cbd, we introduced the "pkg.ceph.arrow" build profile to
support building with system Arrow packages. However, neither Debian nor
Ubuntu currently ships Arrow packages.

Since WITH_RADOSGW_SELECT_PARQUET is always enabled in debian/rules,
Arrow support is required for all builds. When the pkg.ceph.arrow profile
is not selected, the build uses vendored Arrow. With the recent change to
use AUTO mode for xsimd detection, Arrow will attempt to find system xsimd
>= 9.0.1. Adding libxsimd-dev as a build dependency ensures it's available
for Arrow to detect and use, reducing build time on supported distributions.

On distributions with insufficient xsimd versions (< 9.0.1), Arrow will
automatically fall back to its bundled version.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

cmake/BuildArrow: Use AUTO mode for xsimd dependency detection

Arrow requires xsimd >= 9.0.1 according to arrow/cpp/thirdparty/versions.txt.
Previously, we unconditionally set -Dxsimd_SOURCE=BUNDLED, forcing the use
of Arrow's vendored xsimd regardless of system package availability.

This commit changes to -Dxsimd_SOURCE=AUTO, which allows Arrow's
resolve_dependency mechanism to automatically:
1. Try to find system xsimd package
2. Check if version >= 9.0.1
3. Use system version if found and sufficient
4. Fall back to bundled version otherwise

This reduces build time and dependencies on systems with sufficient xsimd,
while maintaining compatibility with older distributions.

Distribution availability:
- Ubuntu Noble (24.04): libxsimd-dev 12.1.1 (✓ will use system)
- Ubuntu Jammy (22.04): libxsimd-dev 7.6.0 (✗ will use bundled)
- Debian Trixie (13): libxsimd-dev 13.2.0 (✓ will use system)
- CentOS Stream 9: xsimd-devel 7.4.9 (✗ will use bundled)

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #65236 from leonidc/delete_all_gws

nvmeofgw: fix issue of delete all gws from the pool/group

Merge pull request #64176 from tchaikov/wip-pybind-cb-types

pybind: fix callback function type compatibility for GCC 14/15

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nitzan Mordhai <nmordech@ibm.com>

Merge pull request #65934 from tchaikov/cephadm-detect-pip

cephadm/build: Fix _has_python_pip() function check

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65919 from phlogistonjohn/jjm-bwc-variants

build-with-container: build image variants

Merge pull request #65930 from cloudbehl/filesystem-grafana-fixes

monitoring: Fix Filesystem grafana dashboard units

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65065 from ifed01/wip-ifed-fix-70390

os/bluestore: complete fix for extent spanning over shard boundaries

Merge pull request #65468 from Kushal-deb/kill-daemon

mgr/cephadm: configurable per-service stop timeout

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

cephadm/build: Fix _has_python_pip() function check

The _has_python_pip() function was incorrectly checking for the venv
module instead of pip, causing it to always return the wrong result.
This would prevent proper detection of whether pip is available during
the cephadm build process.

Fix by changing the module check from 'venv' to 'pip'.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #65848 from Hezko/nvmeof-cli-def-max-ns-num-on-subsys-create

mgr/dashboard: change the default max namespace from 4096 to None in subsystem add command

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65791 from aainscow/fix_compiler_warnings

crimson/rgw: Fix clang compiler warnings.

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Edwin Rodriguez <erodriguez@lazyk-ranch.com>

Merge pull request #65829 from rhcs-dashboard/73379-fix-secure-monitoring-stack

mgr/dashboard : Fix secure-monitoring-stack creds issue

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #60361 from rhcs-dashboard/converting-badges-to-carbon-tag

mgr/dashboard: replace bootstrap badges with carbon tags

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

script/build-with-container: add build image variants

Allow the user to control the content of the build image with a
high-level `--image-variant=` switch. Currently the supported values are
`default` (the same maximal image we have been generating) and
`packages` a slimmer image that avoids installing certain test-only
dependencies.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

Dockerfile.build: make FOR_MAKE_CHECK a build argument

Set it only during install time.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

install-deps.sh: let FOR_MAKE_CHECK variable take precedence

Previously, the FOR_MAKE_CHECK variable could only enable installing
extra (test) dependencies when install-deps.sh was used and it was
ignored if `tty -s` exited true. This change allows FOR_MAKE_CHECK to
take precedence over the tty check and to specify one of true, 1, yes to
enable extra "for make check" deps or false, 0, no to explicitly disable
the extra deps.

Based-on-work-by: Dan Mick <dan.mick@redhat.com>
Signed-off-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65731 from koch-synyx/doc/dashboard-rsa-note

doc/mgr/dashboard: add note that only RSA keys are supported for TLS

Merge pull request #65531 from ShwetaBhosale1/fix_issue_72906_haproxy_changes_for_nfs_active_active_support

mgr/cephadm: Add stick table and haproxy peers in haproxy.cfg for NFS to support nfs active-active cluster

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65851 from guits/cv-fix-db-pre-created-lvs

ceph-volume: lvm.Lvm.setup_metadata_devices refactor

Merge pull request #65898 from gbregman/main

mgr/cephadm: Limit the value of max-namespaces-per-subsystem.

Merge pull request #65909 from bluikko/doc-sphinx-warnings-plus-cephfs

doc/cephfs: Fix Sphinx warnings and other minor improvements

Merge pull request #65375 from ifed01/wip-ifed-bluefs-ratio

os/bluestore: report metadata/data ratio in BlueFS perf counter

Reviewed-by: Mark Nelson <mark.a.nelson@gmail.com>

Merge pull request #64682 from ifed01/wip-ifed-fix-zstd

compressor/zstd: compressor correct buffer end detection using get_remaining()

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

monitoring: Fix Filesystem grafana dashboard units

Fixes: https://tracker.ceph.com/issues/73521
Signed-off-by: Ankush Behl <cloudbehl@gmail.com>

Merge branch 'ceph:main' into main

Merge pull request #64009 from rzarzynski/wip-bug-70869

osd: prevent OSDMap::check_health() from asserting due to new OSDs found in subtree

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@ibm.com>

Merge pull request #65910 from anoopcs9/fix-mgr-smb-doc

doc/mgr: Fix a copy-paste error in smb.rst

doc/mgr: Fix a copy-paste error in smb.rst

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>

doc/cephfs: Fix Sphinx warnings and other minor improvements

Fix 2 Sphinx warnings about problematic syntax in troubleshooting.rst:
add empty lines between paragraphs.

In fs-volumes.rst:

Fix 1 Sphinx warning about problematic syntax:
Fix indentation and change to ordered list instead of manually
hardcoding item numbers.

Use privileged bash prompt consistently for privileged commands.

Use the "[...] run a command of the following form:" for CLI examples
with placeholders.

Fix accidental emphasis on a list item by adding empty lines around
sub-list.

Use title case in section titles and trim overly long underline.

Capitalize UID, GID, Unicode, Ceph in text.

Use double backticks consistently for command line switches, data, etc.

Start with capital case and end in full stop if full sentence.

Linkify mention of quiesce dev doc and add a label for it in
doc/dev/mds_internals/quiesce.rst.

Other very minor changes like typo, remove space at end of line.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #65745 from guits/cv-drop-subprocess-call-get-devices

ceph-volume: use udev data instead of LVM subprocess in get_devices()

Merge pull request #65554 from matteopt/fix/udevdata-init-empty-file

ceph-volume: fix UdevData initialisation from empty /run/udev/data/* file

Merge pull request #65893 from thuvh/doc-m1-getopt

docs: add package on macos to run ceph-backport.sh

Merge pull request #65783 from benhanokh/dedup_permissions

rgw/dedup: Grant dedup process full RGW permissions.

mgr/cephadm: Limit the value of max-namespaces-per-subsystem.

Fixes: https://tracker.ceph.com/issues/73505
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #64908 from Jakesquelch/wip-jakes-default-chunk-size

mon: default chunk size change

Merge pull request #65131 from kamoltat/wip-ksirivad-fix-72647

mgr/progress: compare up set instead of acting set

Merge pull request #65422 from NitzanMordhai/wip-nitzan-destroyed-osds-remove-health-msgs

mgr: remove health msgs from the metrics if osd destroyed

Merge pull request #65305 from rhcs-dashboard/upgrade-carbon-components-pkg

mgr/dashboard: upgrade carbon components package@5.59.2

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65841 from Hezko/nvmeof-cli-ns-list-no-nqn-fix

mgr/dashboard: ns list now support not passing nqn param

Reviewed-by: Afreen Misbah <afreen@ibm.com>

docs: add package on macos to run ceph-backport.sh

Signed-off-by: Hoai-Thu Vuong <thuvh87@gmail.com>

Merge pull request #64709 from dparmar18/fix-qa-fuse-mount-infinite-loop

qa/tasks/cephfs: raise exception if incorrect fstype found

Reviewed-by: Igor Golikov <igolikov@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #64345 from dparmar18/i71740

mds, client, mgr/volumes: toggle snapshot visibility for subvolume based paths

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #62971 from thuvh/feat_rgw_pubsub_push_metric

rgw: add metric when send message with kafka and ampq

Merge PR #65892 into main

* refs/pull/65892/head:
.github/workflows: update qa-symlink to use pull_request_target
script/verify-qa: print commit on run

Merge pull request #65855 from rhcs-dashboard/bump-monitoring-stack

mgr/cephadm: bump monitoring stack versions

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Afreen Misbah <afreen@ibm.com>

.github/workflows: update qa-symlink to use pull_request_target

This should allow the script to run even when a PR is submitted by an
external contributor.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/verify-qa: print commit on run

To allow sanity checking what the script is running against.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

qa/tasks/workunit: fix no module named 'pipes'

Python 3.13 finally dropped the 'pipes' module,
replacing it with shlex.

Fixes: https://tracker.ceph.com/issues/73498
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Merge pull request #65723 from mheler/rgw_cloud_transition_header_fix

rgw/s3: Always include x-amz-content-sha256 header in AWS v4 signatures

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge PR #65839 into main

* refs/pull/65839/head:
pybind/cephfs: fix including of platform_errno.h

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #65525 from ethanwu-syno/fix-snapper-parse-m

osd/SnapMapper: fix SnapMapper::Scrubber shard parsing

Merge pull request #65450 from tchaikov/wip-fix-out-of-bound-access

cpp-btree: fix array bounds warning in btree_node::swap()

Merge pull request #65033 from Nordix/fix-72380-sunnat

mgr/prometheus: Handle empty JSON from orch get-security-config

Merge pull request #65757 from phlogistonjohn/jjm-qa-task-smb

qa/tasks: move smb related task funcs out of cephadm.py to smb.py

Reviewed-by: Adam King <adking@redhat.com>

pybind/cephfs: fix including of platform_errno.h

Introduced-by: 2439bcb87398
Fixes: https://tracker.ceph.com/issues/73435
Signed-off-by: Rishabh Dave <ridave@redhat.com>

doc/mgr/dashboard: add note that only RSA keys are supported for TLS

The dashboard module fails to start when configured with ECDSA/EC
private keys due to pyOpenSSL limitations ("key type unsupported").
Add a note to the SSL/TLS documentation advising users to use
RSA keys until ECDSA is supported.

References: https://tracker.ceph.com/issues/73324

Signed-off-by: Martin Koch <koch@synyx.de>

mgr/dashboard: replace bootstrap badges with carbon tags

Fixes: https://tracker.ceph.com/issues/68252
Signed-off-by: pujaoshahu <pshahu@redhat.com>

Merge pull request #65852 from rhcs-dashboard/73447-fix-usage-bar-for-secondary-cluster

mgr/dashboard : Fixed usage bar for secondary site in rbd mirroing

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #63190 from adamemerson/wip-gcc15-rocksdb-cstdint

build: Modify rocksdb submodule

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

mgr/dashboard : Fix secure-monitoring-stack creds issue
Fixes : https://tracker.ceph.com/issues/73379

Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #65840 from rhcs-dashboard/fix-permissionsrt

mgr/dashboard: fix dashboard freeze on missing smb permissions

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65734 from ArbitCode/wip-raja-get-caller-identity-issue

rgw/sts :  get-caller-identity issue fix

Merge pull request #65866 from samarahu/d4n-suite-redis-fix

qa/d4n: Fix redis scanning in workunit

Merge pull request #65857 from rhcs-dashboard/table-title-template

mgr/dashboard: support templates in table component title

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65558 from rhcs-dashboard/rbd-form-fixes

mgr/dashboard: fix rbd form mirroring toggle

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #65833 from rhcs-dashboard/custom-message-validator

mgr/dashboard: support custom validator messages in inline edit

Reviewed-by: Naman Munet <nmunet@redhat.com>

crimson/seastore: use DMA alignment for block size instead of stat

Before this fix, BlockSegmentManager used stat.block_size (typically 512
bytes from file_stat()) as the alignment requirement for writes. However,
Seastar's DMA engine requires alignment to disk_write_dma_alignment()
(typically 4096 bytes, the logical block size) for performant writes.

This mismatch caused failures in BlockSegmentManager::segment_write():

1. Crimson believed block_size was 512 bytes (from file_stat())
2. Crimson prepared 512-byte aligned buffers for writing
3. Seastar's internal::sanitize_iovecs() trimmed the unaligned portions
   based on the actual 4096-byte DMA alignment requirement
4. This left an empty buffer (512 bytes trimmed from 512-byte buffer)
5. The write operation returned 0 bytes written
6. The assertion 'written != len' failed in do_writev()

The fix queries the actual DMA alignment requirement from Seastar via
file.disk_write_dma_alignment() and uses that as block_size throughout
the segment manager. This ensures all writes are properly aligned for
Seastar's DMA engine.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #65865 from jmundack/doc-Remove-unsupposed-OS-from-packages-and-container-hosts-table

doc: Update os-recommendations.rst to remove empty rows

Merge pull request #64587 from SundownRises/NotificationArea-component

mgr/dashboard: Carbonised Notification area component

Reviewed-by: Afreen Misbah <afreen@ibm.com>