Merge branch 'wip-nitzan-MOSDOpReply-pgid64-encode-decode-fix' of https://github.com/NitzanMordhai/ceph into wip-bharath5-testing-2025-10-18-0915

Merge branch 'wip-naveen-bz-2251015-docs-clear-snapset' of https://github.com/Naveenaidu/ceph into wip-bharath5-testing-2025-10-18-0915

Merge pull request #65585 from cbodley/wip-rgw-lc-bucket-already-run-today

rgw/lc: enforce consistent rgw_lc_debug_interval start times

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #60815 from rhcs-dashboard/fix-69029-main

mgr/cephadm: Use a persistent volume to store Loki DB

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65982 from bluikko/doc-config-ref-formatting-radosgw

doc/radosgw: Small fixes in config-ref.rst

Merge pull request #64959 from edwinzrodriguez/ceph-wip-72442

rgw: Update buffer size for HMAC signature

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #62787 from dang/wip-dang-getattrs

RGW - zipper - Remove target from get_obj_attrs()

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65926 from soumyakoduri/wip-skoduri-restore-tests

rgw/restore: increase read_thorugh restore period

Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>

Merge pull request #65980 from idryomov/wip-debug-cls-fixup

cls/hello: debug_cls -> debug_objclass in the comment

Reviewed-by: Neha Ojha <nojha@redhat.com>

doc/radosgw: Small fixes in config-ref.rst

Use privileged prompt for CLI command.

Use title case consistently for section titles.

Fix a typo that caused RST syntax rendered as-is.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #65920 from nh2/docs-cephfs-inodes-on-replicated

doc/cephfs/createfs: Recommend default data pool on SSDs for non-EC

rgw: Update buffer size for HMAC signature and improve signature max size calculation

Move SIGNATURE_MAX_SIZE to public interface of AWSEngine::VersionAbstractor
Use SIGNATURE_MAX_SIZE to size buffer in get_v2_signature

Fixes: https://tracker.ceph.com/issues/72442
Signed-off-by: Edwin Rodriguez <edwin.rodriguez1@ibm.com>

cls/hello: debug_cls -> debug_objclass in the comment

debug_cls option doesn't exist -- it's spelled debug_objclass.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #65970 from cbodley/wip-cmake-arrow-thrift-boost-jammy

cmake: BuildArrow.cmake uses bundled thrift if system version < 0.17

Reviewed-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #64762 from mkogan1/wip-ratelim-list-v001

rgw: rate limit for LIST and DELETE ops

messages: fix MOSDOpReplay decode of old version bad_replay_version

When decoding an old version of MOSDOpReplay or when the PGID64
feature is enabled, bad_replay_version is not being set, which
causes inconsistent output in ceph-dencoder.

To fix this, set bad_replay_version to the head reassert_version
value. This ensures that if the struct is later re-encoded, the
decode output will be consistent.

Fixes: https://tracker.ceph.com/issues/69814
Signed-off-by: Nitzan Mordechai <nmordech@ibm.com>

include/types: Update set wire function parameter

Fixes: https://tracker.ceph.com/issues/69814
Signed-off-by: Nitzan Mordechai <nmordech@ibm.com>

messages: MOSDOpReply encode and decode errorcode32_t with PGID64 features on

we used to have raw encode\decode of results when PGID64 features is on.
we should use errorcode32_t os convertions using set\get wire.

Fixes: https://tracker.ceph.com/issues/69814
Signed-off-by: Nitzan Mordechai <nmordech@ibm.com>

Merge pull request #65168 from stackhpc/swap-tip-fix-wording

doc/start: fix wording in swap tip

Merge pull request #65869 from tchaikov/wip-crimson-aligned-dma-write

crimson/seastore: use DMA alignment for block size instead of stat

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65973 from rhcs-dashboard/inline-edit-validator-fix

mgr/dashboard: fix generic form submit validator for inline edit

Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #65707 from a16bitsysop/crimson-gcc15

crimson: admin: fix FTBFS with gcc 15

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

mgr/dashboard: fix generic form submit validator for inline edit

currently the validation error is being applied generically to the
parent formgroup which will set the whole form into an error state when
one of the inline editing is failing on a validation. So just changing
that to a single control.

Fixes: https://tracker.ceph.com/issues/73558
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65954 from positiveEV/patch-2

doc/rados/operations: remove duplicate word

cmake: BuildArrow.cmake uses bundled thrift if system version < 0.17

the bump to arrow 17.0.0 broke the ubuntu jammy builds with:

In file included from /usr/include/thrift/transport/TTransport.h:25,
                 from /usr/include/thrift/protocol/TProtocol.h:28,
                 from /usr/include/thrift/TBase.h:24,
                 from /build/ceph-20.3.0-3599-g3d863d32/src/arrow/cpp/src/generated/parquet_types.h:14,
                 from /build/ceph-20.3.0-3599-g3d863d32/src/arrow/cpp/src/generated/parquet_constants.h:10,
                 from /build/ceph-20.3.0-3599-g3d863d32/src/arrow/cpp/src/generated/parquet_constants.cpp:7:
/usr/include/thrift/transport/TTransportException.h:23:10: fatal error: boost/numeric/conversion/cast.hpp: No such file or directory
   23 | #include <boost/numeric/conversion/cast.hpp>
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.

when comparing the gcc command line with arrow-15.0.0, the following argument
is no longer present:
> -isystem /build/ceph-20.3.0-3402-gb2db4947/obj-x86_64-linux-gnu/boost/include

arrow 17.0.0 seems to assume that thrift doesn't depend on boost anymore. a
comment in https://github.com/apache/arrow/issues/32266 claims that
> we don't need Boost with system Thrift 0.17.0 or later

but our jammy builds are stuck with libthrift-0.16.0. to reenable jammy builds,
instruct Arrow's cmake to use its bundled thrift dependency if our system thrift
version is < 0.17.0

Signed-off-by: Casey Bodley <cbodley@redhat.com>

cmake: Findthrift.cmake parses version string

when thrift headers are found, parse the version string into a
cmake variable and pass it to find_package_handle_standard_args

this will be needed by BuildArrow.cmake for some conditional logic

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65774 from ljflores/wip-add-telemetry-pool-flag

mgr/telemetry: add 'ec_optimizations' flag to 'basic_pool_flags' collection

Merge pull request #65955 from gbregman/main

mgr/cephadm: Increase the default expiration time for NVMEoF subsyste…

Merge pull request #65891 from kshtsk/wip-workunit-drop-pipes

qa/tasks/workunit: fix no module named 'pipes'

Merge pull request #65967 from jmundack/doc-sort-csc-memer-list

doc: Update governance.rst to have member names sorted

doc: Update governance.rst to have member names sorted

Originally this list was sorted by first name, overtime new members were added at the bottom. Resorting them again by first name

Signed-off-by: Joseph Mundackal <jmundackal@bloomberg.net>

Merge pull request #64359 from mkogan1/wip-d3n-stripe-gt-chunk-py

rgw/qa/d3n: improve D3N test robustness

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #65367 from myoungwon/wip-nvmedevice-coroutine

crimson/os/seastore/rbm: switch rbm to coroutine

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65935 from tchaikov/wip-debian-libxsimd-dev

debian/control: Add libxsimd-dev build dependency for vendored Arrow

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65664 from cbodley/wip-73240

rgw/lc: LCOpAction_CurrentExpiration checks mtime for delete markers

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

mgr/cephadm: Increase the default expiration time for NVMEoF subsystem cache

Fixes: https://tracker.ceph.com/issues/73542
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #65529 from mkogan1/wip-d4n-reserve

rgw/d4n: refactor unused conf rgw_d4n_l1_datacache_size

doc/rados/operations: remove duplicate word

Signed-off-by: positiveEV <50848762+positiveEV@users.noreply.github.com>

Merge pull request #65054 from BBoozmen/dequeue_op_latency_at_completion

OSD: add latency data to DEQUEUE_OP_END event

Merge pull request #64377 from ljflores/wip-tracker-70716

qa/tasks: Ignore expected `backfill_toofull` warning

Merge pull request #65616 from xxhdx1985126/wip-73159

crimson/osd/pg: create "submit_lock" unlocker before locking it

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #64756 from rzarzynski/wip-bug-67244

monc: synchronize tick() of MonClient with shutdown()

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #65578 from Matan-B/wip-matanb-crimson-seastore-should_block

crimson/os/seastore/epm: Verify available segments on mkfs/mount

Reviewed-by: Samuel Just <sjust@redhat.com>

debian/control: Add libxsimd-dev build dependency for vendored Arrow

In commit e8460cbd, we introduced the "pkg.ceph.arrow" build profile to
support building with system Arrow packages. However, neither Debian nor
Ubuntu currently ships Arrow packages.

Since WITH_RADOSGW_SELECT_PARQUET is always enabled in debian/rules,
Arrow support is required for all builds. When the pkg.ceph.arrow profile
is not selected, the build uses vendored Arrow. With the recent change to
use AUTO mode for xsimd detection, Arrow will attempt to find system xsimd
>= 9.0.1. Adding libxsimd-dev as a build dependency ensures it's available
for Arrow to detect and use, reducing build time on supported distributions.

On distributions with insufficient xsimd versions (< 9.0.1), Arrow will
automatically fall back to its bundled version.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

cmake/BuildArrow: Use AUTO mode for xsimd dependency detection

Arrow requires xsimd >= 9.0.1 according to arrow/cpp/thirdparty/versions.txt.
Previously, we unconditionally set -Dxsimd_SOURCE=BUNDLED, forcing the use
of Arrow's vendored xsimd regardless of system package availability.

This commit changes to -Dxsimd_SOURCE=AUTO, which allows Arrow's
resolve_dependency mechanism to automatically:
1. Try to find system xsimd package
2. Check if version >= 9.0.1
3. Use system version if found and sufficient
4. Fall back to bundled version otherwise

This reduces build time and dependencies on systems with sufficient xsimd,
while maintaining compatibility with older distributions.

Distribution availability:
- Ubuntu Noble (24.04): libxsimd-dev 12.1.1 (✓ will use system)
- Ubuntu Jammy (22.04): libxsimd-dev 7.6.0 (✗ will use bundled)
- Debian Trixie (13): libxsimd-dev 13.2.0 (✓ will use system)
- CentOS Stream 9: xsimd-devel 7.4.9 (✗ will use bundled)

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #65236 from leonidc/delete_all_gws

nvmeofgw: fix issue of delete all gws from the pool/group

Merge pull request #64176 from tchaikov/wip-pybind-cb-types

pybind: fix callback function type compatibility for GCC 14/15

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nitzan Mordhai <nmordech@ibm.com>

Merge pull request #65934 from tchaikov/cephadm-detect-pip

cephadm/build: Fix _has_python_pip() function check

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65919 from phlogistonjohn/jjm-bwc-variants

build-with-container: build image variants

doc/cephfs/createfs: Recommend default data pool on SSDs for non-EC

Signed-off-by: Niklas Hambüchen <mail@nh2.me>

Merge pull request #65930 from cloudbehl/filesystem-grafana-fixes

monitoring: Fix Filesystem grafana dashboard units

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65065 from ifed01/wip-ifed-fix-70390

os/bluestore: complete fix for extent spanning over shard boundaries

Merge pull request #65468 from Kushal-deb/kill-daemon

mgr/cephadm: configurable per-service stop timeout

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

cephadm/build: Fix _has_python_pip() function check

The _has_python_pip() function was incorrectly checking for the venv
module instead of pip, causing it to always return the wrong result.
This would prevent proper detection of whether pip is available during
the cephadm build process.

Fix by changing the module check from 'venv' to 'pip'.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #65848 from Hezko/nvmeof-cli-def-max-ns-num-on-subsys-create

mgr/dashboard: change the default max namespace from 4096 to None in subsystem add command

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65791 from aainscow/fix_compiler_warnings

crimson/rgw: Fix clang compiler warnings.

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Edwin Rodriguez <erodriguez@lazyk-ranch.com>

Merge pull request #65829 from rhcs-dashboard/73379-fix-secure-monitoring-stack

mgr/dashboard : Fix secure-monitoring-stack creds issue

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #60361 from rhcs-dashboard/converting-badges-to-carbon-tag

mgr/dashboard: replace bootstrap badges with carbon tags

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

rgw/restore: increase read_thorugh restore period

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

script/build-with-container: add build image variants

Allow the user to control the content of the build image with a
high-level `--image-variant=` switch. Currently the supported values are
`default` (the same maximal image we have been generating) and
`packages` a slimmer image that avoids installing certain test-only
dependencies.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

Dockerfile.build: make FOR_MAKE_CHECK a build argument

Set it only during install time.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

install-deps.sh: let FOR_MAKE_CHECK variable take precedence

Previously, the FOR_MAKE_CHECK variable could only enable installing
extra (test) dependencies when install-deps.sh was used and it was
ignored if `tty -s` exited true. This change allows FOR_MAKE_CHECK to
take precedence over the tty check and to specify one of true, 1, yes to
enable extra "for make check" deps or false, 0, no to explicitly disable
the extra deps.

Based-on-work-by: Dan Mick <dan.mick@redhat.com>
Signed-off-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65731 from koch-synyx/doc/dashboard-rsa-note

doc/mgr/dashboard: add note that only RSA keys are supported for TLS

Merge pull request #65531 from ShwetaBhosale1/fix_issue_72906_haproxy_changes_for_nfs_active_active_support

mgr/cephadm: Add stick table and haproxy peers in haproxy.cfg for NFS to support nfs active-active cluster

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65851 from guits/cv-fix-db-pre-created-lvs

ceph-volume: lvm.Lvm.setup_metadata_devices refactor

Merge pull request #65898 from gbregman/main

mgr/cephadm: Limit the value of max-namespaces-per-subsystem.

Merge pull request #65909 from bluikko/doc-sphinx-warnings-plus-cephfs

doc/cephfs: Fix Sphinx warnings and other minor improvements

Merge pull request #65375 from ifed01/wip-ifed-bluefs-ratio

os/bluestore: report metadata/data ratio in BlueFS perf counter

Reviewed-by: Mark Nelson <mark.a.nelson@gmail.com>

Merge pull request #64682 from ifed01/wip-ifed-fix-zstd

compressor/zstd: compressor correct buffer end detection using get_remaining()

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

monitoring: Fix Filesystem grafana dashboard units

Fixes: https://tracker.ceph.com/issues/73521
Signed-off-by: Ankush Behl <cloudbehl@gmail.com>

Merge branch 'ceph:main' into main

Merge pull request #64009 from rzarzynski/wip-bug-70869

osd: prevent OSDMap::check_health() from asserting due to new OSDs found in subtree

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@ibm.com>

Merge pull request #65910 from anoopcs9/fix-mgr-smb-doc

doc/mgr: Fix a copy-paste error in smb.rst

doc/mgr: Fix a copy-paste error in smb.rst

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>

doc/cephfs: Fix Sphinx warnings and other minor improvements

Fix 2 Sphinx warnings about problematic syntax in troubleshooting.rst:
add empty lines between paragraphs.

In fs-volumes.rst:

Fix 1 Sphinx warning about problematic syntax:
Fix indentation and change to ordered list instead of manually
hardcoding item numbers.

Use privileged bash prompt consistently for privileged commands.

Use the "[...] run a command of the following form:" for CLI examples
with placeholders.

Fix accidental emphasis on a list item by adding empty lines around
sub-list.

Use title case in section titles and trim overly long underline.

Capitalize UID, GID, Unicode, Ceph in text.

Use double backticks consistently for command line switches, data, etc.

Start with capital case and end in full stop if full sentence.

Linkify mention of quiesce dev doc and add a label for it in
doc/dev/mds_internals/quiesce.rst.

Other very minor changes like typo, remove space at end of line.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #65745 from guits/cv-drop-subprocess-call-get-devices

ceph-volume: use udev data instead of LVM subprocess in get_devices()

Merge pull request #65554 from matteopt/fix/udevdata-init-empty-file

ceph-volume: fix UdevData initialisation from empty /run/udev/data/* file

Merge pull request #65893 from thuvh/doc-m1-getopt

docs: add package on macos to run ceph-backport.sh

Merge pull request #65783 from benhanokh/dedup_permissions

rgw/dedup: Grant dedup process full RGW permissions.

mgr/cephadm: Limit the value of max-namespaces-per-subsystem.

Fixes: https://tracker.ceph.com/issues/73505
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #64908 from Jakesquelch/wip-jakes-default-chunk-size

mon: default chunk size change

Merge pull request #65131 from kamoltat/wip-ksirivad-fix-72647

mgr/progress: compare up set instead of acting set

Merge pull request #65422 from NitzanMordhai/wip-nitzan-destroyed-osds-remove-health-msgs

mgr: remove health msgs from the metrics if osd destroyed

Merge pull request #65305 from rhcs-dashboard/upgrade-carbon-components-pkg

mgr/dashboard: upgrade carbon components package@5.59.2

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65841 from Hezko/nvmeof-cli-ns-list-no-nqn-fix

mgr/dashboard: ns list now support not passing nqn param

Reviewed-by: Afreen Misbah <afreen@ibm.com>

docs: add package on macos to run ceph-backport.sh

Signed-off-by: Hoai-Thu Vuong <thuvh87@gmail.com>

Merge pull request #64709 from dparmar18/fix-qa-fuse-mount-infinite-loop

qa/tasks/cephfs: raise exception if incorrect fstype found

Reviewed-by: Igor Golikov <igolikov@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #64345 from dparmar18/i71740

mds, client, mgr/volumes: toggle snapshot visibility for subvolume based paths

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #62971 from thuvh/feat_rgw_pubsub_push_metric

rgw: add metric when send message with kafka and ampq

Merge PR #65892 into main

* refs/pull/65892/head:
.github/workflows: update qa-symlink to use pull_request_target
script/verify-qa: print commit on run

Merge pull request #65855 from rhcs-dashboard/bump-monitoring-stack

mgr/cephadm: bump monitoring stack versions

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Afreen Misbah <afreen@ibm.com>

.github/workflows: update qa-symlink to use pull_request_target

This should allow the script to run even when a PR is submitted by an
external contributor.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/verify-qa: print commit on run

To allow sanity checking what the script is running against.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

qa/tasks/workunit: fix no module named 'pipes'

Python 3.13 finally dropped the 'pipes' module,
replacing it with shlex.

Fixes: https://tracker.ceph.com/issues/73498
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Merge pull request #65723 from mheler/rgw_cloud_transition_header_fix

rgw/s3: Always include x-amz-content-sha256 header in AWS v4 signatures

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge PR #65839 into main

* refs/pull/65839/head:
pybind/cephfs: fix including of platform_errno.h

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #65525 from ethanwu-syno/fix-snapper-parse-m

osd/SnapMapper: fix SnapMapper::Scrubber shard parsing

Merge pull request #65450 from tchaikov/wip-fix-out-of-bound-access

cpp-btree: fix array bounds warning in btree_node::swap()

Merge pull request #65033 from Nordix/fix-72380-sunnat

mgr/prometheus: Handle empty JSON from orch get-security-config

Merge pull request #65757 from phlogistonjohn/jjm-qa-task-smb

qa/tasks: move smb related task funcs out of cephadm.py to smb.py

Reviewed-by: Adam King <adking@redhat.com>