RGW/multisite: add some more debug logs to sync codepath

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>

RGW/test_multi: remove unused import

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>

RGW/test_multi: allow Cluster object to run ceph admin commands

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>

RGW: add delay injection options for integration testing

Introduce two developer-level configuration options for controlled delay
injection during integration testing:

  - rgw_inject_delay_sec: duration of the injected delay (in seconds)
  - rgw_inject_delay_pattern: pattern to select which delay points are
    activated

These options help reproduce timing-sensitive or race conditions in a
deterministic way during RGW integration tests.

In the future, these options may evolve to support more complex timing
scenarios by using list or map types. This would allow multiple delay
injection points to be configured simultaneously, for example: delaying
pattern A by 5 seconds, pattern B before or after a specific event, or
using different durations for each point.

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>

RGW: make SSTR macro safe against variable name collisions

The original SSTR macro defined a local variable `std::stringstream ss`
inside its expansion. When an expression that used a variable named `ss`
is passed to this macro, it led to name shadowing and unexpected results.

  Example:
    std::stringstream ss;
    ss << "aaa";
    auto result = SSTR("this is ss=" << ss.str());

  Actual result:
    "this is ss=this is ss="
  Expected result:
    "this is ss=aaa"

This change rewrites the macro to construct an unnamed temporary to
avoid any name collision.

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>

Merge pull request #66352 from tchaikov/debian-invoke-rc.d

debian: remove invoke-rc.d calls from postrm scripts

Merge pull request #66591 from NitzanMordhai/wip-nitzan-pickup-object-corpus-20.2.0-380-gdbcbbd3f281

ceph-object-corpus: pick up 20.2.0-380-gdbcbbd3f281

Merge pull request #66553 from smanjara/wip-fix-object-sync-enoent

rgw: retry ENOENT if bucket reshard races with index operation

Merge pull request #66721 from swjtu-zhanglei/main-wip

rgw: refact by encapsulating io_context_pool to enforce lazy initialization

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #66567 from mertsunacoglu/wip-prerequest-auth

RGW: Change prerequest hook to run after authorization process

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #66509 from morphes1995/rgw_qos_fix

rgw: ops large budget caused by rate limiter was enabled and max_ops …

Reviewed-by: Mark Kogan <mkogan@ibm.com>

Merge pull request #67264 from guits/fix-74818

ceph-volume: pass osd_type value to ceph-volume

Merge pull request #66594 from cbodley/wip-qa-rgw-account-migration

qa/rgw: add test_account_migration workunit

Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>

Merge PR #66657 into main

* refs/pull/66657/head:
developer: Add name to maps

Reviewed-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #67309 into main

* refs/pull/67309/head:
doc: correct spelling

Reviewed-by: Zac Dover <zac.dover@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #67078 into main

* refs/pull/67078/head:
doc: Fixes a spelling error on the RATIO for PG scaling recommendation.

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #66526 from gardran/wip-gardran-show-sharding

os/bluestore: show RocksDB sharding information

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

Merge PR #67320 into main

* refs/pull/67320/head:
.github/workflows: use main branch for config diff

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Naveen Naidu <naveen.naidu@ibm.com>

Merge pull request #66821 from rhcs-dashboard/cephfs-mirroring-filesystem

mgr/dashboard: Cephfs mirroring Filesystem Selection

Reviewed-by: Naman Munet <nmunet@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #67044 from Hezko/nvme-submodule-to-1-6-5

mgr/dashboard: bump nvmeof submodule to 1.6.5

Merge pull request #66929 from mkogan1/wip-t74245

ceph-volume: fix build on RHEL 10/python 3.12

Reviewed-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #66906 from rhcs-dashboard/gateway-resources

mgr/dashboard: NVme-gateway-resource

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge PR #67316 into main

* refs/pull/67316/head:
doc/dev/release-checklist: add release to redmine-upkeep trigger
.github/workflows/redmine-upkeep: run for release branches

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

.github/workflows: use main branch for config diff

This script does not exist for the "head" reference of backport PRs.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

qa/rgw: add test_account_migration workunit

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #67307 from leonidc/fix-tests-after-beacon-diff

 qa: fixing the qa test in mon/misc.sh after adding beacon-diff feature

doc/dev/release-checklist: add release to redmine-upkeep trigger

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

.github/workflows/redmine-upkeep: run for release branches

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #67011 into main

* refs/pull/67011/head:
qa/multisite: use boto3's ClientError in place of assert_raises from tools.py.
qa/multisite: test fixes
qa/multisite: boto3 in tests.py
qa/multisite: zone files use boto3 resource api
qa/multisite: switch to boto3 in multisite test libraries

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc: correct spelling

I saw a typo so I fixed it

Signed-off-by: Amnay <amnay.m@gmail.com>

 qa: fixing the qa test in mon/misc.sh after adding beacon-diff feature

Signed-off-by: Leonid Chernin <leonidc@il.ibm.com>

mgr/dashboard: NVme-gateway-resource

Fixes: https://tracker.ceph.com/issues/74334
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

Merge pull request #67290 from shraddhaag/wip-shraddhaag-cephadm-crimson-tests

cephadm, ceph-volume: add tests for crimson OSD support

Merge pull request #66255 from rkachach/fix_issue_73853

mgr/cephadm: don't remove TLS certs if svc still has daemons on host

Reviewed-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/dashboard: Cephfs Mirroring - Filesystem Selection

Fixes: https://tracker.ceph.com/issues/74280
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge PR #65538 into main

* refs/pull/65538/head:

Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: Shachar Sharon <ssharon@redhat.com>

Merge pull request #67182 from Kh9705/add-s3select-limit-examples

doc/radosgw/s3select: added SQL LIMIT operator examples

Merge pull request #67104 from rhcs-dashboard/header-page-component

mgr/dashboard: add page header component

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #67059 from bluikko/wip-src-script-backport-fixes

ceph-backport.sh: clean function argument use and update GitHub help link

Merge pull request #67202 from tchaikov/wip-ec-isa-cleanup

erasure-code/isa: eliminate redundant map lookups

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>

Merge pull request #67128 from afreen23/subsystem-step-2

mgr/dashboard: Step two subsystem creation form

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>

mgr/dashboard: bump nvmeof submodule to 1.6.5

update proto files and gateway submodule
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
tomer

Merge pull request #67174 from bluikko/wip-fix-74721-trailing-space

mgr/dashboard: remove trailing space from directory name

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>

Merge pull request #66092 from kshtsk/wip-fix-lua-kernel-check

qa/cephfs: lua to respect missing kernel in yaml

cephadm, ceph-volume: add tests for crimson OSD support

This commit adds tests for the crimson OSD support in cephadm and ceph-volume.
The following tests are added for the same:

1. cephadm: DriveGroupSpec validation checks for osd_type.
2. cephadm: entrypoint verification in runfile.
3. cephadm to ceph-volume: command verification when osd_type is specified in spec.
4. ceph-volume: binary selection verification for mkfs cmd.

Fixes: https://tracker.ceph.com/issues/74851
Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #66815 from bluikko/wip-doc-man-fix-directives

doc/man: fix invalid directive missing a second colon

mgr/dashboard: Add step two of subsystem create form

- add steps to add initiators
- can add by input field
- added right influencer (right panel) in tearsheet component
- added unit tests
- includes api updates

Fixes https://tracker.ceph.com/issues/74096

Signed-off-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: add page header component

Adds page header component and applies it to the CephFS Mirroring list

Fixes: https://tracker.ceph.com/issues/74626
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

Merge PR #64743 into main

* refs/pull/64743/head:

Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #66979 from idryomov/wip-73824

librbd: introduce RBD_LOCK_MODE_EXCLUSIVE_TRANSIENT

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #64819 from aclamk/aclamk-rocksdb-binned-cache-perf-counters

kv/RocksDB: Add instrumentation to BinnedLRUCache

Reviewed-by: Jaya Prakash <jayaprakash@ibm.com>

Merge pull request #67170 from afreen23/subsystem-step-3

mgr/dashboard: Step three subsystem creation form

Reviewed-by: pujaoshahu <pshahu@redhat.com>

Merge pull request #67217 from aliakseimakarau/main-s390x-fixexecstack

Mark s390x CRC assembly code as not requiring ELF execstack

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #67261 from Matan-B/wip-matanb-crimson-66488-revert

Revert "crimson/os/seastore/cache: TRIM_DIRTY/CLEANER_* transactions won't invalidate other transactions anymore"

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge pull request #67266 from gbregman/main

mgr/cephadm: Change the default value of omap_file_lock_duration in  NVMEoF spec file

Merge PR #67251 into main

* refs/pull/67251/head:
qa: set column for insertion
qa: bail sqlite3 on any error
qa: use actual sqlite3 blob instead of string
test: use json_extract instead of awkward json_tree

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #66552 from Jayaprakash-ibm/wip-add-scrub-flag

osd: Add flag to Identify Scrub IO

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>
Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>

ceph-volume: pass osd_type value to ceph-volume

Use OSDType.value when building the ceph-volume lvm batch command
so that the CLI receives "classic" or "crimson" instead of the enum
repr ("OSDType.classic").

Fixes: https://tracker.ceph.com/issues/74818
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #67024 from amathuria/wip-amat-fix-73791

crimson/os/seastore: Add progress logging to transaction processing

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65814 from amathuria/wip-amat-crimson-add-pg-num-testing

qa/suites/crimson-rados: Add pg splitting tests to crimson thrash tes…

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

qa/suites/crimson-rados/thrash: Modify osd_target_transaction_size

We observed in Seastore, deletion of a large batch (default osd_target_transaction_size=30)
can take a significant amount of time.

Because this happens inside the peering_pp.process stage, it blocks the PG's peering pipeline.
During this block, any incoming OSDMap updates (PGAdvanceMap) are stalled behind the deletion work.
This eventually causes a global OSD-wide map progression hang because
the OSD cannot advance past an epoch until all PGs have processed
it.

To fix this, we are reducing osd_target_transaction_size to 5 to lower
conflict rates and allow deletion transactions to complete.

Fixes: https://tracker.ceph.com/issues/73791
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

mgr/cephadm: Change the default value of omap_file_lock_duration in NVMEoF spec file

Fixes: https://tracker.ceph.com/issues/74822
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Revert "crimson/os/seastore/lba_mapping: don't allow classes above"

This reverts commit 45726996d65ec07b2c35a420c3ee0e42f0bf6cb4.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of"

This reverts commit 5a24cac63a676f0a4641257286f1d1f4f7377ce3.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/async_cleaner: avoid its header dependence on"

This reverts commit 1aae6f34b68faf15a8691f599420f23d5a84943e.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/lba_manager: make sure alloc_extents return viewable"

This reverts commit e6fd2e87a18ed25845e5ba5f6d03ebb20818e583.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/async_cleaner: renew backref cursors when they are"

This reverts commit a9c17a2c0912064f51492c2b012cd5608c6a57c1.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/seastore_types: define rewriting transactions"

This reverts commit 1696011379dfa5f1558b3119d4936ef4943ecedf.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/cache: add facilities to synchronize data and states"

This reverts commit 2fc047c51f37cbdfd3952f616cc07f99cf2483d7.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/cache: unlink mutated extents from the stable"

This reverts commit bfc1231e3716f7b780fb1362a76e13078e767f4c.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/cache: since extent committer will also set"

This reverts commit 7e72a79af75d24119c094c533ec4101358aa258d.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/cache: drop unused last_commit"

This reverts commit 33e63bc85fafc057974142071318a32121a62a59.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/cache: rewrite transactions don't invalidate other"

This reverts commit 5ba464e6050a03c8d618728a0bb214ef63d4c944.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore: disable linked tree node operations when committing"

This reverts commit 21d76b9673264ac5817d01e9e11401fbba20e895.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/cached_extent: treat extents under rewrite io as"

This reverts commit ec66079995e8c32771ecd42c5f3c386c5c4c2022.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/transaction_manager: block client transactions if"

This reverts commit a156475f3f8139f2a0b31b9176438cee224da4bd.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Revert "crimson/os/seastore/extent_pinboard: reset 2q_state when removing"

This reverts commit ee2d2fb2ff3435fc8f7108c5724da2d7f80d52fe.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #66644 from rhcs-dashboard/fix-doc-controller-reponses

mgr/dashboard: Add application/json content type to api doc respones

Reviewed-by: Nizamudeen A <nia@redhat.com>

s390x CRC assembly not requiring ELF execstack

ceph-osd and libceph-common.so.2 are marked as execstack ELFs.
This PR does add the GCCs noexecstack option.

Fixes: https://tracker.ceph.com/issues/74751
Signed-off-by: Aliaksei Makarau <aliaksei.makarau@ibm.com>

erasure-code/isa: eliminate redundant map lookups

Use find() instead of count() + operator[] to avoid multiple lookups
and reduce nesting.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #67254 from tchaikov/wip-doc-build-mgr-module-command

doc/_ext: fix ceph_commands.py for new decorator-based command system

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #67186 from perezjosibm/wip-perezjos-tracker74642

crimson: fix dump_metrics skipping metrics argument.

qa: set column for insertion

    2026-02-08T13:02:24.439 INFO:tasks.workunit.client.0.trial031.stderr:Parse error near line 2: no such column: "start" - should this be a string literal in single-quotes?

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

qa: bail sqlite3 on any error

Otherwise it will wrongly proceed executing the next SQL statement.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

qa: use actual sqlite3 blob instead of string

No functional change.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

test: use json_extract instead of awkward json_tree

Ideally this should be port better across sqlite3 versions. The sqlite3
on rocky10 failed because it started requiring components of the keys
to be quoted:

    sqlite> select * from p as a, p as b where a.i=1 and b.i = 2 and a.fullkey = '$."libcephsqlite_vfs"."opf_sync".avgcount' and b.fullkey = '$."libcephsqlite_vfs"."opf_sync".avgcount';
    i  key       value  type     atom  id   parent  fullkey                                    path                              i  key       value  type     atom  id   parent  fullkey
    -  --------  -----  -------  ----  ---  ------  -----------------------------------------  --------------------------------  -  --------  -----  -------  ----  ---  ------  ------------------
    1  avgcount  4      integer  4     581  570     $."libcephsqlite_vfs"."opf_sync".avgcount  $."libcephsqlite_vfs"."opf_sync"  2  avgcount  5      integer  5     581  570     $."libcephsqlite_v

Fixes: https://tracker.ceph.com/issues/74755
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #67086 into main

* refs/pull/67086/head:
qa/suites/upgrade: Exclude ceph-osd-classic/crimson when installing LTS releases
qa/suites/fs/upgrade: Exclude ceph-osd-classic/crimson when installing LTS releases

Reviewed-by: Kefu Chai <k.chai@proxmox.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #67145 into main

* refs/pull/67145/head:
src/script/build-with-container.py: fix a few spelling errors

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

mgr/dashboard: Add application/json content type to api doc respones

This will fix the sphinx documentation generated and properly display endpoint documentation responses.
Also adds a doc link to the openapi swagger

Fixes: https://tracker.ceph.com/issues/73413
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

doc/_ext: fix ceph_commands.py for new decorator-based command system

After commit 4aa9e246f, mgr modules migrated from using a class-level
COMMANDS list to decorator-based command registration using per-module
CLICommand instances (e.g., @BalancerCLICommand.Read('balancer status')).

This broke the ceph_commands.py Sphinx extension which was hardcoded to
expect m.COMMANDS to be a list, causing documentation builds to fail.

But not all modules are using this per-module CLICommand. Some modules are
fully migrated (balancer, hello, etc.) and use decorators, while others
are partially migrated (volumes, progress, stats, influx, k8sevents,
osd_perf_query, osd_support) - they have CLICommand defined but still
use the old COMMANDS list.

This fix updates _collect_module_commands() to handle three scenarios:

1. Fully migrated modules: Check CLICommand.dump_cmd_list() and use it
   if it returns commands
2. Partially migrated modules: Fall back to the old COMMANDS list if
   dump_cmd_list() returns empty
3. Legacy modules: Use COMMANDS list if CLICommand doesn't exist

This ensures the Sphinx extension works with modules in any migration
state, maintaining backwards compatibility while supporting the new
decorator pattern.

Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #67247 from ivancich/wip-fix-versioning-test-fix

rgw/test: fix rgw versioning test fix

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #67243 from anthonyeleven/updateslink

doc/start: Update Slack invite link in doc/start/get-involved.rst

rgw/test: fix rgw versioning test fix

Removing parentheses that are problematic.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #66467 from athanatos/wip-sjust-mgr-cli-command-74042

pybind/mgr: update modules to use independent CLICommand subtypes with distinct COMMAND attributes

doc/start: Update Slack invite link in doc/start/get-involved.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #67220 from shraddhaag/wip-shraddhaag-74753

doc: add instructions for deploying crimson with cephadm

Merge pull request #67180 from afreen23/fix-notif-panel

mgr/dashboard: Fix footer of notification panel

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

doc: add instructions for deploying crimson with cephadm

This PR adds user facing instructions on how to deploy crimson
OSDs with cephadm. It also updates the build information as per
latest changes.

Fixes: https://tracker.ceph.com/issues/74753
Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #67222 from anthonymicmidd/wip-docs-page

Update foundation.rst

Reviewed-by: Josh Durgin <jdurgin@ibm.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #65623 from JonBailey1993/data_digests_are_inconsistent_fix

osd: fix for "data digests are inconsistent"