Merge pull request #63463 from zdover23/wip-doc-2025-05-26-rados-operations-pgcalc

doc/rados: s/enpty/empty/ in pgcalc doc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #62600 from zdover23/wip-doc-2025-04-01-cephadm-host-management

doc/cephadm: improve "Maintenance Mode"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63428 from myoungwon/wip-fix-incorrect-space-calculation

crimson/os/seastore/rbm: prevent incorrect space calculation at maximum capacity

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #63487 from anthonyeleven/scrubscope

src/common/options: Clarify scope of scrub intervals in osd.yaml.in

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63376 from xxhdx1985126/wip-seastore-omap-root-fix

crimson/os/seastore/omap_manager: handle the cases in which omap nodes are rewritten before seen by users

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

src/common/options: Clarify scope of scrub intervals in osd.yaml.in

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #63480 from bluikko/doc-minor-fixes-cloud-restore-radosgw

doc/radosgw: Small improvements in cloud-restore.rst

Merge pull request #63366 from Hezko/nvmeof-cli-align-part-2

mgr/dashboard: align cli commands listener list, ns list, host list

doc/radosgw: Small improvements in cloud-restore.rst

Add a label in file cloud-transition.rst for linking to it.
Change a link using full URL of Ceph docs to use :ref: and said label.

Indent text in unordered lists so that they are rendered as list items.

Use consistently double backticks for references to configuration
values.

Change one external link pointing to old v1 of AWS CLI to the
recommended v2 docs.

Change another external link pointing to old v1 of AWS CLI to the
current AWS API doc instead and add link text instead of rendering the
whole URL.
However, both the old and the new text (which are the same) do not
currently seem to explicitly confirm the claim "storage class of
restored objects should remain unchanged".

Change one CLI command prompt to privileged prompt because it uses
radosgw-admin.

Use "lifecycle" consistently instead of "Life Cycle" in one place and
put the acronym "LC" inside parenthesis instead of the full spelling.

Fix typo "Th" into "The".

Use admonitions instead of spelling out "Note: [...]".

Small improvement to language in one admonition.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #63434 from cbodley/wip-70673-debug

test/rgw: link lua test against unit-main for g_ceph_context

Merge pull request #62179 from benhanokh/s3_full_object_dedup

rgw/dedup: full object dedup

Merge pull request #63335 from Hezko/nvmeof-align-gw-info

mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli

Merge pull request #63334 from Hezko/nvmeof-cli-fix-spdk-set-lvl

mgr/dashboard: fix set spdk log level cli command

Merge PR #59161 into main

* refs/pull/59161/head:
qa: test failure for duplicate retention spec
mgr/snap_schedule: fix message format error

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

mgr/dashboard: align cli commands listener list, ns list, host list

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

mgr/dashboard: fix set spdk log level cli command

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

Merge pull request #63475 from zdover23/wip-doc-2025-05-26-mgr-telegraf-62782-followup

doc/mgr: edit telegraf.rst

Merge pull request #63474 from zdover23/wip-doc-2025-05-26-mgr-smb-62782-followup

doc/mgr: edit smb.rst

doc/mgr: edit telegraf.rst

Edit doc/mgr/telegraf.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit smb.rst

Edit doc/mgr/smb.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63464 from zdover23/wip-doc-2025-05-26-cephfs-mount-using-kernel-driver

doc/cephfs: correct ill-formatted command

Merge pull request #63469 from zdover23/wip-doc-2025-05-26-mgr-orchestrator-62782-followup

doc/mgr: edit orchestrator.rst

Merge pull request #63472 from zdover23/wip-doc-2025-05-26-mgr-rgw-62782-followup

doc/mgr: edit rgw.rst

doc/mgr: edit rgw.rst

Edit doc/mgr/rgw.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit orchestrator.rst

Edit doc/mgr/orchestrator.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/cephfs: correct ill-formatted command

Correct a command that was broken across two lines, causing the argument
of an option to appear as though it was a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/rados: s/enpty/empty/ in pgcalc doc

s/enpty/empty/ in doc/rados/operations/pgcalc/index.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63027 from tchaikov/any-alignas

include/any.h: avoid using std::aligned_storage_t

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge PR #63420 into main

* refs/pull/63420/head:
doc/mgr: edit mds_autoscaler.rst

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

test/rgw/dedup: add dedup test suite to teuthology

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #63426 from bluikko/doc-account-formatting-radosgw

doc/radosgw: Cosmetic improvements and ref links in account.rst

Merge pull request #63415 from zdover23/wip-doc-2025-05-22-mgr-influx-62782-followup

doc/mgr: edit influx.rst.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

crimson/os/seastore/omap_manager: handle the cases in which omap nodes
are rewritten before seen by users

Fixes: https://tracker.ceph.com/issues/71383
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge pull request #62683 from alexjr2001/issue-66309-scroll-up-navigation

scroll up by default when clicking on side navigation

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #63446 from bluikko/doc-cloud-transition-formatting-radosgw

doc/radosgw: Cosmetic improvements in cloud-transition.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

doc/radosgw: Cosmetic improvements in cloud-transition.rst

Indent text that should belong to list items so they are formatted as
list items.

Add missing full stop for a few sentences.

Move "the" outside of inline preformatted.
Format S3 API operation name with inline preformatted which seems
common.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

doc/radosgw: Cosmetic improvements and ref links in account.rst

Use double backticks consistently when referring to data, commands etc.

Change links pointing to existing labels to use ref.

Use title case consistently in section titles.

Use ordered lists instead of hardcoding list numbers.

Use inline strong for emphasis instead of inline preformatted.

Change several tab to four spaces for indent.

Call it "RADOS Gateway" instead of "RadosGW".

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #63400 from ronen-fr/wip-rf-71404-nodeep

qa/standalone/scrub: extra delay in osd-scrub-test.sh

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #63411 from ceph/debpathnorm

make-debs.sh: Optionally rm version from build dir

Merge pull request #63360 from cbodley/wip-doc-rgw-sts

doc/rgw: add notes about 'rgw sts key'

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

Merge pull request #62777 from tobias-urdin/rgw-admin-bucket-pagination

rgw/admin: Add max-entries and marker to bucket list

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw/dedup: full object dedup

Design Document:
https://docs.google.com/document/d/152VyCTR2NlZ6ongbe6-CJfP4qxr1_zH83FB_WukWD7c

Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>

Merge pull request #63352 from mkogan1/wip-d3n-exit-valg

rgw/d3n: fix valgrind invalid read during exit

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #63161 from aclamk/aclamk-bs-recomp-improve-is-worth

os/bluestore: Do not recompress large compressed blobs

Merge pull request #63189 from cbodley/wip-rgw-config-store-realm-watcher

rgw: move rados-specific parts of RGWRealmWatcher into ConfigStore

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

test/rgw: link lua test against unit-main for g_ceph_context

test_rgw_lua.cc was allocating a CephContext without initializing it, so
log statements from the tests/rgw code weren't actually being logged

the unit-main target links in the main() function from test/unit.cc
which initializes the CephContext via global_init(). use the resulting
global g_ceph_context instead of managing a separate one

Related-to: https://tracker.ceph.com/issues/70673
Signed-off-by: Casey Bodley <cbodley@redhat.com>

crimson/os/seastore: prevent incorrect space calculation at maximum capacity

This commit updates seastore to increment used_bytes only when
 allocation is successful.
Without this commit, the seatore reports incorrect size if alloc_paddr fails
(e.g., due to insufficient space)

Signed-off-by: Myoungwon Oh <ohmyoungwon@gmail.com>

Merge pull request #63292 from tchaikov/test_not_before_queue-fix-leaks

test/test_not_before_queue: Fix memory leak by freeing ineligible items in destructor

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #63369 from zdover23/wip-doc-2025-05-20-mgr-diskprediction-62782-followup

doc/mgr: edit diskpredictor.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/mgr: edit mds_autoscaler.rst

Edit mds_autoscaler.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit influx.rst.

Edit doc/mgr/influx.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63308 from Hezko/nvmeof-cli-align-subsys-list

mgr/dashboard: Add missing fields to subsytem list API/CLI

Reviewed-by: Afreen Misbah <afreen@ibm.com>

make-debs.sh: Optionally rm version from build dir

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #63048 from JoshuaGabriel/joshua_71135

orch/module: Make orch unpause an alias for orch resume

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #63371 from bluikko/doc-cephfs-mirroring-formatting-cephfs

doc/cephfs: Cosmetic changes and small fixes in cephfs-mirroring.rst

Merge pull request #63379 from ronen-fr/wip-rf-noloadavg

osd/scrub: remove OsdScrub::LoadTracker

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/rgw: use 'confval' directive to render sts config options

the 'confval' directive reads the config options from
common/options/rgw.yaml and renders them nicely. this keeps
everything consistent between the options and their docs

improve the config option descriptions:

* add existing note about rgw_sts_key length/format
* add example openssl command to generate a conforming sts key
* add notes about sharing sts key between gateways/zones

format the last remaining 'Note' with the 'note' directive

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #63368 from zdover23/wip-doc-2025-05-20-mgr-dashboard_plugins-motd-inc-62782-followup

doc/mgr: edit motd.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

rgw: move rados-specific parts of RGWRealmWatcher into ConfigStore

split RGWRealmWatcher in two halves, moving the rados-specific stuff
into a RadosRealmWatcher that inherits from RGWRealmWatcher

add factory function ConfigStore::create_realm_watcher() that returns a
generic RGWRealmWatcher. ConfigStore backends that don't support
watch/notify can return nullptr

rgw::AppMain uses this to avoid relying on checking for a "rados" driver
name, which doesn't work correctly when there are filters on top of the
RadosStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/standalone/scrub: extra delay in osd-scrub-test.sh

Modify TEST_just_deep_scrubs():
The test turns 'no-deep' off, and expects the scrub to be
concluded and reported within a short period. But the PG
already had a chance to try scrubbing (and fail due to
the 'no-deep'), and its 'not-before'
was pushed out by osd_scrub_retry_after_noscrub.

The fix is to reduce the value of osd_scrub_retry_after_noscrub
for this test, and to increase the timeout for the test itself.

Fixes: https://tracker.ceph.com/issues/71404
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #62906 from rhcs-dashboard/fix-70276-main

mgr/dashboard: Allow the user to re-use existing realm/zg/zone and setup replication

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>

doc/mgr: edit motd.inc.rst

Edit doc/mgr/dashboard_plugins/motd.inc.rst.

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63367 from zdover23/wip-doc-2025-05-20-mgr-dashboard_plugins-feature_toggles-inc-62782-followup

doc/mgr: edit feature_toggles.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63365 from zdover23/wip-doc-2025-05-15-mgr-dashboard_plugins-debug-inc-rst-62782-followup

doc/mgr: edit debug.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge PR #62934 into main

* refs/pull/62934/head:
libcephfs / pybind: use uid_t and gid_t instead of int

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #63331 from Matan-B/wip-matanb-crimson-tentacle-nightlies

qa/crontab: run Crimson tentacle nightly

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>

doc/cephfs: Cosmetic changes and small fixes in cephfs-mirroring.rst

Don't format an unordered list as preformatted block.

Fix (not linked) reference to a section name that doesn't exist.

Don't call systemd unit files "systemctl unit files", add an "and"
between them.

Clarify by means of inline formatting and whitespace that config value
is "60" and the unit for that is seconds (as opposed to value being
"60s").

Use double backticks consistently when listing commands, file names or
paths, command parameters, syntaxes, etc.

Use star for inline italic instead of single backtick (to differentiate
from the previous).

Don't use double backticks for "cephadm" when talking about the concept.

Don't capitalize a few words that didn't need it.
Capitalize table data for consistency.
All caps for "MDS".

Small updates to language in text.

Call it "cephfs-mirror" everywhere and not "cephfs_mirror" at one place.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

mgr/dashboard: Allow the user to re-use existing r
ealm/zg/zone and setup replication

1. Currently, we just allow the user to create a new realm/zg/zone and setup replication using the multi-site replication wizard. The ask is to allow the user to select the pre-existing realm/zg/zone and setup replication via automatic export and import of token as well.

2. Enable rgw module automatically in the selected cluster if its not
   enabled

Fixes: https://tracker.ceph.com/issues/70276
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #62071 from zhscn/wip-lba-mapping-refactor

crimson/os/seastore: introduce BtreeCursor to simplify the implementation of LBAMapping/BackrefMapping

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #62684 from mchangir/mds-use-already-avaialble-CInode-in-uninline-path

mds: use available CInode* for uninline data

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #63099 from phlogistonjohn/jjm-dash-node-chown

dashboard: ensure nodeenv downloaded content is owned by current user

Merge pull request #62507 from NVShawn/main

[Packaging]: Use system-defined location for home directories

mgr/dashboard: scroll up by default when clicking on side navigation

Ensures the side menu scrolls into view when an item (e.g., "Administration") is clicked and goes out of the screen view. This is done with an onClick event in cds-sidenav tag due to limitations in the Carbon Design System that prevent direct access to `onclick` events.

Fixes: https://tracker.ceph.com/issues/66309
Signed-off-by: Alexander Gomez <alexsgdc@gmail.com>
Update src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.ts

Co-authored-by: afreen23 <afreen23.git@gmail.com>
Signed-off-by: alexjr2001 <63054183+alexjr2001@users.noreply.github.com>
mgr/dashboard: apply lint fixes

Merge pull request #63370 from zdover23/wip-doc-2025-05-20-mgr-hello-62782-followup

doc/mgr: edit hello.rst

Merge pull request #63181 from shraddhaag/wip-shraddhaag-availability-docs

docs: add release notes and docs for availability score feature

Merge pull request #62946 from MaxKellermann/rgw_cksum__unreachable

rgw/rgw_cksum: work around -Wsometimes-uninitialized

Reviewed-by: Casey Bodley <cbodley@redhat.com>

osd: move load avg units conversion to the client

The OSD calls OsdScrub::update_load_average() to find out the load
average, and notes it down in a performance counter. The system
load average is multipled by 100 (to improve precision). That
multiplication should be on the side of the client, not the
scrub queue service.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

osd/scrub: remove OsdScrub::LoadTracker

As we no longer maintain a 'daily average', and as the interaction
between the load tracker and the scrub scheduler is now much simplified,
we can remove the load tracker entirely.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

doc: address review comments

Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

crimson/os/seastore/FixedKVBtree: correct MAX_DEPTH

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/FixedKVBtree: remove with_btree_ret helper function

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/lba: flatten lba namespace to keep consistent with backref

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BtreeLBAManager: support refresh LBAMapping

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore: simplify the processing of indirect LBAMapping

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore: fix LBAMapping/BackrefMapping usages

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BackrefManager: adpat new BackrefMapping

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BtreeLBAManager: cleanup the impl of alloc mapping and remap

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BtreeLBAManager: refactor update_mapping_ret_bare_t

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BtreeLBAManager: refactor with LBACursorRef

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BtreeLBAManager: split _alloc_extents implementation

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/BtreeLBAManager: cleanup alloc_mapping_info_t

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore: rename type remap_entry to remap_entry_t

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore: refactor LBAMapping and BackrefMapping

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/FixedKVBtree: return BtreeCursor instead of BtreeMapping

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/btree: introduce BtreeCursor

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore/btree: move lba/backref_map_val_t to the common header file

rename btree_range_pin.h to btree_types.h

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore: remove child_pos in LBAMapping

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore: remove PhysicalNodeMapping and BtreeNodeMapping

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

crimson/os/seastore: move BtreeNodeMapping::is_viewable_by_trans to CachedExtent

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>