crimson/osd: update snapmapper bits during pg splitting

SnapMapper bits for both parent and children PGs should be updated
during the splitting workflow

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

crimson/osd: add snapmapper for split PGs

make_snapmapper_oid was missing for the new PGs created post-splitting.
This was causing a scrub error due to the missing snap mapper object in the children PGs.

Fixes: https://tracker.ceph.com/issues/72661
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

crimson/osd/scrub: check if stats have been marked invalid

In case of splits/merges the PeeringState::split_into function will mark
the child and parent pgs stats invalid.
We need to check for this when scrub finishes, update the stats and mark them valid.

Fixes: https://tracker.ceph.com/issues/72676
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

test_pg_splitting: add test for splitting with radosbench writes

Adds a test for splitting to start while a pool is being written to.

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

crimson/osd/pg: discard ops in case of split

Clients will take care of re-sending the ops.
We can discard it here.

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

Merge pull request #65140 from rhcs-dashboard/shared-component-style-fixes

mgr/dashboard: style fixes for shared components

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #64979 from zhscn/fix-2q-empty-extents

crimson/os/seastore/2Q: don't add empty extents to the warm out queue

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

mgr/dashboard: style fixes for shared components

fixes: https://tracker.ceph.com/issues/72651

Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #65128 from zdover23/wip-doc-2025-08-19-rados-config-mon-config-ref

doc/rados: repair short underline

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65103 from ljflores/wip-tracker-72594

debian/control: install libnuma-dev unconditionally

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>

Merge pull request #64988 from joscollin/wip-update-mirror-doc

doc: update cephfs-mirror replication

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64864 from chrisphoffman/wip-choffman-72355

client: use path supplied in statfs

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Frank S. Filz <ffilzlnx@mindspring.com>

doc/rados: repair short underline

Repair a too-short underline that was introduced in
https://github.com/ceph/ceph/commit/babd3c00341c59cb82e66f93f41c687ab4fc6928.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #64929 from zdover23/wip-doc-2025-08-10-cephfs-troubleshooting-2

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65084 from avanthakkar/fix-smb-metadata-collection

mgr/prometheus: fix enabled_modules check for smb metadata

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65048 from ronen-fr/wip-rf-newdump

qa/standalone/scrub: re-code osd-scrub-dump.sh to test scrub repair

Reviewed-by: Jon Bailey <jonathan.bailey1@ibm.com>

Merge pull request #64835 from cloudbehl/rbd-metadata

prometheus: Add RBD image metadata to prometheus

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

doc/cephfs: edit troubleshooting.rst

Edit the section "ceph-fuse" in the file doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #65021 from zdover23/wip-doc-2025-08-14-cephfs-troubleshooting

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

qa/standalone/scrub: re-code osd-scrub-dump.sh to test scrub repair functionality.

The new version of osd-scrub-dump.sh is designed to
allow multiple "corruption methods" on a subset of objects.
The functionality includes specifying:
- the number of objects created;
- the number to have their Primary version modified;
- the number to have their Replicas modified;
- the set of "manipulations" to perform on the objects.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

debian/control: install libnuma-dev unconditionally

The arm64-only module uadk needs numa.h to build; nothing else
ensures it's available.  Make it an unconditional ceph build
dependency on behalf of the arm64 build.

Fixes: https://tracker.ceph.com/issues/72594
Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #65020 from rhcs-dashboard/tiering-glacier-target-sc

mgr/dashboard: [RGW] - Target Storage Class in s3 tiering Config

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #64940 from zdover23/wip-doc-2025-08-11-cephfs-troubleshooting-2

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64931 from zdover23/wip-doc-2025-08-10-cephfs-troubleshooting-4

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64928 from zdover23/wip-doc-2025-08-10-cephfs-troubleshooting

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64921 from zdover23/wip-doc-2025-08-09-cephfs-troubleshooting

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

tasks/cephfs: Use different errmsg for invalid dir

During test_df_for_invalid_directory, path_walk is now called.
Use a more general error message as more errnos can be returned
and this will be a better catch all.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

doc/cephfs: edit troubleshooting.rst

Edit the section "In-memory log dumps" in
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit bc1aa66f356981ed977ac96e7d235f4f9c43547b)

fixup

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

mgr/prometheus: fix enabled_modules check for smb metadata

For get_smb_metadata check for enabled modules from mgr_map instead of available modules
to get list of mgr modules which are enabled on active mgr.

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #64626 from xxhdx1985126/wip-72173

crimson/os/seastore: add support for OP_SPLIT_COLLECTION2

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #64828 from xxhdx1985126/wip-71363

crimson/os/seastore: link RetiredExtentPlaceholder up to lba leaf nodes

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #64698 from rhcs-dashboard/72044-make-grafana-iframe-scrollable-and-height-consistent

mgr/dashboard: Made expandable table row height consistent across the cluster

Merge pull request #65051 from jannisspeer/patch-4

doc/cephfs: Update quota.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64772 from rhcs-dashboard/form-and-style-fixes

mgr/dashboard: form and style fixes

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>

doc/cephfs: Update quota.rst

Make the user aware to adapt the client capabilities to enable the configuration of quotas.

Signed-off-by: Jannis Speer <Jannis.speer@tutanota.com>
doc/cephfs: fix broken link

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #64939 from zdover23/wip-doc-2025-08-11-cephfs-troubleshooting

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: edit troubleshooting.rst

Edit the section "Slow requests" in the file
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #65022 from gbregman/main

pybind/rados: Add list_lockers() and break_lock() to Rados Python interface

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #64980 from rhcs-dashboard/multi-cluster-subs-close

mgr/dashboard: close token status subscription properly

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #64945 from afreen23/fix-cap-thresholds

Replace capacity threshold data with prometheus metrics

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #64731 from rishabh-d-dave/test_for_6_ongoing_clones

qa/cephfs: increase clones for test_for_6_ongoing_clones

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #64702 into main

* refs/pull/64702/head:

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #64701 from izxl007/getattr

fuse: improve error handling in fuse_ll_getattr

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #64804 from soumyakoduri/wip-skoduri-restore-expdate

rgw/restore: Update expiry-date of restored copies

Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

rgw/restore: Update expiry-date of restored copies

As per AWS spec (https://docs.aws.amazon.com/AmazonS3/latest/API/API_RestoreObject.html),
if a `restore-object` request is re-issued on already restored copy, server needs to
update restoration period relative to the current time. These changes handles the same.

Note: this applies to only temporary restored copies

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #64372 from phlogistonjohn/jjm-smb-remotectl

smb: add remote control server

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@samba.org>

Merge pull request #64787 from vshankar/wip-improve-cephfs-dr-doc

doc/cephfs: update cephfs disaster recovery documentation

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #64981 from zdover23/wip-doc-2025-08-12-cephfs-troubleshooting

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64930 from zdover23/wip-doc-2025-08-10-cephfs-troubleshooting-3

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64923 from zdover23/wip-doc-2025-08-09-cephfs-troubleshooting-3

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64922 from zdover23/wip-doc-2025-08-09-cephfs-troubleshooting-2

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64811 from ceph/fix-dependabot_dashboard_upgrades-main

dependabot: stop dashboard npm upgrade PRs

doc/cephfs: edit troubleshooting.rst

Edit the "Mount 5 Error" and "Mount 12 Error" sections of
doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #64982 from zdover23/wip-doc-2025-08-12-cephfs-troubleshooting-2

doc/cephfs: edit troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #65008 from chanyoung/omap-fast-check-mappings

test/crimson/seastore/test_omap_manager: faster check mappings

Reviewed-by: Samuel Just <sjust@redhat.com>

pybind/rados: Add list_lockers() and break_lock() to Rados Python interface.

Fixes: https://tracker.ceph.com/issues/72544
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

mgr/dashboard: [RGW] - Target Storage Class in s3 tiering config

Fixes: https://tracker.ceph.com/issues/72583
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #65013 from Naveenaidu/wip-naveen-update-cephadm-docs

doc/man/cephadm: update `--orphan-initial-daemons` argument description

doc: update cephfs-mirror replication

Mention cephfs-mirror replication is push-based

Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #63938 from tchaikov/wip-osd-recalc-decode

osd: recalculate coll_t::_str during decode() to fix stale values

Reviewed-by: Samuel Just <sjust@redhat.com>

mgr/dashboard: Replace capacity threshold data with prometheus metrics

- Fixes https://tracker.ceph.com/issues/72519
- the osd dump metrics is used in /api/osd/settings
- this metrics creates perf bottleneck when osds are 1000s
- replacing with similar prometheus metrics
- minor refactors - including renaming, comments.

Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #61770 from rkachach/fix_issue_69484

Prometheus configuration generation improvements

Reviewed-by: nizamial09 <nia@redhat.com>

client: bring client_lock out of statfs helper method

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: move mref_reader check in statfs out of helper

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

test: Add test for libcephfs statfs

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: get quota root based off of provided inode in statfs

In statfs, get quota_root for inode provided. Check if a quota
is directly applied to inode. If not, reverse tree walk up and
maybe find a quota set higher up the tree.

Fixes: https://tracker.ceph.com/issues/72355
Signed-off-by: Christopher Hoffman <choffman@redhat.com>

mgr/dashboard: form and style fixes

fixes: https://tracker.ceph.com/issues/72354

Signed-off-by: Naman Munet <naman.munet@ibm.com>

doc/man/cephadm: update --orphan-initial-daemons argument description

Signed-off-by: Naveen Naidu <naveen.naidu@ibm.com>

test/crimson/seastore/test_omap_manager: faster check mappings

Signed-off-by: Chanyoung Park <chaney.p@kakaoenterprise.com>

Merge pull request #64998 from chanyoung/monotonic

test/crimson/seastore/test_omap_manager: add monotonic inc UT

Reviewed-by: Samuel Just <sjust@redhat.com>

doc/cephfs: edit troubleshooting.rst

Edit the "Dynamic Debugging" section of doc/cephfs/troubleshooting.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
doc/cephfs: improve dynamic debugging section

Signed-off-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #64976 from phlogistonjohn/jjm-container-pkgs

container: support building a container image with custom packages

Merge pull request #64942 from chanyoung/redesign_depth3_split

test/crimson/seastore/test_omap_manager: redesign depth3 split

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #64964 from edwinzrodriguez/ceph-wip-72454

test/librbd/fsx: initialize effective_size variable

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #64821 into main

* refs/pull/64821/head:
.github: only run redmine-upkeep actions from ceph/ceph.git
script/redmine-upkeep: add transform to resolve merged issue
script/redmine-upkeep: set default filter name/priority
script/redmine-upkeep: raise exception for PUT failures
script/redmine-upkeep: finish transform after application
script/redmine-upkeep: indicate log location in comments
script/redmine-upkeep: check envvar to see if running as action
script/redmine-upkeep: bullet issue list
script/redmine-upkeep: add stronger note on upkeep-failed tag in failure message
script/redmine-upkeep: do not raise commennt if upkeep-failed already present
script/redmine-upkeep: correct filter out of upkeep-failed
.github/workflows: allow redmine-upkeep to write comments

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

doc/mgr: more consistent capitalization in smb.rst

When not referring to a code object or field value or module name, try
to spell ID and SMB in all caps everywhere in the document.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

doc: document remote control in the mgr smb file

It covers the remote control configuration object and the tls credential
resource and source object created to support it and future tls needs.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

.github: only run redmine-upkeep actions from ceph/ceph.git

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: add transform to resolve merged issue

Few things:

- Add priority to transforms. Largely this is to have the "merged"
  transformation run first to update the "Merge Commit" field of the ticket
  before any other transform intends to look at that field. This avoids
  duplicating logic to set the Merge Commit field.

- Fix a bug where the github API cannot be trusted to indicate the Merge Commit
  for a PR. When the branch is rename or changed, the github backend clearly
  gets confused and gives the "HEAD" commit instead.

- Add new transform to resolve tickets that are merged to either Resolved or
  Pending Backport status.

* Note: filters on TAGS cannot be combined. There is some restructuring to deal with that.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #64938 from chanyoung/omap-binary-search

crimson/.../string_kv_node_layout: switch linear to binary search

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

script/redmine-upkeep: set default filter name/priority

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: raise exception for PUT failures

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: finish transform after application

Doing this at the end makes confusing error messages.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: indicate log location in comments

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: check envvar to see if running as action

This obviates --github-action in the workflow.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: bullet issue list

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: add stronger note on upkeep-failed tag in failure message

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: do not raise commennt if upkeep-failed already present

If the script is run manually on an issue, don't leave a new comment if we
already have the issue tagged with upkeep-failed.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/redmine-upkeep: correct filter out of upkeep-failed

"!~" is the proper filter for "does not contain".

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

.github/workflows: allow redmine-upkeep to write comments

Fixes errors like:

    Posting a comment to GitHub PR #62992.
    GitHub API error posting comment to PR #62992: 401 Client Error: Unauthorized for url: https://api.github.com/repos/ceph/ceph/issues/62992/comments - Response: {"message":"Requires authentication","documentation_url":"https://docs.github.com/rest/issues/comments#create-an-issue-comment","status":"401"}

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

test/crimson/seastore/test_omap_manager: add monotonic inc UT

Signed-off-by: Chanyoung Park <chaney.p@kakaoenterprise.com>

Merge pull request #64501 from aainscow/ec_fixpack2_pr

Optimized Erasure Coding - Fixpack 2

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #64926 from chanyoung/faster-seastore-eph-dev

crimson/.../ephemeral: faster seastore eph dev

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

mgr/smb: add tests applying & showing tls credential resources

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/smb: add a tls credential resource test case

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/cephadm: support tls creds via uri in service spec

Support populating the cert data sent to the cephadm binary using
special `URI:` prefixed strings instead of putting the cert data itself
in the smb service spec. This avoids having an extra copy of the cert
floating around but still matches the behavior of other services where
cephadm writes the certs into files.

In the future we may be able to avoid even putting the data in here as
sambacc can use rados apis - but for simplicity and matching other
services we will send the data this way for now.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/smb: make tls credential types work in smb show

Update the handler code needed to make tls credential types work
corrently for `ceph smb show` commands.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/smb: add tls credential and remote control support to handler

Use the new tls credential resource and remote control cluster field
to configure the tls creds for the remote control sidecar in the
service spec.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/smb: remove unused generate_smb_service_spec function

Remove the generate_smb_service_spec as it was unused (it was used
early on for a debug dump command). Leaving it would have meant
keeping it up-to-date with the real spec generating function and
unnecessary extra work.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

mgr/smb: add tls credential support to staging

Add the necessary cross-check functions to staging.py for tls credential
resources. Add prune function for tls resources because they support
linked_to_cluster.

Signed-off-by: John Mulligan <jmulligan@redhat.com>