src/common: add guidance for deep-scrubbing ratio warning

Add an explanation of how to set the value of
"mon_warn_pg_not_deep_scrubbed_ratio" to the confval definition of that
variable. Although this variable contains the string "mon", it is set on
the Manager. I have added a note to direct users to set this value on
the Manager.

This issue was pointed out by Petr Tlapa on Slack in late March of 2025.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #62430 from ankitk18/fix/alignment-action-btn

mgr/dashboard:fixed alignment of create action button

Merge pull request #62366 from anthonyeleven/improve-radosgw-layout

doc/radosgw: Improve layout.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #62442 from anthonyeleven/improve-cephadm-svc-osd

doc/cephadm/services: Add mention of --zap for OSD removal

Reviewed-by: Zac Dover <zac.dover@proton.me>

doc/cephadm/services: Add mention of --zap for OSD removal

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #62413 from ceph/pin-actions

workflows: Pin specific SHAs

mgr/dashboard:fixed alignment of create action button

Fixes:https://tracker.ceph.com/issues/70433
Signed-off-by: Ankit Kumar <51ankitkp@gmail.com>

Merge pull request #62370 from laimis9133/main

doc/rados/troubleshooting/log-and-debug: add separate section for Monitors

Merge pull request #62101 from rhcs-dashboard/nfs-fix

mgr/dashboard: NFS - Fix Edit NFS export request

Merge pull request #60631 from kamoltat/wip-ksirivad-fix-3az-unset

[3AZ] src/mon : Allow user to specify crush_rule, size and min_size when unsetting a stretch pool

Merge pull request #62100 from rhcs-dashboard/bucket-lifecycle-fixes

mgr/dashboard: bucket lifecycle fixes after using xmltodict package

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: NFS - Fix Edit NFS export request

Fixes: https://tracker.ceph.com/issues/70284
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #61646 from aclamk/wip-aclamk-teuto-better-bluestore-testing

qa/rados: Augmented bluestore testing

Merge pull request #61745 from soumyakoduri/wip-skoduri-glacier-cli

rgw/cloud-restore [PART1] : Add Restore support from Glacier/Tape cloud endpoints

Merge pull request #62426 from anthonyeleven/fixup-db_slots

doc/cephadm/services: Correct indentation in osd.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

doc/cephadm/services: Correct indentation in osd.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #61732 from rishabh-d-dave/mgr-vol-pools

mgr/vol: allow passing pool names to "fs volume create" cmd

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #61084 from adamemerson/wip-boost-1.87

Boost 1.87

Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>

Merge pull request #62285 from cbodley/wip-rgw-iam-arnlike

rgw/iam: add policy evaluation for Arn-based Conditions

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #62368 from ivancich/wip-radoslist-improvements

rgw: radoslist improvements primarily to better support gap list tool

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #62166 from rkachach/fix_issue_70352

mgr/cephadm: use ip_hash to enforce the same prometheues upstream

Reviewed-by: Adam King <adking@redhat.com>

workflows: Pin specific SHAs

Fixes https://www.wiz.io/blog/new-github-action-supply-chain-attack-reviewdog-action-setup

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #61873 from rhcs-dashboard/nfs-create-cluster

mgr/dashboard: NFS Cluster and Export Listing

Merge pull request #62387 from rhcs-dashboard/user-form-display-name-fix

mgr/dashboard: Not able to edit user display/full name in user form

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #62397 from aainscow/interval_set_qf

test/common: skip google tests which create core dumps in test_interval_set

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

Merge pull request #61937 from vshankar/wip-file-block-diff

mds/client: file blockdiff support

Merge pull request #62244 from ronen-fr/wip-rf-cast-conf

common, osd: add cmd_getval_cast_or()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Alex Ainscow <aainscow@uk.ibm.com>

PendingReleaseNote: add note that "volume create" accepts pool names...

in args.

Add a release note that "ceph fs volume create" command allows users to
pass pool names to "ceph fs volume create" command.

Signed-off-by: Rishabh Dave <ridave@redhat.com>

doc/cephfs: mention new options for "fs volume create" cmd

Command "ceph fs volume create" accepts 2 new options to allow users to
pass data and metadata pool name. Update docs to include mention of both
the options.

Signed-off-by: Rishabh Dave <ridave@redhat.com>

mgr/nfs: NFS Cluster and Export Listing

Fixes: https://tracker.ceph.com/issues/70022
Signed-off-by: Achint Kaur <ackaur@redhat.com>

Merge pull request #61075 from rhcs-dashboard/topicmanagment

mgr/dashboard: Add RGW topics endpoint creation for create ,delete and list in dashboard

Merge pull request #62323 from clwluvw/bucket-replication-mismatch

rgw: reject PutBucketReplication policies with mismatched statuses, skip sync on update

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #62149 from rhcs-dashboard/fix-access-perm-ui

mgr/dashboard: fix access control permissions for roles

Reviewed-by: Afreen Misbah <afreen@ibm.com>

rgw: radolist clean up, calculate obj info slightly earlier

With recent changes, it's better to determine bucket and object names
earlier.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

rgw: modify radoslist to better support the rgw-gap-list tool

When the `radosgw-admin bucket radoslist ...` sub-command was
introduced, it was written specifically for finding orphans. It has
since been updated to work for finding gaps, that is indexed RGW
objects that are missing one or more supporting rados objects.

When a head object was not found, it was ignored. Now it does produce
output with the oid and related information for the missing head
object.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

rgw: fix regression in radoslist with SLO manifests

A regression was inadvertently introduced in commit
bcd7883d7212c96ebfb89c938c79fc7efbb80d2f that then prevented
`radosgw-admin bucket radoslist ...` from working properly with
buckets using SLO manifests. This corrects that regression.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #62394 from laimis9133/laims9133-notiffix

doc/radosgw/notifications: fix topic details

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #62372 from tchaikov/libcephfs-proxy-compare-unsigned

libcephfs_proxy: remove redundant unsigned >= 0 comparison

Reviewed-by: Xavi Hernandez <xhernandez@gmail.com>
Reviewed-by: Sachin Punadikar <sachin.punadikar@ibm.com>

Merge pull request #62206 from rhcs-dashboard/smb-overview

monitoring: add SMB overview grafana dashboard

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #62262 from ankitk18/fix/notification-icon-click

mgr/dashboard:fixed issue with notification icon

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #62169 from anoopcs9/mgr-smb-add-ceph-snapshots

mgr/smb: Add ceph_snapshots vfs module to share definition

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

mgr/dashboard: add types for mgr-module list

also introducing a const for rgw

Fixes: https://tracker.ceph.com/issues/70331
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix access control permissions for roles

Since prometheus is being used in the dashboard page we need to make
sure every role has prometheus read only access so that the dashboard
page can load the utilization metrics.

I also saw permission issue with the osd settings endpoint when its
trying to get the nearfull/full ratio. so instead of failing the entire
page i am proceeding with a chart that doesn't have those details when
the user doesn't have permission to access the config opt.

Multisite page was not accessible in the case of rgw-manager or
read-only user because its trying to show the status of rgw module. This
si also now gracefully handled to show the alert only when the user has
sufficient permission.

Fixes: https://tracker.ceph.com/issues/70331
Signed-off-by: Nizamudeen A <nia@redhat.com>

test/common: skip google tests which create core dumps in test_interval_set

CI Pipelines are being broken because this test is creating a number of core dumps. This
does not make the test fail, but it does create some core dumps. This appears to be
breaking something in the CI pipeline.  This commit is a workaround and I will find a
better solution later.

Fixes: https://tracker.ceph.com/issues/70543
Signed-off-by: Alex Ainscow <aainscow@uk.ibm.com>

mgr/dashboard: bucket lifecycle fixes after using xmltodict package

Fixes: https://tracker.ceph.com/issues/70275
Signed-off-by: Naman Munet <naman.munet@ibm.com>

mgr/dashboard: Not able to edit user display/full name in user form

Fixes: https://tracker.ceph.com/issues/70554
Signed-off-by: Naman Munet <naman.munet@ibm.com>

doc/radosgw /notifications: fix topic details

This commit fixes documentation about many-to-many topic relationship for notifications. The current sentence states the same fact twice instead of clarifying.

Fixes: https://tracker.ceph.com/issues/64956
Signed-off-by: Laimis Juzeliunas <laimis.juzeliunas@oxylabs.io>

qa/cephfs: test passing pool names to "fs volume create" cmd

Signed-off-by: Rishabh Dave <ridave@redhat.com>

qa/cephfs: separate the tests for "ceph fs volume create" cmd

Signed-off-by: Rishabh Dave <ridave@redhat.com>

mgr/vol: allow passing pool names to "fs volume create" cmd

Fixes: https://tracker.ceph.com/issues/69878
Signed-off-by: Rishabh Dave <ridave@redhat.com>

mgr/dashboard:fixed issue with notification icon

Fixes:https://tracker.ceph.com/issues/70253
Signed-off-by: Ankit Kumar <51ankitkp@gmail.com>

Merge pull request #62275 from rhcs-dashboard/fix-70450-main

mgr/dashboard: Fix rgw user key modal not shown

Reviewed-by: Nizamudeen A <nia@redhat.com>

test/unitest_bluestore_types: fix a compilation error

The test was failing to compile because of a missing
'include' directive.
Problem was introduced in commit 2e73c875640

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

osd: use cmd_getval_cast_or() to fetch shard-id

as that interface alleviates the need to cast shard_id_t::NO_SHARD
back and forth to/from int.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

common: add cmd_getval_cast_or()

This slight variation of cmd_getval_or() can be used where
the object type is different from the configuration item
type (as when the object is a wrapper around an integer).
It allows specifying the 'default' value in the object type.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #61766 from aainscow/shard_id_t

osd: Require explicit casting for shard_id_t

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

monitoring: add SMB overview grafana dashboard

Fixes: https://tracker.ceph.com/issues/70423
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #62367 from anthonyeleven/pg-autoscale-upgrade

doc/cephadm: Add PG autoscaler advice to upgrade.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #61055 from cybozu/osd_max_scrubs-take-effect-even-though-mclock-is-used

common/options: fix the description of osd_max_scrubs

Reviewed-by: Zac Dover <zac.dover@proton.me>

libcephfs_proxy: remove redundant unsigned >= 0 comparison

Fix a clang warning in proxy_async.c where an unsigned value was being
unnecessarily compared against 0:
```
/home/kefu/dev/ceph/src/libcephfs_proxy/proxy_async.c:29:12: warning: result of comparison of unsigned expression >= 0 is always true [-Wtautological-unsigned-zero-compare]
   29 |         if ((size >= 0) && !info->write) {
      |              ~~~~ ^  ~
1 warning generated.
```

Since unsigned values are always >= 0 by definition, remove this
tautological check to resolve the "-Wtautological-unsigned-zero-compare"
warning.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #62371 from laimis9133/laimis9133-mailinglists

doc/dev/developer_guide/essentials: update mailing lists

doc/cephadm: Add PG autoscaler advice to upgrade.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

doc/dev/developer_guide/essentials: update mailing lists

Update information for subscribing to Ceph development mailing lists as current documentation is outdated.

Fixes: https://tracker.ceph.com/issues/64580
Signed-off-by: Laimis Juzeliunas <laimis.juzeliunas@oxylabs.io>

Merge pull request #57629 from clwluvw/policy-remove-self-access

rgw: implement ConfirmRemoveSelfBucketAccess header for bucket policy

Reviewed-by: Adam Emerson <aemerson@redhat.com>

doc/rados/troubleshooting/log-and-debug: add section for Monitors

Adding separate section for Monitors related logging configs.

Fixes: https://tracker.ceph.com/issues/63354
Signed-off-by: Laimis Juzeliunas <laimis.juzeliunas@oxylabs.io>
Co-authored-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #62359 into main

* refs/pull/62359/head:
doc: add clarification note on how charmap is applied

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>

doc/radosgw: Improve layout.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #62140 from rzarzynski/wip-nitzan-pg_pool_t-encode-decode-versions-compability

osd_type: decouple is_stretch_pool() from versioning of pg_pool_t's schema

Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #62165 from athanatos/sjust/wip-recovery-ops-leak-61594-with-history

osd: fix osd mclock queue item leak

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #61821 from pritha-srivastava/wip-rgw-sts-oidc-user

rgw/sts: replacing load_stats with list_buckets

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge PR #62335 into main

* refs/pull/62335/head:
crypto: remove unused include

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

doc: add clarification note on how charmap is applied

There was confusion about whether setting the charmap on a directory also
affects the name of the directory itself.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

qa: Edit test files to incorporate unset arguments, crush_rule, size,
min_size

Fixes: https://tracker.ceph.com/issues/68842
Signed-off-by: Kamoltat Sirivadhna <ksirivad@redhat.com>

Merge PR #62031 into main

* refs/pull/62031/head:
qa: test fio with multiple versions of NFS

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #62253 from adamemerson/wip-rgw-shutdown-notify-crash

rgw: Try to handle unwatch errors sensibly

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #62156 from cbodley/wip-70270

rgw: sync fairness watcher reconnects on any error

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-By: Oguzhan Ozmen <oozmen@bloomberg.net>

Merge pull request #61803 from clwluvw/duplicate-prio

rgw: check for duplicate rule priorities in replication configuration

Reviewed-by: Adam Emerson <aemerson@redhat.com>

mgr/dashboard: Fix rgw user key modal not shown

Fixes: https://tracker.ceph.com/issues/70450
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #60843 from rhcs-dashboard/fix-69055-main

mgr/dashboard: When configuring the RGW Multisite endpoints from the UI allow FQDN(Not only IP)

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #62336 from tchaikov/librbd-std-variant

librbd: migrate from boost::variant to std::variant

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #62328 from ronen-fr/wip-rf-fin1-keys

common: md_config_obs_impl: remove deprecated get_tracked_conf_keys()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #62343 from VallariAg/wip-nvmeof-prometheus-singlegateway-rename

monitoring: rename NVMeoFSingleGatewayGroup alert

Merge pull request #61004 from rishabh-d-dave/mgr-vol-EINVAL

mgr/vol: use error number instead of error message

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #62301 from rishabh-d-dave/mgr-vol-fix-flake8-err

mgr/volumes: fix issues pointed by flake8

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #62203 from rishabh-d-dave/mgr-vol-fix-logger-name

mgr/vol: correct logger names

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #62334 from tchaikov/cmake-mark-cap-required

cmake: make libcap REQUIRED

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

librbd: migrate from boost::variant to std::variant

This change is part of a broader effort to reduce dependencies on
third-party libraries by leveraging C++ standard library alternatives.

Migrating from boost::variant to std::variant improves code readability
and maintainability while reducing external dependencies.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #62190 from ljflores/wip-tracker-69760

mon, osd: add command to remove invalid pg-upmap-primary entries

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Josh Salomon <josh.salomon@gmail.com>

mon, osd: add command to remove invalid pg-upmap-primary entries

The current rm-pg-upmap-primary command checks that the pgid exists
in the pgmap before continuing to remove it. Due to https://tracker.ceph.com/issues/66867,
some invalid pg-upmap-primary entires may exist for pools that have been removed.
Currently, these mappings are impossible to remove since the pgids no longer
exist in the pgmap.

This new command, rm-pg-upmap-primary-all, allows users the ability to remove
any and all pg-upmap-primary mappings in the osdmap at once, which includes
valid and invalid entries.

This command may also be helpful when upgrading from versions where users
are plagued by https://tracker.ceph.com/issues/61948. Users may use an upgraded
mon to remove all pg-upmap-primray entries (valid and invalid) so they continue
to upgrade to a safe version.

See manual testing for this patch here: https://tracker.ceph.com/issues/67179#note-12

Fixes: https://tracker.ceph.com/issues/67179
Fixes: https://tracker.ceph.com/issues/69760
Signed-off-by: Laura Flores <lflores@ibm.com>

Merge pull request #62110 from cbodley/wip-69842

rgw: rgw_init_ioctx() adds set_pool_full_try()

Reviewed-by: Adam Emerson <aemerson@redhat.com>

monitoring: rename NVMeoFSingleGatewayGroup alert

Rename the alert to NVMeoFSingleGateway.

The original name was confusing because it
accidently might convey that alert would be
triggered if there is a single gateway group.
Though 'NVMeoFSingleGatewayGroup' alert means that
there is single gateway in a group.

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

Merge pull request #62276 from Matan-B/wip-matanb-radosbench

qa/tasks/radosbench: fix missing concurrency usage (on write)

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>

Merge pull request #62331 from baum/nvmeof_1_5

nvmeof: bump image version to 1.5

doc/rados/operations/pools: Edit Unsetting values for a stretch pool

Fixes: https://tracker.ceph.com/issues/68842
Signed-off-by: Kamoltat Sirivadhna <ksirivad@redhat.com>

[3AZ Stretch pool]: Allow user to specify values when unsetting pools

Problem:

When we enable stretched mode on the pools,
we modify 6 configs on the pool,
namely peering_crush_bucket_count,
peering_crush_bucket_target,
peering_crush_bucket_barrier,
crush_rule, size, min_size.

Out of these, only 3 configs,
namely peering_crush_bucket_count,
peering_crush_bucket_target,
peering_crush_bucket_barrier is reset to 0.

The remaining 3 configs,
namely crush_rule, size,
min_size are not reverted back,
and are still the values that were set with stretch set command.

Solution:

The unset command now is required
to specify `crush_rule`, `size`, `min_size`.

Fixes: https://tracker.ceph.com/issues/68842
Signed-off-by: Kamoltat Sirivadhna <ksirivad@redhat.com>

Merge pull request #61990 from aclamk/wip-aclamk-write-v2-dirty-reshard

os/bluestore: write_v2 resharding misplaced

crypto: remove unused include

openssl_crypto_accel.cc does not need the declarations included by
openssl/engine.h, also, openssl/engine.h was deprecated in favor of
the provider API, the engine support was removed in fedora 41.

so, let's avoid including it. please note, the "ENGINE" struct's
definition is available in openssl/types.h.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

cmake: make libcap REQUIRED

this header is required when building the extended block device plugins
on linux, without it the build fails like:

```
/home/kefu/dev/ceph/src/extblkdev/ExtBlkDevInterface.h:38:10: fatal error: 'sys/capability.h' file not found
   38 | #include <sys/capability.h>
      |          ^~~~~~~~~~~~~~~~~~
```

so, let's mark this package REQUIRED, so that we can fail early
when generating the building system.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

nvmeof: bump image version to 1.5

Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>

mgr/dashboard: Add RGW topics endpoint creation for create ,delete and list in dashboard

Fixes: https://tracker.ceph.com/issues/69229
Signed-off-by: pujaoshahu <pshahu@redhat.com>