Merge PR #61173 into wip-vshankar-testing-20250917.131748-debug

* refs/pull/61173/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

Merge PR #65309 into wip-vshankar-testing-20250917.131748-debug

* refs/pull/65309/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

Merge PR #65392 into wip-vshankar-testing-20250917.131748-debug

* refs/pull/65392/head:

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65483 into wip-vshankar-testing-20250917.131748-debug

* refs/pull/65483/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65565 into wip-vshankar-testing-20250917.131748-debug

* refs/pull/65565/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65516 into main

* refs/pull/65516/head:
common: remove unused attribute

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #65559 from nbalacha/wip-nbalacha-cleanup-1

rgw/bucket-logging: minor code cleanup

mds: remove unused enum values for subvolume metrics

Signed-off-by: Igor Golikov <igolikov@redhat.com>
Fixes: https://tracker.ceph.com/issues/73053

doc: deprecate 'peer_add' command

Fixes: https://tracker.ceph.com/issues/72683
Signed-off-by: Jos Collin <jcollin@redhat.com>

cephfs_mirror: deprecate 'peer_add' command

Fixes: https://tracker.ceph.com/issues/72683
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #63089 from smanjara/wip-fix-object-lock-rule

rgw/multisite: sync put-object-lock-configuration

Merge pull request #64428 from sungjoon-koh/add-wildcard-support-cond-read

rgw: add wildcard "*" support for conditional read

rgw/bucket-logging: minor code cleanup

Fixes a typo in a variable name and the placement
of a comment.

Signed-off-by: N Balachandran <nithya.balachandran@ibm.com>

Merge pull request #65481 from rhcs-dashboard/snapshot-schdule-interval

mgr/dashboard: fix missing schedule interval in rbd API

Merge pull request #62469 from igomon-bloomberg/wip-timestamp-ver-epoch

rgw: implements timestamp-based epochs for versioned objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #64917 from aainscow/ec_fixpack3_pr

EC fixpack 3

Merge pull request #65370 from kchheda3/wip-fixed-acl-account-migration

rgw/account: bucket acls are not completely migrated once the user is migrated to an account

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw: implement timestamp-based epochs.

Signed-off-by: Igor Gomon <igomon@bloomberg.net>

Merge pull request #65536 from bluikko/doc-services-mon-improvements-cephadm

doc/cephadm: Fix errors and improvements in services/monitoring.rst

Merge pull request #65498 from adamemerson/wip-rgw-weekly-baseline-prio-subset

qa: Run fewer RGW jobs at higher priority every week

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #65530 from rkachach/fix_issue_73025

doc: fixing starting release of mgmt-gateway/oauth2-proxy services

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #64771 from Matan-B/wip-matanb-crimson-seastore-coro

crimson/os/seastore/segment_manager: Check segments prior to mkfs

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #64970 from edwinzrodriguez/ceph-wip-72479

crush/mapper: Mark pushed variable as maybe unused

Merge pull request #65227 from tchaikov/wip-generate-brace-init

src: replace push_back(T{}) with emplace_back()

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

doc/cephadm: Fix errors and small improvements in services/monitoring.rst

Add that certmgr is new in version Tentacle.

Fix broken links with formatting rendered as text.

Capitalize consistently in text HTTP, YAML, URL, Alertmanager, Grafana,
centralized logging; Prometheus or use inline preformat with lower case
when referring to the module name.

Use inline preformat consistently for CLI commands within text
paragraphs.

Use title case in section titles.

Trim section title underline syntax.

Use consistently pre-formatted blocks bash prompt, YAML.

Start all block formatting paragraphs at the left margin instead of
indenting.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #65514 from phlogistonjohn/jjm-bwc-arg-grouping

build-with-container: add argument groups to organize options

build-with-container: add argument groups to organize options

Use the argparse add_argument_group feature to organize the mass of
arguments into more sensible categories. Hopefully, someone reading
over the `--help` output can now more easily see options that
are useful rather than being overwhelmed by a wall of text.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

doc: fixing starting release of mgmt-gateway/oauth2-proxy services

Fixes: https://tracker.ceph.com/issues/73025
Signed-off-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #65456 from yuvalif/wip-yuval-72940

rgw/logging: rollover objects when conf changes

Merge pull request #65521 from shraddhaag/wip-shraddhaag-availability-release-notes

doc: update data availability release notes

Merge pull request #64728 from rhcs-dashboard/wip-aashish-log-promtail-main

mgr/dashboard: Migrate from promtail to grafana alloy

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65170 from rhcs-dashboard/tiering-tracker-72569

[mgr/dashboard]: Mismatch in the object size observed in Advance section in Tiering.

Reviewed-by: Naman Munet <nmunet@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

crimson/os/seastore/segment_manager: Check segments prior to mkfs

Verify Segment count for prior to mkfs
* ExtentPlacementManager::init - dynamic_max_rewrite_generation segments
* SegmentedJournal segment (1)

Fixes: https://tracker.ceph.com/issues/72484
Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore: BlockSegmentManager::primary_mkfs coroutines

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

common/options/crimson.yaml.in: add hot_tier_generations minimum

See ExtentPlacementManager::init

dynamic_max_rewrite_generation = hot_tier_generations - 1;
ceph_assert(dynamic_max_rewrite_generation > MIN_REWRITE_GENERATION);

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore/epm: Add logs and comments

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/tools/store_bench: update example, switch to --debug

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore: Remove error on expected logic

In read_meta we should not use ERROR when the key is not found
as this is expected.
Same in _mkfs, if mkfs_done exists we shouldn't use ERROR.
This can be confusing when debugging is disabled and few ERROR log
lines are printed.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore: add logs around mkfs

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore: SeaStore::mkfs() into coroutines

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore: prepare_meta() into coroutines

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore: test_mkfs() into coroutines

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65494 from yuvalif/wip-yuval-72543

rgw/logging: add error message when log_record fails

doc: update data availability release notes

Signed-off-by: Shraddha Agrawal <shraddhaag@ibm.com>

Merge pull request #65388 from jamiepryde/main-choose-pdw-over-rmw

osd: Choose PDW over traditional RMW if number of reads required is equal

Merge pull request #65181 from qiuxinyidian/lttng

rados/lttng: add lttng open *tp.so error message

Merge pull request #65172 from shraddhaag/wip-shraddhaag-availability-frequency-config

mon: add config option to change availability score update interval

Merge PR #65499 into main

* refs/pull/65499/head:
script/redmine-upkeep: reset merge state after PR change

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

common: remove unused attribute

This resolves an obnoxious compiler warning:

    [79/768] Building CXX object src/mgr/CMakeFiles/ceph-mgr.dir/__/ceph_mgr.cc.o
    In file included from /run/host/home/sepian/ceph/src/global/global_init.h:23,
                     from /run/host/home/sepian/ceph/src/ceph_mgr.cc:27:
    /run/host/home/sepian/ceph/src/common/ceph_context.h:153:42: warning: ‘maybe_unused’ attribute ignored [-Wattributes]
      153 |   [[maybe_unused]] std::unique_ptr<char> _ex_handler;
          |                                          ^~~~~~~~~~~

Fixes: 39af0bc23b3ae2063f8e846b0ff522bafa0f5c27
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #65350 from adamemerson/wip-perfcounters-unique-string

common: Allow PerfCounters to return a provided service ID

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #65507 from MaxKellermann/log__includes

log: add missing includes

Reviewed-by: Casey Bodley <cbodley@redhat.com>

crush/mapper: Mark 'pushed' variable as maybe unused to suppress compiler warnings

Mark 'pushed' variable as maybe_unused

Fixes: https://tracker.ceph.com/issues/72479
Signed-off-by: Edwin Rodriguez <edwin.rodriguez1@ibm.com>

Merge pull request #64829 from aclamk/aclamk-jenkins-fix-make-check

common/ceph_context.h: reserve space for breakpad in CephContext

mds: fix rank 0 marked damaged if stopping fails after Elid flush and log trimmed

steps to reproduce
 ../src/vstart.sh --debug --new -x --localhost --bluestore
 ./bin/ceph tell mds.<rank 0> config set mds_kill_shutdown_at 10
 ./bin/ceph fs set <fs name> down true

wait for a few seconds and will see the following log from take-over mds
and rank 0 is marked damaged
2025-09-11T16:47:24.591+0800 785dabeaa6c0 -1 log_channel(cluster) log [ERR] : No subtrees found for root MDS rank!
2025-09-11T16:47:24.591+0800 785dabeaa6c0 5 mds.beacon.b set_want_state: up:rejoin -> down:damaged

During shutdown_pass after submitting Elid and trimming mdlog, mds log
will now have only ELid event which does nothing at replay.
After replay, no subtree is found.

Fix this by checking whther MDLog contains only one event.
If so, skip the subtree check for rank 0, and allow it to request
STATE_STOPPED just like the other ranks.

Fixes: https://tracker.ceph.com/issues/72983
Signed-off-by: ethanwu <ethanwu@synology.com>

log: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

Merge pull request #64271 from benhanokh/full_dedup

rgw/dedup: Tech preview of full dedup support which means duplicate objects will be removed

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #64341 from mertsunacoglu/wip-swift-conditional-write

fix: Swift API conditional write if_match, if_none_match

mgr/dashboard: Migrate from promtail to grafana alloy

Since promtail is now deprecated, we need to start using grafana alloy for centralized logging setup

Fixes: https://tracker.ceph.com/issues/71072
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge PR #64434 into main

* refs/pull/64434/head:

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

mgr/dashboard: fix missing schedule interval in rbd API

Fetching the rbd image schedule interval through the rbd_support module
schedule list command

GET /api/rbd will have the following field per image
```
"schedule_info": {
                    "image": "rbd/rbd_1",
                    "schedule_time": "2025-09-11 03:00:00",
                    "schedule_interval": [
                        {
                            "interval": "5d",
                            "start_time": null
                        },
                        {
                            "interval": "3h",
                            "start_time": null
                        }
                    ]
                },
```

Also fixes the UI where schedule interval was missing in the form and
also disable editing the schedule_interval.

Extended the same thing to the `GET /api/pool` endpoint.

Fixes: https://tracker.ceph.com/issues/72977
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65010 from irq0/pr/verify-barbican-keyid-before-sending

rgw: Verify key id before sending to Barbican

Reviewed-by: Tobias Urdin <tobias.urdin@binero.com>

Merge pull request #64569 from cbodley/wip-71607

rgw: DeleteObject supports sigv4 with Transfer-Encoding: chunked

Reviewed-by: Robin H. Johnson <robbat2@orbis-terrarum.net>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

script/redmine-upkeep: reset merge state after PR change

This prevents mischief like: https://tracker.ceph.com/issues/70916?tab=history#note-34

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #64504 from NitzanMordhai/wip-nitzan-rados-suites-remove-cache-tier-test

qa/workunits/rados: remove cache tier test

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

qa: Run fewer RGW jobs at higher priority every week

So that they actually run.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

Merge PR #64324 into main

* refs/pull/64324/head:
qa/cephfs: fix test_subvolume_group_charmap_inheritance test
doc: add name mangling documentation for subvolume group creation
qa: add tests for name mangling in subvolume group creation
pybind/mgr: add name mangling options to subvolume group creation

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

rgw/logging: add error message when log_record fails

when log_record fails in journal mode due to issues in the target
bucket, the result code that the client get will be confusing, since
there is no indication that the issue is wit hte target bucket and not
the source bucket on which the client was operating.
the HTTP error message will be used to convey this information.

Fixes: https://tracker.ceph.com/issues/72543
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

mgr/dashboard: fix data mismatch in Advance section in Tiering.

Fixes: https://tracker.ceph.com/issues/72641
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #64992 from rhcs-dashboard/tiering-enhancement

mgr/dashboard: Tiering form -  Placement Target in Advanced Section

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: pujashahu <pshahu@redhat.com>

Merge pull request #65115 from rhcs-dashboard/72628-fix-inputfield-css-carbon

mgr/dashboard : fix css for carbon input fields

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #64683 from tobias-urdin/rgwadmin-max-entries-fix

radosgw-admin: Pass max_entries for bucket list

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #65321 from guits/support-extra-dmcrypt-options

ceph-volume: support additional dmcrypt params

Merge pull request #64855 from rhcs-dashboard/72431-mirrored-images-have-incorrect-usage-info

mgr/dashboard : Fixed mirrored image usage info bar

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65312 from rhcs-dashboard/72788-group-similar-alerts

mgr/dashboard: Group similar alerts

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #64190 from SundownRises/carbon-toast

mgr/dasboard: Carbonised Toast Notification

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

qa/cephfs: fix test_subvolume_group_charmap_inheritance test

Signed-off-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #65158 from jzhu116-bloomberg/wip-72667

rgw: discard olh_ attributes when copying object from a versioning-suspended bucket to a versioning-disabled bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65393 from MaxKellermann/rgw_includes

rgw: include cleanup

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #64800 from BBoozmen/wip-72375-bulk_delete_olh

RGW: multi object delete op; skip olh update for all deletes but the last one

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc: update documentation

Fixes: https://tracker.ceph.com/issues/68931
Signed-off-by: Igor Golikov <igolikov@ibm.com>

test: add subvolume metrics sanity test

Signed-off-by: Igor Golikov <igolikov@ibm.com>
Fixes: https://tracker.ceph.com/issues/68929

qa/cephfs: run selective test classes from basic volumes test

Signed-off-by: Venky Shankar <vshankar@redhat.com>

qa/cephfs: use fuse mount for volumes/subvolume tests

Using the kernel client is a) not really required existing
volume/subvolume test and b) per-subvolume metrics is only
supported by the user-space client library.

Signed-off-by: Venky Shankar <vshankar@redhat.com>

mds, messages: include subvolume metric count in log dumps and message exchanges

Signed-off-by: Venky Shankar <vshankar@redhat.com>

mds: remove unneeded SubvolumeMetric field from `struct Metric`

Signed-off-by: Venky Shankar <vshankar@redhat.com>

mds: add metric debug log in refresh_subvolume_metrics_for_rank()

Signed-off-by: Venky Shankar <vshankar@redhat.com>

mgr,stats: integrate subvolume metrics

mgr and stats support for the new subvolume metrics via existing perf
queries mechanism

Fixes: https://tracker.ceph.com/issues/68932
Signed-off-by: Igor Golikov <igolikov@ibm.com>

mds: aggregate and expose subvolume metrics

rank0 periodically receives subvolume metrics from other MDS instances
and aggregate subvolume metrics using sliding window.
The MetricsAggregator exposes PerfCounters and PerfQueries for these
metrics.

Fixes: https://tracker.ceph.com/issues/68931
Signed-off-by: Igor Golikov <igolikov@ibm.com>

client,mds: add support for subvolume level metrics

Add support for client side metrics collection using SimpleIOMetric
struct and aggregation using AggregatedIOMetrics struct,
Client holds SimpleIOMetrics vector per each subvolume it recognized
(via caps/metadata messages), aggregates them into the
AggregatedIOMetric struct, and sends  periodically to the MDS, along
with regulat client metrics.
MDS holds map of subvolume_path -> vector<AggregatedIOMetrics> and sends
it periodically to rank0, for further aggregation and exposure.

Fixes: https://tracker.ceph.com/issues/68929, https://tracker.ceph.com/issues/68930
Signed-off-by: Igor Golikov <igolikov@ibm.com>

Merge pull request #65470 from rhcs-dashboard/add-user-agent

monitoring: add user-agent headers to the urllib

rgw/logging: rollover objects when conf changes

and return the name of the flushed object to the client

Fixes: https://tracker.ceph.com/issues/72940
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #65428 from rkachach/fix_rgw_docs_certmgr

doc: update RGW HTTPS configuration to use certmgr and new fields

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65406 from rkachach/fix_grafana_docs

doc: update Grafana certificate configuration to use certmgr

Reviewed-by: Adam King <adking@redhat.com>

monitoring: add user-agent headers to the urllib

The documentation started raising 403 suddenly. Adding User-Agent
headers to the request

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge PR #65320 into main

* refs/pull/65320/head:

Reviewed-by: Anoop C S <anoopcs@cryptolab.net>

Merge pull request #64463 from ljflores/wip-qa-summary-script

script: add script to help format QA review summaries

Merge pull request #58926 from TRYTOBE8TME/wip-shard-id-option

src/rgw: Adding "sync error trim" option

mgr/dashboard: Tiering form - Placement Target in Advanced Section

Fixes: https://tracker.ceph.com/issues/72545
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

mgr/dashboard: Carbonised Toast Notification
Used carbon toast component to carbonise toast notifications

Dashboard: Toast Notification carbonised
This PR replaces the existing ngx-toastr implementation with Carbon Design System toast notifications to maintain UI consistency across the Ceph dashboard application.

Fixes:https://tracker.ceph.com/issues/71735
Signed-off-by: Anikait Sehwag <anikaitsehwag.amg@gmail.com>

libcephfs_proxy: fix userperm pointer decoding for older protocols

The random data used to decode pointers coming from the old protocol was
taken from the client instead of using the global_random data, which is
the correct one.

Fixes: https://tracker.ceph.com/issues/72800
Signed-off-by: Xavi Hernandez <xhernandez@gmail.com>