Merge pull request #59903 from connorfawcett/wip-connorfa-ec-consistency-2024-09-18-1703

qa/tasks: Add a task which performs an offline check of the consistency of parity shards

Merge pull request #62496 from aainscow/interval_set_reenable_assert

test/osd: Adapt strategy for testing asserts in interval_sets

Merge pull request #63419 from zdover23/wip-doc-2025-05-22-mgr-localpool-62782-followup

doc/mgr: edit localpool.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63275 from zdover23/wip-doc-2025-05-14-dev-cephfs-mirroring-63237-followup-3-of-x

doc/dev/cephfs-mirroring: edit file 3 of x

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63530 from anthonyeleven/balancer-advice

doc/rados/operations: Add settings advice to balancer.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #62973 from connorfawcett/exerciser-fixes-2404

common/io_exerciser: Fixes for sequencing options

Merge pull request #63327 from Hezko/nvmeof-cli-text-format

mgr/dashboard: Nvmeof CLI plain format support

doc/rados/operations: Add settings advice to balancer.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

qa/tasks: Add a task which performs an offline check of the consistency of parity shards

Add a Python script which can be used to scan a Ceph cluster, find any erasure coded data objects and
check them for consistency. This is achieved by reading the data shards for a given object, running the data shards
through the existing EC tool and verifying the output matches the parity shards stored on the OSDs.

This commit adds a new teuthology task but does not add it to any YAMLs currently, this work will be
expanded on in future commits.

Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/71412

Merge pull request #60833 from connorfawcett/wip-vstart-runner-fns2

qa/vstart_runner: Add get_file and write_file equivalents to the LocalRemoteProcess class

Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>

Merge pull request #63267 from ceph/wip-yuriw-17.2.9-release.notes-main

doc: quincy 17.2.9 release notes

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #63433 from stackhpc/cephadm-upgrade-order

doc/cephadm: fix upgrade ordering

common/io_exerciser: Fix the --sequence and --listsequence options for
the IO exerciser. Also fix an incorrect read operation in SEQ7.

Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/71074

mgr/dashboard: add plain output type support to nvme cli

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>
fixon

Merge pull request #62955 from yuvalif/wip-yuval-fix-admin-flush

rgw/logging: extract tenant from bucket name on admin flush

Merge pull request #63377 from yuvalif/wip-yuval-71385

rgw/logging: add mtime to get-bucket-logging response

Merge pull request #63268 from yuvalif/wip-yuval-71312

rgw/logging: part upload operation name should be REST.PUT.PART

Merge pull request #63347 from cloudbehl/application-pool-panel-fix

mgr/dashboard: Fix application pool table for filtered pools
Fixes: fixes: https://tracker.ceph.com/issues/71361
Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #63459 from myoungwon/wip-fix-oi-max-length

crimson/os/seastore: increase OI_MAX_LENGTH to avoid storing OI data in the omap tree

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #63418 from zdover23/wip-doc-2025-05-22-mgr-iostat-62782-followup

doc/mgr: edit iostat.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63417 from zdover23/wip-doc-2025-05-22-mgr-insights-62782-followup

doc/mgr: edit insights.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63465 from zdover23/wip-doc-2025-05-26-rados-operations-cache-tiering

doc/rados: improve markup in cache-tiering.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63463 from zdover23/wip-doc-2025-05-26-rados-operations-pgcalc

doc/rados: s/enpty/empty/ in pgcalc doc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #62600 from zdover23/wip-doc-2025-04-01-cephadm-host-management

doc/cephadm: improve "Maintenance Mode"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63428 from myoungwon/wip-fix-incorrect-space-calculation

crimson/os/seastore/rbm: prevent incorrect space calculation at maximum capacity

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #63487 from anthonyeleven/scrubscope

src/common/options: Clarify scope of scrub intervals in osd.yaml.in

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63376 from xxhdx1985126/wip-seastore-omap-root-fix

crimson/os/seastore/omap_manager: handle the cases in which omap nodes are rewritten before seen by users

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

src/common/options: Clarify scope of scrub intervals in osd.yaml.in

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

qa/vstart_runner: Add get_file and write_file equivalents to the LocalRemoteProcess class

Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>

Merge pull request #63480 from bluikko/doc-minor-fixes-cloud-restore-radosgw

doc/radosgw: Small improvements in cloud-restore.rst

Merge pull request #63366 from Hezko/nvmeof-cli-align-part-2

mgr/dashboard: align cli commands listener list, ns list, host list

doc/radosgw: Small improvements in cloud-restore.rst

Add a label in file cloud-transition.rst for linking to it.
Change a link using full URL of Ceph docs to use :ref: and said label.

Indent text in unordered lists so that they are rendered as list items.

Use consistently double backticks for references to configuration
values.

Change one external link pointing to old v1 of AWS CLI to the
recommended v2 docs.

Change another external link pointing to old v1 of AWS CLI to the
current AWS API doc instead and add link text instead of rendering the
whole URL.
However, both the old and the new text (which are the same) do not
currently seem to explicitly confirm the claim "storage class of
restored objects should remain unchanged".

Change one CLI command prompt to privileged prompt because it uses
radosgw-admin.

Use "lifecycle" consistently instead of "Life Cycle" in one place and
put the acronym "LC" inside parenthesis instead of the full spelling.

Fix typo "Th" into "The".

Use admonitions instead of spelling out "Note: [...]".

Small improvement to language in one admonition.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #63434 from cbodley/wip-70673-debug

test/rgw: link lua test against unit-main for g_ceph_context

Merge pull request #62179 from benhanokh/s3_full_object_dedup

rgw/dedup: full object dedup

Merge pull request #63335 from Hezko/nvmeof-align-gw-info

mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli

Merge pull request #63334 from Hezko/nvmeof-cli-fix-spdk-set-lvl

mgr/dashboard: fix set spdk log level cli command

Merge PR #59161 into main

* refs/pull/59161/head:
qa: test failure for duplicate retention spec
mgr/snap_schedule: fix message format error

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

mgr/dashboard: align cli commands listener list, ns list, host list

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

mgr/dashboard: fix set spdk log level cli command

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

Merge pull request #63475 from zdover23/wip-doc-2025-05-26-mgr-telegraf-62782-followup

doc/mgr: edit telegraf.rst

Merge pull request #63474 from zdover23/wip-doc-2025-05-26-mgr-smb-62782-followup

doc/mgr: edit smb.rst

doc/mgr: edit telegraf.rst

Edit doc/mgr/telegraf.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit smb.rst

Edit doc/mgr/smb.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63464 from zdover23/wip-doc-2025-05-26-cephfs-mount-using-kernel-driver

doc/cephfs: correct ill-formatted command

Merge pull request #63469 from zdover23/wip-doc-2025-05-26-mgr-orchestrator-62782-followup

doc/mgr: edit orchestrator.rst

Merge pull request #63472 from zdover23/wip-doc-2025-05-26-mgr-rgw-62782-followup

doc/mgr: edit rgw.rst

doc/mgr: edit rgw.rst

Edit doc/mgr/rgw.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit orchestrator.rst

Edit doc/mgr/orchestrator.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/rados: improve markup in cache-tiering.rst

Correct ill-formatted markup in cache-tiering.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/cephfs: correct ill-formatted command

Correct a command that was broken across two lines, causing the argument
of an option to appear as though it was a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/rados: s/enpty/empty/ in pgcalc doc

s/enpty/empty/ in doc/rados/operations/pgcalc/index.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63027 from tchaikov/any-alignas

include/any.h: avoid using std::aligned_storage_t

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge PR #63420 into main

* refs/pull/63420/head:
doc/mgr: edit mds_autoscaler.rst

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

crimson/os/seastore: increase OI_MAX_LENGTH to avoid storing OI data in the omap tree

Due to a recent change (adding shard_versions in object_info_t),
the size of OI has increased to 236. This causes to store OI data to the omap tree
because the size is over than OI_MAX_LENGTH. As a result, this results in
performance drop in small random write.

Signed-off-by: Myoungwon Oh <ohmyoungwon@gmail.com>

test/rgw/dedup: add dedup test suite to teuthology

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #63426 from bluikko/doc-account-formatting-radosgw

doc/radosgw: Cosmetic improvements and ref links in account.rst

Merge pull request #63415 from zdover23/wip-doc-2025-05-22-mgr-influx-62782-followup

doc/mgr: edit influx.rst.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

crimson/os/seastore/omap_manager: handle the cases in which omap nodes
are rewritten before seen by users

Fixes: https://tracker.ceph.com/issues/71383
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge pull request #62683 from alexjr2001/issue-66309-scroll-up-navigation

scroll up by default when clicking on side navigation

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #63446 from bluikko/doc-cloud-transition-formatting-radosgw

doc/radosgw: Cosmetic improvements in cloud-transition.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

doc/radosgw: Cosmetic improvements in cloud-transition.rst

Indent text that should belong to list items so they are formatted as
list items.

Add missing full stop for a few sentences.

Move "the" outside of inline preformatted.
Format S3 API operation name with inline preformatted which seems
common.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

doc/radosgw: Cosmetic improvements and ref links in account.rst

Use double backticks consistently when referring to data, commands etc.

Change links pointing to existing labels to use ref.

Use title case consistently in section titles.

Use ordered lists instead of hardcoding list numbers.

Use inline strong for emphasis instead of inline preformatted.

Change several tab to four spaces for indent.

Call it "RADOS Gateway" instead of "RadosGW".

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

Merge pull request #63400 from ronen-fr/wip-rf-71404-nodeep

qa/standalone/scrub: extra delay in osd-scrub-test.sh

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/releases: add release note about OpenSSL version

Signed-off-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

rgw/logging: part upload operation name should be REST.PUT.PART

(in standard mode)

Fixes: https://tracker.ceph.com/issues/71312
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

rgw/logging: extract tenant from bucket name on admin flush

test instructions:
https://gist.github.com/yuvalif/adfa186fdbe9ad4c5b689753a15ec480

bug was introduced in: 790c38eacc52cc4c14beb48fca8b204235632793

Fixes: https://tracker.ceph.com/issues/71231
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

doc/cephadm: fix upgrade ordering

This fixes the documentation of Cephadm upgrade ordering, as defined by
CEPH_UPGRADE_ORDER.

Also replace the long single line ASCII arrow chain with a bullet list.

Signed-off-by: Pierre Riteau <pierre@stackhpc.com>

Merge pull request #63411 from ceph/debpathnorm

make-debs.sh: Optionally rm version from build dir

Merge pull request #63360 from cbodley/wip-doc-rgw-sts

doc/rgw: add notes about 'rgw sts key'

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

Merge pull request #62777 from tobias-urdin/rgw-admin-bucket-pagination

rgw/admin: Add max-entries and marker to bucket list

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw/dedup: full object dedup

Design Document:
https://docs.google.com/document/d/152VyCTR2NlZ6ongbe6-CJfP4qxr1_zH83FB_WukWD7c

Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>

Merge pull request #63352 from mkogan1/wip-d3n-exit-valg

rgw/d3n: fix valgrind invalid read during exit

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #63161 from aclamk/aclamk-bs-recomp-improve-is-worth

os/bluestore: Do not recompress large compressed blobs

Merge pull request #63189 from cbodley/wip-rgw-config-store-realm-watcher

rgw: move rados-specific parts of RGWRealmWatcher into ConfigStore

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

test/rgw: link lua test against unit-main for g_ceph_context

test_rgw_lua.cc was allocating a CephContext without initializing it, so
log statements from the tests/rgw code weren't actually being logged

the unit-main target links in the main() function from test/unit.cc
which initializes the CephContext via global_init(). use the resulting
global g_ceph_context instead of managing a separate one

Related-to: https://tracker.ceph.com/issues/70673
Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw/logging: add mtime to get-bucket-logging response

Fixes: https://tracker.ceph.com/issues/71385
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

crimson/os/seastore: prevent incorrect space calculation at maximum capacity

This commit updates seastore to increment used_bytes only when
 allocation is successful.
Without this commit, the seatore reports incorrect size if alloc_paddr fails
(e.g., due to insufficient space)

Signed-off-by: Myoungwon Oh <ohmyoungwon@gmail.com>

Merge pull request #63292 from tchaikov/test_not_before_queue-fix-leaks

test/test_not_before_queue: Fix memory leak by freeing ineligible items in destructor

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #63369 from zdover23/wip-doc-2025-05-20-mgr-diskprediction-62782-followup

doc/mgr: edit diskpredictor.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/mgr: edit mds_autoscaler.rst

Edit mds_autoscaler.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit localpool.rst

Edit doc/mgr/localpool.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit iostat.rst

Edit doc/mgr/iostat.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit insights.rst

Edit doc/mgr/insights.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/mgr: edit influx.rst.

Edit doc/mgr/influx.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63308 from Hezko/nvmeof-cli-align-subsys-list

mgr/dashboard: Add missing fields to subsytem list API/CLI

Reviewed-by: Afreen Misbah <afreen@ibm.com>

make-debs.sh: Optionally rm version from build dir

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #63048 from JoshuaGabriel/joshua_71135

orch/module: Make orch unpause an alias for orch resume

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #63371 from bluikko/doc-cephfs-mirroring-formatting-cephfs

doc/cephfs: Cosmetic changes and small fixes in cephfs-mirroring.rst

Merge pull request #63379 from ronen-fr/wip-rf-noloadavg

osd/scrub: remove OsdScrub::LoadTracker

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/rgw: use 'confval' directive to render sts config options

the 'confval' directive reads the config options from
common/options/rgw.yaml and renders them nicely. this keeps
everything consistent between the options and their docs

improve the config option descriptions:

* add existing note about rgw_sts_key length/format
* add example openssl command to generate a conforming sts key
* add notes about sharing sts key between gateways/zones

format the last remaining 'Note' with the 'note' directive

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #63368 from zdover23/wip-doc-2025-05-20-mgr-dashboard_plugins-motd-inc-62782-followup

doc/mgr: edit motd.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

rgw: move rados-specific parts of RGWRealmWatcher into ConfigStore

split RGWRealmWatcher in two halves, moving the rados-specific stuff
into a RadosRealmWatcher that inherits from RGWRealmWatcher

add factory function ConfigStore::create_realm_watcher() that returns a
generic RGWRealmWatcher. ConfigStore backends that don't support
watch/notify can return nullptr

rgw::AppMain uses this to avoid relying on checking for a "rados" driver
name, which doesn't work correctly when there are filters on top of the
RadosStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/standalone/scrub: extra delay in osd-scrub-test.sh

Modify TEST_just_deep_scrubs():
The test turns 'no-deep' off, and expects the scrub to be
concluded and reported within a short period. But the PG
already had a chance to try scrubbing (and fail due to
the 'no-deep'), and its 'not-before'
was pushed out by osd_scrub_retry_after_noscrub.

The fix is to reduce the value of osd_scrub_retry_after_noscrub
for this test, and to increase the timeout for the test itself.

Fixes: https://tracker.ceph.com/issues/71404
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #62906 from rhcs-dashboard/fix-70276-main

mgr/dashboard: Allow the user to re-use existing realm/zg/zone and setup replication

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Naman Munet <nmunet@redhat.com>

doc/mgr: edit motd.inc.rst

Edit doc/mgr/dashboard_plugins/motd.inc.rst.

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #63367 from zdover23/wip-doc-2025-05-20-mgr-dashboard_plugins-feature_toggles-inc-62782-followup

doc/mgr: edit feature_toggles.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63365 from zdover23/wip-doc-2025-05-15-mgr-dashboard_plugins-debug-inc-rst-62782-followup

doc/mgr: edit debug.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge PR #62934 into main

* refs/pull/62934/head:
libcephfs / pybind: use uid_t and gid_t instead of int

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

mgr/dashboard: Fix applicatin pool table for filtered pools

fixes: https://tracker.ceph.com/issues/71361

Signed-off-by: Ankush Behl <cloudbehl@gmail.com>