rgw/dbstore: Update README

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #51750 from zhscn/fix-scan-order

crimson/os/seastore/backref_manager: scan backref entries by journal seq

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #51748 from rhcs-dashboard/rgw-roles-fix

mgr/dashboard: fix the rgw roles page

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #51408 from AliMasarweh/wip-alimasa-topics-op-by-bucket

RGW: add admin interfaces to get and delete notifications by bucket

Merge pull request #51396 from rhcs-dashboard/access-landing-page-readonly-users

mgr/dashboard: fix issues with read-only user on landing page

Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix issues with read-only user on landing page

Fixes: https://tracker.ceph.com/issues/61418
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51662 from yuvalif/wip-yuval-61328

rgw/notification/kafka: simplify kafka connection memory management

Merge pull request #51575 from yuvalif/wip-yuval-fix-61254

rgw/kafka: remove potential race condition between creation and deletion of endpoint

RGW: add admin interfaces to get and delete notifications from bucket

Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>

Merge pull request #51787 from zdover23/wip-doc-2023-05-27-rados-config-bluestore-config-ref-2-of-x

doc/rados: edit bluestore-config-ref.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: edit bluestore-config-ref.rst (2 of x)

Edit the second part of doc/rados/configuration/bluestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthoy D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51771 from zdover23/wip-doc-2023-05-26-rados-config-bluestore-config-ref-1-of-x

doc/rados: edit bluestore-config-ref.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: edit bluestore-config-ref.rst (1 of x)

Edit the first part of doc/rados/configuration/bluestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51747 from rhcs-dashboard/cypress-followups

mgr/dashboard: remove deprecated preserveOnce

Reviewed-by: Pegonzal <NOT@FOUND>

Merge pull request #51734 from cbodley/wip-61300

rgw: disable RGWDataChangesLog::add_entry() when log_data is off

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #51579 from phlogistonjohn/jjm-fix-test_cephadm

cephadm: fix a cephadm test when docker doesn't exist

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #51570 from NitzanMordhai/wip-nitzan-test-mon-thrasher-quorum-delay-inc

test: monitor thrasher wait until quorum

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>

Merge pull request #51527 from NitzanMordhai/wip-nitzan-thrash-eio-pool-size-correct

test: correct osd pool default size

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>

Merge pull request #51456 from Svelar/filestore-mon

mon: remove filestore

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>

Merge pull request #48999 from tchaikov/wip-nerados-fmt-v9

neorados: s/ostream_formatter/fmt::ostream_formatter/

Reviewed-by: Adam Emerson <aemerson@redhat.com>

mgr/dashboard: add more e2e for cephx users

Fixes: https://tracker.ceph.com/issues/61421
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51516 from ivancich/wip-integrate-logging-flag

rgw: multisite data log flag not used

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #50841 from smanjara/fix-duplicate-objects-archive

rgw/archive: avoid duplicating objects when syncing from multiple zones

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51219 from smanjara/wip-archive-delete-bucket

rgw/multisite[archive zone]: fix storing of bucket instance info in the new bucket entrypoint

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51233 from smanjara/wip-archive-bucket-metadata

rgw/multisite[archive zone]: remove bucket metadata modification during object sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51280 from tcoldrick-bb/multisite-dencoder-types

rgw: Add log types to dencoder

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51497 from mkogan1/wip-rgw-bulk

rgw: set bulk pool flag when creating data pool

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #50876 from rishabh-d-dave/qa-ceph-man-get-keyring

qa/ceph_manager: preserve newline char at EOF in keyring

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

Merge pull request #50312 from rishabh-d-dave/ceph-caps-improvements

mon, osd: set subsystem prefix for logging MonCap and OSDCap

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #51004 from rishabh-d-dave/authmon-invalid-caps

mon/AuthMonitor: log when parsing caps fails

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge PR #50875 into main

* refs/pull/50875/head:
mon/MDSMonitor: ignore extraneous up:boot messages
qa: add test case for mds sending multiple boot messages
qa: support checking for a log message that should not exist

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

Merge pull request #51749 from chenyuanrun/fix_dencoder_trash_watcher

tools/ceph-dencoder: Fix incorrect type define for trash_watcher

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #51754 from zdover23/wip-doc-2023-05-25-rados-configuration-common-link-fix

doc/rados: fix link in common.rst

mgr/dashboard: fix the rgw roles page

Fixes: https://tracker.ceph.com/issues/61421
Signed-off-by: Nizamudeen A <nia@redhat.com>

doc/rados: fix link in common.rst

Fix a link in doc/rados/configuration/common.rst that was missing its
final letter, causing a 404 error when readers attempted to follow it.

This bug was reported by stalwart friend of the Ceph documentation
project Eugen Block, who is here credited as a co-author. This bug was
reported at https://pad.ceph.com/p/Report_Documentation_Bugs.

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51745 from zdover23/wip-doc-2023-05-25-rados-configuration-filestore-config-ref

doc/rados: edit filestore-config-ref.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

crimson/os/seastore/backref_manager: scan backref entries by journal seq

Signed-off-by: Zhang Song <zhangsong325@gmail.com>

tools/ceph-dencoder: Fix incorrect type define for trash_watcher

Signed-off-by: Chen Yuanrun <chen-yuanrun@foxmail.com>
Fixes: https://tracker.ceph.com/issues/61368

mgr/dashboard: remove deprecated preserveOnce

cypress is deprecating preserveOnce and instead favoring using
cy.session(). session is already introduced as part of the upgrade to
cypress 10. So removing the preserveOnce here

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #50037 from rhcs-dashboard/cypress-10

mgr/dashboard: update to cypress 10

Reviewed-by: Pegonzal <NOT@FOUND>

mgr/dashboard: fix the hosts e2e failure

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix the cephadm grafana e2e failure

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51696 from rhcs-dashboard/fix-requirement-test-regression

mgr/dashboard: fix regression caused by -  bcc92adb96d1ab8155d30cb51933b0d07b398cdc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

doc/rados: edit filestore-config-ref.rst

Edit doc/rados/configuration/filestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51730 from anthonyeleven/anthonyeleven/formatting

doc/rados/operations: Fix erasure-code-jerasure.rst fix

Reviewed-by: Zac Dover <zac.dover@proton.me>

doc/rados/operations: Fix erasure-code-jerasure.rst fix

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge PR #50501 into main

* refs/pull/50501/head:
mon/MDSMonitor: do not propose on error in prepare_update

Reviewed-by: Rishabh Dave <ridave@redhat.com>

Merge PR #51407 into main

* refs/pull/51407/head:
mon/MDSMonitor: check fscid in pending exists in current

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

rgw: disable RGWDataChangesLog::add_entry() when log_data is off

this restores a check for RGWZone::log_data in add_entry(). with
per-bucket replication, this check was replaced by a call to
`RGWBucketSyncPolicyHandler::bucket_exports_data()`

this call has to consult two rados objects,
`bucket.sync-source-hints.<bucketname>` and
`bucket.sync-target-hints.<bucketname>`

but if the zone is not configured for multisite, we should avoid these
extra object reads and return early

Fixes: https://tracker.ceph.com/issues/61300
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51656 from amathuria/wip-amat-mclock-change-default-scrub-cost

osd: Change scrub cost in case of mClock scheduler

mgr/dashboard: update to cypress 10

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51713 from cbodley/wip-58953

cmake: cls_rgw and cls_fifo depend on fmt

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #50858 from zdover23/wip-doc-2023-04-04-rados-operations-monitoring-osd-pg-question-2-active-set

doc/rados/operations: Acting Set question

mgr/dashboard: fix regression caused by bcc92adb96d1ab8155d30cb51933b0d07b398cdc

This PR intends to revert the changendone in requirements-test.tzt by PR
50643

Fixes: bcc92adb96d1ab8155d30cb51933b0d07b398cdc
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

doc/rados/operations: Acting Set question

Clear up a paragraph that describes the behavior of the Acting Set.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51723 from anthonyeleven/anthonyeleven/tracker-58723

doc: Update jerasure.org references

Merge pull request #50847 from smanjara/wip-fix-ret-bucket-sync-status

rgw/multisite: fix ret handling in bucket read_sync_status()

doc: Update jerasure.org references

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #51679 from zdover23/wip-doc-2023-05-23-mgr-telemetry-leaderboard

doc/mgr: edit "leaderboard" in telemetry.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #50438 from SUSE/wip-fix-58477

Fix FTBFS on gcc 13

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51511 from soumyakoduri/wip-skoduri-bucket-repl

rgw/multisite: Fix issue with parsing replication rules

Reviewed-by: Casey Bodley <cbodley@redhat.com>

cmake: cls_rgw and cls_fifo depend on fmt

Fixes: https://tracker.ceph.com/issues/58953
Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw/multisite: Fix issue with parsing replication rules

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #50598 from rzarzynski/wip-crimson-only-tcmalloc-lsan-supp

crimson/osd: add embedded suppression ruleset for LSan

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #51665 from petrutlucian94/map_err

rbd-wnbd: improve image map error message

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

osd: mClock default_min reservation should be 0

All the mClock profiles enforce no minimum reservation for the background best-effort client.
For this purpose, the default_min value should 0 and not 1.

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

Merge pull request #51682 from zdover23/wip-doc-2023-05-23-glossary-bluestore

doc/glossary: update bluestore entry

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

osd: Change scrub cost in case of mClock scheduler

With osd_op_queue as WPQ, high costs were assigned to scrub in order to throttle it effectively.
In the case of mClock scheduler, mClock parameters are used to do the throttling and the cost should represent a realistic value.

Fixes: https://tracker.ceph.com/issues/61313
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>

Merge pull request #51590 from rhcs-dashboard/rbd-snapshot-disabled-fix

mgr/dashboard: fix create snapshot is disabled for rbd images

Reviewed-by: Pegonzal <NOT@FOUND>

doc/glossary: update bluestore entry

Update the BlueStore entry in the glossary, explaining that as of Reef
BlueStore and only BlueStore (and not FileStore) is the storage backend
for Ceph.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51265 from cbodley/wip-59471

rgw/s3: ListObjectsV2 returns correct object owners

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

doc/mgr: edit "leaderboard" in telemetry.rst

Standardize the presentation of commands in the "Leaderboard" section of
doc/mgr/telemetry.rst.

Follow-up to https://github.com/ceph/ceph/pull/50977

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #51651 from zdover23/wip-doc-2023-05-22-cache-tiering-deprecation-notes

doc: note deprecation of Cache Tiering in Reef

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge PR #49553 into main

* refs/pull/49553/head:
mds: wait reintegrate to finish when unlinking
message: make MClientReply inherit MMDSOp
mds: notify the waiters in replica MDSs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #51535 from rzarzynski/wip-bs-include-bdev-in-cbt-logs

os/bluestore: CBT includes bdev's logs when --log-file is set

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #51528 from NitzanMordhai/wip-nitzan-tests-using-override-instead-overrides

tests: change override to overrides so conf will take affect

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #51352 from rosinL/crimson-crush-hook

crimson/osd: add crush_location_hook feature to crimson

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #51498 from athanatos/sjust/wip-scrub-59049

src/osd/scrubber: process MapsCompared event syncronously

mgr/dashboard: fix create snapshot is disabled for rbd images

also the rename and rollback option in the snapshot list is enabled even if there isn't anything in the list

also disabled the Mirror Image Snapshot option in the Create RBD
Snapshot form (only shown for images configured with Snapshot mirroring)
with the helpe

Fixes: https://tracker.ceph.com/issues/61296
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51658 from rhcs-dashboard/daemon-details-fix

mgr/dashboard: fix broken daemon details tab

Reviewed-by: cloudbehl <NOT@FOUND>

Merge PR #51661 into reef

* refs/pull/51661/head:
Revert "mds: fix client isn't responding to mclientcaps(revoke)"

Reviewed-by: Xiubo Li <xiubli@redhat.com>

Merge pull request #51090 from banuchka/mgr/prometheus-plugin-fix-2-bugs-implemented-by-PR#48204,-PR#49519

mgr/prometheus: fix pool_objects_repaired and daemon_health_metrics format

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #51393 from adk3798/fix-related-service-logging

mgr/cephadm: lower log level when logging about related services

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

test: monitor thrasher wait until quorum
With 1 sec. delay we may sometimes fail to get correct length of
quorum since the monitor didn't updated on time.
With the following fix, we will wait for quorum and check every few
seconds (3) until timeout (30).

Fixes: https://tracker.ceph.com/issues/52316
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #50657 from guits/remove-filestore-cv

ceph-volume: drop filestore support

rbd-wnbd: improve image map error message

"rbd-wnbd map" commands are delegated to the centralized
ceph-rbd Windows service, which in turn will create the
actual image mapping. This allows the daemons to continue
running even after the current session ends.

rbd-wnbd communicates with the service through a named pipe.
If the operation fails, we're only getting an error code.

This change will print the according error message based on the
error code, suggesting the user to check the logs or use
foreground mode ("-f") for additional information.

We could also capture the entire subprocess console output and
print it in case of errors. This can be quite verbose, so we'll
keep it simple for now.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

Merge pull request #51480 from sseshasa/wip-fix-pr48703-followup

osd/scheduler: Reset ephemeral changes to mClock built-in profile

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #51646 from anthonyeleven/anthonyeleven/clean-up-cecil-the-seastore

doc/dev/crimson: Improve crimson.rst

Revert "mds: fix client isn't responding to mclientcaps(revoke)"

Signed-off-by: Venky Shankar <vshankar@redhat.com>

rgw/notification/kafka: simplify kafka connection memory management

use a bare pointer and a unique_ptr instead of a shared pointer (boost::intrusive_ptr).
and use the broker name as the handle exposed outside of the kafka module.

Fixes: https://tracker.ceph.com/issues/61328
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

rgw: set bulk pool flag when creating data pool

fixes: https://tracker.ceph.com/issues/58692

Signed-off-by: Mark Kogan <mkogan@redhat.com>

doc/dev/crimson: Improve crimson.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

mgr/dashboard: fix broken daemon details tab

Fixes: https://tracker.ceph.com/issues/61329
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51552 from rhcs-dashboard/fix-61215-main

mgr/dashboard: Status column in Cluster > Hosts shows empty

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51589 from rhcs-dashboard/services-running

mgr/dashboard: merge running and size columns in services page

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51565 from rhcs-dashboard/helper-user-suspend

mgr/dashboard: add helper on the rgw user Suspended

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>

Merge pull request #51562 from rhcs-dashboard/fix-nan-undefined-values

mgr/dashboard: fix Nan undefined values and add empty pipe on expand-cluster

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51553 from rhcs-dashboard/fix-61216-main

mgr/dashboard: Show a helper for Unmanaged checkbox in service creation form

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51557 from rhcs-dashboard/fix-61222-main

mgr/dashboard: show the host's IP address on Hosts page

Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #51551 from rhcs-dashboard/keys-visibility

mgr/dashboard: more visibility for keys

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>