mgr/dashboard: fix the hosts e2e failure

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 3279afa920a1b732c9c85c242670d6b5e72780b5)

mgr/dashboard: fix the cephadm grafana e2e failure

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit c56e10af0b71b65f405f4a1c6a8c137bc6a62a13)

mgr/dashboard: update landing page e2e tests

ignore the region that can vary on different clusters like charts

fixes: https://tracker.ceph.com/issues/59142
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 1157e3bff978b19573549c1af1a8fac720b678f6)

mgr/dashboard: update to cypress 10

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 222dec3750304385dff51a2a4bfb91e12eb4e9aa)

mgr/dashboard: fix create snapshot is disabled for rbd images

also the rename and rollback option in the snapshot list is enabled even if there isn't anything in the list

also disabled the Mirror Image Snapshot option in the Create RBD
Snapshot form (only shown for images configured with Snapshot mirroring)
with the helpe

Fixes: https://tracker.ceph.com/issues/61296
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 896ae75901b564677ea1611a89f4d61da881a6e1)

mgr/dashboard: fix broken daemon details tab

Fixes: https://tracker.ceph.com/issues/61329
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 156cb50eab15414232d3dbad3467572d024a9c9f)

mgr/dashboard: more visibility for keys

Fixes: https://tracker.ceph.com/issues/61239
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 5ac61e925145154c6616a7630b3fc9643311ed7b)

mgr/dashboard: add helper on the rgw user Suspended

Fixes: https://tracker.ceph.com/issues/61247
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit b187dda20ca9a2d66a64d79d5bd3c746ce54729a)

mgr/dashboard: fix rgw roles breadcrumbs

Fixes: https://tracker.ceph.com/issues/61241
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 9518cd9d70020bcf5197dea6d61ea0bd2b21ae54)

mgr/dashboard: put some default values on rgw encryption config form

Fixes: https://tracker.ceph.com/issues/61246
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 024ba4ee38212138d9c5aa85bd3e12be68e5a40c)

mgr/dashboard: default encryption type to sse-s3 in rgw

by default the form doesn't select any values, so i am defaulting it to
sse-s3

Fixes: https://tracker.ceph.com/issues/61211
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit a08f89e777852f73d4900808a69bfcae0e4aa961)

mgr/dashboard:Change Daemons > Object Gateway section to Gateways
- Change the Daemons to Gateways
- Changing the breadcrums to call it Gateways
- In list page Calling Daemons List as Gateways List

Fixes: https://tracker.ceph.com/issues/61245
Signed-off-by: Ankush Behl <cloudbehl@gmail.com>
(cherry picked from commit eda2c573b285a61e365acb48384123f8854aa790)

mgr/dashboard: remove Selected Object Gateway dropdown

Only from Daemons and Multisite page because its not needed there.

Fixes: https://tracker.ceph.com/issues/61230
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 075fce3cf8f8bc5150abd4684bc87e56e993da5e)

mgr/dashboard: reorder rgw daemons list items

Fixes: https://tracker.ceph.com/issues/61212
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 130a52ed508761dcbf5f722ba98ffb4500a6a5b3)

mgr/dashboard: merge running and size columns in services page

Fixes: https://tracker.ceph.com/issues/61295
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 3eeca5c5c42c85d1925828a2e9ac3d87c83a401b)

mgr/dashboard: show the host's IP address on Hosts page

Fixes: https://tracker.ceph.com/issues/61222
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit ef9d53027ad472d8ee5e0e8524fce6ce7a40af89)

mgr/dashboard: Show a helper for Unmanaged checkbox in service creation form

Fixes: https://tracker.ceph.com/issues/61216
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit aa60bb88a5564f9e854b91b1cdc5a3a8945d1940)

mgr/dashboard: Status column in Cluster > Hosts shows empty

Fixes: https://tracker.ceph.com/issues/61215
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 930e48008403ce246105a0cc631efba2974494f4)

mgr/dashboard: add warning message on why osd creation disabled

When no options are present when creating OSDs, you can see the form
with lots of things disabled without having a clear explanation. This
PR introduces a warning banner with a description on why it is
happening.

Fixes: https://tracker.ceph.com/issues/61223
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 1d6b318b1a95dc961838dba5b06ebb70b039ee86)

mgr/dashboard: filte hosts by services

Fixes: https://tracker.ceph.com/issues/61242
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 510a582fa8bd04125a565afe12d245fc4dadff2f)

mgr/dashboard: Rename Cluster > Monitoring to Alerts and change Cluster>Users to Cluster>Ceph Users

Fixes: https://tracker.ceph.com/issues/61213
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 31b692f4e38e94d3e690921418f8eeebc2b48212)

mgr/dashboard: rename Service>Details to Service>Daemons

Daemons and services are not interchangeable in cephadm terms. As stated
in the docs: `A daemon is a systemd unit that is running and part of a
service.` https://docs.ceph.com/en/latest/cephadm/services/#daemon-status

Fixes: https://tracker.ceph.com/issues/61214
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit a0c59bf580adacb755334d9cc8f7c452223f9706)

mgr/dashboard: remove title tooltip of cards landing page

Fixes: https://tracker.ceph.com/issues/61250
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit ac73126362f3ea0f26ae32218b86ad9f9ab73670)

mgr/dashboard: add-scroll-in-key-value-tables

Fixes: https://tracker.ceph.com/issues/61220
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 1ae6a035b4ebfcee0009ee67740d485a2f9b8a9b)

mgr/dashboard: fix spacing of embedded grafana buttons

Fixes: https://tracker.ceph.com/issues/61220
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 5b7e850f67097f37276bc4bda87a65a79ce71b6c)

mgr/dashboard: fix tooltip for alerts silence matchers

Fixes: https://tracker.ceph.com/issues/61208
Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit 82ea356879c6fc6404b9bd76da3bbc5418ea5a2d)

mgr/dashboard: fix Nan undefined values and add empty pipe on expand-cluster

Fixes: https://tracker.ceph.com/issues/61207
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 764a1b67392f09a288a6f38d9d4f89d2a203cf57)

Merge pull request #51717 from soumyakoduri/wip-skoduri-reef

[reef] RGW backports

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51762 from neha-ojha/wip-reef-rc

reef: src/ceph_release: dev -> rc

Merge pull request #51731 from cbodley/wip-59351-again

reef: cmake: cls_rgw and cls_fifo depend on fmt

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #51735 from smanjara/wip-61406-reef

reef: rgw/multisite: handle shard_id correctly in data sync when bucket num_shards is 0

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #51724 from smanjara/wip-61387-reef

reef: rgw/multisite: fix ret handling in bucket read_sync_status()

Reviewed-by: Casey Bodley <cbodley@redhat.com>

 doc/dev/release-checklists.rst: reef is in rc phase

Signed-off-by: Neha Ojha <nojha@redhat.com>

doc/dev/release-checklists.rst: add after dev freeze section

- add release to redmine
- add milestone

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 1e048aade95880fe3c227f551bc91ac420701a8d)

src/ceph_release: dev -> rc

reef is now in rc phase

Signed-off-by: Neha Ojha <nojha@redhat.com>

Merge pull request #51001 from ifed01/wip-ifed-bluefs-duplicate-dir-link-ree

reef: os/bluestore/bluefs: fix dir_link might add link that already exists in compact log

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>

Merge pull request #50930 from ifed01/wip-ifed-fix-spillover-alert-ree

reef: os/bluestore: fix spillover alert

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>

Merge pull request #51755 from zdover23/wip-doc-2023-05-25-backport-51754-to-reef

reef: doc/rados: fix link in common.rst

doc/rados: fix link in common.rst

Fix a link in doc/rados/configuration/common.rst that was missing its
final letter, causing a 404 error when readers attempted to follow it.

This bug was reported by stalwart friend of the Ceph documentation
project Eugen Block, who is here credited as a co-author. This bug was
reported at https://pad.ceph.com/p/Report_Documentation_Bugs.

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8128ce20fef3d75c6251691d10af21861c01e155)

Merge pull request #51751 from zdover23/wip-doc-2023-05-25-backport-51745-to-reef

reef: doc/rados: edit filestore-config-ref.rst

Merge pull request #51162 from rhcs-dashboard/dependabot-pr-50580

reef: mgr/dashboard: bump webpack and @angular-devkit/build-angular

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #51077 from aaSharma14/wip-59447-reef

reef: mgr/dashboard: Fix rbd snapshot creation

Reviewed-by: Nizamudeen A <nia@redhat.com>

doc/rados: edit filestore-config-ref.rst

Edit doc/rados/configuration/filestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1202e4207bc182d83f193adb1557359d52687103)

mgr/dashboard: bump webpack and @angular-devkit/build-angular

Bumps [webpack](https://github.com/webpack/webpack) to 5.76.1 and updates ancestor dependency [@angular-devkit/build-angular](https://github.com/angular/angular-cli). These dependencies need to be updated together.

Updates `webpack` from 5.70.0 to 5.76.1
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.70.0...v5.76.1)

Updates `@angular-devkit/build-angular` from 13.3.9 to 13.3.11
- [Release notes](https://github.com/angular/angular-cli/releases)
- [Changelog](https://github.com/angular/angular-cli/blob/main/CHANGELOG.md)
- [Commits](https://github.com/angular/angular-cli/compare/13.3.9...13.3.11)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: indirect
- dependency-name: "@angular-devkit/build-angular"
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
(cherry picked from commit a6514bd04a78ab71b6b47706942de3dee9055db5)

Merge pull request #51739 from zdover23/wip-doc-2023-05-25-backport-50858-to-reef

reef: doc/rados/operations: Acting Set question

Merge pull request #51742 from zdover23/wip-doc-2023-05-25-backport-51730-to-reef

reef: doc/rados/operations: Fix erasure-code-jerasure.rst fix

doc/rados/operations: Fix erasure-code-jerasure.rst fix

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 2a3177e60d93742d3125f3ef0913dfeb8743e8bf)

doc/rados/operations: Acting Set question

Clear up a paragraph that describes the behavior of the Acting Set.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3bc9cfd83b3b836775433c7f1b075fe397b56463)

rgw/multisite: parse shard_id value correctly to handle num_shards 0 case

For buckets that have num_shards set to 0, bucket instance
will not have a shard_id delimiter. When this bucket instance is parsed,
we end up assigning a value of -1 to shard_id, which is invalid
in data sync. This change ensures that we represent the shard_id correctly
by giving it a valid number

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit f11b3dce832221a344440787333c41f61a9f9c67)

Merge pull request #51712 from amathuria/wip-reef-change-default-scrub-cost

reef: osd: Change scrub cost in case of mClock scheduler

Merge pull request #51683 from athanatos/sjust/wip-scrub-59049-reef

reef: src/osd/scrubber: process MapsCompared event syncronously

Merge pull request #51323 from rhcs-dashboard/wip-59621-reef

reef: mgr/dashboard: fix the rbd mirroring configure check

Reviewed-by: Pegonzal <NOT@FOUND>

cmake: cls_rgw and cls_fifo depend on fmt

Fixes: https://tracker.ceph.com/issues/58953
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 72164b129ea56b82e1f3e8b58764ba14bb4bf7df)

Merge pull request #51711 from Matan-B/wip-51388-reef

reef: qa/suites/crimson: Enhance rbd api testing

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #51716 from Matan-B/wip-51312-reef

reef: crimson/osd/ops_executer: Fix usage of Message's connection

Reviewed-by: Samuel Just <sjust@redhat.com>

rgw/sync-policy: Support disabling per-bucket replication

When the zones replicate, allow disabling replication
for specific buckets using sync policy.

These are the semantics to be followed while resolving the policy
conflicts -

==================================================
zonegroup bucket Result
==================================================
enabled enabled enabled
allowed enabled
forbidden disabled
allowed enabled enabled
allowed disabled
forbidden disabled
forbidden enabled disabled
allowed disabled
forbidden disabled

In case multiple group policies are set to reflect for any sync pair
(<source-zone,source-bucket>, <dest-zone,dest-bucket>), the following
rules are applied in the order -
1) Even if one policy status is FORBIDDEN, the sync will be disabled
2) Atleast one policy should be ENABLED for the sync to be allowed.

Various cases tested are outlined here -
https://docs.google.com/document/d/19oBQA-bYxLBR4BnekA2DTwJJaTFvjAfrqAk9G3RGU0I/edit#heading=h.4qac9dpc76m

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit aeb3a746180675bc5fcfaea4af839daadb0abdd7)

Merge pull request #51725 from zdover23/wip-doc-2023-05-24-backport-51273-to-reef

reef: doc: Update jerasure.org references

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: Update jerasure.org references

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 5e60e0de275f7260aeae9e664ca22ebfdf8fc5f9)

rgw/multisite: fix ret handling in bucket read_sync_status()

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 91642f4757f91eee45df0b18f79cc3dc38c46d63)

Merge pull request #51615 from adk3798/wip-59636-reef

reef: mgr/cephadm: allow configuring anonymous access for grafana

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #51663 from sseshasa/wip-61336-reef

reef: osd/scheduler: Reset ephemeral changes to mClock built-in profile

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #51666 from amathuria/wip-61303-reef

reef: mClockScheduler: Set priority cutoff in the mClock Scheduler

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #51720 from zdover23/wip-doc-2023-05-24-backport-51679-to-reef

reef: doc/mgr: edit "leaderboard" in telemetry.rst

Merge pull request #51714 from ljflores/wip-backport-pr-50482

reef: .github/milestone.yml: add reef

doc/mgr: edit "leaderboard" in telemetry.rst

Standardize the presentation of commands in the "Leaderboard" section of
doc/mgr/telemetry.rst.

Follow-up to https://github.com/ceph/ceph/pull/50977

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4935ad8aed2aa796015473de5b38cc973ba85ba1)

Merge pull request #51128 from petrutlucian94/wip-59480-reef

reef: win32_deps_build: avoid pip

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #50755 into reef

* refs/pull/50755/head:
mds: add config to decide whether to mark dentry bad
qa: add missing scan_links step for data scan recovery
qa/tasks/cephfs: test damage to dentry's first is caught
qa/tasks/cephfs: use rank_asok and allow specifying rank
qa/tasks: allow specifying timeout command prefix to ceph
mds: provide test configs for creating first corruption
mds: catch damage to dentry's first field
mds: add debugging for pre_cow_old_inode
mds: cleanup code

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>

rgw/multisite: Fix issue with parsing replication rules

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit 570de795721d13ddd6d39e28416b6d6f48477501)

rgw/archive: Correct the bucket sync status cmd output

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit d7af6c228253d05a16dd3be993f150518f1b6f66)

rgw: Disable logging for datalog and bilog if zone doesn't export data

Zones (such as archive zone) which do not export data should have
sync logging disabled.

Fixes# https://tracker.ceph.com/issues/59106

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit 85f0cb592aa0d755c101d2e2845ad736a7697e3e)

rgw/cloud-transition: New attrs to detect cloudtiered objects

Add new attrs "RGW_ATTR_CLOUD_TIER_TYPE" and "RGW_ATTR_CLOUD_TIER_CONFIG"
to store details about cloud-tiered objects so that they get synced accordingly
in a multisite environment.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit 0f690117439384827cdfffaf662b71a99f73b34a)

rgw: Dump tier_* config in RGWObjManifest

This was missed as part of refactoring done to encoder
and decoder methods (https://github.com/ceph/ceph/commit/2414c7584eb90bfff42d512879a0aa6b220d359e)

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit 4db632567d29ebc5df753faac9c80444884cc785)

rgw/cloudtransition: Allow multisite zones to sync cloudtiered objects

In a multisite configuration, zones should be able to fetch & sync
cloud-transitioned objects as well. To allow this, a new header
'x-rgwx-sync-cloudtiered' is added to be used by sync client to GET
such objects.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit cec19b09efc5a56a5f5600000675b951428b98ce)

rgw/cloudtier: Fix bug with decoding tier_targets

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit e33946b89ee9a3c61f0c4e08597f67b42ca4850b)

rgw/rados: cosmetic cleanup of attr handling

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 8ee9b3fc5e7e81a79d637593eca9add365c0b784)

rgw/rados: don't use attrset[] to create entries that don't exist

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 33273476730c70f4a5103151c36947030f11348e)

rgw: add s3 error message to cloud-tiered objects

better to tell the s3 client why their request failed than to log it as
an ERROR; this is normal/expected when cloud tiering is enabled

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 5713a040c38c5c17fa2ae4913067a602a412b639)

rgw: catch manifest decode errors in GetObj/PutObj/CopyObj

if we read an object that doesn't have a manifest attribute,
RGWRados::get_obj_state_impl() adds an empty one and causes decode to
throw an end_of_buffer exception

Fixes: https://tracker.ceph.com/issues/58794
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 77e0b9848cb458427b5dcf86d2c19769ea65e0bc)

crimson/osd/ops_executer: Fix usage of Message's connection

See #50835.
In crimson, conn is independently maintained outside Message.
Therefore, when trying to use the message's connection for
`get_orig_source_inst()` we won't be able to get the peer address.

Fixes: https://tracker.ceph.com/issues/59589
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit d569703a5f35a48ef042d61702eaa86a6e2d48bd)

Merge pull request #51710 from Matan-B/wip-47749-reef

reef: crimson/os/seastore/btree: link fixedkvbtree's nodes and logical extents with forward and backward pointers, and drop the pin_set

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #51709 from Matan-B/wip-51381-reef

reef: crimson/osd/osd_operations/client_request: Fix client blocklisting

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #51708 from Matan-B/wip-48717-reef

reef: crimson/os: support multicore seastore

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #51707 from Matan-B/wip-50835-reef

reef: crimson/net: change ConnectionRef to be a local_shared_foreign_ptr

Reviewed-by: Samuel Just <sjust@redhat.com>

.github/milestone.yml: add reef

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 573d0ff5d58a07a8ae27daea7cc69cbe323b5865)

Merge pull request #51248 from mchangir/wip-59411-reef

reef: mgr/snap_schedule: add debug log for paths failing snapshot creation

Reviewed-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #51142 from joscollin/wip-59481-reef

reef: tools/cephfs/top/CMakeList.txt: check the minimum compatible python version for cephfs-top

Reviewed-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #51704 from petrutlucian94/wip-61365-reef

reef: rbd-wnbd: improve image map error message

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

osd: mClock default_min reservation should be 0

All the mClock profiles enforce no minimum reservation for the background best-effort client.
For this purpose, the default_min value should 0 and not 1.

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
(cherry picked from commit 05848b4957713c5c98c249e15eb8de01d1c6a1e6)

osd: Change scrub cost in case of mClock scheduler

With osd_op_queue as WPQ, high costs were assigned to scrub in order to throttle it effectively.
In the case of mClock scheduler, mClock parameters are used to do the throttling and the cost should represent a realistic value.

Fixes: https://tracker.ceph.com/issues/61313
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
(cherry picked from commit 43544d296c5fc14aaf638ddf21de9ea9d99f6059)

qa/suites/crimson: Introduce rbd_python_api_tests.yaml

Test python api with new image format.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 01958e648ef6ea0689e30e946be71b28a641303c)

qa/suites/crimson: Skip unsupported tests (Crimson)

Align with `rbd_api_tests` and skip deep_copy and breaklock tests
in Crimson.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 5823c04542c2a6870cb038da752e752ea2a3cf9a)

test/*rbd: Enable supported Crimson test

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 6895fb33e8308d8bfabe14d92e156b02044b9c8e)

crimson/tools/store_nbd: read logical extents via
TransactionManager::read_pin()

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 33b56a04d51443f5f035bfc267da16d4a5dfe28c)

crimson/os/seastore/cache: add comment about backref_extent_entry_t

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 62974a65897edce2afdb16ba99baea0193a0d4a6)

test/crimson/seastore: complement lba test with logical extents

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 3c4f8c761333dcc1a4e24e73f37808720c8f684f)

test/crimson/seastore: check intra-fixedkv-btree parent->child trackers during unittests

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 302bc3c2d95cd36012008e334444f689ddb6694f)

crimson/os/seastore/btree: drop btree_pin_set_t

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 4a3dfc0f630d6e635bd82801e0107be78d3d2c6d)

crimson/os/seastore/transaction_manager: follow leaf<->logical extent pointers to read extent

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 89c2d0b3af7feb4124b7a5ac7f54026c205663b5)

crimson/os/seastore/lba_manager: link lba leaf nodes with logical extents by pointers

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit cce850d75609c7c34bce0920e4e12ba9b9513229)

crimson/os/seastore/btree: "templatize" btree leaf node to distinguish leaf nodes with(out) children

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
(cherry picked from commit 55e1924e3818e7fb574893372ba7dfad4fa54014)