qa: verify labelled replication perf metrics

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit f29dd57cd0a1f609f54d62f97025ec2d67979472)

 Conflicts:
qa/tasks/cephfs/test_mirroring.py

test_mirroring.py does not use run_ceph_cmd() in reef, so, adjust
for that.

qa: test per-client labelled perf counters

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 36e24585d562d0023398196e715522cc8cf74fb3)

Conflicts:
    qa/tasks/cephfs/test_admin.py

Use time.sleep() instead of sleep() (via import).

mds: export per-client metrics as labelled perf counters

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 164c547edcff86ed7dbb0d398b6db54f71e3f9b8)

cephfs_mirror: add labeled replication performance metrics

Fixes: http://tracker.ceph.com/issues/63945
Signed-off-by: Jos Collin <jcollin@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 658ee6c40116e07f45085ad0df7ef33d3c8ed78e)

cephfs-mirror: typo ending bracket

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 4c14f143b59c96ecb2c23e5142829d47e2c03e22)

Merge pull request #55635 from zdover23/wip-doc-2024-02-19-backport-55633-to-reef

reef: doc/man: edit "manipulating the omap key"

Merge PR #52751 into wip-61794-reef

* refs/pull/52751/head:
PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
snap_schedule/tests: fix db upgrade issue
qa: add yaml for on demand subvol version testing
qa: add test cases for testing --subvol and --group arguments
mgr/volumes: conditionalize subvolume upgrade
mgr/volumes: ensure correct init of v1 subvol
mgr/snap_schedule: add subvol and subvol group arguments to cli
mds/snap_schedule: add subvolume group column management
mgr/volumes: add remote helper methods to fetch subvolume info
mgr/snap_schedule: catch all exceptions for cli

Reviewed-by: Venky Shankar <vshankar@redhat.com>

doc/man: edit "manipulating the omap key"

Edit the section "Manipulating the Object Map Key" in
doc/man/8/ceph-objectstore-tool.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 44ec668d43951c2710271fb3ca1799c4c4ded940)

Merge pull request #55630 from zdover23/wip-doc-2024-02-18-backport-55626-to-reef

reef: doc/rados: add PG definition

doc/rados: add PG definition

Add a definition of Placement Groups to
doc/rados/operations/placement-groups.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 39c809b33fe27064277292b721639cbb144fac6a)

Merge PR #55590 into reef

* refs/pull/55590/head:
qa: do upgrades from quincy and older reef minor releases

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55613 from zdover23/wip-doc-2024-02-16-backport-55539-to-reef

reef: doc/glossary: improve OSD definitions

Merge pull request #55611 from zdover23/wip-doc-2024-02-16-backport-55585-to-reef

reef: doc/rados: add link to pg blog post

doc/glossary: improve OSD definitions

Remove expletive construction from three OSD-id-related terms.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dec3d3730712bbc0994f5cbd1989761d64f93019)

doc/rados: add link to pg blog post

Add a link in the "Placement Groups" section that links to Sage Weil's
April 5, 2019 blog post "New in Nautilus: PG merging and autotuning".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9344893e0857be8c6ae134f6d4d5e9057e2cb99e)

Merge PR #54952 into reef

* refs/pull/54952/head:
qa: configure balancer for multi-mds workloads
qa: create qa subvolumes in named subvolumegroup
qa: do not rely on default max_mds value
qa: add automate_balance to dashboard qa schema
doc/cephfs: add docs for balance_automate
doc/cephfs: use bash prompt for shell code
mds: add balance_automate fs setting

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #55603 from zdover23/wip-doc-2024-02-16-backport-55566-to-reef

reef: doc/cephadm: correct nfs config pool name

Merge pull request #55557 from zdover23/wip-doc-2024-02-13-backport-55546-to-reef

reef: doc/glossary: Add link to CRUSH paper

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: correct nfs config pool name

s/nfs-ganesha/.nfs/ in doc/cephadm/services/nfs, in accordance with
information given to me by John Mulligan over Slack.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 574421aeec3bdd502c64e87102846e5181b18415)

Merge pull request #55026 from idryomov/wip-63607-reef

reef: librados: make querying pools for selfmanaged snaps reliable

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #54595 from idryomov/wip-53593-reef

reef: osd: don't require RWEXCL lock for stat+write ops.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #54373 from batrick/wip-63456-reef

reef: common: resolve config proxy deadlock using refcounted pointers

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>

Merge pull request #55538 from guits/reef-node-proxy-handle-fetch-oob-error

(reef) node-proxy: improve http error handling in fetch_oob_details

qa: do upgrades from quincy and older reef minor releases

Fixes: https://tracker.ceph.com/issues/64441
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

tools/rados: just return instead of exit(1) in "rados cppool" handler

Otherwise an occasional segfault occurs.  This instance was missed in
commit 2c149262888c ("tools/rados: always call rados.shutdown() before
exit()").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit de6635582b7615eb54800a616711073a3c7b0dbd)

qa: make sure "rados cppool" requires --yes-i-really-mean-it for RBD

Safeguards in rados CLI tool isn't really the subject of this test, but
it fits nicely.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2b135a2eb60e0dd5ab22d213d3d2435608c6a9d3)

librados: make querying pools for selfmanaged snaps reliable

If get_pool_is_selfmanaged_snaps_mode() is invoked on a fresh RADOS
client instance that still lacks an osdmap, it returns false, same as
for "this pool is not in selfmanaged snaps mode".  The same happens if
the pool in question doesn't exist since the signature doesn't allow to
return an error.

The motivation for this API was to prevent users from running "rados
cppool" on a pool with unmanaged snapshots and deleting the original
thinking that they have a full copy.  Unfortunately, it's exactly
"rados cppool" that fell into this trap, so no warning is printed and
--yes-i-really-mean-it flag isn't enforced.

Fixes: https://tracker.ceph.com/issues/63607
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0999e63bfbbee46b8e19c3f05881eee64dba8b5e)

Conflicts:
PendingReleaseNotes [ moved to >=18.2.2 section ]

librados: clarify get_pool_is_selfmanaged_snaps_mode() semantics

Refer to the commit message of 8a9769a1d5fd ("librados: add
get_pool_is_selfmanaged_snaps_mode() function").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 54edc7955b0593423d2c03ca308b5e5fcdc528a3)

Merge pull request #55474 from idryomov/wip-47287-reef

reef: librbd: return ENOENT from Snapshot::get_timestamp for nonexistent snap_id

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #55427 from idryomov/wip-63341-reef

reef: librbd: improve rbd_diff_iterate2() performance in fast-diff mode

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #55424 from petrutlucian94/wip-64294-reef

reef: msg: update MOSDOp() to use ceph_tid_t instead of long

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

Merge pull request #55571 from aaSharma14/wip-64048-reef

reef: mgr/dashboard: increase the number of plottable graphs in charts

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

mgr/cephadm: add fullreport in ceph orch CLI (node-proxy)

This adds the `fullreport` category to the `ceph orch hardware status` CLI.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 056d4f7a3d4ca8564b374880551a574858e68395)

mgr/cephadm: conditionally deploy node-proxy

Only attempt to deploy the node-proxy agent when oob details
are provided for a given host.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 3ae32c44a7d1ea15bd3459a266b2dbf3c9f9a408)

node-proxy: call time.sleep() after each reporter iteration

This makes sure time.sleep() is always call in the reporter loop.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 6fc3d861c5785aad76aa6bde6944e2bb317df4f3)

node-proxy: improve http error handling in fetch_oob_details

This makes the daemon handle the error nicer in fetch_oob_details()

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 7bfe445e690d13eec8552f2ba88c9ff25ed3cf92)

PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit b3ff5f794985c173ba87926f34e6d9793c5d5c67)
Signed-off-by: Milind Changire <mchangir@redhat.com>

snap_schedule/tests: fix db upgrade issue

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit dfc35a4679495a3d7136927374e838409c29ab4a)
Signed-off-by: Milind Changire <mchangir@redhat.com>

qa: add yaml for on demand subvol version testing

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 2533ac5b90f367dd55f61c1e95dee0e154940930)
Signed-off-by: Milind Changire <mchangir@redhat.com>

qa: add test cases for testing --subvol and --group arguments

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 006c68f492044327594fbf7204774d7d7d4ee518)
Signed-off-by: Milind Changire <mchangir@redhat.com>

mgr/volumes: conditionalize subvolume upgrade

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 0c5804ab4e5eb284d127044c5e51fbc870f5727a)
Signed-off-by: Milind Changire <mchangir@redhat.com>

mgr/volumes: ensure correct init of v1 subvol

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 614d112cff522439c08e554a14472f1f391dd125)
Signed-off-by: Milind Changire <mchangir@redhat.com>

mgr/snap_schedule: add subvol and subvol group arguments to cli

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 5b250907d03196bf99fe4a56ea00245a4c830264)
Signed-off-by: Milind Changire <mchangir@redhat.com>

mds/snap_schedule: add subvolume group column management

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit ffa197c03159e2acb7c3892f09a1ed616b9c1cd8)
Signed-off-by: Milind Changire <mchangir@redhat.com>

mgr/volumes: add remote helper methods to fetch subvolume info

  * add remote method to fetch subvolume path
  * add remote method to list subvolumes
  * add remote method to fetch subvolume attributes

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit d2205bf8247edec08a456377c1e8988428e9ba29)
Signed-off-by: Milind Changire <mchangir@redhat.com>

mgr/snap_schedule: catch all exceptions for cli

Any unknown exception causes the module to be unloaded and unresponsive.
So, it'll be ideal to catch all exceptions during command-line interaction
and report them instead of crashing with a traceback.

Fixes: https://tracker.ceph.com/issues/58195
Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 651fb2e3b515c80e9dc4a24638c9d1a0d487c729)

Conflicts:
src/pybind/mgr/snap_schedule/module.py
- minor conflicts due to changed variable names

mgr/dashboard: Fix issue with Object's Overview page

Fixes https://tracker.ceph.com/issues/64150

Issue: Due to absence of null checks, the overview page was failing to
load.

Fix: Added, null check at relevant places to ensure data availability
before accessing the data.

Signed-off-by: Afreen <afreen23.git@gmail.com>

mgr/dashboard: increase the number of plottable graphs in charts

Fixes: https://tracker.ceph.com/issues/64024
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #55544 from rhcs-dashboard/wip-61657-reef

reef: mgr/dashboard: change deprecated grafana URL in daemon logs

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: ivoalmeida <NOT@FOUND>

Merge pull request #55515 from afreen23/wip-64367-reef

reef: mgr/dashboard: fix error while accessing roles tab when policy attached

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #55542 from rhcs-dashboard/wip-61714-reef

reef: mgr/dashboard: fix the jsonschema issue in install-deps

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: ivoalmeida <NOT@FOUND>

doc/glossary: Add link to CRUSH paper

Add a link in the CRUSH definition to the original CRUSH paper.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit aa1e6352d0c2c77c299a16f93e16e83903fb9d54)

Merge pull request #55497 from guits/wip-64357-reef

reef: ceph-volume: Fix migration from WAL to data with no DB

mgr/dashboard: change deprecated grafana URL in daemon logs

See https://github.com/grafana/grafana/issues/51276

I am also increasting the height of the panel

Fixes: https://tracker.ceph.com/issues/61618
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit f428b1468844345915b4cf607a104732b1b967f3)

mgr/dashboard: fix the jsonschema issue in install-deps

Fixes: https://tracker.ceph.com/issues/61690
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit a6a123d3b498c6fa8a09339ed5e7d5b95581419b)

 Conflicts:
src/pybind/mgr/dashboard/requirements-test.txt
  - accept the incoming changes

Merge pull request #55517 from rhcs-dashboard/wip-64370-reef

reef: mgr/dashboard: dashboard area chart unit test

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #55511 from zdover23/wip-doc-2024-02-09-backport-55465-to-reef

reef: doc: add description of metric fields for cephfs-top

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55505 from zdover23/wip-doc-2024-02-09-backport-55490-to-reef

reef: doc:start.rst fix typo in hw-recs

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

mgr/dashboard: dashboard area chart unit test

Fixes: https://tracker.ceph.com/issues/63243
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 445724fa61a27071bce02afa084bfc1437acd271)

mgr/dashboard: fix error while accessing roles tab when policy attached

Fixes https://tracker.ceph.com/issues/64270

Issue:
======
Accessing Object->Users-Roles tab causing 500 internal servor error.
This is due to the "PermissionPolicies" which are attached to role and
backend was not handling this field for rgw roles.

Fix:
====
Added "PermissionPolicies" as the valid field in backend and updated
frontend to render the attached policy in formatted JSON

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 5247d7d19455a5ab7d1bb56b9586c6b08843b15d)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/shared/models/crud-table-metadata.ts

Merge pull request #55224 from rhcs-dashboard/wip-64077-reef

reef: mgr/dashboard: chartjs and ng2-charts version upgrade

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #55477 from guits/wip-64337-reef

reef: ceph-volume: fix zap_partitions() in devices.lvm.zap

Merge pull request #55489 from rhcs-dashboard/wip-64245-reef

reef: mgr/dashboard: create cephfs snapshot clone

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

doc: add description of metric fields for cephfs-top

Fixes: https://tracker.ceph.com/issues/63991
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
(cherry picked from commit 956f644f86c0790c17976b98df112747d66837df)

doc:start.rst fix typo in hw-recs

s/power less/power loss/

Signed-off-by: Eduardo Roldan <trazor@gmail.com>
(cherry picked from commit b80c12d080275e3c221a1e305c345fbc1caa3c8e)

Merge pull request #55369 from afreen23/wip-64239-reef

reef: mgr/dashboard: Create subvol of same name in different group

Reviewed-by: Nizamudeen A <nia@redhat.com>

ceph-volume: Fix migration from WAL to data with no DB

Fixes: https://tracker.ceph.com/issues/64260
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 88466b3e7daad51a93ef1ccdbced1f33337c4eec)

Merge pull request #55491 from rkachach/fix_issue_64339

backport mgr/prometheus: fix orch check to prevent Prometheus crash

backport mgr/prometheus: fix orch check to prevent Prometheus crash
https://tracker.ceph.com/issues/64339

Signed-off-by: Redouane Kachach <rkachach@redhat.com>

mgr/dashboard: create cephfs snapshot clone

Fixes: https://tracker.ceph.com/issues/64175
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 129f1db734777f3df551965c35f40ee0ab7d467a)

 Conflicts:
src/pybind/mgr/dashboard/controllers/cephfs.py
  - Left the snapshot scheduler controller out

Merge pull request #55484 from zdover23/wip-doc-2024-02-08-backport-55475-to-reef

reef: doc/radosgw: add confval directives

doc/radosgw: add confval directives

Add confval directives to the documentation of "quota cache" options.
This addresses a request made by Antony D'Atri in https://github.com/ceph/ceph/pull/55075/files#r1444006246.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6504732e1b5b34756a119bc1547d22c07bd6458a)

Merge pull request #55482 from zdover23/wip-doc-2024-02-08-backport-55476-to-reef

reef: doc/cephadm - edit t11ing.

Merge pull request #55454 from guits/node-proxy-subthread-bkp-reef

reef: node-proxy: refactor entrypoint (backport)

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #55460 from zdover23/wip-doc-2024-02-06-backport-55447-to-reef

reef: doc/rados: update PG guidance

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm - edit t11ing.

Edit "Running Repeated Debugging Sessions" in
doc/cephadm/troubleshooting.rst. Improve grammar. Fix a misspelling.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f5b8afe981650f5072294303b0e488b91fc65fe8)

ceph-volume: fix zap_partitions() in devices.lvm.zap

The current logic is unable to find the holders for the
partition being zapped.

This commit fixes this issue.

Fixes: https://tracker.ceph.com/issues/64248
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 36c83bf5424308214228b1c86d8e1d215b8519c5)

librbd: return ENOENT from Snapshot::get_timestamp for nonexistent snap_id

Fixes: https://tracker.ceph.com/issues/47287
Signed-off-by: John Agombar <agombar@uk.ibm.com>
(cherry picked from commit 2a2d3d4c6b38a917f465680e9321e810426555ea)

Merge pull request #55290 from ceph/revert-54865-wip-63782-reef

Revert "reef: qa: add support/qa for cephfs-shell on CentOS 9 / RHEL9"

Reviewed-by: Milind Changire <mchangir@redhat.com>

doc/rados: update PG guidance

Update the "Creating a Pool" section of doc/rados/operations/pools.rst
so that the documentation no longer insists that the user change the
values of "osd_pool_default_pg_num" and "osd_pool_default_pgp_num".

See also: https://github.com/ceph/ceph/pull/55419

Tracker: https://tracker.ceph.com/issues/64259

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5ad241442d2c141ba508faba61f39d70f3f09679)

Revert "reef: qa: add support/qa for cephfs-shell on CentOS 9 / RHEL9"

Signed-off-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55237 from joscollin/wip-64073-reef

reef: pybind/mgr/mirroring: drop mon_host from peer_list

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55208 from mchangir/wip-62842-reef

reef: mgr/snap_schedule: add support for monthly snapshots

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55057 from vshankar/wip-63922-reef

reef: mds: change priority of mds rss perf counter to useful

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #55002 from leonid-s-usov/bp/renameat2/reef

reef: client/fuse: handle case of renameat2 with non-zero flags

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #54911 from lxbsz/wip-63809

reef: mds: set the loner to true for LOCK_EXCL_XSYN

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #54899 from neesingh-rh/wip-63810-reef

reef: mds: scrub repair does not clear earlier damage health status

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #54895 from mchangir/wip-63416-reef

reef: mds: do not simplify fragset

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #54766 from vshankar/wip-53418-reef

reef: qa: use exisitng ignorelist override list for fs:mirror[-ha]

Reviewed by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #54716 from batrick/wip-63676-reef

reef: mds: revert standby-replay trimming changes

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #54714 from mchangir/wip-63575-reef

reef: qa: use correct imports to resolve fuse_mount and kernel_mount

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #54493 from leonid-s-usov/bp/balance-after-stop/reef

reef: mds/MDBalancer: ignore queued callbacks if MDS is not active

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #54466 from lxbsz/wip-63273

reef: client: queue a delay cap flushing if there are ditry caps/snapcaps

Reviewed-by: Milind Changire <mchangir@redhat.com>

node-proxy: refactor entrypoint

This commit introduces a major refactor of the main
entrypoint.

- subclass threading.Thread:
  - Introduce a new class `BaseThread()` that is a
    `threading.Thread()` abstraction class in order
    to monitor the different threads.
  - `BaseSystem()` inherits from `BaseThread()`.
  - Handle `SIGTERM` signal in order to gracefully shutdown
    node-proxy (make threads exit gracefully, log out from RedFish API, etc.)

Additionally, this:
  - drops the class `Logger()` from util.py which
was not adding value. It is now replaced with a simple `get_logger()`
function.
  - changes the node-proxy API port from 8080 to 9456
    (8080 being widely used for frontend apps...)
  - changes the container entrypoint in order to use the
    `ceph-node-proxy` binary from the packaging

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit ebf05d5d6cf0532d321a668a4444d2069f995d4a)

Merge pull request #54404 from joscollin/wip-63474-reef

reef: client: call _getattr() for -ENODATA returned _getvxattr() calls

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #53359 from k0ste/wip-62004-reef

reef: client: readdir_r_cb: get rstat for dir only if using rbytes for size

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #55445 from zdover23/wip-doc-2024-02-05-backport-55434-to-reef

reef: src/common/options: Correct typo in rgw.yaml.in

src/common/options: Correct typo in rgw.yaml.in

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 1796022aa4778226c2d7e04c1cb989ab9d025272)

Merge pull request #55438 from zdover23/wip-doc-2024-02-04-backport-55419-to-reef

reef: doc/rados: update config for autoscaler

doc/rados: update config for autoscaler

Update doc/rados/configuration/pool-pg-config-ref.rst to account for the
behavior of autoscaler.

Previously, this file was last meaningfully altered in 2013, prior to
the invention of autoscaler. A recent confusion was brought to my
attention on the Ceph Slack whereby a user attempted to alter the
default values of a Quincy cluster, as suggested in this documentation.
That alteration caused Ceph to throw the error "Error ERANGE: 'pgp_num'
must be greater than 0 and lower or equal than 'pg_num', which in this
case is one" and a related "rgw_init_ioctx ERROR" reading in part
"Numerical result out of range". The user removed the
"osd_pool_default_pgp_num" configuration line from ceph.conf and the
cluster worked as expected. I presume that this is because the removal
of this configuration line allowed autoscaler to work as intended.

Fixes: https://tracker.ceph.com/issues/64259
Co-authored-by: David Orman <ormandj@corenode.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4dc12092be584da44baca14e31ca33231164235f)