Merge pull request #58371 from zdover23/wip-doc-2024-07-01-backport-58366-to-reef

reef: doc/cephfs: update cephfs-shell link

Merge pull request #58364 from zdover23/wip-doc-2024-07-01-backport-55577-to-reef

reef: doc/start: fix wording & syntax

doc/cephfs: update cephfs-shell link

Repair the link to cephfs-shell.rst in doc/cephfs/cephfs-shell.rst that
was broken in https://github.com/ceph/ceph/pull/41165/ when
doc/cephfs/cephfs-shell.rst was moved to doc/man/8/cephfs-shell.rst.

This commit is made in response to a request by Lander Duncan that was
made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4f8903cf80a94596a1b17b4a07affb874f21ae76)

Merge pull request #58113 from vshankar/wip-66518-reef

reef: qa: use centos9 for fs:upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/start: fix wording & syntax

Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>
(cherry picked from commit a8b27af84910d324023a37e616f42d6d3faa4ecf)

Merge pull request #58360 from zdover23/wip-doc-2024-06-30-backport-58358-to-reef

reef: doc/cephfs: take Anthony's suggestion

doc/cephfs: take Anthony's suggestion

Incorporate Anthony's suggestion in
https://github.com/ceph/ceph/pull/57567#discussion_r1607016050 into
doc/cephfs/fs-volumes.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7a78dda0a92339db27359f91f0cb081703e2e7f9)

qa/cephfs: fs:upgrade:mds_upgrade_sequence uses centos9

Signed-off-by: Venky Shankar <vshankar@redhat.com>

qa: upgrade sub-suite upgraded_client from from n-1|n-2 releases

... and move to centos9.

Fixes: https://tracker.ceph.com/issues/65580
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 76589659480c6e9cd2ad09b3be21deeb6d1686d1)

 Conflicts:
qa/suites/fs/upgrade/upgraded_client/tasks/0-from/nautilus.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/0-install.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/0-install/quincy.yaml

qa: upgrade sub-suite nofs from n-1 and n-2 releases

also adjust the respective upgrade YAMLs and move to
centos9.

For reef release, start upgrade from pacific/quincy.

Fixes: https://tracker.ceph.com/issues/65580
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit f00a69f714dd07d580731a326aff41cacca6d0b6)

qa: use supported releases for featureful_client

... and switch for centos9.

For reef release, start upgrade from pacific/quincy.

Fixes: https://tracker.ceph.com/issues/65580
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 3715ce671de97530dda30d59fe643cebc3ebc508)

qa: refactor client upgrade yamls and other minor touchups

* start testing new_ops and stress_tests with both the drivers(i.e. fuse and kclient)
therefore moved 0-clients/ from tasks/3-workload/new_ops/ to tasks/ and renamed it to
2-clients/

* since new_ops/ and stress_tests/ now share the common upgrade yaml, moved the
tests yamls(in stress_tests/1-tests) directly under 3-workload/stress_tests/

* renamed 1-client-sanity.yaml in new_ops/ to newops.yaml

Fixes: https://tracker.ceph.com/issues/62953
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
(cherry picked from commit c556c7324763332df62f4d382da02314900f1a60)

 Conflicts:
qa/suites/fs/upgrade/upgraded_client/tasks/2-clients/fuse-upgrade.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-clients/kclient.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/new_ops/0-clients/fuse-upgrade.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/new_ops/0-clients/kclient.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/new_ops/1-client-sanity.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/new_ops/newops.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/1-tests/blogbench.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/1-tests/dbench.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/1-tests/fsstress.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/1-tests/iozone.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/1-tests/kernel_untar_build.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/blogbench.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/dbench.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/fsstress.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/iozone.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/2-workload/stress_tests/kernel_untar_build.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/new_ops/0-clients/kclient.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/new_ops/1-client-sanity.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/1-tests/blogbench.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/1-tests/dbench.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/1-tests/fsstress.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/1-tests/iozone.yaml
qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/1-tests/kernel_untar_build.yaml
qa/suites/rbd/device/workloads/.qa

Merge pull request #58308 from zdover23/wip-doc-2024-06-27-backport-58287-to-reef

reef: doc/rados: update how to install c++ header files

Merge pull request #58305 from zdover23/wip-doc-2024-06-27-backport-58299-to-reef

reef: doc/dev: Fix typos in encoding.rst

doc/rados: update how to install c++ header files

In this example librados2-devel only install C header files on fedora 40,
therefore I added libradospp-devel to the command to include C++ header files.

Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 7e87441601db2379488fab62e900cd834086f26d)

doc/dev: Fix typos in encoding.rst

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 9f43c67a639958a13fef198ffe62cf5241f1f53c)

Merge pull request #58272 from zdover23/wip-doc-2024-06-26-backport-58226-to-reef

reef: doc/rados: edit troubleshooting-osd.rst

doc/rados: edit troubleshooting-osd.rst

Make minor changes to the "Debugging Slow Requests" section of
doc/rados/troubleshooting/troubleshooting-osd.rst in preparation
for an expansion of this section in response to a reqeust from Joel
Davidow.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8b211b9c7f9b173bb12028eb7108d13867883d6e)

Merge pull request #58258 from zdover23/wip-doc-2024-06-25-backport-58243-to-reef

reef: doc/rados: credit Prashant for a procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: credit Prashant for a procedure

Credit Prashant D for creating the stretch-mode workaround procedure for
retrieving the correct size of datacenters.

Follows: https://github.com/ceph/ceph/pull/58109

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e777cb4f8bd682b807b97074f930826aa902db9)

Merge pull request #58203 from zdover23/wip-doc-2024-06-23-backport-58200-to-reef

reef: doc/start: add links to Beginner's Guide

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/start: add links to Beginner's Guide

Add two links to Sage Weil's overview talks about Ceph.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 785020f212504cdbf374e0d3ca843fd92309de98)

Merge pull request #58190 from zdover23/wip-doc-2024-06-21-backport-55675-to-reef

reef: doc/src: invadvisable is not a word

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58182 from zdover23/wip-doc-2024-06-21-backport-58109-to-reef

reef: doc/rados: add stretch_rule workaround

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58162 from zdover23/wip-doc-2024-06-20-backport-57156-to-reef

reef: doc/rados: followup to PR#58057

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58188 from zdover23/wip-doc-2024-06-21-backport-58112-to-reef

reef: doc/rbd: fix typos in NVMe-oF docs.

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58170 from idryomov/wip-qemu-task-version-reef

reef: qa/tasks/qemu: Fix OS version comparison

Reviewed-by: Ramana Raja <rraja@redhat.com>

doc/src: invadvisable is not a word

changed to inadvisable on line 4997

Signed-off-by: Doug Whitfield <douglasawh@gmail.com>
(cherry picked from commit fb4a5d09e11b75a2f38c42c489af7e6f148916a7)

doc/rbd: fix typos in NVMe-oF docs.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 0cd415c53b49b2e9168df488340dab91d4c6badc)

doc/rados: add stretch_rule workaround

Add a method for defining a CRUSH rule that returns the actual value of
the total available size.

Fixes: https://tracker.ceph.com/issues/56650
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 007385a3ef05bd92e006fc7d6aba3fbb51792ef7)

Merge pull request #57472 from guits/wip-66020-reef

reef: ceph-volume: use os.makedirs for mkdir_p

qa/tasks/qemu: Fix OS version comparison

See: https://sentry.ceph.com/share/issue/21ed88d705854238bdafbf6711e795ee/
They're strings, not floats.
This surfaced as a result of https://github.com/ceph/teuthology/pull/1953

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 260a45a03148ba4d2bbfcac9485bcf9a8743cade)

Merge pull request #58005 from zdover23/wip-doc-2024-06-13-backport-57650-to-reef

reef: ceph-volume: use importlib from stdlib on Python 3.8 and up

doc/rados: followup to PR#58057

Incorporate Anthony D'Atri's suggestions in
https://github.com/ceph/ceph/pull/58057

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e999a26ef2d3c12d81bd54c187a6225a5fcd7a6)

Merge pull request #58137 from petrutlucian94/wip-66546-reef

reef: ceph_test_rados_api_misc: adjust LibRadosMiscConnectFailure.ConnectTimeout timeout

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #56929 from adk3798/wip-65512-reef

reef: mgr/dashboard: fix duplicate grafana panels when on mgr failover

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #58131 from zdover23/wip-doc-2024-06-19-backport-58123-to-reef

reef: doc: clarify availability vs integrity

ceph_test_rados_api_misc: adjust LibRadosMiscConnectFailure.ConnectTimeout timeout

The test sets a 2 second connection timeout and asserts that the
attempt takes less than 4 seconds.

Under load, the asserted timeout can be exceeded. In particular,
this affects the Windows CI job, which uses a VM with a reduced
amount of resources.

    [ RUN      ] LibRadosMiscConnectFailure.ConnectTimeout
    /home/ubuntu/ceph/src/test/librados/misc.cc:87: Failure
    Expected: (dur) < (utime_t(4, 0)), actual: 5.987712 vs 4.000000

We'll adjust the timeouts, using a 5s configured timeout, asserting
that the connection attempt doesn't take more than 15s.

Fixes: https://tracker.ceph.com/issues/66534
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 3a2b4a58898477ae9f62b506bd5be56ff9abacf0)

doc: clarify availability vs integrity

(cherry picked from commit 3888cf77075eceb079b1d5a8ce19092d12fd82bd)

mgr/dashboard: fix duplicate grafana panels when on mgr failover

Fixes: https://tracker.ceph.com/issues/64970
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit e6ff23d1297cbcf5da030178c53e14a6b6ce5f43)

Conflicts:
src/pybind/mgr/cephadm/templates/services/prometheus/prometheus.yml.j2
src/pybind/mgr/cephadm/tests/test_services.py

Merge pull request #55857 from lxbsz/wip-64655

reef: qa: switch to use the merge fragment for fscrypt

Reviewed-by: Jos Collin <jcollin@redhat.com>

qa: switch to use the merge fragment for fscrypt

Currently only the upstream kclient supports fscrypt feature.

Fixes: https://tracker.ceph.com/issues/59195
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 04fab9b5f967eab51beef5429e2b6317909bde38)

qa: switch to use .qa/cephfs/mount/ instead

Fixes: https://tracker.ceph.com/issues/59195
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit e7272e7a7e46909e07d862e3c72375fe25de7bc6)

qa: remove the FuseMount/KernelMount check in test_fscrypt.py

Will use the postmerge fragment to check this.

Fixes: https://tracker.ceph.com/issues/59195
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit f52f1316b7a254d57b4ebbc844910a1dacb3174f)

Merge pull request #53628 from lxbsz/wip-62866

reef: qa: increase the http postBuffer size and disable sslVerify

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56415 from batrick/wip-65088-reef

reef: qa/cephfs: add mgr debugging

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57162 from batrick/i63782-v2

reef: qa: add support/qa for cephfs-shell on CentOS 9 / RHEL9

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56666 from batrick/wip-65105-reef

reef: qa/cephfs: add probabilistic ignorelist for pg_health

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56664 from batrick/wip-65274-reef

reef:  mds: some request errors come from errno.h rather than fs_types.h

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56886 from dparmar18/wip-65315-reef

reef: mds: CInode::item_caps used in two different lists

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56955 from batrick/wip-65325-reef

reef: client: log debug message when requesting unmount

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #56953 from batrick/wip-65365-reef

reef: qa: test test_kill_mdstable for all mount types

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56836 from rishabh-d-dave/wip-65440-reef

reef: qa/cephfs: CephFSTestCase.create_client() must keyring

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56895 from chrisphoffman/wip-65488-reef

reef: mds: Add fragment to scrub

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57834 from rishabh-d-dave/wip-65921-reef

reef: mds: don't add counters in warning for standby-replay MDS

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56747 from lxbsz/wip-65321

 reef: mds: defer trim() until after the last cache_rejoin ack being received

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56701 from joscollin/wip-65319-reef

reef: cephfs-mirror: use monotonic clock

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>

mds: defer trim() until after the last cache_rejoin ack being received

Just before the last cache_rejoin ack being received the entire
subtree, together with the inode subtree root belongs to, were
trimmed the isolated_inodes list couldn't be correctly erased. We
should defer calling the trim() until the last cache_rejoin ack
being received.

Fixes: https://tracker.ceph.com/issues/62036
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit dd783803f44d8cc424fdf33fef0a6a9203be3447)

Merge pull request #58106 from zdover23/wip-doc-2024-06-18-backport-58901-to-reef

reef: doc/dev: link to ceph.io leads list

Merge pull request #56019 from vshankar/wip-64756-reef

reef: qa: ignore container checkpoint/restore related selinux denials for centos9

Reviewed-by: Jos Collin <jcollin@redhat.com>

doc/dev: link to ceph.io leads list

Remove the docs.ceph.com list of team leads, and link to the list of
leads on ceph.io.

Fixes: https://tracker.ceph.com/issues/66392
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5134aeb78bb1d9d956442333ad372e1f397ff7b3)

Merge pull request #57437 from joscollin/wip-65980-reef

reef: cephfs_mirror: increment sync_failures when sync_perms() and sync_snaps() fails

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #57441 from joscollin/wip-65983-reef

reef: mgr/stats: initialize mx_last_updated in FSPerfStats

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #57763 from joscollin/wip-66271-reef

reef: pybind/mgr/mirroring: Fix KeyError: 'directory_count' in daemon status

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #57115 from lxbsz/wip-65676

reef: mds: fix the description for inotable testing only options

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

Merge pull request #57227 from kotreshhr/wip-65405-reef

reef: mds: log at a lower level when stopping

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56403 from batrick/wip-65061-reef

reef: qa/cephfs: ignorelist clog of MDS_UP_LESS_THAN_MAX

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56022 from vshankar/wip-64763-reef

reef: qa/cephfs: add more ignorelist entries

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #55391 from dparmar18/wip-64066-reef

reef: qa: fix error reporting string in assert_cluster_log

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #52985 from leonid-s-usov/backport/strip-nofail/reef

reef: nofail option in fstab not supported

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #56951 from batrick/wip-65520-reef

reef: qa: ignore human-friendly POOL_APP_NOT_ENABLED in clog

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57172 from batrick/wip-65707-reef

reef: qa: increase debugging for snap_schedule

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57174 from batrick/wip-65709-reef

reef: client: clear resend_mds only after sending request

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57446 from mchangir/wip-65898-reef

reef: mgr/snap_schedule: restore yearly spec to lowercase y

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57557 from lxbsz/wip-66053

reef: qa/fsx: use a specified sha1 to build the xfstest-dev

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #57837 from rishabh-d-dave/wip-65927-reef

reef: mon,cephfs: require confirmation flag to bring down unhealthy MDS

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #58076 from idryomov/wip-cephadm-flake8-fix-reef

reef: mgr/cephadm: fix flake8 test failures

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/cephadm: fix flake8 test failures

after a recent update on flake8, some tests in cephadm started failing
```
flake8: commands[0]> flake8 --config=tox.ini alerts balancer cephadm cli_api crash devicehealth diskprediction_local hello iostat localpool nfs orchestrator prometheus rbd_support rgw selftest smb
cephadm/configchecks.py:94:6: E204 whitespace after decorator '@'
cephadm/module.py:3017:10: E204 whitespace after decorator '@'
cephadm/module.py:3344:144: E226 missing whitespace around arithmetic operator
cephadm/tests/test_cephadm.py:982:6: E204 whitespace after decorator '@'
3     E204 whitespace after decorator '@'
1     E226 missing whitespace around arithmetic operator
```

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit a9563d91c2ac405ae9101bd4e63fa9b749d54432)

Merge pull request #58060 from zdover23/wip-doc-2024-06-16-backport-58057-to-reef

reef: doc/rados: explain replaceable parts of command

doc/rados: explain replaceable parts of command

Add an explanation that directs the reader to replace the "X" part of
the command "ceph tell mon.X mon_status" with the value specific to the
reader's Ceph cluster (which is (probably) not "X").

In the future, such replaceable strings in commands may be bounded by
angle brackets ("<" and ">").

This improvement to the documentation was suggested on the [ceph-users]
email list by Joel Davidow. This email, an absolute model of user
engagement with an upstream project, can be reviewed here:
https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/KF67F5TXFSSTPXV7EKL6JKLA5KZQDLDQ/

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d071ad2575c86f300a9ba39df3c4949e5dc9c47d)

ceph-volume: fix regression

This fixes a regression introduced by: 24f8e5c61b19deab7397b0237f8376c6c03a5dcb

`iter_entry_points` from `pkg_resources` takes one argument whereas
`entry_points` from `importlib.metadata` does not.

The call to `entry_points(group=group)` makes ceph-volume fail.

Fixes: https://tracker.ceph.com/issues/66328
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 6e3b0b93055538cad234018ef8700bfacec03076)

Merge pull request #57994 from ljflores/wip-66450-reef

reef: mgr/k8sevents: update V1Events to CoreV1Events

Merge pull request #58050 from zdover23/wip-doc-2024-06-14-backport-58007-to-reef

reef: doc/rados: add pg-states and pg-concepts to tree

doc/rados: add pg-states and pg-concepts to tree

Add "pg-states" and "pg-concepts" to the left tree pane on
docs.ceph.com.

This commit has been made in response to a request from the upstream
made in https://pad.ceph.com/p/Report_Documentation_Bugs.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0629f47faf73a5b88adbeceaf022ee23111bae7d)

ceph-volume: use importlib from stdlib on Python 3.8 and up

since packaging was apparently removed from pkg_resources, let's use
importlib.metadata when it is available and pkg_resources on older
Python versions.

Refs https://tracker.ceph.com/issues/66201
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 24f8e5c61b19deab7397b0237f8376c6c03a5dcb)

mgr/k8sevents: update V1Events to CoreV1Events

centos9 only provides kubernetes 26.1.0 as base dep and hence the
k8sevents code needs to be updated accordingly. the api changes happened
in kuberenetes while 19.0.0 was released

Fixes: https://tracker.ceph.com/issues/65627
Fixes: https://tracker.ceph.com/issues/64981
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 6af964719217d720e6c2fd1ba2a607f6255d2604)

Merge pull request #57983 from zdover23/wip-doc-2024-06-12-backport-57976-to-reef

reef: doc/glossary: Add "S3"

qa/cephfs: set joinable on FS before exiting tests in TestFSFail

After running TestFSFail, CephFSTestCase.tearDown() fails attempting
to unmount CephFS. Set joinable on FS and wait for the MDS to be up
before exiting the test. This will ensure that unmounting is
successful in teardown.

Fixes: https://tracker.ceph.com/issues/65841
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit faa30e03f31551a71ebb8330dbbe7005d9ddd559)

qa/cephfs: pass MDS name, not FS name, to "ceph mds fail" cmd

This issue was not caught in original QA run because "ceph mds fail"
returns 0 even though MDS name received by it in argument is
non-existent. This is done for the sake of idempotency, however it
caused this bug to go uncaught.

Fixea: https://tracker.ceph.com/issues/65864
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit ab643f7a501797634a366fd29bf4acef6a8f0cf2)

qa/cephfs: add tests failing MDS and FS when MDS is unhealthy

Add tests to verify that the confirmation flag is mandatory for running
commands "ceph mds fail" and "ceph fs fail" when MDS has one of the two
health warnings: MDS_CACHE_OVERSIZE or MDS_TRIM.

Also, add MDS_CACHE_OVERSIZE and MDS_TRIM to ignorelist for
test_admin.py so that QA jobs knows this an expected failure.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 214d614309a75fe9926d1a46be5b184c7cd0cbc1)

qa/cephfs: pass confirmation flag to fs fail in tear down code

Since "ceph fs fail" command now requires the confirmation flag when
Ceph cluster has either health warning MDS_TRIM or MDS_CACHE_OVERSIZE,
update tear down in QA code. During the teardown, the CephFS should be
failed, regardless of whether or not Ceph cluster has health warnings,
since it is teardown.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit a1af1bf538a20ae7d021098f5787534ce61dbd7c)

PendingReleaseNotes: note need of confirmation for "ceph fs fail"

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 24816428e65069fe84bef22f5e134bb1b651ef52)

doc/cephfs: mention need of confirmation for "ceph fs fail"

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit de18c5a1cc0c20be9cd1dc153d008828b5eadc9b)

cephfs,mon: require confirmation to fail unhealthy FS

Confirmation flag must be passed when running the command "ceph fs fail"
when the MDS for this FS has either of the two health warnings: MDS_TRIM
or MDS_CACHE_OVERSIZED. Else, the command will fail and print an
appropriate error message.

Restarting an MDS with these health warnings is not recommened since it
will have a slow recovery during restart which will create new problems.

Fixes: https://tracker.ceph.com/issues/61866
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit b901616494a8359e59f7ec2cd661077c4aced01c)

Conflicts:
- src/mon/FSCommands.cc
  -  lines surrounding the patch are different in reef compared to main.
     the reef code was still accessing "mds_map" directly instead of
     accessing it using "get_mds_map()".
  - return value of get_filesystem() is different in main.

doc/glossary: Add "S3"

Add "S3" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit be6d0645c40431e8312244019c0331e4076bd5f2)

Merge pull request #57959 from zdover23/wip-doc-2024-06-11-backport-57957-to-reef

reef: doc/rados: improve leader/peon monitor explanation

doc/rados: improve leader/peon monitor explanation

Add an explanation of leader-peon conditions that obtain when the
cluster is in the "HEALTH_OK" state. Previously, the text discussed
these two monitor states only in the context of a health detail entry.

This improvement to the documentation was suggested on the [ceph-users]
email list by Joel Davidow. This email, an absolute model of user
engagement with an upstream project, can be reviewed here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/KF67F5TXFSSTPXV7EKL6JKLA5KZQDLDQ/

I will list Joel Davidow here as the co-author for the sake of more
expediently getting this change into the documentation, but though he is
listed as the co-author, he is the true author.

Co-authored-by: Joel Davidow <jdavidow@nso.edu>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6fb9a5ef817eda5184d51ebcb425a6091ca82299)

Merge pull request #57949 from zdover23/wip-doc-2024-06-10-backport-57947-to-reef

reef: doc/start: remove "intro.rst"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>

doc/start: remove "intro.rst"

Remove "start/intro.rst", which has been renamed "start/index.rst" in
order to follow the conventions followed elsewhere in the documentation.

Follows https://github.com/ceph/ceph/pull/57900.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 74cc624d002e51769da37c04b3bdc32e0077d370)

Merge pull request #57937 from zdover23/wip-doc-2024-06-08-backport-57923-to-reef

reef: doc/src: add inline literals (``) to variables

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>