qa: typo fix when checking for perf counter - s/md_thresh_evicted/mdthresh_evicted

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 5856a1e6b72dc77d3b4d9109385481b924e4fe36)

qa: lower mds_session_metadata_threshold for tests

... and increase the number of files that are created so as to
hit the threshold with a high probability.

Fixes: http://tracker.ceph.com/issues/62873
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 92200d9d10d30ed35f640fd1120be65577a3ce64)

PendingReleaseNotes: add a note for `mds_session_metadata_threshold` mds config

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit ac3ab1a203ad65c7db07bc2c02acb5620800fb25)

test: add test to verify that a buggy client is blocklisted

... when its session metadata is bloated due to buildup of
`completed_requests`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 84df4b3d0c9e767a74cf5af80e8138239992df2c)

mds: add perf counter to track number of sessions evicted due to metadata threshold being exceeded

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 59dd587ddb3bc95a95d0fb8715511d194181ec6f)

mds: blocklist clients with "bloated" session metadata

Buggy clients (or maybe a MDS bug) causes a huge buildup of
`completed_requests` metadata in its session information.
This could cause the MDS to go read-only when its flushing
session metadata to the journal since the bloated metadata
causes the ODSOp payload to exceed the maximum write size.

Blocklist such clients so as to allow the MDS to continue
servicing requests.

Fixes: http://tracker.ceph.com/issues/61947
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit bc6814d72a9fbec9c41ed75aee2314666cfca34b)

 Conflicts:
src/common/options/mds.yaml.in
src/mds/MDSRank.cc

Straight-forward conflicts due to missing configs.

Merge pull request #53303 from rhcs-dashboard/wip-62718-quincy

quincy: mgr/dashboard: remove used and total used columns in favor of usage bar

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #53318 from zdover23/wip-doc-2023-09-07-backport-53300-to-quincy

quincy: doc/rados: add bulk flag to pools.rst

Merge pull request #53316 from zdover23/wip-doc-2023-09-07-backport-53314-to-quincy

quincy: doc/man: radosgw-admin.rst typo

doc/rados: add bulk flag to pools.rst

Add a link in pools.rst to the section in placement-groups.rst
describing the commands used to manage pools that are flagged "--bulk".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 31f1224f611b560af7c42131ef38f0aa6dcdffb3)

doc/man: radosgw-admin.rst typo

Edit the text in the "bucket radoslist" entry.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fb808732e8c8f9b64a443aa3ea30a677b1347be3)

Merge pull request #53313 from zdover23/wip-doc-2023-09-07-backport-53302-to-quincy

quincy: doc/man: remove docs about support for unix domain sockets

doc/man: remove docs about support for unix domain sockets

doc/man: support for unix domain sockets is not implemented, hence we
removed documentation about it.

(Note: the changes in this commit were the work of Rok Jaklič in
https://github.com/ceph/ceph/pull/48537. This pull request has been
raised because that pull request was for some mysterious reason causing
merge conflicts that were never resolved.)

Co-authored-by: Rok Jaklič rjaklic@gmail.com
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fa40b7ef560fc60a107dad1604650e0bcf27e77e)

mgr/dashboard: remove used and total used columns in favor of usage bar

Fixes: https://tracker.ceph.com/issues/62697
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 802410d4b15c63e756c31672816ef8985341b47c)

Merge pull request #50974 from mchangir/wip-59201-quincy

quincy: qa: add subvolume option flavors

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #53253 from rhcs-dashboard/wip-62656-quincy

quincy: mgr/dashboard: fix image columns naming

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #53268 from zdover23/wip-doc-2023-09-04-backport-53264-to-quincy

quincy: doc/man/8: improve radosgw-admin.rst

doc/man/8: improve radosgw-admin.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit d986537f9b06e7e848b9624718a2eda21bb54f70)

Merge pull request #53262 from zdover23/wip-doc-2023-09-03-backport-50360-to-quincy

quincy: doc/radosgw: multisite - edit "migrating a single-site"

doc/radosgw: multisite - edit "migrating a single-site"
Add the import step of the section "Migrating a Single-Site Deployment to Multi-Site"
in doc/radosgw/multisite.rst. The field "name" and "api_name" should be matched.

Signed-off-by: Qi Tao <tgfree7@gmail.com>
(cherry picked from commit 579c14055d202429ad25a469c30a3d68e0329391)

Merge pull request #53259 from zdover23/wip-doc-2023-09-02-backport-53247-to-quincy

quincy: doc/README.md - improve "Running a test cluster"

doc/README.md - improve "Running a test cluster"

Improve the English in the section "Running a test cluster in the
ceph/README.md file.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 420ecc7addaad1969cb634289c2399ea38ea9a90)

mgr/dashboard: fix image columns naming

Fixes: https://tracker.ceph.com/issues/62551
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 338bb5c8a46e2a84fd139c392302e7ff846d3ef8)

Merge pull request #53225 from rhcs-dashboard/wip-62599-quincy

quincy: mgr/dashboard: n/a entries behind primary snapshot mode

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #53226 from zdover23/wip-doc-2023-08-30-backport-53213-to-quincy

quincy: doc/cephadm: edit "Adding Hosts" in install.rst

doc/cephadm: edit "Adding Hosts" in install.rst

Edit the English in the "Adding Hosts" section of
doc/cephadm/install.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f0df9e1ea95362b28ca516e3a2efaab6365de5ea)

mgr/dashboard: n/a entries behind primary snapshot mode

Fixes: https://tracker.ceph.com/issues/62576
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 6066e37ad3c6bc43c3e5e4313a89265007e7d0d8)

Merge pull request #53216 from rhcs-dashboard/wip-62633-quincy

quincy: mgr/dashboard: fix rgw page issues when hostname not resolvable

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

mgr/dashboard: fix rgw page issues when hostname not resolvable

Fixes: https://tracker.ceph.com/issues/62396
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 78cfeb6372707ec3f997d28ad617367feb3a983e)

 Conflicts:
src/pybind/mgr/dashboard/services/rgw_client.py
  - only keep the CephService import

Merge pull request #52706 from rhcs-dashboard/wip-62239-quincy

quincy: mgr/dashboard: allow PUT in CORS

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #51867 from rhcs-dashboard/wip-61492-quincy

quincy: mgr/dashboard: fix the rgw roles page

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #53203 from rhcs-dashboard/wip-62619-quincy

quincy: mgr/dashboard: set CORS header for unauthorized access

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

mgr/dashboard: add more e2e for cephx users

Fixes: https://tracker.ceph.com/issues/61421
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 6bac361b54eb6233b04dfb34c62086a9d3df3c43)

mgr/dashboard: allow CORS for unauthorized access

Fixes: https://tracker.ceph.com/issues/62612
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 8158bdab7134714dc2a9f155e599cc2838c3358d)

Merge pull request #53200 from zdover23/wip-doc-2023-08-29-backport-53198-to-quincy

quincy: doc/cephadm: add ssh note to install.rst

doc/cephadm: add ssh note to install.rst

Add a note instructing the reader to have ssh running before the
"cephadm bootstrap" command is run.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f10781a281ef6a00a69d45dd6b78f29fd219f049)

Merge pull request #52538 from cfsnyder/wip-62066-quincy

quincy: rgw: fix consistency bug with OLH objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #53174 from rhcs-dashboard/wip-62601-quincy

quincy: mgr/dashboard: disable protect if layering is not enabled on the image

Reviewed-by: Nizamudeen A <nia@redhat.com>

rgw: fix/improve test_rgw_versioning.py tests

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit aa1f40e80d78ce08a2f51dad6fadf620866d17a3)

Merge pull request #53180 from zdover23/wip-doc-2023-08-28-backport-53096-to-quincy

quincy: doc/start: edit os-recommendations.rst

doc/start: edit os-recommendations.rst

Improve the grammar in one sentence of the "Platforms" section of
doc/start/os-recommendations.rst. Improving that grammar involved
splitting the sentence into two sentences, but that's life. Update:
Anthony substantially rewrote this, so credit for this should rightly
go to him.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e19b9cea62c56cbd73049957d69d5aac16a97c08)

mgr/dashboard: disable protect if layering is not enabled on the image

Fixes: https://tracker.ceph.com/issues/62498
Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit 16e913f0ba3918732cfc9984f707379df65ac29a)

Merge pull request #53147 from zdover23/wip-doc-2023-08-25-backport-53125-to-quincy

quincy: doc: expand and consolidate mds placement

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #53165 from zdover23/wip-doc-2023-08-27-backport-53163-to-quincy

quincy: doc/cephadm: edit sentence in mgr.rst

doc/cephadm: edit sentence in mgr.rst

Improve the grammar in the first sentence of
doc/cephadm/services/mgr.rst. This is a small change, but I could not
resist.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3b8877481a8de0a92a7b68a775915eb079744f23)

doc: expand and consolidate mds placement

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 3a5f9dc37a72a83046a5749e42182322799e0306)

Merge pull request #52228 from batrick/wip-61691-quincy

quincy:  mon/MDSMonitor: batch last_metadata update with pending

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #53060 from zdover23/wip-doc-2023-08-21-backport-52963-to-quincy

quincy: doc/troubleshooting: edit cpu-profiling.rst

doc/troubleshooting: edit cpu-profiling.rst

Improve the language in the "oprofile" section of the RADOS
Troubleshooting Guide.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 513c436aefc3c0b2e7d784c5c00e744c255a95b1)

Merge pull request #52503 from lxbsz/wip-62010

quincy: client: wait rename to finish

Merge pull request #52498 from lxbsz/wip-62045

quincy: client: trigger to flush the buffer when making snapshot

Merge pull request #50991 from lxbsz/wip-59199

quincy: qa: enable kclient test for newop test

Merge pull request #53058 from zdover23/wip-doc-2023-08-20-backport-53055-to-quincy

quincy: doc/README.md - edit "Building Ceph"

doc/README.md - edit "Building Ceph"

Improve the "Building Ceph" section of ceph/README.md.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5bb3942365c4829f0b6580dec5d37e45f2e51e9d)

Merge pull request #53050 from zdover23/wip-doc-2023-08-18-backport-53035-to-quincy

quincy: doc: edit README.md - contributing code

doc: edit README.md - contributing code

Edit the "Contributing Code" section of the "ceph/README.md" file.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9433a3e62f7453926e4be2512639f94beb887a4c)

Merge pull request #52516 from neesingh-rh/wip-61988-quincy

quincy: mds: session ls command appears twice in command listing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52514 from joscollin/wip-62056-quincy

quincy: mds: MDLog::_recovery_thread: handle the errors gracefully

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52508 from lxbsz/wip-61985

quincy: client: force sending cap revoke ack always

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52502 from lxbsz/wip-62042

quincy: client: do not send metrics until the MDS rank is ready

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52303 from lxbsz/wip-61796

quincy: client: only wait for write MDS OPs when unmounting

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52245 from batrick/wip-59303-quincy

quincy: tools/cephfs: add basic detection/cleanup tool for dentry first damage

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52241 from batrick/wip-59558-quincy

quincy: qa: check each fs for health

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52236 from batrick/wip-59371-quincy

quincy: qa: wait for MDSMonitor tick to replace daemons

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52127 from joscollin/wip-61736-quincy

quincy: mds: display sane hex value (0x0) for empty feature bit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #52074 from joscollin/wip-61695-quincy

quincy: debian: install cephfs-mirror systemd unit files and man page

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #51697 from dparmar18/wip-61203-quincy

quincy: MDS imported_inodes metric is not updated.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #51690 from vshankar/tr-59722

quincy: qa: run scrub post file system recovery

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #51685 from lxbsz/wip-61348

quincy: mds: wait reintegrate to finish when unlinking

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #50922 from batrick/i59367

quincy: qa: test_rebuild_simple checks status on wrong file system

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #50815 from dparmar18/wip-59262-quincy

quincy: mds: fix stray evaluation using scrub and introduce new option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #50807 from dparmar18/wip-59250-quincy

quincy: mgr/nfs: disallow non-existent paths when creating export

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #50786 from vshankar/tr-59002

quincy: mgr/volumes: avoid returning -ESHUTDOWN back to cli

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #53025 from zdover23/wip-doc-2023-08-16-backport-51170-to-quincy

quincy: doc: Fix doc for mds cap acquisition throttle

doc: Fix doc for mds cap acquisition throttle

The config values picks the definition from the
description. Removed the duplicate description
in the doc.

Signed-off-by: Kotresh HR <khiremat@redhat.com>
(cherry picked from commit 65b0e45dd702fdedcf66f64dd6c5b8ae11df430b)

Merge pull request #53001 from zdover23/wip-doc-2023-08-16-backport-52991-to-quincy

quincy: doc: improve submodule update command - README.md

Merge pull request #52999 from zdover23/wip-doc-2023-08-15-backport-52761-to-quincy

quincy: doc/rados/configuration: Avoid repeating "support" in msgr2.rst

doc: improve submodule update command - README.md

Improve the portion of README.md that directs the reader to update the
submodules. Previously, the text assumed that the reader knew that they
should cd into the ceph directory. Now the text is explicit about the
necessity of this action.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 578fdb27a09c629003ab20c0d27267d4d97b5d6c)

doc/rados/configuration: Avoid repeating "support" in msgr2.rst

Instead of saying "[...] support is not supported"
change the first "support" to "operation".

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit df43ab5ba626c49aad6d3aca59c9737b06f8bfd8)

Merge pull request #52992 from idryomov/wip-62402-quincy

quincy: qa/suites/upgrade/octopus-x: skip TestClsRbd.mirror_snapshot test

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #52947 from zdover23/wip-doc-2023-08-11-backport-52945-to-quincy

quincy: doc: Add a note on possible deadlock on volume deletion

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>

Merge pull request #52968 from zdover23/wip-doc-2023-08-14-backport-52966-to-quincy

quincy: doc: update rados.cc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

qa/suites/upgrade/octopus-x: skip TestClsRbd.mirror_snapshot test

The behavior of the class method changed in reef; the change was
backported to pacific and quincy.  An octopus test binary used against
quincy OSDs produces an expected failure:

    [ RUN      ] TestClsRbd.mirror_snapshot
    .../15.2.17/rpm/el8/BUILD/ceph-15.2.17/src/test/cls_rbd/test_cls_rbd.cc:2279: Failure
    Expected equality of these values:
      -85
      mirror_image_snapshot_unlink_peer(&ioctx, oid, 1, "peer2")
        Which is: 0
    [  FAILED  ] TestClsRbd.mirror_snapshot (6 ms)

Fixes: https://tracker.ceph.com/issues/62402
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc: update rados.cc

Clarify a line in ceph/src/tools/rados/rados.cc.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 152a0fdc6858f95dadb6c86fbb2f626f4a608309)

Merge pull request #52959 from zdover23/wip-doc-2023-08-12-backport-52957-to-quincy

quincy: doc/rados: update monitoring-osd-pg.rst

doc/rados: update monitoring-osd-pg.rst

Ingest Anthony D'Atri's notes from
https://github.com/ceph/ceph/pull/50856#discussion_r1289532902
which should have been included earlier.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 73503d4e2665bee9c49a055c11be1ffe2db253a1)

Merge pull request #52917 from rhcs-dashboard/wip-62375-quincy

quincy: mgr/dashboard: paginate hosts

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #52256 from ronen-fr/wip-rf-59537-quincy

Quincy: osd/scrub: verify SnapMapper consistency

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #52161 from pdvian/wip-61569-quincy

quincy: mon: Fix ceph versions command

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #48171 from ifed01/wip-ifed-fix-blufs-unlink-fsync-qui

quincy: os/bluestore: do not signal deleted dirty file to bluefs log

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

Merge pull request #48279 from ifed01/wip-ifed-fix-57688

quincy: os/bluestore: use direct write in BlueStore::_write_bdev_label

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

doc: Add a note on possible deadlock on volume deletion

Fixes: https://tracker.ceph.com/issues/62407
Signed-off-by: Kotresh HR <khiremat@redhat.com>
(cherry picked from commit b93b3364ae00946b9eb1fa1406be0ee22e60baac)

Merge pull request #52079 from guits/wip-61699-quincy

quincy: ceph-volume: set lvm membership for mpath type devices

Merge pull request #52620 from guits/wip-62149-quincy

quincy: ceph-volume: fix raw list for lvm devices

Merge pull request #52929 from guits/wip-62037-quincy

quincy: ceph-volume: add --osd-id option to raw prepare

mgr/dashboard: invalidate rbd image cache on CRUD ops

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Fixes: https://tracker.ceph.com/issues/58710

mgr/dashboard: paginate hosts

Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
Fixes: https://tracker.ceph.com/issues/56513
(cherry picked from commit 720bb10e30bb7f686eb528d19c112bcf7ae7765c)

ceph-volume: add --osd-id option to raw prepare

This adds the support of the --osd-id option to the raw prepare command.

Fixes: https://tracker.ceph.com/issues/61995
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 16729656aa208deeedd631dcf871d501d6eba7f5)

Merge pull request #52642 from zdover23/wip-doc-2023-07-26-backport-52630-to-quincy

quincy: doc: update README.md

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #52913 from zdover23/wip-doc-2023-08-10-backport-52702-to-quincy

quincy: doc/start: update linking conventions