doc/cephadm: clean "Adv. OSD Service Specs"

Clean the English grammar and the .RST in the section "Advanced OSD
Service Specifications" in the file doc/cephadm/services/osd.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f6b56f9ee5d9f0b54dcaf1832d7a977895eb9c94)

Merge pull request #60645 from zdover23/wip-doc-2024-11-07-backport-60643-to-reef

reef: doc/cephadm: link to "host pattern" matching sect

doc/cephadm: link to "host pattern" matching sect

Link to the "Placement by Pattern Matching" section in
doc/cephadm/services/index.rst from the "Advanced OSD Service
Specifications" section in doc/cephadm/services/osd.rst.

Fixes: https://tracker.ceph.com/issues/68812
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit cdfa299a2511ee35dfe0a857702af6d3ba257efd)

Merge pull request #60638 from zdover23/wip-doc-2024-11-06-backport-56599-to-reef

reef: doc/cephadm: Update operations.rst

doc/cephadm: Update operations.rst

Fixed typo 'no' to 'not' in sentence "If this test fails, cephadm will
no be able to manage services on that host."

Signed-off-by: rhkelson <119636079+rhkelson@users.noreply.github.com>
(cherry picked from commit 34bc35a73443fa56908395a83ea2dd404a8fc4a6)

Merge pull request #60418 from cbodley/wip-63024-reef

reef: qa/rgw/sts: keycloak task installs java manually

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #59104 from YiteGu/wip-53048-reef

reef: os/bluestore: add some slow count for bluestore

Merge pull request #59048 from YiteGu/wip-some-blk-discard-path

reef: a series of optimizations for kerneldevice discard

Merge pull request #59043 from NitzanMordhai/wip-67351-reef

reef: Test: osd-recovery-space.sh extends the wait time for "recovery toofull"

Merge pull request #59629 from sseshasa/wip-66422-reef

reef: osd/scrub: Change scrub cost to average object size

Merge pull request #56475 from amathuria/wip-65141-reef

reef: osd: Change PG Deletion cost for mClock

Merge pull request #60594 from zdover23/wip-doc-2024-11-02-backport-60584-to-reef

reef: doc: s/Whereas,/Although/

doc: s/Whereas,/Although/

Change the subordinating conjunction "Whereas" followed by a comma to
the less grammatically-incorrect "Although". I've been meaning to do
this since 22 Mar 2023.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ea1a470fb4809d312f854e72fc5f8081cbcb2c49)

Merge pull request #58802 from ljflores/wip-67129-reef

reef: osd: bump versions of decoders for upmap-primary

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58741 from ifed01/wip-ifed-async-compact-reef

reef: os/bluestore: enable async manual compactions

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #58734 from pereman2/wip-67082-reef

reef: tools/objectstore: check for wrong coll open_collection

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58413 from ljflores/wip-66826-reef

reef: qa/suites/rados/thrash/workloads: remove cache tiering workload

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #58315 from cbodley/wip-66723

reef: build: Make boost_url a list

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #57588 from NitzanMordhai/wip-66137-reef

reef: osd: full-object read CRC mismatch due to 'truncate' modifying oi.size w/o clearing 'data_digest'

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58283 from pponnuvel/wip-66699-reef

reef: mgr/nfs: Don't crash ceph-mgr if NFS clusters are unavailable.

Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #57615 from sajibreadd/wip-66148-reef

reef: osd: fix for segmentation fault on OSD fast shutdown

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #57456 from badone/wip-tracker-59196-lazy-omap-regex-segfault-reef

reef: test/lazy-omap-stats: Convert to boost::regex

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #57241 from sajibreadd/wip-65356-reef

reef: os/bluestore: expand BlueFS log if available space is insufficient

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #55774 from ifed01/wip-ifed-no-death-tests-reef

reef: test/store_test: get rid off assert_death.

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #60538 from zdover23/wip-doc-2024-10-29-backport-60508-to-reef

reef: doc/rados: add blaum_roth coding guidance

Merge pull request #60526 from zdover23/wip-doc-2024-10-29-backport-60470-to-reef

reef: doc: explain the consequence of enabling mirroring through monitor co…

doc/rados: add blaum_roth coding guidance

Direct Ceph administrators using blaum_roth coding for erasure-coded
pools to change the default value of w=7 to a different value in order
to ensure that w+1 is prime.

This information was provided to the Ceph upstream by Benjamin Mare in
September of 2024.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6648d94aed5ff5643f50fcd4f3f07d97b846e885)

doc: explain the consequence of enabling mirroring through monitor commands

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit ed3ce72fbc0b097131945cbb39caa0831401b94a)

Merge pull request #60501 from zdover23/wip-doc-2024-10-26-backport-60444-to-reef

reef: doc/rados: standardize markup of "clean"

Merge pull request #60504 from zdover23/wip-doc-2024-10-26-backport-60434-to-reef

reef: doc/glossary: add "PLP" to glossary

doc/glossary: add "PLP" to glossary

Add "PLP" to the glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 599bdbf0a240ee718ed6da4104141b0f23330fbe)

Merge pull request #60468 from zdover23/wip-doc-2024-10-24-backport-60465-to-reef

reef: doc/cephfs: edit "Disabling Volumes Plugin"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: add doc for disabling mgr/volumes plugin

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 373910de34fc9e1d98218aed0361cd9bf3badffa)
(cherry picked from commit 8868ecc6ce70603986c0c59a6cc0d3d695dbecaa)

doc/rados: standardize markup of "clean"

Standardize the markup around the status "clean" in the documentation so
that readers don't mistakenly get the idea that inconsistent
presentation of the word "clean" implies a never-stated difference
between one instance and the other.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c8b4155d2d27228917d4be1f11514504100c55c7)

Merge pull request #60497 from zdover23/wip-doc-2024-10-26-backport-58647-to-reef

reef: doc/cephfs: add doc for disabling mgr/volumes plugin

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: add doc for disabling mgr/volumes plugin

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 373910de34fc9e1d98218aed0361cd9bf3badffa)

Merge pull request #60483 from zdover23/wip-doc-2024-10-25-backport-60480-to-reef

reef: doc/cephfs: use 'p' flag to set layouts or quotas

doc/cephfs: use 'p' flag to set layouts or quotas

Remind users that clients must use the 'p' flag when writing file
layouts.

This PR is made in response to
https://www.reddit.com/r/ceph/comments/1gbad51/comment/ltkgd5v/

Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: TruongSinh Tran-Nguyen <i@truongsinh.pro>
(cherry picked from commit 13c7c9d99881c7b4491ba1a693283c047161ea8a)

Merge pull request #60402 from smanjara/wip-reef-pr-56874

[reef] qa/multisite: stabilize multisite testing

Merge pull request #59326 from cbodley/wip-67619-reef

reef: qa: barbican: restrict python packages with upper-constraints

Merge pull request #59105 from YiteGu/wip-52185-reef

reef: osd/perf_counters: raise prio of before queue op perfcounter

Merge pull request #59103 from YiteGu/wip-53250-reef

reef: os/bluestore: add perfcount for bluestore/bluefs allocator

Merge pull request #58817 from Svelar/wip-67135-reef

reef: bluestore/bluestore_types: avoid heap-buffer-overflow in another way to keep code uniformity

Merge pull request #59415 from clwluvw/wip-67686-reef

reef: rgw: load copy source bucket attrs in putobj

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58764 from smanjara/wip-67026-reef

reef: rgw/multisite: don't retain RGW_ATTR_OBJ_REPLICATION_TRACE attr on copy_object

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58058 from yuvalif/wip-66498-reef

reef: rgw: do not assert on thread name setting failures

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #59764 from yuvalif/wip-68046-reef

reef: rgw/kafka: refactor topic creation to avoid rd_kafka_topic_name()

Merge pull request #59669 from mkogan1/wip-67921-reef

reef: rgw: decrement qlen/qactive perf counters on error

Merge pull request #59440 from cbodley/wip-67713-reef

reef: rgw/http: finish_request() after logging errors

Merge pull request #59356 from k0ste/wip-64277-reef

reef: rgw: swift: tempurl fixes for ceph

Merge pull request #60126 from adamemerson/wip-40692-reef

reef: global: Call getnam_r with a 64KiB buffer on the heap

Merge pull request #60462 from zdover23/wip-doc-2024-10-24-backport-60460-to-reef

reef: doc/start: add vstart install guide

doc/start: add vstart install guide

Add "vstart Cluster Installation and Configuration Procedure" to the
Beginner's Guide.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a42be085bd7b9159f4924853ac2b2d92c37884b0)

Merge pull request #60436 from zdover23/wip-doc-2024-10-23-backport-60433-to-reef

reef: doc/cephfs: rearrange subvolume group information

doc/cephfs: rearrange subvolume group information

Rearranging the documentation to align it with CephFS encapsulation design.

Signed-off-by: Indira Sawant <indira.sawant@ibm.com>
(cherry picked from commit f6cf7ae5281f5740ac78bfa5e2a22913353b8167)

qa/rgw/sts: keycloak task installs java manually

java had already been installed automatically before centos 9. add an
override to install the jdk-17 packages manually

Fixes: https://tracker.ceph.com/issues/62536
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 06f6a3e6e8ad65e75d640a128338ffa9dc246f4a)

Conflicts:
tasks/1-keycloak.yaml was not renamed from first.yaml

multisite/qa: resolve rebase conflicts

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 6753e27daab5135973fa45e5a45a4e8e5fbac101)
(cherry picked from commit dfb8f8544283a1dd20c921077231ff14f38aa78a)

Merge pull request #59271 from k0ste/wip-63065-reef

reef: test/cls_lock: expired lock before unlock and start check

Merge pull request #59501 from idryomov/wip-67698-reef

reef: rbd: "rbd bench" always writes the same byte

Merge pull request #59660 from idryomov/wip-67845-reef

reef: librbd/migration: prune snapshot extents in RawFormat::list_snaps()

Merge pull request #60170 from idryomov/wip-63184-reef

reef: librbd/crypto/LoadRequest: clone format for migration source image

Merge pull request #59772 from nbalacha/wip-67763-reef

reef: rbd-mirror: use correct ioctx for namespace

multisite/qa: disable sync error injection

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit da788bc28dbf19bbb54fa91b8c3867063b711551)
(cherry picked from commit cccc43d530d3d4ae5f84c4bb01d3beba9edbd684)

qa/multisite: disable two-zonegroup and three-zone configs.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit fb3186266ee52b352ebdf4ce394d3144a23db8f2)
(cherry picked from commit 7f0ae8e03636cf81811b295f62fdb4a5fddafbf2)

qa/multisite: disable sync policy, endpoint and data_sync_init tests until fixed.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 79d520698d4dc3f06535d3c8fc7ad119fd52ada1)
(cherry picked from commit 724b3d43af74ab3a23c5de58534dc6266a54d81c)

qa/rgw/multisite: add two-zone configuration

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 14204442ac2eaaaa3f40a76403da49f0f4ed92c1)
(cherry picked from commit 627dd7b86d0c59768625b508b614fa35d008708b)

qa/rgw/multisite: double cluster nodes and osd count

> WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand.

give each cluster 2 nodes instead of 1, and 6 osds instead of 3

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a80cf4bf473c95c8d0b18fcdce88be20f74f973)
(cherry picked from commit a77c2d42277e44633643bcc1f8969f90724c49ef)

qa/rgw/multisite: reduce polling intervals from 20s to 5s

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit bc084c0ac64477abdbf54d96bc4981edf41e1343)
(cherry picked from commit 32fb2b923bc07b2228b8fe7d1c1f4bc2f3bf263b)

rgw/multisite: reconfigure checkpoint delay to 90s

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit af7c4d83c7f5b61e907a90622c082a373f3995d9)

Merge pull request #60358 from rhcs-dashboard/reef-i18n

reef: mgr/dashboard: update translations for reef

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60339 from zdover23/wip-doc-2024-10-16-backport-60302-to-reef

reef: doc,mailmap: update my email / association to ibm

Merge pull request #60333 from cbodley/wip-doc-rgw-multisite-secondary-commit-reef

reef: doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

mgr/dashboard: update translations for reef

not a backport, missed this on the release so its reef based commit

Signed-off-by: Nizamudeen A <nia@redhat.com>

mailmap: add my ibm email

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
(cherry picked from commit e4177406f9734f1c8af91f8292aa972d01fb77f9)

doc/governance: update my CSC email

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
(cherry picked from commit 2f61b2847d92b5156408dbcfa5b6e09e2de404c1)

doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

this was copy/pasted from Configuring a Master Zone -> Update the Period
but still referred to the 'master zone'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cfe254758b1ca9647c4dcfb13b6a3310558b88d2)

Merge pull request #59282 from k0ste/wip-65040-reef

reef: librados: use CEPH_OSD_FLAG_FULL_FORCE for IoCtxImpl::remove

Merge pull request #59263 from k0ste/wip-61465-reef

reef: BlueStore: Improve fragmentation score metric

Merge pull request #59146 from NitzanMordhai/wip-67472-reef

reef: suites: test should ignore osd_down warnings

Merge pull request #59108 from YiteGu/wip-61395-reef

reef: osd/TrackedOp: Fix TrackedOp event order

Merge pull request #56681 from ushitora-anqou/wip-65258-reef

reef: mon: add created_at and ceph_version_when_created meta

Merge pull request #54500 from zdover23/wip-doc-2023-11-15-backport-54499-to-reef

reef: doc/rgw/notifications: specify which event types are enabled by default

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #60200 from zdover23/wip-doc-2024-10-09-backport-60163-to-reef

reef: doc/man: supplant "wsync" with "nowsync" as the default

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60228 from dmick/wip-68468-reef

reef: Add Containerfile and build.sh to build it.

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #60295 from rhcs-dashboard/wip-68522-reef

reef: mgr/dashboard: introduce server side pagination for osds

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

blk/kernel: Fix uninitialized discard_stop

Value discard_stop could be uninitialized.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit bdcc7dab9957b010bcac9e0775f593663a8639e3)

container/build.sh: fix arm architecture tagging

The wrong string was used for comparison, and for tagging,
so the arm64 branch and sha1 images overwrote and destroyed
the amd64 images.

Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit 7e03ee798f4ed3aa4a0bb1a9e9d62df52e54406d)

Merge pull request #60298 from zdover23/wip-doc-2024-10-14-backport-60242-to-reef

reef: doc: SubmittingPatches-backports - remove backports team

Merge pull request #60273 from zdover23/wip-doc-2024-10-12-backport-60243-to-reef

reef: doc/dev: remove "Stable Releases and Backports"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: SubmittingPatches-backports - remove backports team

Remove all references to the "Stable Releases and Backports Team", which
as of October 2024 does not exist.

Fixes: https://tracker.ceph.com/issues/68471
Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0317b5f87ac22399f6242d72f0bb9924794687de)

mgr/dashboard: introduce server side pagination for osds

Fixes: https://tracker.ceph.com/issues/56511
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 86378344ab0a381569b116c2112a981404f93671)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/osd-list.component.ts
 - remove carbon modal from import
src/pybind/mgr/dashboard/frontend/src/app/shared/api/osd.service.ts
 - remove CdFormGroup from import since its unused

Merge pull request #59963 from aaSharma14/wip-68210-reef

reef: mgr/dashboard: update period after migrating to multi-site

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

doc/dev: remove "Stable Releases and Backports"

Remove mention of "Stable Releases and Backports" from
doc/dev/developer_guide/essentials.rst.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 95916c91906604c516e78b550010e9de511fc1e9)

Merge pull request #60270 from zdover23/wip-doc-2024-10-12-backport-59507-to-reef

reef: doc/rbd: add namespace information for mirror commands

doc/rbd: add namespace information for mirror commands

Updates the rbd man page to clarify  that some mirror commands
can apply to pools and namespaces.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5e64748927d029ceffc27edbc6cbf7c774a7b291)

Merge pull request #60234 from zdover23/wip-doc-2024-10-10-backport-60204-to-reef

reef: doc: fix email

doc: fix email

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
(cherry picked from commit 512eea1af52126e9b082744ee7b870c12c23d55d)

Merge pull request #60155 from rhcs-dashboard/wip-68314-reef

reef: mgr/dashboard: fix doc links in rgw-multisite

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Add Containerfile and build.sh to build it.

The intent is to replace ceph-container.git, at first for ci containers
only, and eventually production containers as well.

There is code present for production containers, including
a separate "make-manifest-list.py" to scan for and glue the two
arch-specific containers into a 'manifest-list' 'fat' container,
but that code is not yet fully tested.

This code will not be used until a corresponding change to the
Jenkins jobs in ceph-build.git is pushed.

Note that this tooling does not authenticate to the container repo;
it is assumed that will be done elsewhere.  Authentication is
verified by pushing a minimal image to the requested repo.

Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit 5c40a5c1737cf0628c899c4e9f788017b8b4fca8)

doc/man: supplant "wsync" with "nowsync" as the default

Change the default from "wsync" to "nowsync". "nowsync" has been the
default since kernel version 5.16.

This information was reported on
https://pad.ceph.com/p/Report_Documentation_Bugs by Benjamin Mare on 07
Oct 2024.

The commit relevant to this change can be seen here, in Linus's main
branch:
https://github.com/torvalds/linux/commit/f7a67b463fb83a4b9b11ceaa8ec4950b8fb7f902

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9f0af5d75dc64ef0520fd78f29815d2a824a859b)