doc/cephadm: Update operations.rst

Fixed typo 'no' to 'not' in sentence "If this test fails, cephadm will
no be able to manage services on that host."

Signed-off-by: rhkelson <119636079+rhkelson@users.noreply.github.com>
(cherry picked from commit 34bc35a73443fa56908395a83ea2dd404a8fc4a6)

Merge pull request #60418 from cbodley/wip-63024-reef

reef: qa/rgw/sts: keycloak task installs java manually

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #59104 from YiteGu/wip-53048-reef

reef: os/bluestore: add some slow count for bluestore

Merge pull request #59048 from YiteGu/wip-some-blk-discard-path

reef: a series of optimizations for kerneldevice discard

Merge pull request #59043 from NitzanMordhai/wip-67351-reef

reef: Test: osd-recovery-space.sh extends the wait time for "recovery toofull"

Merge pull request #59629 from sseshasa/wip-66422-reef

reef: osd/scrub: Change scrub cost to average object size

Merge pull request #56475 from amathuria/wip-65141-reef

reef: osd: Change PG Deletion cost for mClock

Merge pull request #60594 from zdover23/wip-doc-2024-11-02-backport-60584-to-reef

reef: doc: s/Whereas,/Although/

doc: s/Whereas,/Although/

Change the subordinating conjunction "Whereas" followed by a comma to
the less grammatically-incorrect "Although". I've been meaning to do
this since 22 Mar 2023.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ea1a470fb4809d312f854e72fc5f8081cbcb2c49)

Merge pull request #58802 from ljflores/wip-67129-reef

reef: osd: bump versions of decoders for upmap-primary

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58741 from ifed01/wip-ifed-async-compact-reef

reef: os/bluestore: enable async manual compactions

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #58734 from pereman2/wip-67082-reef

reef: tools/objectstore: check for wrong coll open_collection

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #58413 from ljflores/wip-66826-reef

reef: qa/suites/rados/thrash/workloads: remove cache tiering workload

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #58315 from cbodley/wip-66723

reef: build: Make boost_url a list

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #57588 from NitzanMordhai/wip-66137-reef

reef: osd: full-object read CRC mismatch due to 'truncate' modifying oi.size w/o clearing 'data_digest'

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #58283 from pponnuvel/wip-66699-reef

reef: mgr/nfs: Don't crash ceph-mgr if NFS clusters are unavailable.

Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #57615 from sajibreadd/wip-66148-reef

reef: osd: fix for segmentation fault on OSD fast shutdown

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #57456 from badone/wip-tracker-59196-lazy-omap-regex-segfault-reef

reef: test/lazy-omap-stats: Convert to boost::regex

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #57241 from sajibreadd/wip-65356-reef

reef: os/bluestore: expand BlueFS log if available space is insufficient

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #55774 from ifed01/wip-ifed-no-death-tests-reef

reef: test/store_test: get rid off assert_death.

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #60538 from zdover23/wip-doc-2024-10-29-backport-60508-to-reef

reef: doc/rados: add blaum_roth coding guidance

Merge pull request #60526 from zdover23/wip-doc-2024-10-29-backport-60470-to-reef

reef: doc: explain the consequence of enabling mirroring through monitor co…

doc/rados: add blaum_roth coding guidance

Direct Ceph administrators using blaum_roth coding for erasure-coded
pools to change the default value of w=7 to a different value in order
to ensure that w+1 is prime.

This information was provided to the Ceph upstream by Benjamin Mare in
September of 2024.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6648d94aed5ff5643f50fcd4f3f07d97b846e885)

doc: explain the consequence of enabling mirroring through monitor commands

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit ed3ce72fbc0b097131945cbb39caa0831401b94a)

Merge pull request #60501 from zdover23/wip-doc-2024-10-26-backport-60444-to-reef

reef: doc/rados: standardize markup of "clean"

Merge pull request #60504 from zdover23/wip-doc-2024-10-26-backport-60434-to-reef

reef: doc/glossary: add "PLP" to glossary

doc/glossary: add "PLP" to glossary

Add "PLP" to the glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 599bdbf0a240ee718ed6da4104141b0f23330fbe)

Merge pull request #60468 from zdover23/wip-doc-2024-10-24-backport-60465-to-reef

reef: doc/cephfs: edit "Disabling Volumes Plugin"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: add doc for disabling mgr/volumes plugin

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 373910de34fc9e1d98218aed0361cd9bf3badffa)
(cherry picked from commit 8868ecc6ce70603986c0c59a6cc0d3d695dbecaa)

doc/rados: standardize markup of "clean"

Standardize the markup around the status "clean" in the documentation so
that readers don't mistakenly get the idea that inconsistent
presentation of the word "clean" implies a never-stated difference
between one instance and the other.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c8b4155d2d27228917d4be1f11514504100c55c7)

Merge pull request #60497 from zdover23/wip-doc-2024-10-26-backport-58647-to-reef

reef: doc/cephfs: add doc for disabling mgr/volumes plugin

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephfs: add doc for disabling mgr/volumes plugin

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 373910de34fc9e1d98218aed0361cd9bf3badffa)

Merge pull request #60483 from zdover23/wip-doc-2024-10-25-backport-60480-to-reef

reef: doc/cephfs: use 'p' flag to set layouts or quotas

doc/cephfs: use 'p' flag to set layouts or quotas

Remind users that clients must use the 'p' flag when writing file
layouts.

This PR is made in response to
https://www.reddit.com/r/ceph/comments/1gbad51/comment/ltkgd5v/

Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: TruongSinh Tran-Nguyen <i@truongsinh.pro>
(cherry picked from commit 13c7c9d99881c7b4491ba1a693283c047161ea8a)

Merge pull request #60402 from smanjara/wip-reef-pr-56874

[reef] qa/multisite: stabilize multisite testing

Merge pull request #59326 from cbodley/wip-67619-reef

reef: qa: barbican: restrict python packages with upper-constraints

Merge pull request #59105 from YiteGu/wip-52185-reef

reef: osd/perf_counters: raise prio of before queue op perfcounter

Merge pull request #59103 from YiteGu/wip-53250-reef

reef: os/bluestore: add perfcount for bluestore/bluefs allocator

Merge pull request #58817 from Svelar/wip-67135-reef

reef: bluestore/bluestore_types: avoid heap-buffer-overflow in another way to keep code uniformity

Merge pull request #59415 from clwluvw/wip-67686-reef

reef: rgw: load copy source bucket attrs in putobj

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58764 from smanjara/wip-67026-reef

reef: rgw/multisite: don't retain RGW_ATTR_OBJ_REPLICATION_TRACE attr on copy_object

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #58058 from yuvalif/wip-66498-reef

reef: rgw: do not assert on thread name setting failures

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #59764 from yuvalif/wip-68046-reef

reef: rgw/kafka: refactor topic creation to avoid rd_kafka_topic_name()

Merge pull request #59669 from mkogan1/wip-67921-reef

reef: rgw: decrement qlen/qactive perf counters on error

Merge pull request #59440 from cbodley/wip-67713-reef

reef: rgw/http: finish_request() after logging errors

Merge pull request #59356 from k0ste/wip-64277-reef

reef: rgw: swift: tempurl fixes for ceph

Merge pull request #60126 from adamemerson/wip-40692-reef

reef: global: Call getnam_r with a 64KiB buffer on the heap

Merge pull request #60462 from zdover23/wip-doc-2024-10-24-backport-60460-to-reef

reef: doc/start: add vstart install guide

doc/start: add vstart install guide

Add "vstart Cluster Installation and Configuration Procedure" to the
Beginner's Guide.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a42be085bd7b9159f4924853ac2b2d92c37884b0)

Merge pull request #60436 from zdover23/wip-doc-2024-10-23-backport-60433-to-reef

reef: doc/cephfs: rearrange subvolume group information

doc/cephfs: rearrange subvolume group information

Rearranging the documentation to align it with CephFS encapsulation design.

Signed-off-by: Indira Sawant <indira.sawant@ibm.com>
(cherry picked from commit f6cf7ae5281f5740ac78bfa5e2a22913353b8167)

qa/rgw/sts: keycloak task installs java manually

java had already been installed automatically before centos 9. add an
override to install the jdk-17 packages manually

Fixes: https://tracker.ceph.com/issues/62536
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 06f6a3e6e8ad65e75d640a128338ffa9dc246f4a)

Conflicts:
tasks/1-keycloak.yaml was not renamed from first.yaml

multisite/qa: resolve rebase conflicts

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 6753e27daab5135973fa45e5a45a4e8e5fbac101)
(cherry picked from commit dfb8f8544283a1dd20c921077231ff14f38aa78a)

Merge pull request #59271 from k0ste/wip-63065-reef

reef: test/cls_lock: expired lock before unlock and start check

Merge pull request #59501 from idryomov/wip-67698-reef

reef: rbd: "rbd bench" always writes the same byte

Merge pull request #59660 from idryomov/wip-67845-reef

reef: librbd/migration: prune snapshot extents in RawFormat::list_snaps()

Merge pull request #60170 from idryomov/wip-63184-reef

reef: librbd/crypto/LoadRequest: clone format for migration source image

Merge pull request #59772 from nbalacha/wip-67763-reef

reef: rbd-mirror: use correct ioctx for namespace

multisite/qa: disable sync error injection

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit da788bc28dbf19bbb54fa91b8c3867063b711551)
(cherry picked from commit cccc43d530d3d4ae5f84c4bb01d3beba9edbd684)

qa/multisite: disable two-zonegroup and three-zone configs.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit fb3186266ee52b352ebdf4ce394d3144a23db8f2)
(cherry picked from commit 7f0ae8e03636cf81811b295f62fdb4a5fddafbf2)

qa/multisite: disable sync policy, endpoint and data_sync_init tests until fixed.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 79d520698d4dc3f06535d3c8fc7ad119fd52ada1)
(cherry picked from commit 724b3d43af74ab3a23c5de58534dc6266a54d81c)

qa/rgw/multisite: add two-zone configuration

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 14204442ac2eaaaa3f40a76403da49f0f4ed92c1)
(cherry picked from commit 627dd7b86d0c59768625b508b614fa35d008708b)

qa/rgw/multisite: double cluster nodes and osd count

> WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand.

give each cluster 2 nodes instead of 1, and 6 osds instead of 3

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a80cf4bf473c95c8d0b18fcdce88be20f74f973)
(cherry picked from commit a77c2d42277e44633643bcc1f8969f90724c49ef)

qa/rgw/multisite: reduce polling intervals from 20s to 5s

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit bc084c0ac64477abdbf54d96bc4981edf41e1343)
(cherry picked from commit 32fb2b923bc07b2228b8fe7d1c1f4bc2f3bf263b)

rgw/multisite: reconfigure checkpoint delay to 90s

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit af7c4d83c7f5b61e907a90622c082a373f3995d9)

Merge pull request #60358 from rhcs-dashboard/reef-i18n

reef: mgr/dashboard: update translations for reef

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60339 from zdover23/wip-doc-2024-10-16-backport-60302-to-reef

reef: doc,mailmap: update my email / association to ibm

Merge pull request #60333 from cbodley/wip-doc-rgw-multisite-secondary-commit-reef

reef: doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

mgr/dashboard: update translations for reef

not a backport, missed this on the release so its reef based commit

Signed-off-by: Nizamudeen A <nia@redhat.com>

mailmap: add my ibm email

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
(cherry picked from commit e4177406f9734f1c8af91f8292aa972d01fb77f9)

doc/governance: update my CSC email

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
(cherry picked from commit 2f61b2847d92b5156408dbcfa5b6e09e2de404c1)

doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

this was copy/pasted from Configuring a Master Zone -> Update the Period
but still referred to the 'master zone'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cfe254758b1ca9647c4dcfb13b6a3310558b88d2)

Merge pull request #59282 from k0ste/wip-65040-reef

reef: librados: use CEPH_OSD_FLAG_FULL_FORCE for IoCtxImpl::remove

Merge pull request #59263 from k0ste/wip-61465-reef

reef: BlueStore: Improve fragmentation score metric

Merge pull request #59146 from NitzanMordhai/wip-67472-reef

reef: suites: test should ignore osd_down warnings

Merge pull request #59108 from YiteGu/wip-61395-reef

reef: osd/TrackedOp: Fix TrackedOp event order

Merge pull request #56681 from ushitora-anqou/wip-65258-reef

reef: mon: add created_at and ceph_version_when_created meta

Merge pull request #54500 from zdover23/wip-doc-2023-11-15-backport-54499-to-reef

reef: doc/rgw/notifications: specify which event types are enabled by default

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #60200 from zdover23/wip-doc-2024-10-09-backport-60163-to-reef

reef: doc/man: supplant "wsync" with "nowsync" as the default

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60228 from dmick/wip-68468-reef

reef: Add Containerfile and build.sh to build it.

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #60295 from rhcs-dashboard/wip-68522-reef

reef: mgr/dashboard: introduce server side pagination for osds

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

blk/kernel: Fix uninitialized discard_stop

Value discard_stop could be uninitialized.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit bdcc7dab9957b010bcac9e0775f593663a8639e3)

container/build.sh: fix arm architecture tagging

The wrong string was used for comparison, and for tagging,
so the arm64 branch and sha1 images overwrote and destroyed
the amd64 images.

Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit 7e03ee798f4ed3aa4a0bb1a9e9d62df52e54406d)

Merge pull request #60298 from zdover23/wip-doc-2024-10-14-backport-60242-to-reef

reef: doc: SubmittingPatches-backports - remove backports team

Merge pull request #60273 from zdover23/wip-doc-2024-10-12-backport-60243-to-reef

reef: doc/dev: remove "Stable Releases and Backports"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: SubmittingPatches-backports - remove backports team

Remove all references to the "Stable Releases and Backports Team", which
as of October 2024 does not exist.

Fixes: https://tracker.ceph.com/issues/68471
Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0317b5f87ac22399f6242d72f0bb9924794687de)

mgr/dashboard: introduce server side pagination for osds

Fixes: https://tracker.ceph.com/issues/56511
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 86378344ab0a381569b116c2112a981404f93671)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/osd-list.component.ts
 - remove carbon modal from import
src/pybind/mgr/dashboard/frontend/src/app/shared/api/osd.service.ts
 - remove CdFormGroup from import since its unused

Merge pull request #59963 from aaSharma14/wip-68210-reef

reef: mgr/dashboard: update period after migrating to multi-site

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

doc/dev: remove "Stable Releases and Backports"

Remove mention of "Stable Releases and Backports" from
doc/dev/developer_guide/essentials.rst.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 95916c91906604c516e78b550010e9de511fc1e9)

Merge pull request #60270 from zdover23/wip-doc-2024-10-12-backport-59507-to-reef

reef: doc/rbd: add namespace information for mirror commands

doc/rbd: add namespace information for mirror commands

Updates the rbd man page to clarify  that some mirror commands
can apply to pools and namespaces.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5e64748927d029ceffc27edbc6cbf7c774a7b291)

Merge pull request #60234 from zdover23/wip-doc-2024-10-10-backport-60204-to-reef

reef: doc: fix email

doc: fix email

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
(cherry picked from commit 512eea1af52126e9b082744ee7b870c12c23d55d)

Merge pull request #60155 from rhcs-dashboard/wip-68314-reef

reef: mgr/dashboard: fix doc links in rgw-multisite

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Add Containerfile and build.sh to build it.

The intent is to replace ceph-container.git, at first for ci containers
only, and eventually production containers as well.

There is code present for production containers, including
a separate "make-manifest-list.py" to scan for and glue the two
arch-specific containers into a 'manifest-list' 'fat' container,
but that code is not yet fully tested.

This code will not be used until a corresponding change to the
Jenkins jobs in ceph-build.git is pushed.

Note that this tooling does not authenticate to the container repo;
it is assumed that will be done elsewhere.  Authentication is
verified by pushing a minimal image to the requested repo.

Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit 5c40a5c1737cf0628c899c4e9f788017b8b4fca8)

doc/man: supplant "wsync" with "nowsync" as the default

Change the default from "wsync" to "nowsync". "nowsync" has been the
default since kernel version 5.16.

This information was reported on
https://pad.ceph.com/p/Report_Documentation_Bugs by Benjamin Mare on 07
Oct 2024.

The commit relevant to this change can be seen here, in Linus's main
branch:
https://github.com/torvalds/linux/commit/f7a67b463fb83a4b9b11ceaa8ec4950b8fb7f902

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9f0af5d75dc64ef0520fd78f29815d2a824a859b)

librbd/crypto/LoadRequest: clone format for migration source image

Migration source and migration target images naturally have the same
encryption format, but the user shouldn't have to need to specify it
for the image that they can't even immediately see -- migration source
image gets moved to the RBD trash to avoid mistaken usage while
migration is in progress.

Fixes: https://tracker.ceph.com/issues/63184
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 7b2085daad168d3d0e6357cd34979f91ecdc8486)

librbd/crypto/LoadRequest: rename m_is_current_format_cloned

Formats must also be cloned if the image is under migration, so
rename m_is_current_format_cloned to m_is_current_format_assumed to
avoid potential confusion with clone() being called in two places but
m_is_current_format_cloned being set in only one place.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 63529523f5778294fa9e447604f9d18c091b6b12)

mgr/dashboard: fix doc links in rgw-multisite

Conflicts:
        - mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zonegroup-form/rgw-multisite-zonegroup-form.component.html
        - mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zone-form/rgw-multisite-zone-form.component.html

Fixes: https://tracker.ceph.com/issues/68295
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit ad471f553d305c8cf7bdacecd3eccc01519ec0f7)

Merge pull request #59962 from aaSharma14/wip-68208-reef

reef: mgr/dashboard: fix handling NaN values in dashboard charts

Reviewed-by: Nizamudeen A <nia@redhat.com>