Merge pull request #54356 from leonid-s-usov/bp/mds-raise/quincy

quincy: common/admin_socket: add a command to raise a signal

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #48310 from k0ste/wip-56637-quincy

quincy: log: Make log_max_recent have an effect again.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #55775 from ifed01/wip-ifed-no-death-tests-qui

quincy: test/store_test: get rid off assert_death.

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #60299 from zdover23/wip-doc-2024-10-14-backport-60242-to-quincy

quincy: doc: SubmittingPatches-backports - remove backports team

Merge pull request #60274 from zdover23/wip-doc-2024-10-12-backport-60243-to-quincy

quincy: doc/dev: remove "Stable Releases and Backports"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: SubmittingPatches-backports - remove backports team

Remove all references to the "Stable Releases and Backports Team", which
as of October 2024 does not exist.

Fixes: https://tracker.ceph.com/issues/68471
Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0317b5f87ac22399f6242d72f0bb9924794687de)

doc/dev: remove "Stable Releases and Backports"

Remove mention of "Stable Releases and Backports" from
doc/dev/developer_guide/essentials.rst.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 95916c91906604c516e78b550010e9de511fc1e9)

Merge pull request #60271 from zdover23/wip-doc-2024-10-12-backport-59507-to-quincy

quincy: doc/rbd: add namespace information for mirror commands

doc/rbd: add namespace information for mirror commands

Updates the rbd man page to clarify  that some mirror commands
can apply to pools and namespaces.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5e64748927d029ceffc27edbc6cbf7c774a7b291)

Merge pull request #60235 from zdover23/wip-doc-2024-10-10-backport-60204-to-quincy

quincy: doc: fix email

doc: fix email

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
(cherry picked from commit 512eea1af52126e9b082744ee7b870c12c23d55d)

log: Make log_max_recent have an effect again.

The log improvements in a747aeac13daf3dba43343120659e802cb569f6b
unfortunately left log_max_recent broken because m_max_recent wasn't
used anymore.

Eliminate m_max_recent and set the capacity of the m_recent ring buffer
when log_max_recent changes. In order to call set_capacity(),
ConcreteEntry needed its move constructor set noexcept.

I haven't followed the boost code all the way down but I suspect that
setting the ring buffer capacity to anything less than 1 entry will
probably cause problems, so restrict log_max_recent to >=1.

Also fix a wrong variable used for printing the max new entries during
"log dump".

Signed-off-by: Joshua Baergen <jbaergen@digitalocean.com>
(cherry picked from commit 3d59ba1671e3e76326fb706a76b8d9638d782924)

Merge pull request #55598 from NitzanMordhai/wip-63976-quincy

quincy: Tools/rados: Improve Error Messaging for Object Name Resolution

Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #55597 from NitzanMordhai/wip-63982-quincy

quincy: mon/Monitor: during shutdown don't accept new authentication and crea…

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>

Merge pull request #54555 from k0ste/wip-57473-quincy

quincy: mgr: fix a race condition in DaemonServer::handle_report()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #54012 from k0ste/wip-63036-quincy

quincy: mgr: add throttle policy for DaemonServer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #50193 from trociny/wip-58806-quincy

quincy: mgr: don't dump global config holding gil

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #59523 from badone/wip-67822-quincy

quincy: test/lazy-omap-stats: Convert to boost::regex

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #60064 from sajibreadd/wip-68325-quincy

quincy: common/Formatter: dump inf/nan as null

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #59532 from ifed01/wip-ifed-fix-spillover-qui

quincy: test/store_test: enforce sync compactions for spillover tests

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #59468 from sajibreadd/wip-67039-quincy

quincy: os/bluestore: Warning added for slow operations and stalled read

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #58674 from ifed01/wip-ifed-many-many-extents-read-qui

quincy: blk/aio: fix long batch (64+K entries) submission

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #56138 from ifed01/wip-ifed-fix-global-repair-stats-qui

quincy: os/store_test: Retune tests to current code

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #55133 from ifed01/wip-ifed-refresh-perf-counters-qui

quincy: os: introduce ObjectStore::refresh_perf_counters() method

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #59236 from NitzanMordhai/wip-67571-quincy

quincy: cls/cas/cls_cas_internal: Initialize 'hash' value before decoding

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #60136 from zdover23/wip-doc-2024-10-05-backport-60116-to-quincy

quincy: doc/governance: add Zac Dover's updated email

doc/governance: add Zac Dover's updated email

Update Zac Dover's email address.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 322c1a792062a72e958a9cfbd6a24a3e7333908d)

Merge pull request #60087 from idryomov/wip-68213-quincy

quincy: qa/suites/rbd/iscsi: enable all supported container hosts

Reviewed-by: N Balachandran <nibalach@redhat.com>

qa/suites/rbd/iscsi: enable all supported container hosts

On Ubuntu open-iscsi and multipath-tools need to be installed instead
of iscsi-initiator-utils and device-mapper-multipath.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 29e122f8754aa56a2b1cdc56ac4f0591828e5269)

Conflicts:
- .qa/distros/supported-container-hosts doesn't exist in quincy,
  replaced with .qa/distros/container-hosts to fix the symlink

qa: avoid a non-standard shell construct in rbd/iscsi_client.t

dash which is used as /bin/sh on Ubuntu interprets "2&> /dev/null" as
an instruction to launch iscsiadm in the background.  While that is
mostly compensated by the following sleep, stderr isn't redirected to
/dev/null either -- the output gets polluted and the test fails.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d3f385aaed0b7631f6d69bf1ed88f9570b1d8f50)

qa: don't hardcode podman in rbd/gwcli_{create,delete}.t

If podman isn't available (e.g. on Ubuntu), cephadm falls back to
docker.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit b66b98e76d424b2881084d97d5da0e3c9ce062be)

qa/tasks/ceph_iscsi_client: don't use mpathconf

... since it's not available on Ubuntu.  In this case mpathconf just
sets a couple of default values and defines an empty blacklist section,
so it's easy enough to replicate.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9022ef19a58155620b3626080ea58b3c60b6fa36)

Merge pull request #60086 from zdover23/wip-doc-2024-10-02-backport-59164-to-quincy

quincy: doc:update e-mail addresses governance

doc:update e-mail addresses governance

with the consent of my colleagues
- Dan van der Ster
- João Eduardo Luis
- Mark Nelson

changed their e-mail addresses to the current one

Signed-off-by: Tobias Fischer <tobias.fischer@clyso.com>
Signed-off-by: Tobias Fischer <138117964+toficly@users.noreply.github.com>
(cherry picked from commit 180378b5adee303fe57ecd4951b0f0ff46afa5e1)

Merge pull request #58512 from k0ste/wip-66889-quincy

quincy: mgr/Mgr.cc: clear daemon health metrics instead of removing down/out osd from daemon state

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #58845 from idryomov/wip-58120-quincy

quincy: osd: avoid watcher remains after "rados watch" is interrupted

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #60074 from kshtsk/wip-68349-quincy

quincy: ceph.spec.in: we need jsonnet for all distroes for make check

Merge pull request #58921 from mohit84/wip-67236-quincy

quincy: test: Create ParallelPGMapper object before start threadpool

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #59370 from NitzanMordhai/wip-67643-quincy

quincy: mgr/rest: Trim  requests array and limit size

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

ceph.spec.in: we need jsonnet for all distroes for make check

Fixes: https://tracker.ceph.com/issues/67938
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
(cherry picked from commit e7139a8f438c2a019de4c1fc8a81d735ca27e35a)

Merge pull request #59109 from YiteGu/wip-61396-quincy

quincy: osd/TrackedOp: Fix TrackedOp event order

common/Formatter: dump inf/nan as null

Fixes: https://tracker.ceph.com/issues/66215
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
(cherry picked from commit 214328d9daa70a9299255bf07e7169dac1ccf5bd)

Conflicts:
src/common/Formatter.h

Merge pull request #60048 from zdover23/wip-doc-2024-09-30-backport-60039-to-quincy

quincy: doc/rados: edit "Placement Groups Never Get Clean"

doc/rados: edit "Placement Groups Never Get Clean"

Make grammar improvements (and correct a verb disagreement) in the
section "Placement Groups Never Get Clean" in
doc/rados/troubleshooting/troubleshooting-pg.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2baa027b13c0b4ac8b9fb864858a42e010ca8948)

Merge pull request #58871 from kshtsk/wip-quincy-containerized-make-check

quincy: run-make-check: use get_processors in run-make-check script

Merge pull request #60035 from zdover23/wip-doc-2024-09-28-backport-60030-to-quincy

quincy: doc: Document the Windows CI job

doc: Document the Windows CI job

We're adding a document that describes:

* the steps performed by the Windows CI job
* artifact structure
* frequently asked questions

The document is meant to assist the Ceph developers in investigating
CI failures. This is especially important as the Windows CI job runs
integration tests that would otherwise only be executed by
Teuthology, thus helping catch potential regressions quickly.

Note that the identified regressions are not necessarily Windows
specific, usually affecting Linux builds as well.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit bb7d5b62d9db13ca8c0268d00b8e353443285957)

Merge pull request #59317 from k0ste/wip-57417-quincy

quincy: rgw: Get canonical storage class when storage class is empty in

Merge pull request #59312 from k0ste/wip-54151-quincy

quincy: rgwlc: fix compat-decoding of cls_rgw_lc_get_entry_ret

Merge pull request #59993 from zdover23/wip-doc-2024-09-26-backport-59986-to-quincy

quincy: doc: fix typo

doc: fix typo

Fixed a typo in the jaeger traces documentation.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5a11bc00e6c068c965bb7d961feeb47353cc893c)

Merge pull request #59909 from zdover23/wip-doc-2024-09-21-backport-59904-to-quincy

quincy: doc: Update "Getting Started" to link to start not install

doc: Update "Getting Started" to link to start not install

Currently the "Getting Started" link points at the install page, not the "Intro to Ceph" section, which seems more appropriate.

If you're happy with this, can it get backported to the still-supported releases, please?

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit d257eacb05a463c93872ae8aa8210806affda4ec)

Merge pull request #59873 from zdover23/wip-doc-2024-09-19-backport-59856-to-quincy

quincy: doc/rados: add confval directives to health-checks

Warning added for slow operations and stalled read in BlueStore. User can control how much time the warning should persist after last occurence and maximum number of operations as a threshold will be considered for the warning.

Fixes: https://tracker.ceph.com/issues/62500
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
(cherry picked from commit 73b80a9a2c38259346fb646f85fa2ba4dcbb1329)

Conflicts:
src/blk/BlockDevice.h
src/common/options/global.yaml.in
src/os/bluestore/BlueStore.cc
src/os/bluestore/BlueStore.h
        doc/rados/operations/health-checks.rst

Merge pull request #59500 from idryomov/wip-67698-quincy

quincy: rbd: "rbd bench" always writes the same byte

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #59659 from idryomov/wip-67845-quincy

quincy: librbd/migration: prune snapshot extents in RawFormat::list_snaps()

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #59774 from nbalacha/wip-67762-quincy

quincy: rbd-mirror: use correct ioctx for namespace

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

doc/rados: add confval directives to health-checks

Add confval directives to doc/rados/operations/health-checks.rst, as
requested by Anthony D'Atri here: https://github.com/ceph/ceph/pull/59635#pullrequestreview-2286205705

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a159821ddfcecaa75f5a92af7e22ea198d82a8db)

Merge pull request #59836 from zdover23/wip-doc-2024-09-17-backport-59788-to-quincy

quincy: doc/README.md: create selectable commands

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/README.md: create selectable commands

An indentation of five spaces relative to the previous line creates a
command that is copyable with a single mouse click. This commit adds
those copyabale commands to the procedure in the section "Building
Ceph".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 36c620b04f3a88562d75955b46cc1864de60ce70)

Merge pull request #59804 from zdover23/wip-doc-2024-09-16-backport-59801-to-quincy

quincy: doc/rados: add osd_deep_scrub_interval setting operation

doc/rados: add osd_deep_scrub_interval setting operation

Add a second method of changing the value of osd_deep_scrub_interval to
remedy the condition indicated by the "PGs not deep-scrubbed in time"
warning.

This procedure was developed by Eugen Block, and is at the time of this
commit available on his blog at
https://heiterbiswolkig.blogs.nde.ag/2024/09/06/pgs-not-deep-scrubbed-in-time/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f57e99e1731af3affee1c299bb9a79852e31f5ea)

Merge pull request #59796 from zdover23/wip-doc-2024-09-15-backport-59613-to-quincy

quincy: doc/rados: add link to messenger v2 info in mon-lookup-dns.rst

Merge pull request #59800 from zdover23/wip-doc-2024-09-15-backport-59024-to-quincy

quincy: doc/README.md - add ordered list

doc/README.md - add ordered list

Add ordered-list formatting to the "Building Ceph" section of README.md.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1f21057e4166f2ea9f51ee037eb8e234c1390cfb)

doc/rados: add link to messenger v2 info in mon-lookup-dns.rst

Add a link to the page about Messenger v2 to the end of
doc/rados/configuration/mon-lookup-dns.rst.

Fixes: https://tracker.ceph.com/issues/58752
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 81f9d064f714f42ff27bf620df526f87b393402b)

rbd-mirror: use correct ioctx for namespace

The PoolReplayer uses the ioctx for the default namespace
to check if other namespaces are enabled for mirroring, causing
it to incorrectly conclude that they are all enabled.

Fixes: https://tracker.ceph.com/issues/67676
Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 2346cd912ee2c5aefe5b203cc872e0528fc96a49)

Merge pull request #59769 from zdover23/wip-doc-2024-09-13-backport-59438-to-quincy

quincy: doc/rgw/d3n: pass cache dir volume to extra_container_args

Merge pull request #59651 from guits/wip-63919-quincy

quincy: ceph-volume: Fix unbound var in disk.get_devices()

Merge pull request #59355 from k0ste/wip-64276-quincy

quincy: rgw: swift: tempurl fixes for ceph

Merge pull request #59338 from k0ste/wip-61633-quincy

quincy: rgw : fix add initialization for RGWGC::process()

doc/rgw/d3n: pass cache dir volume to extra_container_args

Fixes: https://tracker.ceph.com/issues/66492
Signed-off-by: Mark Kogan <mkogan@ibm.com>
(cherry picked from commit 4594e38bf19a8f73191904f5f373a3707cddd2f3)

Merge pull request #59758 from zdover23/wip-doc-2024-09-12-backport-59753-to-quincy

quincy: doc/install: Keep the name field of the created user consistent with …

doc/install: Keep the name field of the created user consistent with the node name in the Start RADOSGW service command

If the user name does not match the name of the node that started the RADOSGW service, this will cause confusion for those who are new to ceph. Because they can't start the radosgw service normally as shown in the tutorial.

Signed-off-by: hejindong <wodeshijie3394@126.com>
(cherry picked from commit 128e6451d8c4764025d4a2565f15ec175c857bb2)

Merge pull request #55336 from guits/wip-64196-quincy

quincy: ceph-volume: use 'no workqueue' options with dmcrypt

Merge pull request #59656 from zdover23/wip-doc-2024-09-08-backport-59628-to-quincy

quincy: doc/dev: add "activate latest release" RTD step

Merge pull request #59735 from zdover23/wip-doc-2024-09-11-backport-59635-to-quincy

quincy: doc/rados: add "pgs not deep scrubbed in time" info

doc/rados: add "pgs not deep scrubbed in time" info

Add a procedure to doc/rados/operations/health-warnings.rst that
explains how to remedy the "X PGs not deep-scrubbed in time" health
warning.

This procedure was developed by Eugen Block, and is at the time of this
commit available on his blog at
https://heiterbiswolkig.blogs.nde.ag/2024/09/06/pgs-not-deep-scrubbed-in-time/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d620a51c306d1ebcdfc974dc0b85dc46cfde8d40)

Merge pull request #58221 from guits/wip-66025-quincy

quincy: ceph-volume: create LVs when using partitions

Merge pull request #58999 from guits/wip-64643-quincy

quincy: src/ceph-volume/ceph_volume/devices/lvm/listing.py : lvm list filters with vg name

ceph-volume: fix regex usage in `set_dmcrypt_no_workqueue`

- Updated the regex pattern to `r'(\d+\.?)+'` to more accurately
  capture version numbers.

- Replaced `re.match` with `re.search` to properly match the cryptsetup
  version in the output.

- `re.match` only checks for a match at the beginning of the string,
   while `re.search` looks for a match anywhere in the string.

This fix ensures that the function correctly retrieves the
cryptsetup version from the output.

Fixes: https://tracker.ceph.com/issues/66393
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 607eb34b2c278566c386efcbf3018629cf08ccfd)

ceph-volume: fix set_dmcrypt_no_workqueue()

`set_dmcrypt_no_workqueue()` from `ceph_volume.util.encryption`

The function `set_dmcrypt_no_workqueue` in `encryption.py` now
dynamically retrieves the installed cryptsetup version using `cryptsetup
--version` command. It then parses the version string using a regular
expression to accommodate varying digit counts. If the retrieved version
is greater than or equal to the specified target version,
`conf.dmcrypt_no_workqueue` is set to True, allowing for flexible version
handling.

Fixes: https://tracker.ceph.com/issues/66393
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit dc28b77a6ea50b3390663ac02eeb80367650b7ed)

ceph-volume: fix partitions support in disk.get_devices()

The following:
```
is_part = get_file_contents(os.path.join(_sys_dev_block_path, item, 'partition')) == "1"
```
assumes any `/sys/dev/block/x:y/partition` contains '1' which is wrong.
This file actually contains the corresponding partition number.

Fixes: https://tracker.ceph.com/issues/64195
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d5d2d1456542829495d3ebbbad6ca2febd7c344d)

ceph-volume: use 'no workqueue' options with dmcrypt

CloudFlare engineers made some testing and realized that using
workqueues with encryption on flash devices has a bad effect.

See [1] for details.

With this patch it will make ceph-volume call crypsetup with
`--perf-no_read_workqueue` and `--perf-no_write_workqueue` options
when the device is not a rotational.

[1] https://blog.cloudflare.com/speeding-up-linux-disk-encryption/

Fixes: https://tracker.ceph.com/issues/64195
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
Co-Authored-by: Stefan Kooman <stefan@kooman.org>
(cherry picked from commit 0985e201342fa53c014a811156aed661b4b8f994)
(cherry picked from commit 956305eb5caf323cfadb772a9a1f910a90aa7740)

Merge pull request #59702 from zdover23/wip-doc-2024-09-10-backport-59675-to-quincy

quincy: doc/README.md: improve formatting

Merge pull request #59684 from zdover23/wip-doc-2024-09-10-backport-59677-to-quincy

quincy: doc/man: edit ceph-bluestore-tool.rst

doc/README.md: improve formatting

Improve the formatting of the section "Building Ceph" in the file
README.md.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7171f73c81d603f8ff62198fc1e5f50c20a0aa05)

doc/man: edit ceph-bluestore-tool.rst

Edit the section "bluefs-bdev-migrate" in
doc/man/8/ceph-bluestore-tool.rst to add the information that this
operation expands the target storage by updating its size label, making
"bluefs-bdev-expand" unnecessary.

Improve the subject-verb agreement in this section, and supply some
absent definite articles.

Co-authored-by: Peter Gervai <grin@drop.grin.hu>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6b34707f827b2b197f53fe2e430d173b30b81401)

Merge pull request #59665 from zdover23/wip-doc-2024-09-09-backport-59642-to-quincy

quincy: doc/cephadm: add malformed-JSON removal instructions

Merge pull request #59639 from zdover23/wip-doc-2024-09-06-backport-59630-to-quincy

quincy: doc/README.md: edit "Build Prerequisites"

doc/cephadm: add malformed-JSON removal instructions

Add instructions for removing malformed JSON that causes the cephadm
module to fail to start, which in turn makes the orchestrator fail to
start.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 93d90ea358cf17b08e502caf8529061a10008fad)

librbd/migration: don't include ImageState.h in formats

src_image_ctx, whether dummy for RawFormat and QCOWFormat or real for
NativeFormat, is managed by OpenSourceImageRequest.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8e58a52a408b703b79342670acbeb6c7303ddde7)

Conflicts:
src/librbd/migration/NativeFormat.cc [ commit 293d523ea69a
  ("librbd/migration: add external clusters support") not in
  quincy ]

librbd/migration: prune snapshot extents in RawFormat::list_snaps()

list-snaps is exempt from clipping in ImageDispatcher::PreprocessVisitor
because it's considered to be an internal API.  Further, reads issued
by ObjectCopyRequest based on list-snaps results may also be exempt
because of READ_FLAG_DISABLE_CLIPPING.

Since RawFormat allows specifying a set of snapshots (possibly of
varying size!) to be imported, it needs to compensate for that in its
list-snaps implementation.  Otherwise, an out-of-bounds read will
eventually be submitted to the stream.

Fixes: https://tracker.ceph.com/issues/67845
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d9192b5aca156b706f14bd858df6fb3e45050079)

librbd: factor out prune_extents() from prune_parent_extents()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5d64c9c5cda5c1ca44c349cfb9e4f1e9eac21bd5)

Conflicts:
src/librbd/ImageCtx.cc [ ImageArea support not in quincy ]

doc/dev: add "activate latest release" RTD step

Add a step to the section called "First Stable Release" that explains
how to activate the latest release in Read the Docs.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e7bd4bcdd074a3defae5866a6c035559bf210271)

ceph-volume: Fix unbound var in disk.get_devices()

00ba00fdfab8 looks to have regressed.

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 0e95b27402e46c34586f460d2140af48d03fa305)

doc/README.md: edit "Build Prerequisites"

Make the sentences in the "Build Prerequisites" section of README.md
more direct.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0b277fe3809c2eae7bfced002ac85f7e1629fa30)

Merge pull request #59600 from idryomov/wip-67752-quincy

quincy: rbd: amend "rbd {group,} rename" and "rbd mirror pool" command descriptions

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #56616 from prazumovsky/wip-63620

quincy: rgw/swift: preserve dashes/underscores in swift user metadata names