Merge pull request #63498 from zdover23/wip-doc-2025-05-27-backport-63463-to-squid

squid: doc/rados: s/enpty/empty/ in pgcalc doc

Merge pull request #63501 from zdover23/wip-doc-2025-05-27-backport-63464-to-squid

squid: doc/cephfs: correct ill-formatted command

Merge pull request #63504 from zdover23/wip-doc-2025-05-27-backport-63465-to-squid

squid: doc/rados: improve markup in cache-tiering.rst

Merge pull request #63507 from zdover23/wip-doc-2025-05-27-backport-63370-to-squid

squid: doc/mgr: edit hello.rst

Merge pull request #63510 from zdover23/wip-doc-2025-05-27-backport-63417-to-squid

squid: doc/mgr: edit insights.rst

Merge pull request #63513 from zdover23/wip-doc-2025-05-27-backport-63418-to-squid

squid: doc/mgr: edit iostat.rst

doc/mgr: edit iostat.rst

Edit doc/mgr/iostat.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 98708a7f7f3c470758063e21e840393440450381)

doc/mgr: edit insights.rst

Edit doc/mgr/insights.rst. Improve the English where necessary.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 31d7dac8ff62ca31ffe86d8ef07a6f16047f2a64)

doc/mgr: edit hello.rst

Edit doc/mgr/hello.rst. This includes the rewriting of sentences so that
they now appear in grammatically-correct English.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 87a375c20fcf2366b5f4b4178e9d89a2fba19585)

doc/rados: improve markup in cache-tiering.rst

Correct ill-formatted markup in cache-tiering.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2c3815aadb45eb607608e6390a48e1eaa5e4f034)

doc/cephfs: correct ill-formatted command

Correct a command that was broken across two lines, causing the argument
of an option to appear as though it was a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit bd4e8d8f03a8c39191ad1b7683e7dd1bea4105f1)

doc/rados: s/enpty/empty/ in pgcalc doc

s/enpty/empty/ in doc/rados/operations/pgcalc/index.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 50dc9f1a04c13faa3d5e7971ec7f0724ddf70709)

Merge pull request #62573 from zdover23/wip-doc-2025-03-31-backport-62572-to-squid

squid: doc/rados/operations: Improve erasure-code.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #61614 from zdover23/wip-doc-2025-02-02-backport-61613-to-squid

squid: doc/architecture: remove sentence

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #63467 from zdover23/wip-doc-2025-05-26-backport-63371-to-squid

squid: doc/cephfs: Cosmetic changes and small fixes in cephfs-mirroring.rst

doc/cephfs: Cosmetic changes and small fixes in cephfs-mirroring.rst

Don't format an unordered list as preformatted block.

Fix (not linked) reference to a section name that doesn't exist.

Don't call systemd unit files "systemctl unit files", add an "and"
between them.

Clarify by means of inline formatting and whitespace that config value
is "60" and the unit for that is seconds (as opposed to value being
"60s").

Use double backticks consistently when listing commands, file names or
paths, command parameters, syntaxes, etc.

Use star for inline italic instead of single backtick (to differentiate
from the previous).

Don't use double backticks for "cephadm" when talking about the concept.

Don't capitalize a few words that didn't need it.
Capitalize table data for consistency.
All caps for "MDS".

Small updates to language in text.

Call it "cephfs-mirror" everywhere and not "cephfs_mirror" at one place.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit 2a1558a543bd047729c96d6a86232adc6c3ee1c5)

Merge pull request #63406 from idryomov/wip-rbd-live-migration-squid

squid: librbd/migration: add external clusters support + NBD stream

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #63454 from zdover23/wip-doc-2025-05-23-backport-63415-to-squid

squid: doc/mgr: edit influx.rst.

doc/mgr: edit influx.rst.

Edit doc/mgr/influx.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 32bdcaab3c4cad830fa05d192a35954ce846a9ae)

Merge pull request #63402 from zdover23/wip-doc-2025-05-21-backport-63368-to-squid

squid: doc/mgr: edit motd.inc.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

librbd/migration/NBDStream: abstract out libnbd and add unit tests

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 6fd11c0276dc3f0b2349e42d877d7da692161bc9)

qa/suites/rbd: add snippets for migration import from NBD

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 3260b8fbea9257f12eb04a59af2ebb6f46042d82)

librbd/migration/NBDStream: call nbd_shutdown() in close()

Avoid warnings like

  qemu-nbd: Disconnect client, due to: Failed to read request:
  Unexpected end-of-file before all bytes were read

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit e1418e1975753bd3b5fbb7af88e361d3bbf7a1b6)

librbd/migration/NBDStream: switch to NBD URIs

This removes the constraint on the transport being TCP, allowing to
use a Unix domain socket or other options.  It also allows specifying
export names which a) are needed in case of serving different content
on different exports and b) some servers may require regardless.

Additionally, NBD URIs are future proof as all that NBDStream needs to
do is forward the string to libnbd.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 90b55cfdc25e9ad5247f076ff48a80e91d907adb)

librbd/migration/NBDStream: check for nbd_get_size() errors

nbd_get_size() can fail with EOVERFLOW and possibly other errors.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d6d308003b2c291f28c0c9defd4895c76137f89c)

librbd/migration/NBDStream: introduce from_nbd_errno()

Errors returned by nbd_get_errno() can't be used to complete Contexts
directly because a) these errors are positive while complete() in most
cases expects a negative error and b) nbd_get_errno() can return 0 even
after libnbd call fails (i.e. returns -1).

Introduce a helper with EIO as a default/fallback error.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 1b12f4603e5a5137e48b795565d7d807b73158ec)

librbd/migration/NBDStream: be more thorough around nbd_block_status()

nbd_block_status() is specified to be really loose: it can return
more status (go beyond the requested range), less status (cover only
some part of the requested range) or nothing at all.  The former would
likely violate some assumptions in ObjectCopyRequest, while the latter
would lead to straight data corruption -- parent blocks that weren't
covered would never get copied up into the destination image.

On top of that, the current implementation is very suboptimal.
Because only "nr_entries == 2" responses are effectively processed,
any extent which has a small amount of data and is otherwise zeroed
(e.g. 8K of data in a 4M object) gets listed as DATA.  A copyup for
such an object would write 4M worth of data instead of 8K, consuming
space in the destination image unnecessarily.

Also, it's unclear whether zero-sized entries can be returned.
Currently, if it happens we would hit an assert in interval_map.

This fixes all of these issues.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d52bd80f1f9daed51e1cdac142b07fcb9dec8615)

librbd/migration: add nbd stream

Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
Signed-off-by: Effi Ofer <effio@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit dc8eed68ce58077433e38317f20f3a96ec81f467)

qa/workunits/rbd: exercise snap_{name,id} parsing in test_import_native_format()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 4a6800f1468df5a33802e15c9ea5d7c3ce8ddf2a)

doc/rbd: clarify when image_id is expected for import-only migration

"optional if image in trash" can be easily interpreted as "required if
image not in trash".

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 175ca1e0f0928eed70a735c980c7619214a12cb5)

librbd/migration: add external clusters support

This commit extends NativeFormat (aka migration where the migration
source is an RBD image) to support external Ceph clusters, limited to
import-only mode.

Co-authored-by: Or Ozeri <oro@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 293d523ea69aaf1fa5c372f058f4426d49a3e196)

librbd/migration: move away from util::create_ioctx() in NativeFormat

This is another step towards supporting migration from external
clusters, where creating an IoCtx from a Rados instance that has
nothing to do with dst_io_ctx would be needed.  It also allows to
get rid of a pool lookup in the middle of parsing code.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 7986662157491419d366de3dd0070553abb9e1c8)

Conflicts:
src/librbd/migration/NativeFormat.cc [ commit 8e58a52a408b
  ("librbd/migration: don't include ImageState.h in formats")
  was backported to squid out of order ]

common/config: export CEPH_CONF_FILE_DEFAULT

It used to be exported until commit 318c62f8ae16 ("common/config:
cleanup remove some unused macros").  Having CEPH_CONF_FILE_DEFAULT
avaialable is handy to prevent parse_config_files() from picking up
CEPH_CONF environment variable.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 57a8c535ccad35a9f6e11e8976bc32f390ad341c)

librbd: RefreshParentRequest::m_parent_snap_id is unused

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit df2189acc5dd10e2741a8bdcb891b4f68bdac6b1)

librbd: assert on parent in ImageCtx destructor

... and switch to in-class initializers while at it.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 23cd20e0d5523efaf6b925df378bb2dd865729aa)

qa/tasks/qemu: remove hard-coding of cluster name

This commit allows running the qemu task on an arbitrary cluster name.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 409d36c7087e1e12dd2ad321c39dc26b3271582f)

qa/tasks/rbd: support non-default ceph clusters

This commit allows running the rbd task on an arbitrary cluster name.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 4f8dc834cc6cfb006a10fe4b3e715df5e720f6fe)

librbd/migration: don't clone when flattening

When the flatten flag is set, instead of creating the
destination image by cloning, create it independently,
as the parent relation is unnecessary in this case.
This will be particularly useful when the migration source
is located in an external Ceph cluster, which will soon be
supported.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 1ee644d97104c9caaa83918b98b388888fc5497b)

Merge pull request #63393 from zdover23/wip-doc-2025-05-21-backport-63365-to-squid

squid: doc/mgr: edit debug.inc.rst

Merge pull request #63396 from zdover23/wip-doc-2025-05-21-backport-63367-to-squid

squid: doc/mgr: edit feature_toggles.inc.rst

doc/mgr: edit motd.inc.rst

Edit doc/mgr/dashboard_plugins/motd.inc.rst.

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8661509c16441d60778bc084df8231daa149a04b)

doc/mgr: edit feature_toggles.inc.rst

Edit doc/mgr/dashboard_plugins/features_toggles.inc.rst.

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 18e4ca258194238699649857f5f0ba195b67dea2)

doc/mgr: edit debug.inc.rst

Edit doc/mgr/dashboard_plugins/debug.inc.rst.

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/63255.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1e87aa66b9de0a4e74bb4b1fbd806d974e0e8dcf)

Merge pull request #62994 from clwluvw/wip-71041

squid: rgw: skip empty check on non-owned buckets by zonegroup

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #62959 from galsalomon66/squid-s3select

squid: rgw/s3select

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #61764 from thuvh/wip-69373-squid

squid: rgw: allow send bucket notification to multiple brokers of kafka cluster

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #63337 from zdover23/wip-doc-2025-05-19-backport-63329-to-squid

squid: doc: Fix missing blank line Sphinx warnings

doc: Fix missing blank line Sphinx warnings

Fix four warnings from Sphinx about missing blank line after explicit
markup.

Indent content in list items correctly, fixing formatting errors.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit 5e1b3cd566fd700b36001551d1c7e092fc850def)

Merge pull request #63311 from zdover23/wip-doc-2025-05-16-backport-63293-to-squid

squid: doc/radosgw: Use ref for hyperlinking to multisite

Merge pull request #63315 from zdover23/wip-doc-2025-05-16-backport-63301-to-squid

squid: doc/mgr: edit dashboard.rst

doc/mgr: edit dashboard.rst

Edit doc/mgr/crash.rst. Add prompts.

This changes eighty-nine prompts. Because this makes so many changes,
all other edits included in https://github.com/ceph/ceph/pull/63255 will
be made in a separate commit. This done for the sake of the patience of
the reviewers (probably Anthony, if history is any guide).

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/63255.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1f587883a671775b44b656cf6b7c641d02319b5f)

doc/radosgw: Use ref for hyperlinking to multisite

Use validated ":ref:" hyperlinks instead of "external links" in "target
definitions" when linking within the Ceph docs:
- Update to use existing label in multisite.rst.
- Remove unused "target definitions".

Also use existing label for linking from multisite.rst.
Fix a broken link within multisite.rst.

The rendered PR should look the same as the old docs, only differing in
the source RST.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit e296c756ca191753080cb65e3df4bf3bb160398b)

Merge pull request #63298 from zdover23/wip-doc-2025-05-15-backport-63256-to-squid

squid: doc/dev/cephfs-mirroring: edit file 1 of x

Merge pull request #63211 from ceph/squid-rtd

squid: .github: Fix RTD build retrigger

doc/dev/cephfs-mirroring: edit file 1 of x

Add prompts (and perform necessary corrections to glaring grammatical
errors) to doc/dev/cephfs-mirroring.rst, as requested by Jos Collin in https://github.com/ceph/ceph/pull/63237/files#r2085886075.

This commit edits the first quarter of the doc/dev/cephfs-mirroring.rst
file. This commit encompasses about one-hundred lines of RST.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e9a27051a7c0f4884e685a4105e45273aef0abe0)

Merge pull request #63054 from shraddhaag/wip-70999-squid

squid: qa/suites/orch/cephadm: add PG_DEGRADED to ignorelist

Merge pull request #62198 from NitzanMordhai/wip-69887-squid

squid: dencoder tests fix type backwards incompatible checks

Merge pull request #63273 from zdover23/wip-doc-2025-05-14-backport-63259-to-squid

squid: doc/dev/cephfs-mirroring: edit file 2 of x

doc/dev/cephfs-mirroring: edit file 2 of x

Add prompts (and perform necessary corrections to glaring grammatical
errors) to doc/dev/cephfs-mirroring.rst, as requested by Jos Collin in
https://github.com/ceph/ceph/pull/63237/files#r2085886075.

This commit edits the second quarter of the doc/dev/cephfs-mirroring.rst
file. This commit encompasses about one-hundred lines of RST.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0768ef3fcab69392635d32ed6c4c7051b27afd37)

Merge pull request #63250 from zdover23/wip-doc-2025-05-13-backport-63237-to-squid

squid: doc: fix formatting in cephfs_mirror dev doc

doc: fix formatting in cephfs_mirror dev doc

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 8280d334b9b3ee98cb1372d91991fa476a89424b)

Merge pull request #63187 from rhcs-dashboard/wip-71258-squid

squid: mgr/dashboard: fix make check tests

Merge pull request #63229 from zdover23/wip-doc-2025-05-12-backport-63209-to-squid

squid: doc/radosgw: Cosmetic and formatting improvements in vault.rst

pybind/mgr: attempt to fix mypy importing from python-common

For some reason mypy on python 3.12 can no longer automatically find
imports from python-common. Help it out by expanding the MYPYPATH
value for the tox.ini.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit d1c942a98499560bb15c50db4498f12f4916866f)

doc/radosgw: Cosmetic and formatting improvements in vault.rst

Use generated "contents" instead of repeating section titles in an
ordered list.

Use Title Case for section titles.

Capitalize consistently "Ceph" and "Object Gateway", "Vault".

Use consistently all caps for acronyms.

Change one entry of "kms" to "SSE-KMS", seems obvious from the context.
Use "certificates" instead of "certs".

Use double backticks for file paths, commands, config options etc.

Improve language in one sentence, several words missing.

Call it consistently "the Object Gateway" and not sometimes "the
Gateway".

Add pre-formatted block for CLI command examples where missing (should
be promptified in the future).

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit aa2e91ff70ea37a56f4013e6087f7e790f527329)

.github: Fix RTD build retrigger

Fixes: https://tracker.ceph.com/issues/70430
Signed-off-by: David Galloway <david.galloway@ibm.com>
(cherry picked from commit 27521bf5580d4f878fbf7cafbd854bc6ef94aed4)

Merge pull request #63197 from zdover23/wip-doc-2025-05-09-backport-63172-to-squid

squid: doc/mgr/ceph_api: edit index.rst

Merge pull request #63200 from zdover23/wip-doc-2025-05-08-backport-63173-to-squid

squid: doc/mgr: edit alerts.rst

Merge pull request #63207 from zdover23/wip-doc-2025-05-09-backport-63084-to-squid

squid: doc/mgr: edit administrator.rst

doc/mgr: edit administrator.rst

Edit doc/mgr/administrator.rst. Add prompts and correct some of the
inelegant English present in the file.

This commit is part of a project to separate out the twenty-five files
that were committed to https://github.com/ceph/ceph/pull/62782.

Credit for this initiative should go to Ville Ojamo.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 859950180f0b7314b097ee9b2f9f192f4cfb3ed4)

doc/mgr: edit alerts.rst

Edit doc/mgr/alerts.rst as part of the project to determine where the
error is in https://github.com/ceph/ceph/pull/62782 that prevents the
Jenkins tests from passing.

This commit adds to the work done in
https://github.com/ceph/ceph/pull/62782 by correcting some of the
English that was present in that PR.

This is a change to one of twenty-five files in
https://github.com/ceph/ceph/pull/62782, and this commit represents one
of what will be at least twenty-five other commits made to track this
error down.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit db28c1f32ff67bd1087866c7976233e8ab23fa2c)

doc/mgr/ceph_api: edit index.rst

Edit doc/mgr/ceph_api/index.rst as part of the project to determine
where the error is in https://github.com/ceph/ceph/pull/62782 that
prevents the Jenkins tests from passing.

This is a change to one of twenty-five files in
https://github.com/ceph/ceph/pull/62782, and this commit represents one
of what will be at least twenty-five other commits made to track this
error down.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5c17f2242318d57e9faaafc83774a8f8a36f6e0e)

mgr/dashboard: fix make check tests

Fixes https://tracker.ceph.com/issues/71246

Pr are failing with errors import errors running pylint

Signed-off-by: Afreen Misbah <afreen@ibm.com>
(cherry picked from commit 29f0f2914efacd2e6b9bc7115f5c2d3790bb12cc)

Merge pull request #63147 from zdover23/wip-doc-2025-05-07-backport-63139-to-squid

squid: doc/cephadm: Correct formatting in upgrade.rst

doc/cephadm: Correct formatting in upgrade.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 0e1adc4ae69b9fdc8f4a8480f3e498efa06520f4)

Merge pull request #62039 from kamoltat/wip-70220-squid

squid: src/mon/OSDMonitor.cc: [Stretch Mode] WRN non-existent CRUSH location assigned to MON

Merge pull request #63108 from zdover23/wip-doc-2025-05-05-backport-62860-to-squid

squid: doc: update cephfs-journal-tool docs

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: update cephfs-journal-tool docs

Fixes: https://tracker.ceph.com/issues/70953
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 7ae0c22dfd63d14773966ab3796c68f1be913534)

Merge pull request #63012 from guits/wip-71105-squid

squid: ceph-volume: Fix splitting with too many parts

Merge pull request #63073 from zdover23/wip-doc-2025-04-30-backport-63060-to-squid

squid: doc/cephadm: correct markup in rgw.rst

doc/cephadm: correct markup in rgw.rst

Correct the presentation of an example string in doc/cephadm/rgw.rst in
order to obviate an error reading "rgw.rst:202: WARNING: Inline emphasis start-string without end-string."

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 64bb1cffe3dd2fc495f9f4ddab1dc6c512eda624)

Merge pull request #63071 from sseshasa/wip-71142-squid

squid: doc/rados: Update mClock doc on steps to override OSD IOPS capacity config

Merge PR #61287 into squid

* refs/pull/61287/head:
mds: add or update MDS thread names
log: cache recent threads up to a day
common: cache pthread names
log: concatenate thread names and print once per thread

Reviewed-by: Laura Flores <lflores@redhat.com>

ceph-volume: Fix splitting with too many parts

The data can be anything and also contain a `=`, causing the line to
fail with `Too many values to unpack`. In my case, it failed with
`ID_FS_LABEL=pvc_name=rook-ceph-lvm-data-44f2gc`.

Regression was introduced here: https://github.com/ceph/ceph/pull/60006

Fixes: https://tracker.ceph.com/issues/71101
Signed-off-by: Janne Heß <janne@hess.ooo>
(cherry picked from commit 315fb96243549afba316c60a8d74c24c9417c18e)

doc/rados: Update mClock doc on steps to override OSD IOPS capacity config

Describe the steps involved to
 - Specify a global value for osd_mclock_max_capacity_iops_{ssd,hdd}, and
 - Override existing individually scoped values for OSDs determined during
   start-up for osd_mclock_max_capacity_iops_{ssd,hdd}.

The above is to help with the following:
 - Steps to override existing setting with a global value.
 - reduce the number of entries in the mon store and instead use a single
   global specification for all OSDs in the cluster in case the underlying
   hardware is the same for all OSDs.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
Fixes: https://tracker.ceph.com/issues/70774
(cherry picked from commit 899da82ae2e857f2a769c08d6623e6da7678d16b)

qa/suites/orch/cephadm: add PG_DEGRADED to ignorelist

Issue: tests are failing in rados/cephadm due to
PG_DEGRADED warning in cluster log.

Cause: This is expected as we are intentionally killing OSDs.
Adding PG_DEGRADED warning to ignorelist will prevent the
test from failing when this warning is raised.

Fixes: https://tracker.ceph.com/issues/70466
Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>
(cherry picked from commit 5ffbc5bd4fbb47ce8949ae20f955bc4598b427c8)

Merge pull request #59191 from NitzanMordhai/wip-67504-squid

squid: qa/tasks: watchdog should terminate thrasher

https://github.com/ceph/ceph/pull/59191

Merge pull request #62802 from sseshasa/wip-70904-squid

squid: osd/scheduler/OpSchedulerItem: Fix calculation of recovery latency counters

Merge pull request #62437 from linuxkidd/backport-max-avail-pr-57003-to-squid

squid: PGMap: remove pool max_avail scale factor

Merge pull request #62514 from ifed01/wip-ifed-fix-bluefs-reserved2-squi

squid: os/bluestore: use block size (4K) as minimal allocation unit for dedicated DB/WAL volumes

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

os/bluestore: introduce locking for the very first DB/WAL alloc unit.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit eb461b4fca243d9ac5885cfa9e5d5bf1b6af1fcb)

os/bluestore: rename bluefs_super_t::version -> seq

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 4130c43d50e6cbd7697b57753f1a889528912334)

os/bluestore: rename BlueFS::get_total -> get_block_device_size()

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit d6a2d378707cd807444243029252e9d9bc0d08b6)

test/store_test: add BlueFS reserved space tests

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 2e3578b01490c3350a4a955155dabbc2ea2710e8)

os/bluestore: get rid off BlueFS::get_block_device_size

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit acdd0e363c76073e2fc60de5e9b55d3441c74a66)

tools/ceph-bluestore-tool: introduce bluefs-super-dump command.

This is a rework of Adam's commit:
https://github.com/ceph/ceph/pull/62069/commits/c8e57c4e06691bef7718277267e7590ae695bd02

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit e9d3ea827568afb6063db2ed4fe222b455e5ddec)

os/bluestore: use dev's block size as a minimal BlueFS allocation unit.

Additionall this locks tail of DB/WAL volumes which is unaligned to
configured (not minimal!!) BlueFS allocation unit.

Effectively replaces changes from
https://github.com/ceph/ceph/pull/57015

Fixes: https://tracker.ceph.com/issues/68772
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit effaa686f38b9eff2f7b9c8df2ffaf76c9a49aff)

os/bluestore: do not substract 'reserved' from bluefs bdev sizes

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 33b43af750fa2c62bf153b87124ee947460dac64)

os/bluestore: show allocator types in metadata dump

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 1aae3b66fa55f893f7ec002854bb699541635d53)

Merge pull request #62839 from aclamk/aclamk-bluefs-remove-truncate-squid

squid: os/bluestore: Fix race in BlueFS truncate / remove

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>