doc/_ext: accomodate three active releases in the Ceph timeline

Avoid this error:
```
/home/jenkins-build/build/workspace/ceph-pr-docs/doc/releases/index.rst:64: ERROR: Error in "ceph_timeline" directive:
maximum 3 argument(s) allowed, 4 supplied.
```

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add fixes

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add Squid target release date

Add the target release date to doc/releases/releases.yml.

Signed-off-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add rbd-wnbd scalability note

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc/releases: add Telemetry section

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>

doc/releases: add Crimson/Seastore section

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: move Op tracker to mgr

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add more to RADOS section

Signed-off-by: Laura Flores <lflores@ibm.com>

doc: Add Squid 19.2.0 release notes

Add release notes for the first stable release of Ceph Squid (19.2.0).

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #59490 from Suyashd999/fix-mfr1

rgw/rgw_aio: forwarding reference passed to std::move()

Reviewed-By: Adam Emerson <aemerson@ibm.com>, Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #59530 from rhcs-dashboard/api_test_mgr_module_failure

qa/tests: fix test_list_enabled_modules timeout error

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #59573 from guits/tracker-67873

ceph-volume: fix generic activation with raw osds

Merge pull request #59551 from idryomov/wip-67845

librbd/migration: prune snapshot extents in RawFormat::list_snaps()

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #59562 from yuvalif/wip-yuval-67857

rgw/notifications: update release notes with fix to principalId

Reviewed-By: Casey Bodley <cbodley@ibm.com>

Merge pull request #59102 from xxhdx1985126/wip-67450

crimson/osd/pg: fix wrong lambda capture of transactions in `PG::submit_error_log()`

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

qa/tests: fix test_list_enabled_modules timeout error

This test deals with enabling/disabling the modules. The assumption I
have is after enabling the
module test will wait for an active mgr but its not able to find it in
time and it fails. so taking inspiration from https://github.com/ceph/ceph/pull/58995/commits/6c7253be6f6fbfa6faed7a539cb78847fec04580 adding retries and logs to see if that's the case

Fixes: https://tracker.ceph.com/issues/62972
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #57896 from mchangir/ptl-tool.py-fix-escape-sequences

ptl-tool.py: replace regular strings with raw string literal for regular expressions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #59588 from athanatos/sjust/wip-nvmeof-reenable

mon: enable nvmeof gw monitor

Reviewed-by: Alexander Indenbaum <aindenba@redhat.com>

Merge pull request #57878 from Suyashd999/fix-uam4

cls: avoid reusing moved-from buffers in cls_queue_src.cc

Merge pull request #59489 from Suyashd999/fix-sia1

rgw/cls_rgw: integer is being interpreted as a character code when assigning it to a string

Merge pull request #57854 from adamemerson/wip-66335

neorados: Fix use-after-move in Builder::build_

Merge pull request #59535 from cbodley/wip-qa-rgw-multisite-account-zone

qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create'

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #59577 from cityofships/main

doc/mds: improve wording

Merge pull request #59185 from NitzanMordhai/wip-nitzan-crimson-help-args

crimson: early config checks and version

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #59407 from xxhdx1985126/wip-67675

crimson/osd/pg: only mutate obc for user triggerred transactions

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #59546 from anthonyeleven/improve-rados-operations-health-checks.rst

doc/rados/operations: Improve health-checks.rst

doc/rados/operations: Improve health-checks.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #59545 from anthonyeleven/improve-radosgw-configref

doc/radosgw: Improve config-ref.rst

Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>

doc/mds: improve wording

Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>

Merge pull request #59368 from xxhdx1985126/wip-crimson-backfill-cancel-part2

crimson/osd: support backfill cancellation ---- part2

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>

ceph-volume: fix generic activation with raw osds

Typical failure:

```
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
--> Failed to activate via raw: activate() takes 1 positional argument but 5 were given
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
--> Failed to activate via LVM: could not find osd.0 with osd_fsid 1e764f4a-db4b-4b41-86eb-468efe4c3f44
--> Failed to activate via simple: 'Namespace' object has no attribute 'json_config'
--> Failed to activate any OSD(s)
```

04c93a1ed42 seems to have broken it.
This commit fixes it.

Fixes: https://tracker.ceph.com/issues/67873
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #59554 from rhcs-dashboard/WrongUIDForUSer

mgr/dashboard: Wrong(half) uid is observed in dashboard

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Merge pull request #59178 from VallariAg/wip-nvmeof-teuthology-v6

qa: add namespace and scale testing for nvmeof teuthology suite

Merge pull request #59478 from idryomov/wip-67752

rbd: amend "rbd {group,} rename" and "rbd mirror pool" command descriptions

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: N Balachandran <nibalach@redhat.com>

qa/suites/nvmeof: wait for service "nvmeof.mypool.mygroup0"

This is because nvmeof gateway group names are now
part of service id.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>

qa/suites/nvmeof: increase hosts in cluster setup

In "nvmeof" task, change "client" config to "installer"
which allows to take inputs like "host.a".

nvmeof/basic: change 2-gateway-2-initiator to
       4-gateway-2-inititator cluster
nvmeof/thrash: change 3-gateway-1-initiator to
        4-gateway-1-inititaor cluster

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>

Merge pull request #58478 from rhcs-dashboard/carbon-forms-fs

mgr/dashboard: carbonize fs forms

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: ivoalmeida <NOT@FOUND>
Reviewed-by: sayaleeraut <NOT@FOUND>

Merge pull request #59496 from rhcs-dashboard/ws-carbon-table

mgr/dashboard: carbon datatable minor bug fixes

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: ivoalmeida <NOT@FOUND>

qa: move nvmeof shell scripts to qa/workunits/nvmeof

Move all scripts qa/workunits/rbd/nvmeof_*.sh
to qa/workunits/nvmeof/*.sh

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>

rgw/notifications: update release notes with fix to principalId

Fixes: https://tracker.ceph.com/issues/67857
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

mgr/dashboard: Wrong(half) uid is observed in dashboard

Fixes: https://tracker.ceph.com/issues/67850
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #59556 from mcv21/patch-2

doc: Correct link to Prometheus docs

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #58543 from rishabh-d-dave/tracker-65808

cephfs: disallow removing root_squash via "fs authorize" cmd

Reviewed-by: Venky Shankar <vshankar@redhat.com>

doc: Correct link to Prometheus docs

The link is to the `#http_sd_config` anchor in the prometheus config docs; that link only works without the trailing `/`.

This correction would ideally get backported to at least reef & squid.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>

mgr/dashboard: carbon datatable minor bug fixes

- fixes empty white spaces in the table
- fixes some tables detail component where it didn't had carbon table
- fix the multi-site details view table not showing up
- fix the nvmeof modals like namespace deletion not getting opened
- fix the cached reload button status not showing correctly in rgw table
- fix show button in the rgw users detail page broken
- fix the multi-cluster list component issue where details component is
  not following carbon attributes
- fixing the configuration page where it does a page reload on form
  submit. instead doing a table refresh

- additionally fixed a validation issue in the service form

fixes the test failures

Fixes: https://tracker.ceph.com/issues/67788
Fixes: https://tracker.ceph.com/issues/67552
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: carbonize cephfs forms

This commit also covers the nfs form

Fixes: https://tracker.ceph.com/issues/67663
Signed-off-by: Nizamudeen A <nia@redhat.com>

librbd/migration: don't include ImageState.h in formats

src_image_ctx, whether dummy for RawFormat and QCOWFormat or real for
NativeFormat, is managed by OpenSourceImageRequest.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

librbd/migration: prune snapshot extents in RawFormat::list_snaps()

list-snaps is exempt from clipping in ImageDispatcher::PreprocessVisitor
because it's considered to be an internal API.  Further, reads issued
by ObjectCopyRequest based on list-snaps results may also be exempt
because of READ_FLAG_DISABLE_CLIPPING.

Since RawFormat allows specifying a set of snapshots (possibly of
varying size!) to be imported, it needs to compensate for that in its
list-snaps implementation.  Otherwise, an out-of-bounds read will
eventually be submitted to the stream.

Fixes: https://tracker.ceph.com/issues/67845
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #59547 from gbregman/main

Revert SPDK rpc fields in nvmeof configuration

librbd: factor out prune_extents() from prune_parent_extents()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

mgr/cephadm: revert SPDK RPC fields in nvmeof configuration
Fixes https://tracker.ceph.com/issues/67844

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

python-common/ceph/deployment: revert SPDK RPC fields in nvmeof configuration
Fixes https://tracker.ceph.com/issues/67844

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #59544 from VallariAg/wip-teuthology-workflow

doc: update tests-integration-testing-teuthology-workflow.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: update tests-integration-testing-teuthology-workflow.rst

* add "Infrastructure" section.

* move "Naming the ceph-ci branch" section under
   "Getting binaries - Build Ceph". Also mention
   about centos9-only trick.

* in "Teuthology Archives", mention about developer
   playground machines and ceph log files.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>

doc/radosgw: Improve config-ref.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #59512 from bugwz/alerts-receivers

mgr/dashboard: alerts module supports setting multiple email recipients

integer being interpreted as a character code when assigning to a string

clang-tidy original warning:

`src/cls/rgw/cls_rgw.cc: warning: an integer is interpreted as a character code when assigning it to a string; if this is intended, cast the integer to the appropriate character type; if you want a string representation, use the appropriate conversion facility [bugprone-string-integer-assignment]
key = BI_PREFIX_CHAR;
^
/home/suyash/ceph/src/cls/rgw/cls_rgw.cc:51:24: note: expanded from macro 'BI_PREFIX_CHAR' #define BI_PREFIX_CHAR 0x80`

**On the following lines we are getting the warning:**

1. 138
2. 319
3. 342
4. 2875
5. 2966
6. 3294
7. 3304
8. 3307
9. 3418
10. 3421

Signed-off-by: Suyash Dongre <suyashd999@gmail.com>

Merge pull request #59508 from rkhudov/src-test-rgw-bucket_notification-update-documentation

src/test/rgw/bucket_notification/README.rst: update RabbitMQ documentation for RGW notification tests

test/crimson: verify the backfill cancellation & resumption

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

test/crimson: add event-type-checking next_round2() to BackfillFixture

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

crimson/osd: wire up backfill resumption

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

crimson/osd: BackfillMachine does support cancel and resume now

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #59531 from nbalacha/wip-nbalacha-unit-test-fix

test/rbd-mirror: fix BootstrapReplayer tests that use expect_is_linked()

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #59528 from zdover23/wip-doc-2024-08-30-ceph-volume-lvm-newdb-bluefs-spillover

doc/ceph-volume: add spillover fix procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #59484 from shraddhaag/add-email-contact

mailmap, githubmap, organisationmap: Add Shraddha Agrawal

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

qa/rgw/multisite: add optional --default arg to 'realm pull'

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/rgw/multisite: fix spelling of is_default in realm configs

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create'

in the rgw/multisite suite, jobs fail on user creation:

> radosgw-admin --cluster c1 account create --account-id RGW11111111111111111
> radosgw-admin --cluster c1 user create --uid rgw-multisite-test-user --account-id RGW11111111111111111 --account-root --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name TestUser --gen-access-key --gen-secret
> could not create user: unable to create user, Failed to load account by id

realms/two-zones.yaml misspells `is_default` as `is default` for the
realm, so it doesn't get set as default. the `account create` command
doesn't specify a realm/zonegroup/zone, so operates on the "default"
zone and zonegroup

use `zone_args()` to add the explicit realm/zonegroup/zone arguments

Fixes: https://tracker.ceph.com/issues/67839
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #59448 from rhcs-dashboard/improve-prometheus-service

mgr/dashboard: improve prometheus service request handling

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Merge PR #59309 into main

* refs/pull/59309/head:
qa: ignore warnings variations

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

tests/rbd-mirror: fixes BootstrapReplayer test

When run with debug_rbd_mirror >= 10, is_linked() is also
called as part of a log message. This causes the tests using
expect_is_linked() to fail.

Signed-off-by: N Balachandran <nibalach@redhat.com>

rbd: mention namespace in "rbd mirror pool" command descriptions

Commit 5e64748927d0 ("doc/rbd: add namespace information for mirror
commands") did this for the man page, update the built-in help as well.

The "by default" bit in the description of "rbd mirror pool enable" and
"rbd mirror pool disable" commands is specific to pool mode which is in
turn specific to journal-based mirroring, so it's removed.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc/ceph-volume: add spillover fix procedure

Add a procedure that explains how, after an upgrade, to move bytes that
have spilled over to a relatively slow device back to the faster device.

This procedure was developed by Chris Dunlop on the [ceph-users] mailing
list, here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/POPUFSZGXR3P2RPYPJ4WJ4HGHZ3QESF6/

Eugen Block requested the addition of this procedure to the
documentation on 30 Aug 2024.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

ptl-tool.py: replace regex strings with raw string literal

Signed-off-by: Milind Changire <mchangir@redhat.com>

Merge PR #58547 into main

* refs/pull/58547/head:
qa: failfast mount for better performance

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #59510 from afreen23/main

mgr/dashboard: Fix banner and scroll issue

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #59182 from zhscn/wip-4k-laddr

crimson/os/seastore: make laddr_t block aligned

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #59507 from nbalacha/wip-nbalacha-rbd-manpage

doc/rbd: add namespace information for mirror commands

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #58950 into main

* refs/pull/58950/head:
mds: add the event when creating the batch head
mds: print the path depth to help debug mds issue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #59310 into main

* refs/pull/59310/head:
qa: load all dirfrags before testing altname recovery

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>

mgr/dashboard: alerts module supports setting multiple email recipients

Signed-off-by: bugwz <xbugwz@gmail.com>

doc/rbd: add namespace information for mirror commands

Updates the rbd man page to clarify  that some mirror commands
can apply to pools and namespaces.

Signed-off-by: N Balachandran <nibalach@redhat.com>

Merge pull request #59469 from smanjara/fix-multisite-script-default-realm

test-rgw-multisite: create default realm in multisite test script

Reviewed-by: Casey Bodley <cbodley@redhat.com>

examples/rgw/boto3/README.md: update documentation for boto3 extension installation. Fixes: https://tracker.ceph.com/issues/67768

Signed-off-by: rkhudov <rhudov@gmail.com>

src/test/rgw/bucket_notification/README.rst: use systemctl, update rabbitmq installation process. Fixes: https://tracker.ceph.com/issues/67768

Signed-off-by: rkhudov <rhudov@gmail.com>

src/test/rgw/bucket_notification/README.rst: update RabbitMQ documentation. Fixes: https://tracker.ceph.com/issues/67768

Signed-off-by: rkhudov <rhudov@gmail.com>

mgr/dashboard: Fix banner and scroll issue

- includes fix to make banner visible again
- includes fix to allow scrolling on longer pages like, expand cluster and upgrade

Fixes https://tracker.ceph.com/issues/67795

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>

Merge pull request #59363 from adk3798/cephadm-mount-nvmeof-certs

cephadm: mount nvmeof certs into container

Reviewed-by: Alexander Indenbaum <aindenba@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #58778 from rhcs-dashboard/fix-67103-main

mgr/dashboard: Zone details showing incorrect data for data pool values and compression info for Storage Classes

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Merge pull request #59495 from zhscn/fix-fmt-missing-arg

crimson/osd/pg: fix missing priority argument

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #59391 from cyx1231st/wip-seastore-more-reports2

crimson/os/seastore/cache: report dirty cache usage and rewrite stats

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge branch 'main' into add-email-contact

crimson/osd/pg: fix missing priority argument

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>

Merge pull request #59390 from ceph/wip-oozmen-67656

doc/rgw/account: Handling notification topics when migrating an existing user into an account

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>

forwarding reference passed to std::move()

Fixes: https://tracker.ceph.com/issues/67781
clang-tidy original warning:

warning: forwarding reference passed to std::move(), which may unexpectedly cause lvalues to be moved; use std::forward() instead [bugprone-move-forwarding-reference]
return [ctx = std::move(ctx), op = std::move(op), trace_ctx] (Aio* aio, AioResult& r) mutable {
^~~~~~~~~
std::forward<Op>

Signed-off-by: Suyash Dongre <suyashd999@gmail.com>

Merge pull request #53915 from pritha-srivastava/wip-rgw-sts-update-oidc-provider

rgw/iam: add AddClientIdToOIDCProvider/UpdateOidcProviderThumbprint

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #59249 from pritha-srivastava/wip-rgw-sts-err-message

rgw/sts: correcting the error message returned for an sts key

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mailmap, githubmap, organisationmap: Add Shraddha Agrawal

Signed-off-by: Shraddha Agrawal <shraddhaag@ibm.com>

Merge PR #59300 into main

* refs/pull/59300/head:
client: calls to _ll_fh_exists() should hold client_lock

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

Merge pull request #59419 from phlogistonjohn/jjm-smb-ctdb-vips

smb: cluster public ip addresses support

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Michael Adam <obnox@samba.org>