mgr/dashboard: update openapi specification for /api/cluster/user/export

This commit updates the openapi specification for /api/cluster/user/export endpoint to reflect the current api behaviour.

Fixes: https://tracker.ceph.com/issues/70043
Signed-off-by: Laimis Juzeliunas <laimis.juzeliunas@oxylabs.io>

Merge pull request #61690 from rhcs-dashboard/bucket-tiering

mgr/dashboard: bucket lifecycle policy management

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #60205 from Rethan/bluestore-aio-submit-retries

os/bluestore: make retry_max and initial_delay configurable for aio s…

Merge pull request #61347 from xxhdx1985126/wip-seastore-tree-pointer-abstract

crimson/os/seastore: refactor fixed-kv-btree

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #61837 from anthonyeleven/osd-svc

doc/cephadm/services: Improve osd.rst

Merge pull request #61883 from anthonyeleven/rgw-into-intro

doc/start: Mention RGW in Intro to Ceph

doc/cephadm/services: Improve osd.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #61867 from anuradhagadge/doc_ca_cert_with_fsid

doc/mgr: Add root CA cert instructions to rgw.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/start: Mention RGW in Intro to Ceph

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #61762 from liu-chunmei/compress_extentmap

os/bluestore: fix do_write_v2 extentmap compress issue

do_write_v2 insert extentmap by aligned offset which is adjusted in writer.do_write, if use original offset will cause extentmap can't do compress.

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

mgr/dashboard: add bucket tiering option to create lifecycle policy

Fixes: https://tracker.ceph.com/issues/69649
Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #61478 from rhcs-dashboard/critical-confirmation-modal-changes

mgr/dashboard: Add confirmation textbox for resource name on delete action

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #61871 from rhcs-dashboard/fix-70019-main

mgr/dashboard: fix Python xmlsec build issue

Reviewed-by: @afreen23
Reviewed-by: @aaSharma14

Merge pull request #61847 from idryomov/wip-63798

test/rbd_mirror: flush watch/notify callbacks in TestImageReplayer

Reviewed-by: Vinay Bhaskar Varada <vvarada@redhat.com>

Merge pull request #61756 from dang/wip-dang-68336

RGW - Fix POSIX bucket notify test

doc/mgr: edit grammar and formatting of rgw.rst

Improve the grammar and correct the formatting of the "Upgrading root ca
certificates" procedure that was added to the documentation in https://github.com/ceph/ceph/pull/61867

Fixes: https://tracker.ceph.com/issues/70014
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #61214 from aclamk/wip-aclamk-bs-fragmentation-health

os/bluestore: Add health warning for bluestore fragmentation

Merge pull request #58752 from Matan-B/wip-matanb-replicated-backend-50608

doc/mgr: Add root CA cert instructions to rgw.rst

Add documentation for adding fs_id in root_ca_cert upgrade path

Fixes: https://tracker.ceph.com/issues/70014
Signed-off-by: Anuradha Gadge <anuradha.gadge@ibm.com>

mgr/dashboard: fix Python xmlsec build issue

It disables the specific pinning to a Python xmlsec version.

Fixes: https://tracker.ceph.com/issues/70019
Fixes: 37e633384b7c18893bc0e30a8f3967f6496da00b
Fixes: https://github.com/ceph/ceph/pull/61089
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: remaning critical-confirmation-modal to delete-confirmation-modal and keeping default demetion impact as medium

Fixes: https://tracker.ceph.com/issues/69628
Signed-off-by: Naman Munet <naman.munet@ibm.com>

mgr/dashboard: Add confirmation textbox for resource name on delete action

Before:
=====
User was able to delete a single or multiple critical resources like (  images, snapshots, subvolumes, subvolume-groups, pools, hosts , OSDs, buckets, file system, services ) by just clicking on a checkbox.

After:
=====
User now has to type the resource name that they are deleting in the textbox on the delete modal, and then only they will be able to delete the critical resource.
Also from now onwards multiple selection for deletions of critical resources is not possible. Hence, user can delete only single resource at a time. On the other side, non-critical resources can be deleted in one go.

fixes: https://tracker.ceph.com/issues/69628

Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #61836 from myoungwon/fix-crimson-osd-invalid-argument-print

crimson/osd: remove invalid an argument when printing log

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

osd/ReplicatedBackend: assert non-trivial obc existence

Added to help debug: https://tracker.ceph.com/issues/50608

More information: https://gist.github.com/Matan-B/24b49e9b734259f06edf17fdfea5d24d

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #61469 from ronen-fr/wip-rf-assert-perf

common/perf-counters: replace 'assert' with 'ceph_assert'

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #61606 from rhcs-dashboard/create-storage-class

mgr/dashboard: RGW - Create Storage Class

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #61793 from MaxKellermann/rados__includes

Add missing librbd includes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #61814 from gbregman/main

mgr/cephadm/nvmeof: Add QOS timeslice field to NVMeOF configuration

Merge pull request #47189 from pdvian/wip-crush-df

crush/CrushWrapper: Merge weights if rule contains multiple take

Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #61752 from afreen23/wip-nvme-ns

Add namespace counter in nvmeof namepsaces

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge PR #60983 into main

* refs/pull/60983/head:
script: ceph-backport no longer launches firefox

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge PR #61552 into main

* refs/pull/61552/head:
script/ceph-debug-docker.sh: fix manifest unknown error

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #61776 into main

* refs/pull/61776/head:
ceph-backport.sh: add squid to known milestones

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge PR #61813 into main

* refs/pull/61813/head:
common: add missing mds op names

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

RGW - Fix POSIX bucket notify test

The BucketCacheFixtureInotify1.List2Inotify1 test was failing due to the
count being wrong.  Fix the count, and flesh out the test case to test
the cache for deleting and adding.  Also, move to per-test fixture, so
tests can't interfere with eachother due to inotify latency.

Fixes: https://tracker.ceph.com/issues/68336
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>

Merge pull request #61785 from ceph/cve-34749-fix

doc: Upgrade and unpin some python versions

mgr/dashboard: RGW - Create Storage Class

Fixes: https://tracker.ceph.com/issues/69750
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

mgr/cephadm/nvmeof: Add QOS timeslice field to NVMeOF configuration
Fixes https://tracker.ceph.com/issues/69952

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

test/rbd_mirror: flush watch/notify callbacks in TestImageReplayer

TestImageReplayer establishes its own (i.e. outside of the SUT code)
watch on the header of the remote image to be able to synchronize the
execution of the test with certain notifications.  This watch is
established before the remote image is opened and is teared down until
after the remote image is closed but while the image replayer is still
running.  The flush that is part of image close sequence thus isn't
guaranteed to cover all callbacks, especially for snapshot-based
mirroring where UnlinkPeerRequest spawned from Replayer::unlink_peer()
generates a notification on the remote image for each completed unlink.
Since TestImageReplayer further immediately deletes C_WatchCtx, pretty
much any test can segfault when C_WatchCtx::handle_notify() is invoked
by TestWatchNotify infrastructure.  Because it's a virtual method, the
segfault often involves a completely bogus instruction pointer:

  fn_anonymous[3176255]: segfault at b ip 000000000000000b sp 00007fffbceba7a8 error 14 in unittest_rbd_mirror[555555554000+96a000]
  Code: Bad RIP value.

Fixes: https://tracker.ceph.com/issues/63798
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #61702 from MaxKellermann/bluestore_includes

os/bluestore: include cleanup

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #61808 from ronen-fr/wip-rf-store-ids

osd/scrub: cleanup scrub-store IDs generation

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #61588 from rhcs-dashboard/smb-share-form-create

mgr/dashboard: SMB Create Share

Reviewed-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: Add namespace counter in nvmeof namepsaces

Fixes https://tracker.ceph.com/issues/69900

Signed-off-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: fix image size in nvmeof namespace create/update api

- Different name is used in POST and PATCH for `rbd_image_size`
- Using same name in both requests
- fixing typing issues in frontend

Fixes https://tracker.ceph.com/issues/69864

Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #61779 from yuvalif/wip-yuval-logging-fields-doc

doc/rgw/logging: update field description

Reviewed-By: Anthony D'Atri <anthony.datri@gmail.com>, Ali Masarwe <ali.masarwa@ibm.com>

librbd: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

rbd_replay: add missing include

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

SimpleRADOSStriper: add missing include

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

librados: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

Merge pull request #61597 from Hezko/nvmf-update-route

mgr/dashboard: namespace update route robustness

Merge pull request #61835 from nbalacha/wip-nbalacha-69978

rbd-mirror: fix possible recursive lock of ImageReplayer::m_lock

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

crimson/osd: remove invalid argurment when printing log

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

osd/scrub: clean-up scrub-store IDs generation

The Scrub Store IDs (used to identify OMAP entries used for storing
object-specific error data) are generated by attaching some prefix to
the text representation of virtual (invented) hobjects.

This commit cleans up the code by moving the name generation
process (creating temporary un-needed objects, then
extracting the to_str() representation of their identity)
into separate functions.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

mgr/dashboard: ns update route robustness

improve namespace update endpoint

fixes: https://tracker.ceph.com/issues/62705

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>

rbd-mirror: fix possible recursive lock of ImageReplayer::m_lock

If periodic status update (LambdaContext which is queued from
handle_update_mirror_image_replay_status()) races with shutdown and
ends up being the last in-flight operation that shutdown was pending
on, we attempt to recursively acquire m_lock in shut_down() because
m_in_flight_op_tracker.finish_op() is called with m_lock (and also
m_threads->timer_lock) held.  These locks are needed only for the call
to schedule_update_mirror_image_replay_status() and should be unlocked
immediately.

Fixes: https://tracker.ceph.com/issues/69978
Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
Signed-off-by: N Balachandran <nithya.balachandran@ibm.com>

Merge pull request #61827 from tchaikov/python3.12-on-ubuntu-noble

do_cmake: use Python 3.12 on ubuntu >= 24

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #61794 from MaxKellermann/cls__includes

cls: add missing includes

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #61608 from MaxKellermann/mon_includes

mon: include cleanup

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #61618 from ronen-fr/wip-rf-perf-sections

common/perf_counters: use the RAII helpers when dumping

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #61678 from phlogistonjohn/jjm-bwc-fixes-1

build-with-container fixes exec bit, dnf cache dir option

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

cls/numops: add missing include

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

cls/rbd: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

cls/cephfs: add missing forward declaration

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

cls/2pc_queue: add missing include

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

journal: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mgr/dashboard: SMB Create Share

Fixes: https://tracker.ceph.com/issues/69733
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

do_cmake: use Python 3.12 on ubuntu >= 24

the "official" Python shipped along with Ubuntu 24.04 (Noble Numbat) is
Python 3.12. And some of our building have been upgraded to Ubuntu
24.04. But we are still using Python 3.10 on Ubuntu >= 22, this breaks
the build. And CMake fails like:

```
CMake Error at /usr/share/cmake-3.28/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find Python3 (missing: Python3_EXECUTABLE Python3_INCLUDE_DIRS
  Python3_LIBRARIES Interpreter Development Development.Module
  Development.Embed) (Required is exact version "3.10")

      Reason given by package:
          Interpreter: Wrong version for the interpreter "/bin/python3"

Call Stack (most recent call first):
  /usr/share/cmake-3.28/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
  cmake/modules/FindPython/Support.cmake:3863 (find_package_handle_standard_args)
  cmake/modules/FindPython3.cmake:545 (include)
  CMakeLists.txt:597 (find_package)
```

This build failure should also happen on developers who build Ceph on
Ubuntu >= 24.

In this change, we use Python 3.12 on Ubuntu >= 24

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #61768 from idryomov/wip-69911

librbd: fix mirror image status summary in a namespace

Reviewed-by: N Balachandran <nibalach@redhat.com>

Merge pull request #61698 from afreen23/wip-fix-nsapi

mgr/dashboard: (refactor)fix image size in nvmeof namespace create/update api

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #61734 from rhcs-dashboard/delete-storage-class

mgr/dashboard: RGW - Delete storage class

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

common/perf_counters: use the RAII helpers when dumping

Using Formatter::ObjectSection & Formatter::ArraySection
to guarantee consistent dump sections opening & closing.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge PR #61763 into main

* refs/pull/61763/head:
pybind/mgr/mgr_module: turn off all automatic transactions

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #61688 from dmick/wip-ceph-release-docs

doc/dev/release-process.rst: release builds cannot build containers

Merge PR #61680 into main

* refs/pull/61680/head:
mds: do not schedule quiesce for non-head imported inodes

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #61675 into main

* refs/pull/61675/head:
qa: do read checks with non-empty file

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

common: add missing mds op names

Fixes: 8970fef4ecc4dc28011bb57c5150fbdc691279d0
Fixes: 7f1d066756383adae37d61cc2b2f5d99bc167f65
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #61700 from MaxKellermann/rgw_includes

rgw: add missing includes

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #60791 from Jayaprakash-ibm/jaya-branch

blk/kernel : Make bdev stop immediately

Reviewed-by : Adam Kupczyk <akupczyk@ibm.com>
Reviewed-by : Igor Fedotov <igor.fedotov@croit.io>

Merge pull request #56925 from ifed01/wip-ifed-dencoder-crc32

tools/ceph-dencoder: introduce add_crc32c command to append crc32 for…

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #61428 from rhcs-dashboard/fix-69575-main

mgr/dashboard: fix service/daemon events not showing up in service details

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #61769 from Matan-B/wip-matanb-clang-14-only

script/lib-build: Use clang 14

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #61089 from pecastro/mgr_proto_build_generation

pybind/mgr: Protobuffer file generation for grpc deps.

Reviewed-by: baum <NOT@FOUND>
Reviewed-by: ceph-jenkins <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mon/ConfigMonitor: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/MonMap: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/mon_types: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/MDSMonitor: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/PGMap: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/FSCommands: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/Monitor: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/Paxos: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/ConfigMap: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/MonClient: add missing include

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/MgrMap: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/Session: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

mon/ElectionLogic: add missing includes

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

krbd: include cleanup

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>

Merge pull request #60994 from MaxKellermann/formatter

Formatter code cleanup

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #61759 from yuvalif/wip-yuval-boto-example-bucket-param

rgw/notification/logging: add bucket as context param

Merge pull request #60305 from MaxKellermann/blk_interface

blk/CMakeLists.txt: generate interface library if `libblk` is disabled

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #61699 from MaxKellermann/crimson_includes

crimson/backref_entry: add missing includes

Reviewed-By: Yingxin Cheng <yingxin.cheng@intel.com>