doc/releases: fix some formatting for the 17.2.8 release notes

Signed-off-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

doc: 17.2.8 Release Notes

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #60529 from zdover23/wip-doc-2024-10-29-start-os-recommendations

doc/start: separate package chart from container chart

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #59328 from mkogan1/wip-d3n-umask

rgw: d3n: set access permissions for the D3N cache directory when creating

doc/start: separate package chart from container chart

Separate the packages-and-containers chart into two charts:
   (1) a chart that shows which OSes Ceph builds packages for
   (2) a chart that shows which OSes support Ceph's containers

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60626 from ivoalmeida/carbon-version-update

mgr/dashboard: update carbon-components-angular

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60511 from rhcs-dashboard/health-test-fix

qa/dashboard: fix tasks.mgr.dashboard.test_health.HealthTest

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #60663 from leonidc/wip-publish-rebalance-ana-group

 mon/nvmeofgw*: monitors publish in nvme-gw show ana group responsible

Merge pull request #60605 from zdover23/wip-doc-2024-11-04-cephadm-services-osd

doc/cephadm: clean "Adv. OSD Service Specs"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60592 from athanatos/sjust/wip-crimson-io-2

crimson: switch to simple RAII obc locking mechanism

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge pull request #60578 from zmc/rpm-sccache-toggle

Merge pull request #60621 from galsalomon66/mask_parquet_dependencies

rgw: hiding parquet dependencies upon parquet-select option is off

qa/dashboard: fix test_list_enabled_module failure

Check the ports availability and go for a new port if the current one is
not available

Fixes: https://tracker.ceph.com/issues/62972
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #60448 from anthonyeleven/improve-mgr-disable

doc: improve pending release notes and CephFS

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

 mon/nvmeofgw*: monitors publish in nvme-gw show ana group responsible
 for  namespace rebalance

Signed-off-by: Leonid Chernin <leonidc@il.ibm.com>

ceph.spec.in: Add option to enable sccache

Signed-off-by: Zack Cerza <zack@redhat.com>

mgr/dashboard: update carbon-components-angular

* update carbon-components-angular pkg to v5.48.0
* fixed change detection errors on unit tests
* fixed pagination page length when limit is 0 and data is empty

Fixes: https://tracker.ceph.com/issues/68837
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>

crimson/.../object_context: remove unused lock helpers

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/osd/object_context_loader.cc: retab remaining methods

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: InternalClientRequests require that the pg is already active

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../client_request: complete_request() only in with_pg_process

This avoids needing to annotate every exit point in
with_pg_process_interruptible with complete_request.  Regardless of the
result, completing with_pg_process_interruptible without an interruption
means that the request is over.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../client_request: always remove from orderer in complete_request

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../client_request: remove unnecessary get_handle().exit()

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: rewrite with_[clone_]obc[_only] via manager, remove other helpers

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: remove unused PG::with_locked_obc

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: convert PG::with_locked_obc users to use obc manager

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: introduce RAII style obc lock mechanic

Currently, we rely on ObjectContextLoader::with_* wrappers to load,
lock, and guarrantee release of obcs.  That mechanism works well enough,
but the execution pathway is pretty tough to read as it spans
[Internal]ClientRequest, PG, ObjectContextLoader, ObjectContext, and
tri_mutex.  This mechanism cuts out PG and ObjectContext (mostly) and
uses coroutine support for auto variables to make the interface easier
to understand.

This mechanism will also allow a future PR to access the ObjectContext
state prior to loading it.  This will be important to using the
ObjectContext memory to host per-object pipeline states.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: track obcs unconditionally

Previously, we only interrupted head obcs.  I don't think that
distinction actually makes sense -- both head and clone obcs
can have ops blocked on the lock.  Let's just track them all.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: remove ObjectContextLoader::reload_obc

Unused.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/osd/object_context: add formatter for RWState::State

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #60600 from Matan-B/wip-matanb-crimson-enable-wait

Revert "suites: crimson basic adding wait for test"

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #56771 from nh2/doc-mclock-references

doc: Document which options are disabled by mClock.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #60642 from yuvalif/wip-yuval-68858

doc/rgw/notification: clarified the notification_v2 behavior upon upgrade

doc/cephadm: clean "Adv. OSD Service Specs"

Clean the English grammar and the .RST in the section "Advanced OSD
Service Specifications" in the file doc/cephadm/services/osd.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60643 from zdover23/wip-doc-2024-11-06-cephadm-osd-host-pattern-matching

doc/cephadm: link to "host pattern" matching sect

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60132 from li-positiveandfocus/wip-67820-lj

qa/tasks: added "is down" warning to thrash-old-clients ignorelist

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #60071 from shraddhaag/fix-mon-cluster-log-test

qa/standalone/mon/mon_cluster_log.sh: retry check for log line

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #59855 from NitzanMordhai/wip-nitzan-expected-failure-wait-osd-down

qa/tasks/ceph: wait the osds down before start check the logs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/cephadm: link to "host pattern" matching sect

Link to the "Placement by Pattern Matching" section in
doc/cephadm/services/index.rst from the "Advanced OSD Service
Specifications" section in doc/cephadm/services/osd.rst.

Fixes: https://tracker.ceph.com/issues/68812
Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/rgw/notification: clarified the notification_v2 behavior upon upgrade

Fixes: https://tracker.ceph.com/issues/68858
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #60622 from idryomov/wip-spdk-submodule

spdk: update submodule to fix build with newer glibc

Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Merge pull request #59743 from sseshasa/wip-fix-mclock-low-iops-capacity-threshold

common,osd: Use last valid OSD IOPS value if measured IOPS is unrealistic

Merge pull request #56599 from rhkelson/patch-2

doc/cephadm: Update operations.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60602 from rhcs-dashboard/cherrypy-version-get-fix

mgr/dashboard: remove cherrypy_backports.py

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc/cephadm: Update operations.rst

Fixed typo 'no' to 'not' in sentence "If this test fails, cephadm will
no be able to manage services on that host."

Signed-off-by: rhkelson <119636079+rhkelson@users.noreply.github.com>

Merge pull request #59483 from kamoltat/wip-ksirivad-exit-stretch-mode

mon [stretch mode]: support disable_stretch_mode
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #56832 from Matan-B/wip-matanb-crimson-recovery-version

crimson/osd/pg: introduce projected_log
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>

hiding parquet dependencies upon parquet-select option is off

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>

Merge PR #58847 into main

* refs/pull/58847/head:
ceph-fuse: Improve fuse mount usage message

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>

Merge pull request #60559 from leonidc/wip-leonidc-no-listeners-fix

fix no-listeners FSM , detect no-listeners

test/crimson/test_backfill: support projected log and pg log

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/osd/pg: introduce projected_log

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

spdk: update spdk submodule to fix build with newer glibc

Pick up a change that introduced CONFIG_HAVE_ARC4RANDOM to allow
building with glibc 2.36 and newer.

Fixes: https://tracker.ceph.com/issues/67843
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #60100 from piyushagarwal1411/fix-68316-main

mgr/dashboard: Add 'Browse Dashboards' button in multi-cluster and ceph-cluster Grafana dashboards

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #60017 from rhcs-dashboard/kcli-quick-install

mgr/dashboard: improve the kcli bootstrap process

Reviewed-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: remove cherrypy_backports.py

since its mostly used only for older cherrypy versions which we don't
support anymore in any of our recent upstream releases, we could remove
it completely

Fixes: https://tracker.ceph.com/issues/68802
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #60577 from zmc/rpm-dwz-toggle

Merge pull request #56677 from athanatos/sjust/for-review/wip-replica-read

osd,crimson/osd: rework of replica read and related state

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #60425 from ShwetaBhosale1/orch_host_drain-attempt_to_drain_non_existing_host_must_fail

mgr/cephadm: ceph orch host drain command to return error for invalid hostname

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anuradha Gadge <Anuradha.Gadge@ibm.com>

Merge pull request #60608 from yuvalif/wip-yuval-68818

doc/rgw/notification: add missing admin commands

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw/notification: add missing admin commands

also remove obsolete admin commands

Fixes: https://tracker.ceph.com/issues/68818
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

mgr/dashboard: improve the kcli bootstrap process

I have a new script added for starting the kcli cluster called
quick-bootstrap.sh

The goal is to use that script to download the ceph image on local
(rather than inside vm) and then copy them over to all the vms that is
being spawned by the kcli. This way all the hosts will get the ceph
image which will make the deployment loads faster.

Another thing I added is to add some dnf.conf to improve
parallel_downlaods and get the fastest server to install deps

eg:
```
╰─$ ./quick-bootstrap.sh -h                                                                                    255 ↵
+ set +x
Usage: ./quick-bootstrap.sh [OPTIONS]

Options:
  -u, --use-cached-image     Uses the existing podman image in local. Only use this if there is such an image present.
  -dir, --ceph-dir             Use this to provide the local ceph directory. eg. --ceph-dir=/path/to/ceph
  -e, --expanded-cluster     To add all the hosts and deploy OSDs on top of it.
  -h, --help             Display this help message.

Example:
  ./quick-bootstrap.sh --use-cached-image

```

```
./quick-bootstrap.sh -u --ceph-dir=/home/nia/projects/ceph
```

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #59725 from mchangir/mds-fallocate-return-EOPNOTSUPP-for-mode-0

client: return EOPNOTSUPP for fallocate with mode 0

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #59486 from ceph/ceph-ec-benchmark-increase-default-buffer-size

test/erasure-code: increase ceph_erasure_code_benchmark default buffe…

Merge pull request #59481 from ifed01/wip-ifed-more-info-in-slow-op-log

os/bluestore: log txc details in slow op notification on committed_kv

doc: Document which options are disabled by mClock.

Not only in the mClock docs, but also in the reference
of the options that are disabled.

Otherwise users are bound to miss it, and surprised
why their options are ignored or reset.

Signed-off-by: Niklas Hambüchen <mail@nh2.me>

mgr/cephadm: orch host drain command does not return error for invalid hostname

Fixes: https://tracker.ceph.com/issues/68681
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

Merge PR #60236 into main

* refs/pull/60236/head:
MDS/CDir: return as early as possible from CDir::should_split_fast()

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #60438 from xxhdx1985126/wip-68661

crimson/osd/pg: make sure ops are sent to backfill targets if and only if the object has been pushed.

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60517 from xxhdx1985126/wip-68737

crimson/osd/osd_operations/client_request: no need to hold head's obc lock throughout the recovery of clones

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #60485 from xxhdx1985126/wip-68719

crimson/osd/backfill_state: discard CancelBackfill events when the backfill is done

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #60439 from xxhdx1985126/wip-68662

crimson/osd/shard_services: fix dangling reference caused by rvalue reference of ShardSercies::dispatch_context()

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #60313 from xxhdx1985126/wip-68541

crimson/osd/pg: trigger PG::wait_for_active_blocker only when the pg is going active

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Revert "suites: crimson basic adding wait for test"

This reverts commit a9de8be0f4633ac825f364f8b7ddcd4c4d5b6a2c.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

mon/nvmeofgw*: fix no-listeners FSM, fix detection of no-listeners
condition

Signed-off-by: Leonid Chernin <leonidc@il.ibm.com>

ceph.spec.in: Add an option to disable dwz

We disabled dwz in 2017, then re-enabled it in 2021. In my tests I observe dwz
adding about 50% to build times in exchange for 33% space-saving.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #60584 from zdover23/wip-doc-2024-11-01-whereas

doc: s/Whereas,/Although/

doc: s/Whereas,/Although/

Change the subordinating conjunction "Whereas" followed by a comma to
the less grammatically-incorrect "Although". I've been meaning to do
this since 22 Mar 2023.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60362 from mchangir/doc-add-note-about-vol-delete-wrt-snap-schedule

doc/cephfs: add note to remind user about snap-schedule during volume delete

Merge pull request #60540 from ronen-fr/wip-rf-revert-57582

osd: revert PR#57582

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60549 from phlogistonjohn/jjm-smb-dataclass-config

cephadm/smb: convert config object to use a dataclass

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60451 from rhcs-dashboard/nvmeof-conf-rm-fix

mgr/dashboard: rm nvmeof conf based on its daemon name

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Merge pull request #60377 from adk3798/cephadm-share-default-images

cephadm: use shared spot for default container image names

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #60281 from phlogistonjohn/jjm-change-cluster-validate

smb: prevent switching between clustering modes

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #60096 from adk3798/maintenance-mode-dead-host

mgr/cephadm: offline host handling for maintenance exit command

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #59957 from adk3798/cephadm-bootstrap-global-public-network

cephadm: make bootstrap default to "global" section for public_network setting

Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #59838 from cbodley/wip-68083

os: remove unused btrfs_ioctl.h and tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #59644 from wlritchi/boost-1.86-compat

src/include/uuid.h: fix for boost 1.86.0

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #59568 from badone/wip-tracker-65235-noscrub-to-ignorelist

qa: Add ignorelist entries for reef-x tests

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #60453 from cbodley/wip-librados-dup

librados: dont duplicate class names in member definitions

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #54954 from diffs/main

osd: add clear_shards_repaired command

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #55693 from adk3798/cephadm-nfsv3

mgr/nfs: add NFSv3 protocol to default protocols

Reviewed-by: John Mulligan <jmulligan@redhat.com>

cephadm: update default image imports to point to common location

Additionally, remove the image defaults from the two previous locations
and update the check for the number of instances of "quay" and "docker"
in these areas respectively.

Fixes: https://tracker.ceph.com/issues/68120
Signed-off-by: Adam King <adking@redhat.com>

cephadm: add python-common/ceph to MYPYPATH and pytest PYTHONPATH

Otherwise the unit tests will fail trying to import from here.

Signed-off-by: Adam King <adking@redhat.com>

python-common: add spot in python-common for cephadm default images

To be shared between the binary and mgr module.

Signed-off-by: Adam King <adking@redhat.com>

cephadm: add python-common/ceph to cephadm zipapp

We want to use this location for files to be shared between
the cephadm binary and cephadm mgr module so it must be included
as part of the zipapp

Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #60541 from gbregman/main

mgr/cephadm: Change NVME image version to 1.3.3.

Merge pull request #60546 from phlogistonjohn/jjm-python-common-codeowners

CODEOWNERS: let orchestration cover all of python-common

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

test/pybind: update to test_fallocate for mode 0

Signed-off-by: Milind Changire <mchangir@redhat.com>

qa: test fallocate fails in mode 0

Signed-off-by: Milind Changire <mchangir@redhat.com>