Merge pull request #65694 from mohit84/mclock_scheduler_monc

osd: Remove monc reference from scheduler

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65687 from pdvian/wip-73272-autoscaler

pybind/mgr/pg_autoscaler: Introduce dynamic threshold to improve scal…

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>

Merge pull request #65698 from cbodley/wip-72771

osdc: Objecter::linger_by_cookie() for safe cast from uint64

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #65615 from chungfengz-syno/fix-get_addr_from_invalid_rank

mon/Elector.cc: prevent assertion failure when receiving pings from r…

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #66311 from rhcs-dashboard/fix-73910-main

monitoring: remove cephfs.libsonnet mention from dashboards.libsonnet

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #66319 from rhcs-dashboard/fix-account-group-mode

mgr/dashboard: rgw accounts form group mode disable option is not working

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #66323 from aainscow/pg_repeer

mon: ceph pg repeer should propose a correctly sized pg temp.

Reviewed-by: Laura Flores <lflores@ibm.com>

Merge pull request #66229 from Matan-B/wip-matanb-crimson-on

ceph.spec.in: Include Crimson by default

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #66325 from solmagd/wip-doc-jd-clock-skew-option

doc: Harmonize hyphens to underscores in rados/troubleshooting/troubleshooting-mon.rst

Merge pull request #55638 from clwluvw/cmake-boost

cmake: skip boost dependency on ALIAS executable targets

Merge pull request #66228 from imran-imtiaz/dashboard

mgr/dashboard: add API endpoint to add images to consistency groups

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65915 from edwinzrodriguez/ceph-zstd-update

zstd: Update zstd to 1.5.6 for cmake 4 compatability

Merge pull request #66120 from Jayaprakash-ibm/wip-fix-cot-bz2404644

tools: handle get-attr as read-only ops in ceph-objectstore-tool

Merge pull request #66022 from Jayaprakash-ibm/wip-nref-opt

os/bluestore: Optimize Blob::put() for single-reference fast path

Merge pull request #63390 from taodd/fix-ms_async_op_threads

common: fix the ms_async_op_threads not applied successfully for daemons running in foreground mode

cmake: skip boost dependency on ALIAS executable targets

The current add_executable override in Boost does not support alias
targets. Although Ceph currently has no alias targets that are
affected by this limitation, addressing this issue now will benefit
future developments and personal projects.
This change enhances the robustness of the override logic, ensuring
compatibility with alias targets moving forward.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>

doc: Harmonize hyphens to underscores in rados/troubleshooting/troubleshooting-mon.rst

Signed-off-by: Joel Davidow <jdavidow@nso.edu>

mon: ceph pg repeer should propose a correctly sized pg temp.

Fixes: https://tracker.ceph.com/issues/73897
Signed-off-by: Alex Ainscow <aainscow@uk.ibm.com>

mgr/dashboard: rgw accounts form group mode disable option is not working

Fixes: https://tracker.ceph.com/issues/73926
Signed-off-by: Naman Munet <naman.munet@ibm.com>

qa/suites: exclude ceph-osd-crimson

Similarly to https://github.com/ceph/ceph/pull/66268.
Once crimson is enabled in RPM, ceph-osd-crimson will
be requried as a dependency.
old-clients and upgrade tests should not try to install the new package
as it is not available in older releases.

See: https://tracker.ceph.com/issues/73848

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

qa/crontab/teuthology-crontab: use default flavor for crimson

By enabling crimson in the "default" flavor - we should be able to
cleanup "crimson-release" flavor. Update the cronjob ro use the default
build flavor.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

debian,ceph.spec: add ceph-osd-crimson as dependency

a37b5b5bde8c2e8d6890f16b31046119ed55f25d added ceph-osd-crimson as dependency using OR requirement.
Once ceph-osd-classic dependency is satisfied, ceph-osd-crimson package must be added manually.
In order to not add crimson packages manually (See "Containerfile"
removed lines) - mark osd-crimson as dependency if with_crimson is
enabled for rpm and if pkg.ceph.crimson build profile is enabled for debian.

With this change, users won't be required to obtain ceph-osd-crimson
package manually when relevant. Similarly to ceph-osd-classic being
a dependency for ceph-osd.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

qa/tasks/ceph.py: introduce crimson_compat

In an attempt to use the default flavor for both crimson and classic,
we can no longer rely on flavors to enable crimson flags.
The existing CRIMSON_COMPAT env variable is defined under "workunit",
and is not supported by tasks/ceph. Instead, introduce, a dedicated
crimson_compat option supported by tasks/ceph.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

ceph.spec.in: Include Crimson by default in RPM builds

With #65782 merged, Crimson could be now built as part of the default RPM build flavor.
The binaries ceph-osd-crimson and ceph-osd-classic are managed via `update-alternatives`
and selected based on priority:

- ceph-osd-classic keeps the **highest** priority (100) and remains the default.
- Switching to crimson is possible via:
  update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson

Existing classic behavior remains unchanged unless the above command is explicitly executed.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #66268 from Matan-B/wip-matanb-old-clients-installs

qa/suites/thrash-old-clients/1-install: exclude ceph-osd-classic

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

mgr/dashboard: add API endpoint to add images to consistency groups

Signed-off-by: Imran Imtiaz <imran.imtiaz@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/73840
Create a consistency group dashboard API endpoint that enables adding
RBD images to the group.

Merge pull request #62765 from bobham-bloomberg/unittest-ceph-assert

test/ceph_assert.cc: Disable core files

Merge pull request #66307 from shraddhaag/wip-shraddhaag-fix-slow-ops

qa/clusters/crimson: increase reactors in fixed-1 cluster

Reviewed-by: Matan Breizman <mbreizma@ibm.com>

monitoring: remove cephfs.libsonnet mention from dashboards.libsonnet

We recently added a new CephFS Overview dashboard and removed the
older MDS Performance dashboard. We need to remove the mention
of cephfs.libsonnet from dashboards.libsonnet file as well.

Fixes: https://tracker.ceph.com/issues/73910
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #65971 from ceph/wip-20.2.0-documentation

doc: add Tentacle v20.2.0 release notes

Merge pull request #65374 from dang/wip-dang-standalone

RGW - Standalone - Enable building without librados

doc/releases: add cephadm notes

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: change final release date

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases/tentacle: add missing rgw deprecation notice

Signed-off-by: Casey Bodley <cbodley@redhat.com>

doc/releases/tentacle: fix Crimson highlight

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases/tentacle: add Crimson highlight

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: arrange sections in alphabetical order

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases/tentacle.rst: more RBD items

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc/releases/tentacle.rst: fix seastore typo

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: remove extra word

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases/tentacle.rst: Update Crimson section

Refer to Tentacle Crimson updates blog post

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: remove note that is not specific to tentacle

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: move smb support update into highlights

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: give smb update a better category title

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add Crimson section and clean up references

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: edit formatting and other small changes

Formatting with double backticks, indentation etc.

Fix some typos and add missing hyphenation.

Add review comment suggestions by anthonyeleven after OOB discussion.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

doc/releases: add one more item to RADOS

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add to CephFS section

And a bit of RGW

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add more to RBD section

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: clean up RGW formatting

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: take quincy out of timeline since it is EOL

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add more to mgr section and fix rados formatting

Signed-off-by: Laura Flores <lflores@ibm.com>

doc: improve rados section for tentacle release notes

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/tentacle: add more RGW release notes

Signed-off-by: Casey Bodley <cbodley@redhat.com>

doc: add Tentacle v20.2.0 release notes

Signed-off-by: Laura Flores <lflores@ibm.com>

qa/clusters/crimson: increase reactors in fixed-1 cluster

Issue: Various different tests were failing randomly due to slow
ops. There was no common ground between them, it was happening
across differnet object stores (seastore and bluestore) and
across different tests.

Cause: Since this is happening quite randomly, this is likely
happening due to low reactor count.

Solution: We are opting the solution to increase reactors used
for testing. I've increased them to 3 from the initial 2 value.

Fixes: https://tracker.ceph.com/issues/72778
Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #66207 from steliaio/fix-rados-fsid-return-doc

include/rados/librados.h: fix documented rados_cluster_fsid return value

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65711 from rhcs-dashboard/fix-73296-main

monitoring: Improve grafana dashboards naming convention

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #66286 from rhcs-dashboard/fix-rgw-user-e2e

mgr/dashboard: link rgw user with account e2e failure

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge PR #66298 into main

* refs/pull/66298/head:
script/ptl-tool: organize options and improve help output
script/ptl-tool: add options to set distros/flavors/archs
ptl-tool: add options to append to branch name

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>

Merge pull request #65735 from rhcs-dashboard/input-string-list

mgr/dashboard: add text-label-list component

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66303 from ronen-fr/wip-rf-tool73900

qs/standalone/scrub: modify osd-scrub-snaps.sh to match ceph-objectstore-tool changes

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>

qs/standalone/scrub: modify osd-scrub-snaps.sh to match
ceph-objectstore-tool changes

A previous commit (2e54b2a) modified ceph-objectstore-tool to no longer
accept the 'clear-snapset' command with no arguments.

This PR modifies the osd-scrub-snaps.sh test script, to match that
change.

Fixes: https://tracker.ceph.com/issues/73900
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #66275 from yuvalif/wip-yuval-vstart-debug

vstart: all rgw debug logs must honor the -d flag

mgr/dashboard: carbonize smb service custom_dns input

Fixes: https://tracker.ceph.com/issues/73319
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

Merge pull request #66259 from rhcs-dashboard/add-panel-footer

mgr/dashboard: add footer to side-panel

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66253 from rhcs-dashboard/add-to-mailmap-githubmap-organizationmap

Add Devika Babrekar into githubmap, organizationmap, mailmap

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66291 from afreen23/illegible-text

mgr/dashboard: Remove illegible texts from the dashboard

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66246 from nbalacha/wip-nbalacha-73812

rgw/notify: fix reading the entries in a loop

Merge pull request #66299 from solmagd/wip-doc-release-dates-jd

doc: Added release dates to 18.2.5 to 18.2.7 and 19.2.0 to 19.2.3.

Reviewed-by: Laura Flores <lflores@ibm.com>

script/ptl-tool: organize options and improve help output

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

script/ptl-tool: add options to set distros/flavors/archs

See: https://github.com/ceph/ceph-build/tree/main/ceph-trigger-build#git-trailer-parameters

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

test/ceph_assert.cc: Disable core files

Without this, core files are produced which subsequently cause
failures in other tests, specifically smoke.sh and safe-to-destroy.sh.

Fixes: bfa83df6d33ee2238f1389ca4518592b5c4fb267
Signed-off-by: Bob Ham <bham12@bloomberg.net>
test/ceph_assert.cc: Update line numbers

Signed-off-by: Bob Ham <bham12@bloomberg.net>

ptl-tool: add options to append to branch name

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

doc: Added release dates to reef 18.2.5 to 18.2.7 and squid 19.2.0 to 19.2.3 inclusive.

Signed-off-by: Joel Davidow <jdavidow@nso.edu>

Merge pull request #66105 from rhcs-dashboard/carbonize-sync-policy-form

mgr/dashboard: Carbonize multisite sync policy forms

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

qa/suites: exclude ceph-osd-classic

a37b5b5bde8c2e8d6890f16b31046119ed55f25d added ceph-osd-classic
package.
old-clients and upgrade tests should not try to install the new package
as it is not available in older releases.

Fixes: https://tracker.ceph.com/issues/73848
Signed-off-by: Matan Breizman <mbreizma@redhat.com>

mgr/dashboard: Remove illegible texts from the dashboard

Signed-off-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: add footer to side-panel

Fixes: https://tracker.ceph.com/issues/73788Wq
Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #65999 from anoopcs9/smb-disable-posix-locking

mgr/smb: Disable posix locking in share definition

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65931 from anoopcs9/update-smbd-ports-config

smb: Update the configuration logic for smbd ports

Reviewed-by: Adam King <adking@redhat.com>

mgr/dashboard: rgw users link user with account e2e failure

Fixes: https://tracker.ceph.com/issues/73835
Changes Include:
Previously, users were initialized without their associated account data,
causing issues in table display and row expansion.

This change ensures that users are initialized only after fetching accounts
and mapping them to each user. If the account API fails, users are still
initialized with a default empty account to prevent errors.

Signed-off-by: Naman Munet <naman.munet@ibm.com>

test/rgw/notify: cover case with motre than 1K topics

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #64909 from darkwsh/cephfs_fix_monc_not_subcribe

cephfs: fix monclient not subscribed monmap/config

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #66206 from samarahu/wip-posix-s3-debugging

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

vstart: all rgw debug logs must honor the -d flag

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

rgw/notify: fix reading the entries in a loop

If more than 1024 entries exist, the start_after variable
is updated to enable reading the subsequent set of entries.

Fixes: https://tracker.ceph.com/issues/73812
Signed-off-by: N Balachandran <nithya.balachandran@ibm.com>

Merge pull request #66179 from rhcs-dashboard/73766-remove-subalerts-detail

mgr/dashboard : Remove subalerts details for multiple subalerts

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

cephfs: make sure mon authenticate before objecter start

Signed-off-by: Shaohui Wang <wangshaohui.0512@bytedance.com>

tests: add a test case for cephfs SingletonClient

In SingletonClient::init(), objecter->start() called before
monc->authenticate(), it makes conns of monc authencated before
monc->authenticate() called if mons reply faster, in this case,
monc will not subsribe monmap/config.

Signed-off-by: Shaohui Wang <wangshaohui.0512@bytedance.com>

Merge pull request #62630 from theanalyst/batch-getattr-fixes

cephfs: MDCache request cleanup

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #65918 from chrisphoffman/wip-choffman-73487

client: account for mixed quotas in statfs

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #66219 from guits/cv-migrate-to-dataclass

ceph-volume: migrate namedtuple based config and sysInfo to dataclasses

Merge pull request #66273 from afreen23/fix-subsystem-limit

mgr/dashboard: Set max subsystem count to 512 rather than 4096

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #66266 from Matan-B/wip-matanb-crimson-seastore-testing-recovery

qa/suites/crimson-rados/thrash: enable seastore

Reviewed-by: Kautilya Tripathi kautilya.tripathi@ibm.com
Reviewed-by: Shraddha Agrawal <shraddhaag@ibm.com>
Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>

mgr/dashboard: Set max subsystem count to 512 rather than 4096

Fixes https://tracker.ceph.com/issues/73867

- regression from https://github.com/ceph/ceph/pull/64477/files
- removing frontend valdations as this values are volatiel and require changes every release. Nvmeof is seeting these and validating as well.

Signed-off-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: Carbonize multisite sync policy forms

Fixes: https://tracker.ceph.com/issues/73164
Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #65773 from trociny/wip-69492

rbd-mirror: add cluster fsid to remote meta cache key

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #65901 from baum/rbd_aio_write_with_crc32c

librbd: add rbd_aio_write_with_crc32c API for precomputed checksums

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

qa/suites/crimson-rados-experimental: cleanp thrash

Moved to crimson-rados/thrash instead.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>