qa/cephfs: introduce nfs-ganesha tests

Signed-off-by: Venky Shankar <vshankar@redhat.com>

pybind/nfs: support passing ceph/nfsv4 blocks in export json

This is to support async, zerocopy and delegations testing.

Signed-off-by: Venky Shankar <vshankar@redhat.com>

qa/cephfs: ignore `OSD_HOST_DOWN` health warning

Fixes: http://tracker.ceph.com/issues/72259
Signed-off-by: Venky Shankar <vshankar@redhat.com>

client: signal waitfor_commit waiters for write delegation enabled inode

Signed-off-by: Venky Shankar <vshankar@redhat.com>

mds: session reclaim could miss blocklisting an old session

Fixes: https://tracker.ceph.com/issues/66003
Signed-off-by: Venky Shankar <vshankar@redhat.com>

mgr/alerts: enforce ssl context to SMTP_SSL

Fixes: https://github.com/ceph/ceph/security/advisories/GHSA-xj9f-7g59-m4jx
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix cephadm e2e failure

- fix add host failure because of cds-tag migration
- fix draining issue where start/stop toggle was not working properly
- supress an undefined class error in cypress which is raised in
  different place from table component

Signed-off-by: Nizamudeen A <nia@redhat.com>

.github/workflow: Disable cron based github actions on forks

Signed-off-by: Joseph Mundackal <joseph.j.mundackal@gmail.com>

install-deps: remove old logic for unsupported centos/rhel 8

Signed-off-by: Casey Bodley <cbodley@redhat.com>

install-deps: warn about gcc older than 13 for el9 and later

function ensure_decent_gcc_on_rh() is supposed to log a warning when it
finds the default gcc version is older than the gcc toolset version
installed by ceph.spec.in

> Your GCC is too old. Please run following command to add DTS to your environment:

however, this function is only called if the dts_ver variable is
initialized, so set it to 13 for centos/rocky 9 and later to match
ceph.spec.in

Signed-off-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: fix oauth2-service creation UI error

While creating the service without providing the allowlist domain, the
UI fails with an error which is logged in the mgr log

```
Nov 05 04:11:56 ceph-node-00 ceph-mgr[1587]: [dashboard ERROR frontend.error] (https://192.168.100.100:8443/#/services/(modal:create)): Cannot read properties of null (reading 'split')
                                              TypeError: Cannot read properties of null (reading 'split')
                                                 at ServiceFormComponent.onSubmit (https://192.168.100.100:8443/src_bootstrap_ts.js:31997:74)
                                                 at ServiceFormComponent_Template_cd_form_button_panel_submitActionEvent_60_listener (https://192.168.100.100:8443/src_bootstrap_ts.js:34168:83)
                                                 at executeListenerWithErrorHandling (https://192.168.100.100:8443/node_modules_angular_core_fesm2022_core_mjs.js:26276:12)
                                                 at Object.wrapListenerIn_markDirtyAndPreventDefault [as next] (https://192.168.100.100:8443/node_modules_angular_core_fesm2022_core_mjs.js:26308:18)
                                                 at SafeSubscriber.__tryOrUnsub (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:960:10)
                                                 at SafeSubscriber.next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:900:14)
                                                 at Subscriber._next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:847:22)
                                                 at Subscriber.next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:824:12)
                                                 at EventEmitter_.next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:604:17)
                                                 at EventEmitter_.emit (https://192.168.100.100:8443/node_modules_angular_core_fesm2022_core_mjs.js:7069:13)
```

Fixes: https://tracker.ceph.com/issues/73717
Signed-off-by: Nizamudeen A <nia@redhat.com>

qa: fix device name in workunits/nvmeof/fio_test.sh

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

qa: Add CEPHADM_FAILED_DAEMON to nvmeof ignorelist

During nvmeof gateway deployment, these healtcheck warnings
come up and get resolved pretty quickly themselves.
We can safely add it to ignorelist because if the gateways
were down later in test, another healtcheck NVMEOF_GATEWAY_DOWN
would fail the test.

Also increase no-huge-pages spdk_mem_size from 4096 to 8192

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

qa: Remove multiple gateway conf from nvmeof thrasher

Remove these files:
- qa/suites/nvmeof/thrash/gateway-initiator-setup/2-subsys-8-namespace.yaml
- qa/suites/nvmeof/thrash/gateway-initiator-setup/120-subsys-8-namespace.yaml

This is because now we can use overrides to change
gateway configuration.

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

qa: add "osds down" to nvmeof:thrash ignorelist

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

qa: allow overrides for nvmeof task

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

qa: Improve scalability test

Improve logs of scalablity script.
And DEBUG mode in comments, we can
use it when needed.

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

osd: hash function for eversion_t

(required by ModeCollector when using eversion_t as key type)

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

doc/radosgw: Fix frontends.rst typo

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge PR #66115 into main

* refs/pull/66115/head:
src/common/options/global.yaml.in: Fix BlueStore capitalization

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #64122 from kamoltat/wip-ksirivad-fix-msg-v2

msg/async/ProtocolV2: Speed up connection logic when peer restarts & Added Netsplit Grace Period

Merge pull request #65872 from aainscow/tracker_73184

Relax scrub of shard sizes for upgraded EC pools

Merge PR #66114 into main

* refs/pull/66114/head:
Revert "Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles"

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #66075 from rhcs-dashboard/bootstrap-fixes

mgr/dashboard: fixes for quick-bootstrap script

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>
Reviewed-by: Abhishek Desai <abhishek.desai1@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #64961 from edwinzrodriguez/ceph-wip-72446

btree: Safeguard delete_leaf_node to prevent dereferencing null nodes

src/common/options/global.yaml.in: Fix BlueStore capitalization

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Revert "Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles"

This reverts commit a22278724154bfcf225c6fe420bd305424559e00, reversing
changes made to cf11d9dd6e1caf3ea398766953b91fde3e078100.

This was not QA'd or reviewed by SME for mon code changes.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #66087 into main

* refs/pull/66087/head:
doc/foundation: Update associate member representative

Reviewed-by: Joseph Mundackal <jmundackal@bloomberg.net>

Merge PR #65886 into main

* refs/pull/65886/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65884 into main

* refs/pull/65884/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #65882 into main

* refs/pull/65882/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65876 into main

* refs/pull/65876/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #66097 from cbodley/wip-cmake-system-qatlib

cmake: fix checks for WITH_SYSTEM_QATLIB

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #66101 from mrVectorz/main

doc: Update the old ceph.com/community/ links to ceph.io/en/news/blog/

Merge pull request #65693 from vshankar/wip-73278

qa: ignore cluster warning (evicting unresponsive ...) with tasks/mgr-osd-full

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

doc: Update the old ceph.com/community/ links to ceph.io/en/news/blog/

Signed-off-by: Marc Methot <mb.methot@gmail.com>

Merge pull request #66001 from baum/nvmeof-client-timer

nvmeof: refactor beacon timer for exact frequency timing with drift correction

Merge pull request #66073 from benaryorg/crushtool-tries-docs-improvement

doc: detailed explanation of set_choose_tries

doc: detailed explanation of set_choose_tries

- specifically call the *crushtool* output a histogram
- include a surface explanation of how PG placement calculation works
- more info on `choose_total_tries`
- small but complete example for explanatory purposes
- that way people can follow along locally and test out things

Signed-off-by: benaryorg <binary@benary.org>

Merge pull request #66060 from dudy-duce/doc-svc-discovery-auth

doc/cephadm/services: Clarify service discovery auth in monitoring.rst

Merge pull request #65942 from samarahu/d4n-add-local-rgw-option

Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

doc/cephadm/services: Clarify service discovery auth in monitoring.rst

Signed-off-by: Dudy <dudythegoat@proton.me>

cmake: fix checks for WITH_SYSTEM_QATLIB

commit 30681236678c7ee006a699b658233388b0f884c8 introduced the cmake
option WITH_SYSTEM_QATLIB, but the checks were based on nonexistent
variable WITH_SYSTEM_QAT

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65568 from rhcs-dashboard/table-check-fix

mgr/dashboard: fix missing checkbox icon in table

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #66082 from rhcs-dashboard/fix-cve

mgr/dashboard: bump validator package to address vulnerability

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66016 from NitzanMordhai/wip-nitzan-suites-perf-ci-disable-mira118-machine

tasks/cbt_performance: Tolerate exceptions during performance data up…

Merge pull request #65763 from gardran/wip-gardran-kill-get-omap-keys

os: eliminate ObjectStore::get_omap_keys method

Merge pull request #66083 from rhcs-dashboard/add-to-mailmap

Add Abhishek Desai into githubmap, organizationmap, mailmap

Merge pull request #65948 from jzhu116-bloomberg/wip-73540

rgw/multisite: check the local bucket's versioning status when replicating deletion from remote

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #65842 from h3nryc0ding/main

rgw: beast add ssl hot-reload

Reviewed-by: Mark Kogan <mkogan@ibm.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #66049 from rhcs-dashboard/table-overview-redirect

mgr/dashboard: generic redirect link for a table item

Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #66084 from rhcs-dashboard/fix-multisite-action-btn

mgr/dashboard: fix icon alignment in navigation header

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65796 from anthonyeleven/caps

src/pybind/mgr/cephadm: Improve text in module.py

Merge pull request #66088 from rhcs-dashboard/fix-cypress-dep-graph

mgr/dashboard: fix cephadm e2e dependency graph failure

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

mgr/dashboard: bump validator package to address vulnerability

fixes: https://tracker.ceph.com/issues/73657

Signed-off-by: Naman Munet <naman.munet@ibm.com>

mgr/dashboard: fix icon alignment in navigation header

Fixes: https://tracker.ceph.com/issues/73665
Signed-off-by: Naman Munet <naman.munet@ibm.com>

mgr/dashboard: fixes for quick-bootstrap script

- bump kcli to fedora42
- modify ip logic
- generate cephadm binary if it doesn't exist

Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix missing checkbox icon in table

Fixes: https://tracker.ceph.com/issues/72961
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: generic redirect link for a table item

Fixes: https://tracker.ceph.com/issues/73638
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix cephadm e2e dependency graph failure

Avoid using relative path in the cypress since its not configured yet.

Fixes: https://tracker.ceph.com/issues/73673
Signed-off-by: Nizamudeen A <nia@redhat.com>

rgw/d4n: Add config option for local RGW address

Signed-off-by: Samarah <samarah.uriarte@ibm.com>

Merge pull request #65834 from ronen-fr/wip-rf-lockedobjcnt

osd/scrub: fix blocked scrub accounting

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/foundation: Update associate member representative

Signed-off-by: Enrico Bocchi <enrico.bocchi@cern.ch>

Add Abhishek Desai into githubmap, organizationmap, mailmap
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #66047 from rhcs-dashboard/fix-user-edit-form

mgr/dashboard: Edit user via UI throwing multiple server errors

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Abhishek Desai <Abhishek.Desai1@ibm.com>

Merge pull request #66059 from bluikko/doc-fix-rtd-pip-version

doc: Pin pip to <25.3 for RTD as a workaround for pybind in admin/doc-read-the-docs.txt

Merge pull request #65859 from ronen-fr/wip-rf-minchunk

osd/scrub: do not reduce min chunk on preemption

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #65714 from batrick/objstore-warning

os: resolve unused variable warning

Merge pull request #64965 from edwinzrodriguez/ceph-wip-72473

os: Use custom delete operator for raw_combined

Merge pull request #64956 from edwinzrodriguez/ceph-wip-72403

osdc: Update CB_ObjectOperation to use value types for patterns

Merge pull request #65608 from ifed01/wip-ifed-bool-async-discard-back

blk/kernel: bring "bdev_async_discard" config parameter back.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Yite Gu <guyite@bytedance.com>

Merge pull request #66044 from anthonyeleven/typofixx

doc/start: Improve hardware-recommendations.rst

doc: Pin pip to <25.3 for RTD as a workaround for pybind

Readthedocs now uses pip 25.3 by default which requires PEP 517.
src/pybind/* does not provide pyproject.toml files for PEP 517.
For an immediate workaround to allow RTD builds to succeed, pin pip
version to earlier than 25.3.

Details for pybind in https://tracker.ceph.com/issues/73645

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

doc/start: Improve hardware-recommendations.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #65049 from edwinzrodriguez/ceph-clang-format

Add .clang-format configuration file

Merge pull request #66053 from cbodley/wip-doc-rgw-sts-lite-dep

doc/radosgw: deprecate STS Lite for tentacle

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

doc/radosgw: deprecate STS Lite for tentacle

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles

Mon: Add health warning for blaum-roth EC profile when w+1 is not prime

Merge pull request #65870 from rhcs-dashboard/fix-73480-main

mgr/dashboard: Maintain sentence case consistency in side nav bar titles

Reviewed-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: Maintain sentence case consistency in side nav bar titles

Use sentence case for side nav bar items

Fixes: https://tracker.ceph.com/issues/73480
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: Edit user via UI throwing multiple server errors

Fixes: https://tracker.ceph.com/issues/73637
Commit includes:
Returning the default user ratelimit when the ratelimit for user is not set, hence eliminating the 500 error on UI

Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #66046 from dmick/ci-container-rocky10-tags

container/build.sh: add 'rocky-10' suffix if necessary

container/build.sh: add 'rocky-10' suffix if necessary

'fromtag' is already available as distillation of the
FROM_IMAGE environment variable: everything after last
slash, s/:/-/.  Use it as a suffix if it's anything other than
"centos-9stream" so that multiple CI container tags can coexist.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Add .clang-format configuration file

Fixes: https://tracker.ceph.com/issues/72587
Signed-off-by: Edwin Rodriguez <edwin.rodriguez1@ibm.com>

Merge pull request #65571 from ceph/dependabot/npm_and_yarn/src/pybind/mgr/dashboard/frontend/vite-5.4.20

build(deps): bump vite from 5.4.19 to 5.4.20 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #66034 from afreen23/refactor-constants

mgr/dashboard: remove hardcoded strings in About component

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65894 from rhcs-dashboard/73192-carbonize-report-an-issue-modal

mgr/dashboard : Carbonize -> Report an issue modal

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65788 from JonBailey1993/stats_mismatch_fix

osd: Fix stats mismatch cluster error seen during scrubbing occasionally

Merge pull request #65770 from aainscow/tracker_73248

osd: Relax missing entry assert for partial writes.

Merge pull request #60105 from MaxKellermann/eventfd

msg/async/Event: use eventfd on Linux

Merge pull request #64128 from thotz/cloud-restore-add-None-option

cloud restore : add None type for cloud-s3-glacier

Reviewed-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #66035 from afreen23/link-alignment

mgr/dashboard: fix misaligned text links on login page

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65991 from bluikko/doc-ops-monitoring-formatting-rados

doc/rados: Fix and improve formatting in operations/monitoring.rst

mgr/dashboard : Carbonize -> Report an issue modal
fixes : https://tracker.ceph.com/issues/73192
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #65864 from cbodley/wip-44208

rgw/beast: disable keepalive for responses before 100 Continue

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

mgr/dashboard: remove hardcoded strings in About component

Replaced inline values for user role, version prefix, and
localStorage keys with shared constants (`USER`, `VERSION_PREFIX`,
and `LocalStorage.DASHBOARD_USERNAME`). This keeps things DRY and
makes future updates easier.

Addresses part of the constant reuse cleanup in the dashboard.

Fixes: https://tracker.ceph.com/issues/70947
Signed-off-by: prik73 <prinovac@gmail.com>
Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65329 from matt-akamai/usage_trim_log_fixes

rgw/cls: fix usage log issues caused by incorrect form of name-by-user keys

Reviewed-by: Yixin Jin <yjin@akamai.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #63762 from cbodley/wip-rgw-lc-wp-coro

rgw/lc: replace WorkPool with ceph::async::spawn_throttle

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #65480 from nzliu-dev/wip-admin-rest-api-for-setting-account-quota

rgw: Implement Admin REST APIs for Setting Account Quota

Reviewed-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: fix misaligned text links on login page

Fixes a UI regression introduced after the Carbon update where
the help-related links (Help, Security, Trademarks) on the login
page were misaligned. The links are now left-aligned under the
Ceph logo for visual consistency.

Fixes: https://tracker.ceph.com/issues/71313
Signed-off-by: prik73 <prinovac@gmail.com>
Signed-off-by: Afreen Misbah <afreen@ibm.com>