client: Fix logic in need read start/end to account for fscrypt.

Fix the logic in need read start/end. We need to make sure that a
whole block is read when a rmw is issued, regardless if it starts
at offset 0 or not. Change size that may be read from where offset
starts to the whole fscrypt block.

Fixes: https://tracker.ceph.com/issues/64819
Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: After a rebase, no lock is necessary.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

Client: fix O_TRUNC issue

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: Ensure symlink plaintext is set

When creating symlink, ensure symlink_plain is set in fscrypt and
non-fscrypt cases.

Fixes: https://tracker.ceph.com/issues/64691
Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: rmw doesn't get_cap_ref like it should. After rmw,
it put_cap_ref and it didn't happen. Issue with bool need_read.

Fixes: https://tracker.ceph.com/issues/64307
Signed-off-by: Christopher Hoffman <choffman@redhat.com>

Populate add key return

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

test: Add test for semantics

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: On fscrypt enabled directories, only allow read/write to files
in dir when unlocked. Client should not be able to read/write the encrypted payload.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

fscrypt: Add tests for add key, remove key, set policy.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client: Allow setpolicy only on dir and when it is empty.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

Add multi user support on a unlock claim.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>

client,test,osdc: add beginnings of fscrypt support

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>

Merge pull request #66122 from cbodley/wip-install-deps-gcc13

install-deps: warn about gcc older than 13 for el9 and later

Reviewed-by: David Galloway <david.galloway@ibm.com>
Reviewed-by: Zack Cerza <zack@redhat.com>

Merge pull request #66124 from rhcs-dashboard/fix-svc-create-issue

mgr/dashboard: fix oauth2-service creation UI error

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

Merge pull request #64292 from VallariAg/wip-nvmeof-ns-load-balancing

qa: Improve scalability test

mgr/dashboard: fix oauth2-service creation UI error

While creating the service without providing the allowlist domain, the
UI fails with an error which is logged in the mgr log

```
Nov 05 04:11:56 ceph-node-00 ceph-mgr[1587]: [dashboard ERROR frontend.error] (https://192.168.100.100:8443/#/services/(modal:create)): Cannot read properties of null (reading 'split')
                                              TypeError: Cannot read properties of null (reading 'split')
                                                 at ServiceFormComponent.onSubmit (https://192.168.100.100:8443/src_bootstrap_ts.js:31997:74)
                                                 at ServiceFormComponent_Template_cd_form_button_panel_submitActionEvent_60_listener (https://192.168.100.100:8443/src_bootstrap_ts.js:34168:83)
                                                 at executeListenerWithErrorHandling (https://192.168.100.100:8443/node_modules_angular_core_fesm2022_core_mjs.js:26276:12)
                                                 at Object.wrapListenerIn_markDirtyAndPreventDefault [as next] (https://192.168.100.100:8443/node_modules_angular_core_fesm2022_core_mjs.js:26308:18)
                                                 at SafeSubscriber.__tryOrUnsub (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:960:10)
                                                 at SafeSubscriber.next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:900:14)
                                                 at Subscriber._next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:847:22)
                                                 at Subscriber.next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:824:12)
                                                 at EventEmitter_.next (https://192.168.100.100:8443/default-node_modules_rxjs__esm2015_internal_AsyncSubject_js-node_modules_rxjs__esm2015_intern-7c6e1a.js:604:17)
                                                 at EventEmitter_.emit (https://192.168.100.100:8443/node_modules_angular_core_fesm2022_core_mjs.js:7069:13)
```

Fixes: https://tracker.ceph.com/issues/73717
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65717 from ronen-fr/wip-rf-evesrionhash

osd: hash function for eversion_t

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Alex Ainscow <aainscow@uk.ibm.com>

Merge PR #66112 into main

* refs/pull/66112/head:
doc/radosgw: Fix frontends.rst typo

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #66115 into main

* refs/pull/66115/head:
src/common/options/global.yaml.in: Fix BlueStore capitalization

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #64122 from kamoltat/wip-ksirivad-fix-msg-v2

msg/async/ProtocolV2: Speed up connection logic when peer restarts & Added Netsplit Grace Period

install-deps: remove old logic for unsupported centos/rhel 8

Signed-off-by: Casey Bodley <cbodley@redhat.com>

install-deps: warn about gcc older than 13 for el9 and later

function ensure_decent_gcc_on_rh() is supposed to log a warning when it
finds the default gcc version is older than the gcc toolset version
installed by ceph.spec.in

> Your GCC is too old. Please run following command to add DTS to your environment:

however, this function is only called if the dts_ver variable is
initialized, so set it to 13 for centos/rocky 9 and later to match
ceph.spec.in

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65872 from aainscow/tracker_73184

Relax scrub of shard sizes for upgraded EC pools

Merge PR #66114 into main

* refs/pull/66114/head:
Revert "Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles"

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #66075 from rhcs-dashboard/bootstrap-fixes

mgr/dashboard: fixes for quick-bootstrap script

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>
Reviewed-by: Abhishek Desai <abhishek.desai1@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #64961 from edwinzrodriguez/ceph-wip-72446

btree: Safeguard delete_leaf_node to prevent dereferencing null nodes

src/common/options/global.yaml.in: Fix BlueStore capitalization

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Revert "Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles"

This reverts commit a22278724154bfcf225c6fe420bd305424559e00, reversing
changes made to cf11d9dd6e1caf3ea398766953b91fde3e078100.

This was not QA'd or reviewed by SME for mon code changes.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #66087 into main

* refs/pull/66087/head:
doc/foundation: Update associate member representative

Reviewed-by: Joseph Mundackal <jmundackal@bloomberg.net>

Merge PR #65886 into main

* refs/pull/65886/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65884 into main

* refs/pull/65884/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #65882 into main

* refs/pull/65882/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65876 into main

* refs/pull/65876/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

doc/radosgw: Fix frontends.rst typo

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #66097 from cbodley/wip-cmake-system-qatlib

cmake: fix checks for WITH_SYSTEM_QATLIB

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #66101 from mrVectorz/main

doc: Update the old ceph.com/community/ links to ceph.io/en/news/blog/

Merge pull request #65693 from vshankar/wip-73278

qa: ignore cluster warning (evicting unresponsive ...) with tasks/mgr-osd-full

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

doc: Update the old ceph.com/community/ links to ceph.io/en/news/blog/

Signed-off-by: Marc Methot <mb.methot@gmail.com>

Merge pull request #66001 from baum/nvmeof-client-timer

nvmeof: refactor beacon timer for exact frequency timing with drift correction

Merge pull request #66073 from benaryorg/crushtool-tries-docs-improvement

doc: detailed explanation of set_choose_tries

doc: detailed explanation of set_choose_tries

- specifically call the *crushtool* output a histogram
- include a surface explanation of how PG placement calculation works
- more info on `choose_total_tries`
- small but complete example for explanatory purposes
- that way people can follow along locally and test out things

Signed-off-by: benaryorg <binary@benary.org>

Merge pull request #66060 from dudy-duce/doc-svc-discovery-auth

doc/cephadm/services: Clarify service discovery auth in monitoring.rst

Merge pull request #65942 from samarahu/d4n-add-local-rgw-option

Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

doc/cephadm/services: Clarify service discovery auth in monitoring.rst

Signed-off-by: Dudy <dudythegoat@proton.me>

cmake: fix checks for WITH_SYSTEM_QATLIB

commit 30681236678c7ee006a699b658233388b0f884c8 introduced the cmake
option WITH_SYSTEM_QATLIB, but the checks were based on nonexistent
variable WITH_SYSTEM_QAT

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65568 from rhcs-dashboard/table-check-fix

mgr/dashboard: fix missing checkbox icon in table

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #66082 from rhcs-dashboard/fix-cve

mgr/dashboard: bump validator package to address vulnerability

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #66016 from NitzanMordhai/wip-nitzan-suites-perf-ci-disable-mira118-machine

tasks/cbt_performance: Tolerate exceptions during performance data up…

Merge pull request #65763 from gardran/wip-gardran-kill-get-omap-keys

os: eliminate ObjectStore::get_omap_keys method

Merge pull request #66083 from rhcs-dashboard/add-to-mailmap

Add Abhishek Desai into githubmap, organizationmap, mailmap

Merge pull request #65948 from jzhu116-bloomberg/wip-73540

rgw/multisite: check the local bucket's versioning status when replicating deletion from remote

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #65842 from h3nryc0ding/main

rgw: beast add ssl hot-reload

Reviewed-by: Mark Kogan <mkogan@ibm.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #66049 from rhcs-dashboard/table-overview-redirect

mgr/dashboard: generic redirect link for a table item

Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #66084 from rhcs-dashboard/fix-multisite-action-btn

mgr/dashboard: fix icon alignment in navigation header

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65796 from anthonyeleven/caps

src/pybind/mgr/cephadm: Improve text in module.py

Merge pull request #66088 from rhcs-dashboard/fix-cypress-dep-graph

mgr/dashboard: fix cephadm e2e dependency graph failure

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

mgr/dashboard: bump validator package to address vulnerability

fixes: https://tracker.ceph.com/issues/73657

Signed-off-by: Naman Munet <naman.munet@ibm.com>

mgr/dashboard: fix icon alignment in navigation header

Fixes: https://tracker.ceph.com/issues/73665
Signed-off-by: Naman Munet <naman.munet@ibm.com>

mgr/dashboard: fixes for quick-bootstrap script

- bump kcli to fedora42
- modify ip logic
- generate cephadm binary if it doesn't exist

Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix missing checkbox icon in table

Fixes: https://tracker.ceph.com/issues/72961
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: generic redirect link for a table item

Fixes: https://tracker.ceph.com/issues/73638
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix cephadm e2e dependency graph failure

Avoid using relative path in the cypress since its not configured yet.

Fixes: https://tracker.ceph.com/issues/73673
Signed-off-by: Nizamudeen A <nia@redhat.com>

rgw/d4n: Add config option for local RGW address

Signed-off-by: Samarah <samarah.uriarte@ibm.com>

Merge pull request #65834 from ronen-fr/wip-rf-lockedobjcnt

osd/scrub: fix blocked scrub accounting

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/foundation: Update associate member representative

Signed-off-by: Enrico Bocchi <enrico.bocchi@cern.ch>

Add Abhishek Desai into githubmap, organizationmap, mailmap
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #66047 from rhcs-dashboard/fix-user-edit-form

mgr/dashboard: Edit user via UI throwing multiple server errors

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Abhishek Desai <Abhishek.Desai1@ibm.com>

Merge pull request #66059 from bluikko/doc-fix-rtd-pip-version

doc: Pin pip to <25.3 for RTD as a workaround for pybind in admin/doc-read-the-docs.txt

Merge pull request #65859 from ronen-fr/wip-rf-minchunk

osd/scrub: do not reduce min chunk on preemption

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #65714 from batrick/objstore-warning

os: resolve unused variable warning

Merge pull request #64965 from edwinzrodriguez/ceph-wip-72473

os: Use custom delete operator for raw_combined

Merge pull request #64956 from edwinzrodriguez/ceph-wip-72403

osdc: Update CB_ObjectOperation to use value types for patterns

Merge pull request #65608 from ifed01/wip-ifed-bool-async-discard-back

blk/kernel: bring "bdev_async_discard" config parameter back.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Yite Gu <guyite@bytedance.com>

Merge pull request #66044 from anthonyeleven/typofixx

doc/start: Improve hardware-recommendations.rst

doc: Pin pip to <25.3 for RTD as a workaround for pybind

Readthedocs now uses pip 25.3 by default which requires PEP 517.
src/pybind/* does not provide pyproject.toml files for PEP 517.
For an immediate workaround to allow RTD builds to succeed, pin pip
version to earlier than 25.3.

Details for pybind in https://tracker.ceph.com/issues/73645

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

doc/start: Improve hardware-recommendations.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #65049 from edwinzrodriguez/ceph-clang-format

Add .clang-format configuration file

Merge pull request #66053 from cbodley/wip-doc-rgw-sts-lite-dep

doc/radosgw: deprecate STS Lite for tentacle

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

doc/radosgw: deprecate STS Lite for tentacle

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles

Mon: Add health warning for blaum-roth EC profile when w+1 is not prime

Merge pull request #65870 from rhcs-dashboard/fix-73480-main

mgr/dashboard: Maintain sentence case consistency in side nav bar titles

Reviewed-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard: Maintain sentence case consistency in side nav bar titles

Use sentence case for side nav bar items

Fixes: https://tracker.ceph.com/issues/73480
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: Edit user via UI throwing multiple server errors

Fixes: https://tracker.ceph.com/issues/73637
Commit includes:
Returning the default user ratelimit when the ratelimit for user is not set, hence eliminating the 500 error on UI

Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #66046 from dmick/ci-container-rocky10-tags

container/build.sh: add 'rocky-10' suffix if necessary

container/build.sh: add 'rocky-10' suffix if necessary

'fromtag' is already available as distillation of the
FROM_IMAGE environment variable: everything after last
slash, s/:/-/.  Use it as a suffix if it's anything other than
"centos-9stream" so that multiple CI container tags can coexist.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Add .clang-format configuration file

Fixes: https://tracker.ceph.com/issues/72587
Signed-off-by: Edwin Rodriguez <edwin.rodriguez1@ibm.com>

Merge pull request #65571 from ceph/dependabot/npm_and_yarn/src/pybind/mgr/dashboard/frontend/vite-5.4.20

build(deps): bump vite from 5.4.19 to 5.4.20 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #66034 from afreen23/refactor-constants

mgr/dashboard: remove hardcoded strings in About component

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65894 from rhcs-dashboard/73192-carbonize-report-an-issue-modal

mgr/dashboard : Carbonize -> Report an issue modal

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65788 from JonBailey1993/stats_mismatch_fix

osd: Fix stats mismatch cluster error seen during scrubbing occasionally

Merge pull request #65770 from aainscow/tracker_73248

osd: Relax missing entry assert for partial writes.

Merge pull request #60105 from MaxKellermann/eventfd

msg/async/Event: use eventfd on Linux

Merge pull request #64128 from thotz/cloud-restore-add-None-option

cloud restore : add None type for cloud-s3-glacier

Reviewed-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #66035 from afreen23/link-alignment

mgr/dashboard: fix misaligned text links on login page

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65991 from bluikko/doc-ops-monitoring-formatting-rados

doc/rados: Fix and improve formatting in operations/monitoring.rst

mgr/dashboard : Carbonize -> Report an issue modal
fixes : https://tracker.ceph.com/issues/73192
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #65864 from cbodley/wip-44208

rgw/beast: disable keepalive for responses before 100 Continue

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

mgr/dashboard: remove hardcoded strings in About component

Replaced inline values for user role, version prefix, and
localStorage keys with shared constants (`USER`, `VERSION_PREFIX`,
and `LocalStorage.DASHBOARD_USERNAME`). This keeps things DRY and
makes future updates easier.

Addresses part of the constant reuse cleanup in the dashboard.

Fixes: https://tracker.ceph.com/issues/70947
Signed-off-by: prik73 <prinovac@gmail.com>
Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65329 from matt-akamai/usage_trim_log_fixes

rgw/cls: fix usage log issues caused by incorrect form of name-by-user keys

Reviewed-by: Yixin Jin <yjin@akamai.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #63762 from cbodley/wip-rgw-lc-wp-coro

rgw/lc: replace WorkPool with ceph::async::spawn_throttle

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>