carbonize  admin service form

Signed-off-by: Achint Kaur <ackaur@redhat.com>

create rgw service form

create rgw service form

Merge branch 'main' into carbonizeServicesForm

Merge pull request #60654 from cyx1231st/wip-seastore-fine-grained-cache

crimson/os/seastore: support partial read for data extents

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore/transaction_manager: fully read the extent before rewritting it

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: convert transaction related paths with interruptor

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: split out transaction_interruptor.h

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: implement and use maybe_indirect_extent_t::get_bl()

Return bufferlist because the extent may be partially loaded under
indirection.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: delay setting bptr for all types of extent in case of read

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

test/crimson/seastore: add test case for partial reads

Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore: disable seastore_max_data_allocation_size by default

Supposing that fine-grained-cache should address the read amplification
issue. By-default disable seastore_max_data_allocation_size with
fine-grained-cache since seastore_full_integrity_check is by-default
disabled.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: update lru size based on loaded extent size

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore: implement partial reads from cached_extent to object_data_handler

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore/cached_extent: introduce BufferSpace for partial reads

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore/cached_extent: minor adjustments to print

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: add missing final keywords

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: hide the complexity of extent indirection

Make it easier for TM::read_pin() users to consume extent without
worrying about the indirections.

This basically reverts 9cdcd06caadef6cdca64a974c6525ba300c1e289

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: fix to use direct key/length to get absent extent

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cache: adjust logs

Mostly convert length to the hex format.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: misc cleanups and asserts

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: clarify zero length is only possible for root

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cached_extent: clarify invarients in the cstors

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cache: cleanup, use the same method to create extents

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cached_extent: unify extent ptr creation

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #60857 from zdover23/wip-doc-2024-11-27-glossary-dc

doc/glossary: add "DC" (Data Center) to glossary

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add "DC" (Data Center) to glossary

Add the initialism "DC" (Data Center) to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60860 from anthonyeleven/update-60846

doc/radosgw: Improve archive-sync-module.rst more

Merge pull request #60721 from anuradhagadge/fix_issue_68748_add_multiple_lable

cephadm: Add multiple labels in single command to host

Reviewed-by: Adam King <adking@redhat.com>

doc/radosgw: Improve archive-sync-module.rst more

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #60856 from ceph/uadk_version

build/uadk: fix uadk repo's commit id

build/uadk: fix uadk repo's commit id

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

Merge pull request #60846 from anthonyeleven/improve-archive-sync

doc/radosgw: Improve archive-sync-module

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60801 from cbodley/wip-qa-rgw-verify-java-last

qa/rgw: the rgw/verify suite runs java tests last

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

doc/radosgw: Improve archive-sync-module.rst

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60747 from mohit84/crimson_device_class

crimson: Set device class during spawn of a crimson osd

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

carbon related changes

Merge pull request #60736 from guits/fix-stale-bot

.github/workflows: Do not exempt PRs with milestone

Merge pull request #59897 from avanthakkar/note-cephfs-earmark

doc: add pendingreleasenotes for cephfs subvolume earmarking feature

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #60768 from VallariAg/wip-prometheus-tested-limits

monitoring: Add alert NVMeoFTooManyNamespaces

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60702 from ceph/wip-yuriw-release-17.2.8-main

doc: 17.2.8 Release Notes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

doc/releases: fix some formatting for the 17.2.8 release notes

Signed-off-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #60756 from ArbitCode/wip-raja-rgw-fix-68211

rgw:Wrong x-rgw-quota-bucket-objects header when bucket quota is disabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #60813 from anthonyeleven/improve-subsystem

doc/rados/troubleshooting: Improve log-and-debug.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60818 from gbregman/main

Add key encryption support to nvmeof configuration

python-common/ceph/deployment: Add key encryption support to nvmeof configuration
Fixes https://tracker.ceph.com/issues/69036

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

mgr/cephadm: Add key encryption support to nvmeof configuration
Fixes https://tracker.ceph.com/issues/69036

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

doc/rados/troubleshooting: Improve log-and-debug.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #60805 from zdover23/wip-doc-2024-11-23-cephadm-install-curl-based-installation

doc/cephadm: Improve "Curl-based Installation"

:Reviewd-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60804 from zdover23/wip-doc-2024-11-23-cephadm-install

doc/cephadm: Clarify "Deploying a new Cluster"

Reviewed-by: Anthony D'Atri<anthony.datri@gmail.com>

doc/cephadm: Improve "Curl-based Installation"

Change the name of the section "curl-based installation" to "Using Curl to Install Cephadm", and improve the English in that section.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/cephadm: Clarify "Deploying a new Cluster"

Change the title of the section "Deploying a new Ceph cluster" to "Using
cephadm to Deploy a New Ceph Cluster". This is part of the initiative to
separate package-related documentation from container-based
documenation.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60775 from cbodley/wip-rgw-access-key-active-json

rgw: RGWAccessKey::decode_json() preserves default value of 'active'

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #58645 from vshankar/wip-omap-commit-header-size

mds: account for header size during omap commit

qa/rgw: the rgw/verify suite runs java tests last

a band-aid for https://tracker.ceph.com/issues/68991 to make sure all
other tests run before the failing java tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #60488 from jmolmo/exporter_manage_sigterm

exporter: SIGTERM/SIGINT/SIGHUP management

rgw:Wrong x-rgw-quota-bucket-objects header when bucket quota is disabled

This commit introduces to get quota settings if bucket quota is enabled

Fixes: https://tracker.ceph.com/issues/68211
Signed-off-by: Raja Sharma <raja@ibm.com>

Merge pull request #60787 from ronen-fr/wip-rf-reservStat

osd/scrub: fixing reservations dump format

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

Merge pull request #60636 from mohit84/issue_68585

TEST_backfill_grow fails after finding "num_bytes mismatch" in osd log

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60253 from MaxKellermann/includes

common: add missing include, reduce header dependencies

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #59524 from liangmingyuanneo/wip-standalone-test-pg-repair

qa/standalone: bugfix for wait_for_scrub

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #60523 from ljflores/wip-tracker-68657

mgr/balancer: optimize 'balancer status detail'

Merge pull request #60542 from adk3798/sign-generated-rgw-certs

mgr/cephadm: sign generated RGW certs

Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #60303 from adk3798/handle-failed-daemon-start

cephadm: handle "systemctl start" failures during deployment better

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #60531 from Kushal-deb/fix_issue_2124175

mgr/cephadm: Added fix for Modifying Profiles(add-setting and rm-setting) to allow multiple setting changes

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60587 from phlogistonjohn/jjm-more-py312-fixes

various python 3.12 fixes

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60319 from baum/no_huge

cephadm: support no huge pages for nvmeof spdk

osd/scrub: fixing reservations dump format

Headers were missing in the faulty dump output. This commit
fixes the section type to 'object section'.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

cephadm/nvmeof: support no huge pages for nvmeof spdk

depends on: https://github.com/ceph/ceph-nvmeof/pull/898

Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>

Merge pull request #60668 from ronen-fr/wip-rf-mconf

osd/scrub: cache frequently used configuration parameters

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60769 from gbregman/main

mgr/cephadm: Add resource limits to nvmeof configuration

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60588 from AlexonOliveiraRH/wip-doc-templates

doc/cephadm/services: Update monitoring.rst to add additional templates

rgw: RGWAccessKey::decode_json() preserves default value of 'active'

squid added the new "bool active" member that defaults to true, but
RGWAccessKey::decode_json() sets it to false when "active" isn't present

this is an issue for multisite when a squid zone replicates user
metadata from a master zone running reef

Fixes: https://tracker.ceph.com/issues/68985
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #60598 from xxhdx1985126/wip-68808

crimson/osd/replicate_backend: add the skipped newly created clone object to the push queue after the clone request completes

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

common: rm the cast operator of md_config_cacher_t

as its replacement - the type-deduced operator() - is now in use,
and the resulting code is more readable and less error-prone.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

osd: rm all uses of the cast operator of md_config_cacher_t

as this interface is to be removed in the next commit.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

osd/scrub: cache frequently used configuration parameters

using the md_config_cacher_t, which is a cache object that registers
itself to the config observer and caches the up-to-date configuration
value.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

common: a simple API to extract md_config_cacher_t cached value

Using a type-deduced operator() (i.e. my_opt() ), instead of the
existing ValueT() operator (which requires a type-matching cast).

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

mgr/cephadm: Add resource limits to nvmeof configuration
Fixes https://tracker.ceph.com/issues/68967

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

python-common/ceph/deployment: Add resource limits to nvmeof configuration
Fixes https://tracker.ceph.com/issues/68967

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #60572 from xxhdx1985126/wip-68787

crimson/osd/backfill_state: don't try to do object backfills when primary_bi is empty

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

crimson: Set device class during spawn of a crimson osd

Implement a wrapper for different backend storage to
set device_class during spawn of a process.

Fixes: https://tracker.ceph.com/issues/66627
Signed-off-by: Mohit Agrawal <moagrawa@redhat.com>

Merge pull request #60661 from ronen-fr/wip-rf-scheduledeep

osd/scrub: fix 'schedule-deepscrub' test asok command

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

monitoring: Add alert NVMeoFTooManyNamespaces

NVMeoFTooManyNamespaces helps to alert user if total
number of namespaces across subsystems are more than
1024.

Change NVMeoFTooManySubsystems limit to 128 from 16.

Fixes: https://github.com/ceph/ceph-nvmeof/issues/948
Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

Merge pull request #60674 from oshrey16/bugfix-rgw-ps-list-topics-op

rgw/notification: Fix segmentation fault in RGWPSListTopicsOp::execute() and correct topic listing to use get_topics_v2

Reviewed-By: Joseph Mundackal <jmundackal@bloomberg.net>, Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #60765 from zdover23/wip-doc-2024-11-19-os-recommendations

doc/start: update os-recommendations.rst

doc/start: update os-recommendations.rst

Remove information about the operating systems that support Ceph's
official container images from the "Platforms" table in
doc/start/os-recommendations.rst and add that information to the (new)
table that shows the operating systems that support Ceph's official
container images.

Credit for this change should go to Enrico Bocchi, who noticed a
discrepancy that motivated it.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60309 from linuxbox2/wip-cksum-68537

rgw_cksum:  treat mpu checksums w/o part count as valid in CompleteMu…

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #60711 from soumyakoduri/wip-skoduri-dbstore

rgw: Update README for DBStore and Posix drivers

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mds: account for header size during omap commit

fnode_t is set in the omap header during directory commit
operation which isn't accounted when tracking operation
size.

Fixes: http://tracker.ceph.com/issues/67597
Signed-off-by: Venky Shankar <vshankar@redhat.com>

rgw/notification: fix segmentation fault and topic listing logic

- Fixed a segmentation fault caused by a null bucket pointer in RGWPSListTopicsOp::execute()
- Corrected logic to use get_topics_v2 when supported, with fallback otherwise

Fixes: https://tracker.ceph.com/issues/68756
Signed-off-by: Oshrey Avraham <oshrey16@gmail.com>

doc: add pendingreleasenotes for cephfs subvolume earmarking feature

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

.github/workflows: Do not exempt PRs with milestone

The stale bot doesn't close certain PRs, even if they have been inactive
for several years, because almost all of these PRs have a milestone

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

crimson/osd/replicate_backend: add the skipped newly created clone
object to the push queue after the clone request completes

Fixes: https://tracker.ceph.com/issues/68808
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

exporter: SIGTERM/SIGINT/SIGHUP management

Ceph exporter manages SIGINT, SIGTERM and SIGHUP signals

Fixes: https://tracker.ceph.com/issues/68721
Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>

Merge pull request #60655 from xxhdx1985126/wip-seastore-move-out-root-meta

crimson/os/seastore: move the root meta out of the root block

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #60209 from myoungwon/wip-init-onode-layout

crimson/os/seastore: initialize oi and ss in onode_layout_t to zero

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

doc: 17.2.8 Release Notes

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #60715 from ronen-fr/wip-rf-dumpsched

osd/scrub: list additional information when dumping the queue

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60727 from guits/dmcrypt-activate

ceph-volume: fix dmcrypt activation regression