rgw/rgw_zone : fixing inline-data default value

added a check and set inline_data to true if the default value was not true

Fixes: https://tracker.ceph.com/issues/67933
Signed-off-by: umesh-mv <umeshmuthuvara@gmail.com>

Merge pull request #60151 from shreyanshjain7174/wip-skoduri-cloud-restore

rgw/restore: Fixed status codes and response headers
Reviewed-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #59449 from tth-trang/wip-65772-quincy

rgw/lc: Fix lifecycle not working while bucket versioning is suspended

Reviewed-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #60910 from clwluvw/putacl-log

rgw: relax RGWPutACLs_ObjStore::get_params read data log

Merge pull request #60254 from clwluvw/zonegroups-createbucket

rgw: initialize createparams zone_placement to avoid garbage value

Merge pull request #60589 from clwluvw/requested-gen-sync

rgw/multisite: revert "rgw/multisite: avoid redundant error repo entry logging

Merge pull request #60906 from zdover23/wip-doc-2024-12-02-cephadm-services-mon-capitalize-ceph

doc/cephadm: s/ceph/Ceph/ in mon.rst

rgw: relax RGWPutACLs_ObjStore::get_params read data log

the input can be logged with level 20 than zero.

Fixes: https://tracker.ceph.com/issues/69093
Signed-off-by: Seena Fallah <seenafallah@gmail.com>

Merge pull request #60412 from ShwetaBhosale1/fix_issue_68605_modify_structure_of_default_images

cephadm: Modify the structure of the default container images

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #60903 from nbalacha/wip-nbalacha-rbd-man

doc/rbd: Add mirror snapshot schedule information

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

doc/rbd: Add mirror snapshot schedule information

Signed-off-by: N Balachandran <nibalach@redhat.com>

Merge pull request #60862 from rhcs-dashboard/fix-multisite-e2e-failures

mgr/dashboard: fix multisite e2e failures

Reviewed-by: Afreen Misbah <afreen@ibm.com>

doc/cephadm: s/ceph/Ceph/ in mon.rst

s/ceph/Ceph/ in doc/cephadm/services/mon.rst where appropriate.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60759 from rhcs-dashboard/add-smb-endpoints

mgr/dashboard: add smb endpoints

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60892 from zdover23/wip-doc-2024-11-30-glossary-dashboard-plugin

doc/glossary.rst: add "Dashboard Plugin"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary.rst: add "Dashboard Plugin"

Add an entry below the (Mimic-era and therefore outdated but
nonetheless historically important) Dashboard Plugin key word in the
glosssary, which before now had never been added to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60882 from anthonyeleven/59466-followup

os/bluestore: Improve documentation introduced by #57722

Reviewed-by: Zac Dover <zac.dover@proton.me>

mgr/dashboard: add smb endpoints

Adds following SMB endpoints:
- cluster: list, get, create
- share: list, delete

Fixes: https://tracker.ceph.com/issues/69044
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

Merge pull request #60560 from ivoalmeida/carbon-tree-component

mgr/dashboard: carbon tree component

Signed-off-by: nizamial09 <nia@redhat.com>

Merge pull request #60884 from zdover23/wip-doc-2024-11-29-radosgw-s3-common

doc/radosgw: update rgw_dns_name doc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

mgr/dashboard: fix multisite e2e failures

Fixes: https://tracker.ceph.com/issues/69072
Signed-off-by: Naman Munet <namanmunet@li-ff83bccc-26af-11b2-a85c-a4b04bfb1003.ibm.com>

Merge pull request #60817 from cyx1231st/wip-seastore-improve-get_extents_if_live

crimson/os/seastore/transaction_manager: improve get_extents_if_live()

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>

doc/radosgw: update rgw_dns_name doc

Update doc/radosgw/s3/commons.rst with the changes made by Jiffin Tony
Thottan in https://github.com/ceph/ceph/pull/54524 and the suggestions
made in that same PR by Anthony D'Atri.

Explain how to set rgw_dns_name to a domain name in order to configure
access to virtual hosted buckets.

Signed-off-by: Zac Dover <zac.dover@proton.me>

os/bluestore: Improve documentation introduced by #57722

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #60427 from mkogan1/wip-vstart-dev-err

vstart: log faulty physical disk device

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

mgr/dashboard: carbon tree component

Replaces the deprecated npm package '@circlon/angular-tree-component' by
Carbon Tree component.

Fixes: https://tracker.ceph.com/issues/68249
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>

crimson/os/seastore/transaction_manager: add log in get_extents_if_live()

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: fix get_extents_if_live

It should not assume the paddr type from get_mappings is SEGMENT.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: adjust do_with for pin_list in get_extents_if_live

To make pin_list alive during parallel_for_each().

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: verify type in read_pin_by_type

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #60654 from cyx1231st/wip-seastore-fine-grained-cache

crimson/os/seastore: support partial read for data extents

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore/transaction_manager: fully read the extent before rewritting it

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: convert transaction related paths with interruptor

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: split out transaction_interruptor.h

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: implement and use maybe_indirect_extent_t::get_bl()

Return bufferlist because the extent may be partially loaded under
indirection.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: delay setting bptr for all types of extent in case of read

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

test/crimson/seastore: add test case for partial reads

Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore: disable seastore_max_data_allocation_size by default

Supposing that fine-grained-cache should address the read amplification
issue. By-default disable seastore_max_data_allocation_size with
fine-grained-cache since seastore_full_integrity_check is by-default
disabled.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: update lru size based on loaded extent size

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore: implement partial reads from cached_extent to object_data_handler

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore/cached_extent: introduce BufferSpace for partial reads

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Jianxin Li <jianxin1.li@intel.com>

crimson/os/seastore/cached_extent: minor adjustments to print

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: add missing final keywords

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: hide the complexity of extent indirection

Make it easier for TM::read_pin() users to consume extent without
worrying about the indirections.

This basically reverts 9cdcd06caadef6cdca64a974c6525ba300c1e289

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/transaction_manager: fix to use direct key/length to get absent extent

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cache: adjust logs

Mostly convert length to the hex format.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: misc cleanups and asserts

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: clarify zero length is only possible for root

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cached_extent: clarify invarients in the cstors

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cache: cleanup, use the same method to create extents

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/cached_extent: unify extent ptr creation

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #60857 from zdover23/wip-doc-2024-11-27-glossary-dc

doc/glossary: add "DC" (Data Center) to glossary

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add "DC" (Data Center) to glossary

Add the initialism "DC" (Data Center) to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60860 from anthonyeleven/update-60846

doc/radosgw: Improve archive-sync-module.rst more

Merge pull request #60721 from anuradhagadge/fix_issue_68748_add_multiple_lable

cephadm: Add multiple labels in single command to host

Reviewed-by: Adam King <adking@redhat.com>

doc/radosgw: Improve archive-sync-module.rst more

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #60856 from ceph/uadk_version

build/uadk: fix uadk repo's commit id

build/uadk: fix uadk repo's commit id

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

Merge pull request #60846 from anthonyeleven/improve-archive-sync

doc/radosgw: Improve archive-sync-module

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60801 from cbodley/wip-qa-rgw-verify-java-last

qa/rgw: the rgw/verify suite runs java tests last

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

doc/radosgw: Improve archive-sync-module.rst

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60747 from mohit84/crimson_device_class

crimson: Set device class during spawn of a crimson osd

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #60736 from guits/fix-stale-bot

.github/workflows: Do not exempt PRs with milestone

Merge pull request #59897 from avanthakkar/note-cephfs-earmark

doc: add pendingreleasenotes for cephfs subvolume earmarking feature

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #60768 from VallariAg/wip-prometheus-tested-limits

monitoring: Add alert NVMeoFTooManyNamespaces

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #60702 from ceph/wip-yuriw-release-17.2.8-main

doc: 17.2.8 Release Notes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

doc/releases: fix some formatting for the 17.2.8 release notes

Signed-off-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #60756 from ArbitCode/wip-raja-rgw-fix-68211

rgw:Wrong x-rgw-quota-bucket-objects header when bucket quota is disabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #60813 from anthonyeleven/improve-subsystem

doc/rados/troubleshooting: Improve log-and-debug.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60818 from gbregman/main

Add key encryption support to nvmeof configuration

python-common/ceph/deployment: Add key encryption support to nvmeof configuration
Fixes https://tracker.ceph.com/issues/69036

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

mgr/cephadm: Add key encryption support to nvmeof configuration
Fixes https://tracker.ceph.com/issues/69036

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

doc/rados/troubleshooting: Improve log-and-debug.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #60805 from zdover23/wip-doc-2024-11-23-cephadm-install-curl-based-installation

doc/cephadm: Improve "Curl-based Installation"

:Reviewd-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60804 from zdover23/wip-doc-2024-11-23-cephadm-install

doc/cephadm: Clarify "Deploying a new Cluster"

Reviewed-by: Anthony D'Atri<anthony.datri@gmail.com>

doc/cephadm: Improve "Curl-based Installation"

Change the name of the section "curl-based installation" to "Using Curl to Install Cephadm", and improve the English in that section.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc/cephadm: Clarify "Deploying a new Cluster"

Change the title of the section "Deploying a new Ceph cluster" to "Using
cephadm to Deploy a New Ceph Cluster". This is part of the initiative to
separate package-related documentation from container-based
documenation.

Signed-off-by: Zac Dover <zac.dover@proton.me>

rgw: send self zonegroup on forward to master

When creating a bucket in the secondary zonegroup, the `rgwx-zonegroup`
is mistakenly set to the master zonegroup when forwarding the request.
Instead, it should be set to the secondary zonegroup so that the master
zonegroup creates the bucket for the intended zonegroup rather than
for itself.

Fixes: https://tracker.ceph.com/issues/67610
Signed-off-by: Seena Fallah <seenafallah@gmail.com>

Merge pull request #60775 from cbodley/wip-rgw-access-key-active-json

rgw: RGWAccessKey::decode_json() preserves default value of 'active'

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #58645 from vshankar/wip-omap-commit-header-size

mds: account for header size during omap commit

qa/rgw: the rgw/verify suite runs java tests last

a band-aid for https://tracker.ceph.com/issues/68991 to make sure all
other tests run before the failing java tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #60488 from jmolmo/exporter_manage_sigterm

exporter: SIGTERM/SIGINT/SIGHUP management

rgw:Wrong x-rgw-quota-bucket-objects header when bucket quota is disabled

This commit introduces to get quota settings if bucket quota is enabled

Fixes: https://tracker.ceph.com/issues/68211
Signed-off-by: Raja Sharma <raja@ibm.com>

Merge pull request #60787 from ronen-fr/wip-rf-reservStat

osd/scrub: fixing reservations dump format

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>

cephadm: Modify the structure of the default container images

Fixes: https://tracker.ceph.com/issues/68605?next_issue_id=68599
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

Merge pull request #60636 from mohit84/issue_68585

TEST_backfill_grow fails after finding "num_bytes mismatch" in osd log

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60253 from MaxKellermann/includes

common: add missing include, reduce header dependencies

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #59524 from liangmingyuanneo/wip-standalone-test-pg-repair

qa/standalone: bugfix for wait_for_scrub

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #60523 from ljflores/wip-tracker-68657

mgr/balancer: optimize 'balancer status detail'

Merge pull request #60542 from adk3798/sign-generated-rgw-certs

mgr/cephadm: sign generated RGW certs

Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #60303 from adk3798/handle-failed-daemon-start

cephadm: handle "systemctl start" failures during deployment better

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #60531 from Kushal-deb/fix_issue_2124175

mgr/cephadm: Added fix for Modifying Profiles(add-setting and rm-setting) to allow multiple setting changes

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60587 from phlogistonjohn/jjm-more-py312-fixes

various python 3.12 fixes

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60319 from baum/no_huge

cephadm: support no huge pages for nvmeof spdk

osd/scrub: fixing reservations dump format

Headers were missing in the faulty dump output. This commit
fixes the section type to 'object section'.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

cephadm/nvmeof: support no huge pages for nvmeof spdk

depends on: https://github.com/ceph/ceph-nvmeof/pull/898

Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>

Merge pull request #60668 from ronen-fr/wip-rf-mconf

osd/scrub: cache frequently used configuration parameters

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #60769 from gbregman/main

mgr/cephadm: Add resource limits to nvmeof configuration

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #60588 from AlexonOliveiraRH/wip-doc-templates

doc/cephadm/services: Update monitoring.rst to add additional templates

rgw: RGWAccessKey::decode_json() preserves default value of 'active'

squid added the new "bool active" member that defaults to true, but
RGWAccessKey::decode_json() sets it to false when "active" isn't present

this is an issue for multisite when a squid zone replicates user
metadata from a master zone running reef

Fixes: https://tracker.ceph.com/issues/68985
Signed-off-by: Casey Bodley <cbodley@redhat.com>