doc: update governance.rst to change email address

Signed-off-by: Myoungwon Oh <ohmyoungwon@gmail.com>

Merge branch 'main' into daemon-upgrade-issue-with-space

mgr/dashboard: [snap-visibility]Edit Client config option remains stuck in loading when nfs user is configured

Fixes: https://tracker.ceph.com/issues/76200
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

mgr/dashboard: mgr/dashboard: Rename namespace block size field and reorder namespace create form fields

Fixes: https://tracker.ceph.com/issues/75707
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

mgr/cephadm: fixed tests for haproxy peer communication port

Fixes: https://tracker.ceph.com/issues/75704
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

Merge pull request #68490 from rhcs-dashboard/fix-76163-main

mgr/dashboard: remove sync_from entry when sync_from_all is true

Reviewed-by: Afreen Misbah <afreen@ibm.com>

mgr/dashboard : Fix RGW restart/stop issue
fixes : https://tracker.ceph.com/issues/76158
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

crimson/os/seastore/cache: conconrrent read of EXIST_CLEAN extents can
lead to non-stable and io pending extents

Fixes: https://tracker.ceph.com/issues/76197
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

mgr/dashboard: Validate no added hosts in second step

Fixes https://tracker.ceph.com/issues/76195

Signed-off-by: Afreen Misbah <afreen@ibm.com>

docs/start: Reflect multi-arch support for SMB service

These days samba containers are built for both x86_64 and aarch64.

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>

cephadm/images: Update tags for samba and smbmetrics containers

It has been a few months since the samba-container and smbmetrics
projects started tagging image names with child manifests corresponding
to system architecture. This commit updates the default images for the
samba-server and samba-metrics containers to use those new architecture
independent tags.

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>

rgw: align period/zone commands in radosgw-admin help

Update inline usage output to match the actual command table.

Replace period rm with period delete and zone rm with zone delete in \radosgw-admin --help, matching OPT::PERIOD_DELETE and OPT::ZONE_DELETE.

Signed-off-by: Farzan <farzan.eng@gmail.com>

rgw/logging: use trans_id for standard access log record

In standard mode, the access log record was using s->req_id for the
request ID field. The correct field is s->trans_id, which matches the
x-amz-request-id returned in the S3 response. This is consistent with
how all other RGW response code uses trans_id.

Fixes: http://tracker.ceph.com/issues/75416
Signed-off-by: cheese-cakee <farzanaman99@gmail.com>

doc/rados/operations/placement-groups: Add pg_autoscaler allocation description
Update Placement Groups doc page with description of pg_autoscaler allocation algorithm.
Add example calculations showing how the algorithm prefers fairness over greedy utilization

Fixes: https://tracker.ceph.com/issues/73418
Signed-off-by: Eric Zhang <emzhang@ibm.com>

mgr/dashboard: Fix osd modal spacings and footer

Fixes https://tracker.ceph.com/issues/76188

- aligned as per https://carbondesignsystem.com/components/modal/usage/#transactional-modal

Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #68465 from rhcs-dashboard/IBMCEPH-10149-rgw-non-version-bucket

mgr/dashboard : fix-non-versioning-bucket-issue

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #68412 from cloudbehl/cephfsdashboardCPUMEM

mgt/dashboard: Add the CPU, Memory to CephFS dashboard

Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

mgr/dashboard: remove sync_from entry when sync_from_all is true

Fixes: https://tracker.ceph.com/issues/76163
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #68411 from rhcs-dashboard/fix-76054-main

mgr/dashboard: Option to select archive option while Import Multi-site token

Reviewed-by: Naman Munet <nmunet@redhat.com>

Merge pull request #67869 from rhcs-dashboard/sync-policy-replication

mgr/dashboard: sync policy created for a bucket in Object >> Multi-site >> Sync-policy, is not reflecting under bucket's replication

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #68485 from kginonredhat/issue-76147-typo-spcified-in-comment

mgr/cephadm: fix typo in schedule.py comment (specified)

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #68464 from vshankar/wip-exlude-crimson-fs-upgrade

qa/cephfs: exclude ceph-osd-{classic,crimson} in fs:upgrade:featurefu…

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

python-common: Validate Ingress spec peer/frontend/monitor ports
Fixes: https://tracker.ceph.com/issues/75704
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/cephadm: Provide option to configure custom haproxy peer communication port in case user wants to run multiple haproxy services in same hosts

Fixes: https://tracker.ceph.com/issues/75704
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

Revert "common/version: strip trailing newline from vendor release file"
Revert "src/common/version: append vendor release to ceph version(s) output"

This reverts commits 5022557a0f23e131731224b11b466a79eb1042c0 and
541439b290001e1bb15dc9b2b40671671c2b85c4.

As discussed in https://github.com/ceph/ceph/pull/67693, using a
file-based approach to get the vendor version is not safe or correct.
We are reverting this and will instead work on an approach where the
version string is baked into the binary at build time.

Fixes: https://tracker.ceph.com/issues/76134
Signed-off-by: Naveen Naidu <naveennaidu479@gmail.com>

Merge pull request #67867 from vshankar/wip-75380

qa/cephfs: treat "implicit declaration of function" for blogbench workunit for newer gcc version

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>

os/bluestore: remove obsolete "zoned" freelist type

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>

Merge pull request #68179 from ifed01/wip-ifed-util-no-warn

common/util: silent "warning: ‘cgroup_limit’ may be used uninitialized"

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

rgw: Inject keystone userid into IAM policy

Expose the Keystone token user UUID as condition key "keystone:userid"
so IAM and bucket policies can restrict access by user (e.g. per-user
buckets or user-specific allow/deny).

On-behalf-of: SAP <supriti.singh@clyso.com>
Signed-off-by: Supriti Singh <supriti.singh@clyso.com>

rgw: Inject keystone roles into IAM policy

Keystone roles are injected into the IAM policy evaluation
environment as "keystone:role" condition keys. This enables
bucket policies to grant or deny access based on Keystone roles.
It bridges the gap between Openstack RBAC and S3 IAM policy.

Document keystone:role in bukcet policy and Keystone S3
integration

Signed-off-by: Supriti Singh <supriti.singh@clyso.com>
Signed-off-by: Marcel Lauhoff <marcel.lauhoff@clyso.com>
On-behalf-of: SAP <supriti.singh@clyso.com>
On-behalf-of: SAP <marcel.lauhoff@sap.com>

Merge pull request #68486 from rhcs-dashboard/fix-76156-main

mgr/dashboard: remove archive option from master zone creation

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #68440 from rhcs-dashboard/tearsheet-layout-fix

mgr/dashboard: tearsheet-layout-fix

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #68224 from rhcs-dashboard/fix/nvmeof-initiator-hostname-prevalidation

mgr/dashboard: NVMe-of Initiator Hostname Pre-validation

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #68160 from rhcs-dashboard/fix-delete-subsystem

mgr/dashboard: fix delete subsystem issue

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>

mgr/cephadm: Add RDMA device check only when ip is available in 'cephadm list-network'

If interface has secondary ip and there is no route explicitly added for that ip then it does not
get listed in 'cephadm list-network'. And RDMA precheck fails even if RDMA enabled interface exists.

Fixes: https://tracker.ceph.com/issues/75189
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/nfs: Added nfs cluster level RDMA precheck for enabling RDMA for export
If NFS cluster level RDMA is enabled then only allow transport as RDMA at export level

Fixes: https://tracker.ceph.com/issues/75189
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

Merge pull request #67546 from kotreshhr/mirror-syncthreads-fair-scheduling

tools/cephfs_mirror: Distribute datasync threads evenly across snapshots

Reviewed-by Venky Shankar <vshankar@redhat.com>

Merge pull request #67710 from vshankar/wip-75083

qa/cephfs: make test_journal_migration immune to stdout changes

Reviewed-by: Christopher Hoffman <choffman@redhat.com>

Merge pull request #67878 from salieri11/igolikov-fix-subvolume-map-75343-new

mds: fix data race on subvolume_metrics_map in MetricsHandler

Reviewed-by: Venky Shankar <vshankar@redhat.com>

ceph-volume: skip /dev/ram* devices in inventory

Kernel RAM disks (/dev/ram*) are not valid OSD targets, filter them out during
device discovery so they don’t appear in inventory.

Fixes: https://tracker.ceph.com/issues/76113
Signed-off-by: Ujjawal Anand <ujjawal.anand@ibm.com>

mgr/dashboard: mgr/dashboard: Carbonize Realm Name and Token block in Multi-site Replication Wizard

Fixes: https://tracker.ceph.com/issues/76085
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

Merge pull request #68175 from rhcs-dashboard/bugfix/nvmeof-namespace-subsystem-selection-order

mgr/dashboard: NVMeoF namespace create form should show subsystem selection first

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>
Reviewed-by: Devika Babrekar <devika.babrekar@ibm.com>

mgr/dashboard: Option to select archive option while Import Multi-site Token

Fixes: https://tracker.ceph.com/issues/76054
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgt/dashboard: Add the CPU, Memory to CephFS dashboard

Fixes: https://tracker.ceph.com/issues/76058
Signed-off-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #68377 from rhcs-dashboard/fix-namespace-block-size

mgr/dashboard: fix namespace block size in namespace form

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

cephadm: Expose RDMA device inside NFS container if RDMA is enabled
Fixes: https://tracker.ceph.com/issues/75189
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/cephadm: Add precheck for RDMA devices when deploying NFS with RDMA enabled

If RDMA is enabled and no bind address is specified, check for any RDMA-capable interface.
Otherwise, verify that the specified interface supports RDMA.

Fixes: https://tracker.ceph.com/issues/75189
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

cephadm: Added command to list RDMA devices
Added 'cephadm list-rdma' command to list RDMA devices and their netdev interfaces

Fixes: https://tracker.ceph.com/issues/75189
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/cephadm: NFS Configuration for RDMA support

Fixes: https://tracker.ceph.com/issues/75189
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/cephadm: Allow colocation for NFS daemon to support active-active mode, Spec will have colocation_ports field to accept ports for colocating daemons

Fixes: https://tracker.ceph.com/issues/74479
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

Merge pull request #68302 from rhcs-dashboard/bug-13708

mgr/dashboard : Unable to remove gateway node from gateway group

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

crimson/os/seastore/cache: Seperate commit_replace_extent paths

commit_replace_extent rewrite isn't actually replacing the extents.
Introduce prepare_rewrite_publish_to_prior for rewrite txns.
No change in behavior yet.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore/transaction: rename need_wait_rewrite

We will need this gate for other types of txns as well

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/os/seastore/cached_extent: Generalize io_wait_t

Currently, we use rewriting bool for visibily checks (is_stable_ready).
To prepare this check to also support user txns, rename this member.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

mgr/dashboard: remove archive option from master zone creation

Fixes: https://tracker.ceph.com/issues/76156
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard : fix-non-versioning-bucket-issue
fixes : https://tracker.ceph.com/issues/76109
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

mgr/cephadm: fix typo in schedule.py comment (specified)

Correct spelling in the ip_addrs allocation comment: "spcified" → "specified".

Fixes: https://tracker.ceph.com/issues/76147
Signed-off-by: Kobi Ginon <kginon@redhat.com>

Merge pull request #68033 from smanjara/wip-zg-rename

rgw/multisite: remove old zonegroup name on the remote zone after a rename

Merge pull request #68163 from ceph/wip-oozmen-75831

rgw/admin: enhance bucket list --marker to support versioned bucket pagination

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #67424 from BBoozmen/wip-oozmen-75031

rgw/beast: use strand executor for timeout timer to prevent concurrent socket access

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>

mgr: Modify unit tests to reflect changes
Modify calc_final_pg_target test cases to reflect optimization algorithm
Add test cases that ensure cost is respected to ensure pools get rounded
closely to target

Fixes: https://tracker.ceph.com/issues/73418
Signed-off-by: Eric Zhang <emzhang@ibm.com>

mgr: Fix autoscaler not distributing PGs evenly + wrong pg_left update
Add optimization algorithm to distribute PGs among pools
to minimize cost (absolute difference between target PG and rounded PG).
Fix autoscaler still allocating pools when autoscale is off but bulk is on

Fixes: https://tracker.ceph.com/issues/73418
       https://tracker.ceph.com/issues/75424
Signed-off-by: Eric Zhang <emzhang@ibm.com>

Merge pull request #67665 from tchaikov/wip-test-rgw-fix-warning

test/rgw: fix -Wstring-plus-char warning in test_d4n_policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #67189 from cbodley/wip-74231

rgw: fix 'bucket stats' when bucket index doesn't exist

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #67958 from cbodley/wip-qa-rgw-compress-encrypted

qa/rgw: crypt subsuite tests compress-encrypted

Reviewed-by: Matthew N. Heler <matthew.heler@hotmail.com>

Merge pull request #68393 from Hezko/traddr-compat

mgr/dashboard: introduce traddr for backward compatibility

qa: Add direct_io test for fscrypt

Fixes: https://tracker.ceph.com/issues/73347
Signed-off-by: Christopher Hoffman <choffman@redhat.com>

Merge pull request #67841 from rhcs-dashboard/fix-pools-app-list-names

mgr/dashboard : Fix application names in pools form

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #68011 from mheler/wip-75650

rgw: always decompress in CopyObject when source is compressed

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #68324 from mheler/wip-multipart-cloud-transition

rgw: fix cloud tier multipart resume using part number 0

Reviewed-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #67560 from mheler/wip-cloud-restore-etag-fix

rgw/cloud-restore: strip quotes from ETag on cloud tier fetch

Reviewed-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #67966 from mheler/wip-75649

rgw: fix fixup_range cascade for compressed+encrypted objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw/gc: mark rgw_gc_max_objs as startup-only

Raising rgw_gc_max_objs at runtime crashes the GC thread.

Reject runtime changes and size the IOManager vectors from the
stored max_objs.

Signed-off-by: Matthew N. Heler <matthew.heler@hotmail.com>

Merge pull request #68466 from bluikko/wip-doc-fix-tentacle-releases

doc/releases: fix Tentacle data in releases.yml

qa/rgw: crypt subsuite tests compress-encrypted

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/rgw: rgw task can enable/disable zone features

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/rgw: don't duplicate 'user list' commands for default zone

some commands during setup expect the zone to exist already, so run
'radosgw-admin user list' to make sure a default zone/zonegroup are
created. avoid duplicating this in several subtasks by moving this to
its own subtask that runs when a realm is not configured

Signed-off-by: Casey Bodley <cbodley@redhat.com>

crimson/tests: fix test_remap_pin_concurrent

The test failed in the following sequence:

  1. 32 coroutines start in parallel, all calling try_get_pin(t, offset)
     with the same offset
  2. One coroutine succeeds in submit_transaction, which calls
     test_mappings.consume(delta) and modifies the shared test_mappings
  3. Other coroutines that haven't reached try_get_pin yet now hit the
     assertion because offset no longer exists in test_mappings

The fix is to add a guard before try_get_pin to check if test_mappings still
contains the offset. If it doesn't, we can safely exit early since that
means another coroutine already succeeded and modified the shared state.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

qa/suites/rados/thrash-old-clients: ignore "Reduced data availability" warning

This type of warning is typical during tests where we are thrashing the
OSDs.

Fixes: https://tracker.ceph.com/issues/73147
Signed-off-by: Laura Flores <lflores@ibm.com>

Merge pull request #67863 from mheler/wip-bug-75569

rgw: stop crashing when an admin tries to assume a nonexistent role

rgw: fix cloud tier multipart resume starting at part number 0

When resuming a cloud tier multipart upload, the part-size
calculation was inside the fresh-init block and never executed.
cur_part, num_parts, and part_size stayed at 0, causing the
remote endpoint to reject part number 0 as invalid.

Move the part-size calculation out of the init block so it
runs for both fresh and resumed uploads.

Signed-off-by: Matthew N. Heler <matthew.heler@hotmail.com>

rgw/cloud-restore: strip quotes from ETag on cloud tier fetch

When objects are restored from a cloud endpoint, the ETag value read
from the HTTP response includes surrounding double-quotes per RFC 7232.
RGW stores ETags unquoted internally, and dump_etag() adds its own
quotes when serving responses. The mismatch results in double-quoted
ETags like ""abc123-6"" on restored objects.

Strip the quotes from both the etag output parameter and the
RGW_ATTR_ETAG attribute after fetching from the cloud endpoint,
matching the unquoted format RGW uses everywhere else.

Signed-off-by: Matthew N. Heler <matthew.heler@hotmail.com>

Merge pull request #68204 from abhishek593/bug-73437

rgw: fix uninitalized fields in pubsub topic creation

test/rgw/kafka: cleanup kafka tgz file

Fixes: https://tracker.ceph.com/issues/76127
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #67548 from mertsunacoglu/wip-rgw-lua-postauth

rgw/lua: Add new Lua postAuth hook that is being run after authorization

Merge pull request #68097 from cheese-cakee/wip-72088-sync-checkpoint-stdout

radosgw-admin: output bucket sync checkpoint to stdout

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #68279 from wuhongsong/fix/rgw-vault-content-type

rgw: add Content-Type header to Vault KMS requests

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #67479 from nbalacha/wip-nbalacha-75127

rgw: Lua Package management fixes

mgr/dashboard : Select replicated rule by default in pools form
fixes : https://tracker.ceph.com/issues/75632
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #66778 from Kushal-deb/d3n-cephadm-automation

mgr/cephadm: Implement D3N L1 persistent datacache support for RGW

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

mgr/dashboard : Fix application names in pools form
Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com>

Merge pull request #66194 from ShwetaBhosale1/fix_issue_73774_nfs_tls_add_xprtsec

mgr/nfs: Cephadm support for NFS-Ganesha TLS configuration adding new option xprtsec

Reviewed-by: Adam King adking@redhat.com

Merge pull request #66763 from Shubhaj1810/fix-issue-2359181

mgr/orchestrator: sort host labels in ceph orch host ls output

Reviewed-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>
Reviewed-by: Kushal Deb <Kushal.Deb@ibm.com>
Reviewed-by: Ujjawal Anand <Ujjawal.Anand@ibm.com>

mgr/dashboard: show rados ns in 'ceph nvmeof top io'

In nvmeof_top_cli.py, show RADOS namespace name
in "RBD Image" column.

Example:
Before: “rbd/image10”
After: “rbd/ns2/image10"

Fixes: https://tracker.ceph.com/issues/76116
Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

Merge pull request #67828 from linuxbox2/wip-75540

rgw_file: always assign string_view of current common_prefix

Merge pull request #67722 from kchheda3/wip-add-transid-notification

rgw/notification: notification Event is not printing the correct  x_amz_request_id.

Merge pull request #67656 from kchheda3/wip-oidc-thumbprint-optional

rgw/oidc: make the thumprint field optional

Merge pull request #67616 from smanjara/wip-bucket-sync-run

rgw/multisite: 'bucket sync run' command during full sync does not take a bucket-wide lock

Merge pull request #60387 from thotz/rgw-placement-store-standard-storageclass

rgw/placement: display storage class in user info dump

Merge pull request #67219 from mertsunacoglu/wip-lua-bucket-metadata

RGW: Add Bucket metadata attribute for Lua scripts