]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 months agoMerge pull request #61962 from clwluvw/replication-perms
Casey Bodley [Tue, 29 Apr 2025 14:14:25 +0000 (10:14 -0400)]
Merge pull request #61962 from clwluvw/replication-perms

rgw: add support replication actions in policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 months agoMerge pull request #62922 from saif-0987/refactor/testid-update-01
afreen23 [Tue, 29 Apr 2025 12:43:34 +0000 (18:13 +0530)]
Merge pull request #62922 from saif-0987/refactor/testid-update-01

mgr/dashboard: Replace data-cy with data-testid for cypress IDs

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2 months agoMerge pull request #63010 from ronen-fr/wip-rf-repair-62451
Ronen Friedman [Tue, 29 Apr 2025 10:36:30 +0000 (13:36 +0300)]
Merge pull request #63010 from ronen-fr/wip-rf-repair-62451

qa/standalone/scrub: fix expected outputs in repair tests

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>
2 months agoMerge pull request #62978 from afreen23/main
afreen23 [Tue, 29 Apr 2025 09:20:49 +0000 (14:50 +0530)]
Merge pull request #62978 from afreen23/main

mgr/dashboard: Update translations

Reviewed-by: Nizamudeen A <nia@redhat.com>
2 months agoqa/standalone/scrub: fix expected output in snaps repair tests 63010/head
Ronen Friedman [Tue, 29 Apr 2025 03:35:13 +0000 (22:35 -0500)]
qa/standalone/scrub: fix expected output in snaps repair tests

Specifically - TEST_corrupt_snapset_scrub_rep in osd-scrub-repair.sh.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 months agoMerge PR #62872 into main
Patrick Donnelly [Mon, 28 Apr 2025 19:44:01 +0000 (15:44 -0400)]
Merge PR #62872 into main

* refs/pull/62872/head:
qa: add test for cloning with charmap
pybind/mgr/volumes: fix typo in casesensitive vxattr

Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: Xavi Hernandez <xhernandez@gmail.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2 months agoMerge PR #62089 into main
Patrick Donnelly [Mon, 28 Apr 2025 19:31:02 +0000 (15:31 -0400)]
Merge PR #62089 into main

* refs/pull/62089/head:
doc/dev/release-checklists: add vX.3.0 checklist item
doc/dev/release-checklist: check v20.0.0 tag

Reviewed-by: Adam King <adking@redhat.com>
2 months agoMerge PR #63011 into main
Patrick Donnelly [Mon, 28 Apr 2025 18:44:23 +0000 (14:44 -0400)]
Merge PR #63011 into main

* refs/pull/63011/head:
.github: run verify-qa from base branch
 .github: run verify-qa when PR HEAD is updated

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 months agorgw: utilize is_impersonating for forwarded sts requests 61962/head
Seena Fallah [Mon, 28 Apr 2025 17:44:10 +0000 (19:44 +0200)]
rgw: utilize is_impersonating for forwarded sts requests

With the introduction of is_impersonating in SysReqApplier,
RoleApplier can now use the same mechanism to mark when a request
has been forwarded by a system user on behalf of another role (e.g.,
through STS) to mark it as a system request (s->system_request).

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months ago.github: run verify-qa from base branch 63011/head
Patrick Donnelly [Mon, 28 Apr 2025 17:44:08 +0000 (13:44 -0400)]
.github: run verify-qa from base branch

If the PR does not have the script, perhaps it does not run?

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2 months ago .github: run verify-qa when PR HEAD is updated
Patrick Donnelly [Mon, 28 Apr 2025 13:50:55 +0000 (09:50 -0400)]
 .github: run verify-qa when PR HEAD is updated

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2 months agorgw: dont rate limit forwarded requests
Seena Fallah [Wed, 23 Apr 2025 22:22:23 +0000 (00:22 +0200)]
rgw: dont rate limit forwarded requests

rely on s->system_request to skip rate limiting on forwarded requests
as well as normal system user requests.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: use is_admin() for permission checks
Seena Fallah [Wed, 23 Apr 2025 22:22:08 +0000 (00:22 +0200)]
rgw: use is_admin() for permission checks

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: override perms for admin on data sync
Seena Fallah [Fri, 18 Apr 2025 14:42:24 +0000 (16:42 +0200)]
rgw: override perms for admin on data sync

If pipe is in user mode and the user is admin, don't check for perms
and let it go.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: change is_admin_of() to is_admin()
Seena Fallah [Thu, 17 Apr 2025 22:09:12 +0000 (00:09 +0200)]
rgw: change is_admin_of() to is_admin()

As admin propery of a user is something global and nothing related
to any other owner, we don't need any comparision.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: make rgw_sync_pipe_params::user optional
Seena Fallah [Tue, 1 Apr 2025 15:28:10 +0000 (17:28 +0200)]
rgw: make rgw_sync_pipe_params::user optional

In rgw_sync_pipe_params, the mode can be either system or user.
When in system mode, no user is involved, but the current
implementation holds an empty rgw_user, which can cause confusion
in pipe_rules::find_basic_info_without_tags().

With this change, rgw_user is now optional, ensuring that when no
user is involved, it is explicitly nullopt rather than an empty object.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agoqa/rgw: add perm check test for copy obj between zonegroups
Seena Fallah [Fri, 28 Mar 2025 23:00:02 +0000 (00:00 +0100)]
qa/rgw: add perm check test for copy obj between zonegroups

Make sure perms are evaluated properly for the source object.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agodoc: add release note for new policy actions on replication
Seena Fallah [Mon, 24 Feb 2025 15:47:50 +0000 (16:47 +0100)]
doc: add release note for new policy actions on replication

Fixes: https://tracker.ceph.com/issues/70093
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: remote copy obj pass rgwx-perm-check-uid for perm evaluation
Seena Fallah [Fri, 28 Mar 2025 20:55:20 +0000 (21:55 +0100)]
rgw: remote copy obj pass rgwx-perm-check-uid for perm evaluation

When copying object from remote source (bucket from another zonegroup)
the perms of the source is not evaluated resulting in reading from
unauthorized buckets.
passing `rgwx-perm-check-uid` will let the source zone evaluates the
perm and close this bug.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: RGWRadosPutObj evals source bucket perm for backward compatibility
Seena Fallah [Fri, 28 Mar 2025 20:52:47 +0000 (21:52 +0100)]
rgw: RGWRadosPutObj evals source bucket perm for backward compatibility

As of a3f40b4 we no longer evaluate perms locally for source bucket,
this could cause broken permission evaluation dusring upgrade as one
zone is not respecting the perm evaluation based on the `rgwx-perm-check-uid`
arg.

This can be dropped in T+2 release.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: make verify_bucket_permission functions const
Seena Fallah [Thu, 24 Apr 2025 19:02:08 +0000 (21:02 +0200)]
rgw: make verify_bucket_permission functions const

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: give hint via header for perm evaluation in GetObj
Seena Fallah [Fri, 28 Mar 2025 20:48:34 +0000 (21:48 +0100)]
rgw: give hint via header for perm evaluation in GetObj

Return `Rgwx-Perm-Checked` header as a hint for the destination zone
to know whether the perms where considered or not.
This is just a backward compatibility for upgrade and can be dropped
in T+2 release.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: rest client callback when all headers are passed
Seena Fallah [Fri, 28 Mar 2025 20:36:38 +0000 (21:36 +0100)]
rgw: rest client callback when all headers are passed

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: pass rgwx-perm-check-uid for multisite fetch object
Seena Fallah [Wed, 5 Mar 2025 19:52:48 +0000 (20:52 +0100)]
rgw: pass rgwx-perm-check-uid for multisite fetch object

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: GetObject(Version) not allowed to replicate sse-kms objects
Seena Fallah [Fri, 28 Feb 2025 16:07:32 +0000 (17:07 +0100)]
rgw: GetObject(Version) not allowed to replicate sse-kms objects

To replicate objects encrypted via sse-kms objects,
s3:GetObjectVersionForReplication is required.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: take account GetObject(Version)Tagging when replicating
Seena Fallah [Thu, 27 Feb 2025 10:53:44 +0000 (11:53 +0100)]
rgw: take account GetObject(Version)Tagging when replicating

In case the uid has no permission to read tagging, the tags should
not be replicated.
Ref. https://docs.aws.amazon.com/AmazonS3/latest/userguide/setting-repl-config-perm-overview.html

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agoqa/rgw: add test for source object perm check in multisite
Seena Fallah [Mon, 24 Feb 2025 22:56:13 +0000 (23:56 +0100)]
qa/rgw: add test for source object perm check in multisite

Check whether the policies are honored on source object in source
zone when replicating.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: replication require lock perm if enabled
Seena Fallah [Fri, 28 Feb 2025 15:51:07 +0000 (16:51 +0100)]
rgw: replication require lock perm if enabled

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: check source object replication by replication actions
Seena Fallah [Mon, 24 Feb 2025 22:41:13 +0000 (23:41 +0100)]
rgw: check source object replication by replication actions

Check for permissions of `s3:GetObjectVersionForReplication` in
addition to `s3:GetObject` and `s3:GetObjectVersion` when fetching
the object for multisite.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: export action_bit_string through header file
Seena Fallah [Sat, 1 Mar 2025 00:22:07 +0000 (01:22 +0100)]
rgw: export action_bit_string through header file

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: only allow system override if identity is not impersonating
Seena Fallah [Mon, 24 Feb 2025 22:33:45 +0000 (23:33 +0100)]
rgw: only allow system override if identity is not impersonating

Since multisite now delegates permission checks for source objects
to the source zone (a3f40b4), we need to avoid allowing system-level
overrides when the request is impersonating another identity.

SysReqApplier should only grant override permission if the request
is truly system-authenticated and not acting on behalf of another
user or role (i.e., no rgwx-perm-check-uid or rgwx-perm-check-role
in the request).

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: SysReqApplier overrides is_admin_of based on impersonation
Seena Fallah [Thu, 17 Apr 2025 12:55:00 +0000 (14:55 +0200)]
rgw: SysReqApplier overrides is_admin_of based on impersonation

SysReqApplier now returns true for is_admin_of() when the requester
was a system user and was not impersonating any user/role using
rgwx-perm-check-uid or rgwx-perm-check-role.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agoqa/rgw: add test for new replication actions
Seena Fallah [Fri, 21 Feb 2025 00:34:27 +0000 (01:34 +0100)]
qa/rgw: add test for new replication actions

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: support s3ReplicateTags perm on destination bucket for replication
Seena Fallah [Thu, 20 Feb 2025 23:57:25 +0000 (00:57 +0100)]
rgw: support s3ReplicateTags perm on destination bucket for replication

Check for tag replication permission on destination bucket, so if
there was an explicit deny, donot include tags in the replicated
object.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: check for s3ReplicateObject perm on destination bucket for replication
Seena Fallah [Thu, 20 Feb 2025 23:56:28 +0000 (00:56 +0100)]
rgw: check for s3ReplicateObject perm on destination bucket for replication

Instead of s3:PutObject rely on s3:s3ReplicateObject permission to
check whether the user can replicate to the destination bucket.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: verify perm on delete replication
Seena Fallah [Thu, 20 Feb 2025 21:15:31 +0000 (22:15 +0100)]
rgw: verify perm on delete replication

Check for s3:ReplicateDelete for replicating object deletes and
delete markers when pipe is set to user mode.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: move RGWUserPermHandler to header
Seena Fallah [Sat, 22 Feb 2025 23:50:16 +0000 (00:50 +0100)]
rgw: move RGWUserPermHandler to header

So it can be used by others.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: weaning off RGWUserPermHandler from RGWDataSyncEnv
Seena Fallah [Thu, 20 Feb 2025 20:38:50 +0000 (21:38 +0100)]
rgw: weaning off RGWUserPermHandler from RGWDataSyncEnv

So it can be called by RGWAsyncRadosRequest classes not holding
sync_env.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: send bucket sync structs to bucket_sync.h
Seena Fallah [Sat, 22 Feb 2025 23:47:55 +0000 (00:47 +0100)]
rgw: send bucket sync structs to bucket_sync.h

So it can be imported by headers like rgw_cr_rados.h that already
has dependency to rgw_data_sync.h.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agorgw: drop unused params passed to RGWStatRemoteObjCR by RGWObjFetchCR
Seena Fallah [Wed, 19 Feb 2025 22:51:11 +0000 (23:51 +0100)]
rgw: drop unused params passed to RGWStatRemoteObjCR by RGWObjFetchCR

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2 months agoMerge pull request #56576 from pritha-srivastava/wip-rgw-assume-role-multisite
Shilpa Jagannath [Mon, 28 Apr 2025 16:45:13 +0000 (09:45 -0700)]
Merge pull request #56576 from pritha-srivastava/wip-rgw-assume-role-multisite

rgw/sts: correcting authentication in case s3 ops are directed to a primary from secondary after assumerole.

2 months agoqa/standalone/scrub: fix expected output in replicated repair tests
Ronen Friedman [Mon, 28 Apr 2025 16:34:47 +0000 (11:34 -0500)]
qa/standalone/scrub: fix expected output in replicated repair tests

Specifically - TEST_corrupt_scrub_replicated in osd-scrub-repair.sh.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 months agoMerge pull request #63004 from dasJ/fix/ceph-volume-split
Guillaume Abrioux [Mon, 28 Apr 2025 15:02:14 +0000 (17:02 +0200)]
Merge pull request #63004 from dasJ/fix/ceph-volume-split

ceph-volume: Fix splitting with too many parts

2 months agoMerge pull request #63008 from bluikko/doc-compression-promptify-radosgw
Anthony D'Atri [Mon, 28 Apr 2025 14:58:46 +0000 (10:58 -0400)]
Merge pull request #63008 from bluikko/doc-compression-promptify-radosgw

doc/radosgw: Promptify CLI commands in compression.rst

2 months agoMerge pull request #63007 from bluikko/doc-keystone-formatting-radosgw
Anthony D'Atri [Mon, 28 Apr 2025 14:57:55 +0000 (10:57 -0400)]
Merge pull request #63007 from bluikko/doc-keystone-formatting-radosgw

doc/radosgw: Promptify commands and improve formatting in keystone.rst

2 months agoMerge pull request #63006 from bluikko/doc-bucketpolicy-formatting-radosgw
Anthony D'Atri [Mon, 28 Apr 2025 14:56:05 +0000 (10:56 -0400)]
Merge pull request #63006 from bluikko/doc-bucketpolicy-formatting-radosgw

doc/radosgw: Improve formatting in bucketpolicy.rst

2 months agoMerge pull request #63009 from bluikko/doc-bucketpolicy-addedin-radosgw
Anthony D'Atri [Mon, 28 Apr 2025 14:34:19 +0000 (10:34 -0400)]
Merge pull request #63009 from bluikko/doc-bucketpolicy-addedin-radosgw

doc/radosgw: Use macro for release info in bucketpolicy.rst

2 months agoMerge PR #61796 into main
Patrick Donnelly [Mon, 28 Apr 2025 13:58:02 +0000 (09:58 -0400)]
Merge PR #61796 into main

* refs/pull/61796/head:
rgw/sts: Use client_id for assumerolewithwebidentityresponse
rgw/sts: adding validation of jwks_uri cert according
rgw/sts: fix to pick jwk which is of type
rgw/sts: adding code for JWT signature validation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 months agoqa/standalone/scrub: fix expected output in EC repair tests
Ronen Friedman [Mon, 28 Apr 2025 13:14:54 +0000 (08:14 -0500)]
qa/standalone/scrub: fix expected output in EC repair tests

Specifically - TEST_corrupt_scrub_erasure_* in osd-scrub-repair.sh.
This is required following recent changes to the EC code.

Fixes: https://tracker.ceph.com/issues/70851
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 months agodoc/radosgw: Improve formatting in bucketpolicy.rst 63006/head
Ville Ojamo [Mon, 28 Apr 2025 09:44:32 +0000 (16:44 +0700)]
doc/radosgw: Improve formatting in bucketpolicy.rst

Add a missing empty line before an unordered list that
caused it to be rendered as just normal text in a
single paragraph, instead of a list.

Use inline code for CLI command names and other
such identifiers.

Capitalize "s3" correctly as "S3" when it refers to
the S3 service/API.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agoMerge pull request #62657 from jamiepryde/ec-plugins-tidying-nits-and-bits
Jamie Pryde [Mon, 28 Apr 2025 13:04:47 +0000 (14:04 +0100)]
Merge pull request #62657 from jamiepryde/ec-plugins-tidying-nits-and-bits

erasure-code: Handle review comments from #61804 to tidy up EC plugin changes

2 months agoMerge pull request #53365 from AliMasarweh/wip-alimasa-keystone-auth-rgw
Ali Masarwa [Mon, 28 Apr 2025 12:49:01 +0000 (15:49 +0300)]
Merge pull request #53365 from AliMasarweh/wip-alimasa-keystone-auth-rgw

RGW: When using Keystone auth for RGW, include the Keystone user in ops log

Reviewed-by: Matthew Benjamin <mbenjamin@redhat.com>
2 months agodoc/radosgw: Use macro for release info in bucketpolicy.rst 63009/head
Ville Ojamo [Mon, 28 Apr 2025 11:34:23 +0000 (18:34 +0700)]
doc/radosgw: Use macro for release info in bucketpolicy.rst

Don't spell out the release that added the feature, instead use RST
macro for it, like other documents do.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agodoc/radosgw: Promptify CLI commands in compression.rst 63008/head
Ville Ojamo [Mon, 28 Apr 2025 10:23:44 +0000 (17:23 +0700)]
doc/radosgw: Promptify CLI commands in compression.rst

Use the bash prompt block for example CLI command.
Separate command output from the CLI command.

Use the correct privileged bash prompt on an already
promptified example command, instead of an
unprivileged bash prompt.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agodoc/radosgw: Promptify commands and improve formatting in keystone.rst 63007/head
Ville Ojamo [Mon, 28 Apr 2025 10:02:32 +0000 (17:02 +0700)]
doc/radosgw: Promptify commands and improve formatting in keystone.rst

Use blocks with bash privileged command prompt for CLI
command examples. Separate example command output to a
preformatted block. Previously a hard-coded prompt in
some place inconsistently while no prompts in others.

Indent multi-line CLI command examples consistently.

Use Title Case consistency in section titles, instead
of some capitalized only first letter of title text.

Use double-backtick inline code for syntax strings,
HTTP header names etc as seems common.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agoceph-volume: Fix splitting with too many parts 63004/head
Janne Heß [Mon, 28 Apr 2025 09:04:25 +0000 (11:04 +0200)]
ceph-volume: Fix splitting with too many parts

The data can be anything and also contain a `=`, causing the line to
fail with `Too many values to unpack`. In my case, it failed with
`ID_FS_LABEL=pvc_name=rook-ceph-lvm-data-44f2gc`.

Regression was introduced here: https://github.com/ceph/ceph/pull/60006

Fixes: https://tracker.ceph.com/issues/71101
Signed-off-by: Janne Heß <janne@hess.ooo>
2 months agoMerge pull request #62860 from joscollin/wip-D70953-cephfs-journal-tool
Zac Dover [Mon, 28 Apr 2025 03:37:29 +0000 (13:37 +1000)]
Merge pull request #62860 from joscollin/wip-D70953-cephfs-journal-tool

doc: update cephfs-journal-tool docs

Reviewed-by: Zac Dover <zac.dover@proton.me>
2 months agoMerge pull request #62977 from tchaikov/mgr-std-variant
Kefu Chai [Mon, 28 Apr 2025 03:34:26 +0000 (11:34 +0800)]
Merge pull request #62977 from tchaikov/mgr-std-variant

mgr: migrate from boost::variant to std::variant

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2 months agoMerge pull request #62975 from tchaikov/libcephfs_proxy-silence-warning
Kefu Chai [Mon, 28 Apr 2025 03:23:00 +0000 (11:23 +0800)]
Merge pull request #62975 from tchaikov/libcephfs_proxy-silence-warning

libcephfs_proxy: remove arithmetic on void*

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Xavi Hernandez <xhernandez@gmail.com>
2 months agoMerge pull request #62991 from tchaikov/common-aligned_storage
Kefu Chai [Sun, 27 Apr 2025 23:52:29 +0000 (07:52 +0800)]
Merge pull request #62991 from tchaikov/common-aligned_storage

common: avoid using std::aligned_storage_t

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 months agoMerge pull request #62996 from ronen-fr/wip-rf-testtoofast
Ronen Friedman [Sun, 27 Apr 2025 12:45:15 +0000 (15:45 +0300)]
Merge pull request #62996 from ronen-fr/wip-rf-testtoofast

osd/scrub: always round up reported scrub duration

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2 months agomgr: migrate from boost::variant to std::variant 62977/head
Kefu Chai [Fri, 25 Apr 2025 15:53:08 +0000 (23:53 +0800)]
mgr: migrate from boost::variant to std::variant

Replace `boost::variant` with `std::variant` as part of our effort to reduce
third-party dependencies in favor of C++ standard library alternatives.

Benefits include:
- Improved code readability and maintainability
- Reduced external dependency surface
- More consistent API usage with other components

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 months agoMerge pull request #62979 from anthonyeleven/formatting
Anthony D'Atri [Sat, 26 Apr 2025 14:25:06 +0000 (10:25 -0400)]
Merge pull request #62979 from anthonyeleven/formatting

doc/radosgw: Improve formatting in layout.rst

2 months agocommon: avoid using std::aligned_storage_t 62991/head
Kefu Chai [Sat, 26 Apr 2025 10:06:26 +0000 (18:06 +0800)]
common: avoid using std::aligned_storage_t

std::aligned_storage_t was deprecated in C++23, to be prepared for
it, let's use alignas for the same behavior.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 months agorgw/qa: added test case to assume a role after role creation 56576/head
Pritha Srivastava [Mon, 1 Apr 2024 15:57:06 +0000 (21:27 +0530)]
rgw/qa: added test case to assume a role after role creation
syncs, and then creating a bucket on both primary and secondary.
The test name is test_assume_role_after_sync.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2 months agorgw/sts: by-passing authentication using temp creds
Pritha Srivastava [Thu, 28 Mar 2024 11:16:20 +0000 (16:46 +0530)]
rgw/sts: by-passing authentication using temp creds
in case the request is forwarded from secondary in
a multi-site setup. authenticating with the system
user creds of which are used to sign the request.
Permissions are still derived from the role.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2 months agoosd/scrub: always round up reported scrub duration 62996/head
Ronen Friedman [Sat, 26 Apr 2025 08:21:29 +0000 (03:21 -0500)]
osd/scrub: always round up reported scrub duration

as expected by some tests, and clearer for the user.

Fixes: https://tracker.ceph.com/issues/68833
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 months agoMerge pull request #62970 from bluikko/doc-toc-sectionlevels2-radosgw
Anthony D'Atri [Sat, 26 Apr 2025 06:30:59 +0000 (02:30 -0400)]
Merge pull request #62970 from bluikko/doc-toc-sectionlevels2-radosgw

doc/radosgw: Fix section header level in config-ref.rst

2 months agoMerge pull request #62986 from bluikko/doc-headerlines-radosgw
Anthony D'Atri [Sat, 26 Apr 2025 06:16:50 +0000 (02:16 -0400)]
Merge pull request #62986 from bluikko/doc-headerlines-radosgw

doc/radosgw: Fix length of section header underlines in oidc.rst

2 months agoMerge pull request #62988 from bluikko/doc-oidc-examples-radosgw
Anthony D'Atri [Sat, 26 Apr 2025 06:16:07 +0000 (02:16 -0400)]
Merge pull request #62988 from bluikko/doc-oidc-examples-radosgw

doc/radosgw: Fix RST syntax rendered as text in oidc.rst

2 months agoMerge pull request #62987 from bluikko/doc-sts-edit-radosgw v20.3.0
Anthony D'Atri [Sat, 26 Apr 2025 06:15:31 +0000 (02:15 -0400)]
Merge pull request #62987 from bluikko/doc-sts-edit-radosgw

doc/radosgw: Improve formatting in STS.rst

2 months agorgw/sts: Use client_id for assumerolewithwebidentityresponse 61796/head
Pritha Srivastava [Mon, 17 Feb 2025 08:11:15 +0000 (13:41 +0530)]
rgw/sts: Use client_id for assumerolewithwebidentityresponse
if aud is not present in JWT.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2 months agorgw/sts: adding validation of jwks_uri cert according
Pritha Srivastava [Thu, 13 Feb 2025 11:18:43 +0000 (16:48 +0530)]
rgw/sts: adding validation of jwks_uri cert according
to https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_providers_create_oidc_verify-thumbprint.html
for n&e which can be later used for all key types
(x5c, n&e).

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2 months agorgw/sts: fix to pick jwk which is of type
Pritha Srivastava [Wed, 12 Feb 2025 08:06:20 +0000 (13:36 +0530)]
rgw/sts: fix to pick jwk which is of type
'sig' for signature validation of the token.

Fixes: https://tracker.ceph.com/issues/54562
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2 months agorgw/sts: adding code for JWT signature validation
Pritha Srivastava [Thu, 26 Dec 2024 08:56:30 +0000 (14:26 +0530)]
rgw/sts: adding code for JWT signature validation
using modulus and exponent for RSA group of algorithms.

A couple of issues and a fix have been suggested by
Pupu Toivonen (pupu.toivonen@csc.fi) in signature calculation
using modulus and exponent.

Fixes: https://tracker.ceph.com/issues/51018
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2 months agodoc/radosgw: Improve formatting in STS.rst 62987/head
Ville Ojamo [Sat, 26 Apr 2025 03:54:12 +0000 (10:54 +0700)]
doc/radosgw: Improve formatting in STS.rst

Some text uses hardcoded ordered list numbers and as a result
have duplicate list numbers. Move to use RST ordered lists and
indent the contents of each list item correctly. Fix referenced
list item number in text that pointed to a wrong list item.

Format references to parameter names, user IDs, file names etc
as inline code.

Add prompts to example commands.

Change instances of "rgw" or "Radosgw" in text to "RGW".

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agodoc/radosgw: Fix RST syntax rendeded as text in oidc.rst 62988/head
Ville Ojamo [Sat, 26 Apr 2025 04:17:16 +0000 (11:17 +0700)]
doc/radosgw: Fix RST syntax rendeded as text in oidc.rst

Empty line after starting a pre-formatted block with the double-colon
syntax is required, otherwise the double-colon does nothing and is just
rendered as-is as "::" and there would be no following pre-formatted
block.

Add empty lines after the double-colon syntax so that the following
block is rendered pre-formatted.

Also add bash privileged prompts to a block with 2 example CLI commands.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agodoc/radosgw: Fix length of section header underlines in oidc.rst 62986/head
Ville Ojamo [Sat, 26 Apr 2025 03:30:57 +0000 (10:30 +0700)]
doc/radosgw: Fix length of section header underlines in oidc.rst

Set the length of the RST syntax underlining for section headers to be
as long as the section header text.
Also it seems common to indent the document title with one space at both
the beginning and the end so do that.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agodoc/radosgw: Improve formatting in layout.rst 62979/head
Anthony D'Atri [Fri, 25 Apr 2025 17:10:06 +0000 (13:10 -0400)]
doc/radosgw: Improve formatting in layout.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2 months agoqa: add test for cloning with charmap 62872/head
Patrick Donnelly [Thu, 17 Apr 2025 23:58:25 +0000 (19:58 -0400)]
qa: add test for cloning with charmap

Fixes: https://tracker.ceph.com/issues/70974
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2 months agopybind/mgr/volumes: fix typo in casesensitive vxattr
Patrick Donnelly [Thu, 17 Apr 2025 23:50:34 +0000 (19:50 -0400)]
pybind/mgr/volumes: fix typo in casesensitive vxattr

Fixes: https://tracker.ceph.com/issues/70974
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2 months agoMerge PR #62901 into main
Patrick Donnelly [Fri, 25 Apr 2025 19:02:03 +0000 (15:02 -0400)]
Merge PR #62901 into main

* refs/pull/62901/head:
qa/workunits/fs/misc: remove data pool cleanup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2 months agoMerge PR #62833 into main
Patrick Donnelly [Fri, 25 Apr 2025 19:00:39 +0000 (15:00 -0400)]
Merge PR #62833 into main

* refs/pull/62833/head:
qa: test charmap changes with dir and snaps
mds: check for snapshots on parent snaprealms
mds: use strict_strtobool for parsing bools
common: take string_view for strict_tobool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2 months agomgr/dashboard: Update translations 62978/head
Afreen Misbah [Fri, 25 Apr 2025 16:29:23 +0000 (21:59 +0530)]
mgr/dashboard: Update translations

Fixes https://tracker.ceph.com/issues/71086

Signed-off-by: Afreen Misbah <afreen@ibm.com>
2 months agoMerge pull request #62966 from bluikko/doc-toc-sectionlevels-radosgw
Anthony D'Atri [Fri, 25 Apr 2025 16:20:51 +0000 (12:20 -0400)]
Merge pull request #62966 from bluikko/doc-toc-sectionlevels-radosgw

doc/radosgw: Fix section header levels in multisite-sync-policy.rst

2 months agomgr/dashboard: Replace `data-cy` to `data-testid` 62922/head
saif [Mon, 21 Apr 2025 18:47:12 +0000 (18:47 +0000)]
mgr/dashboard: Replace `data-cy` to `data-testid`

Issue: There was some inconsistency in naming attributes of cypress test IDs,  both `data-testid` and `data-cy` were being used across the code.

Changes: Replaces all `data-cy` attributes with `data-testid` to keep it consistent across the codebase.

Fixes: https://tracker.ceph.com/issues/70986
Signed-off-by: Mohammad saif <samdto987@gmail.com>
2 months agolibcephfs_proxy: remove arithmetic on void* 62975/head
Kefu Chai [Fri, 25 Apr 2025 15:10:37 +0000 (23:10 +0800)]
libcephfs_proxy: remove arithmetic on void*

this change is created in the same spirit of bb1fa818.

when building the tree with clang-21, following warning was raised:
```
/home/kefu/dev/ceph/src/libcephfs_proxy/proxy_async.c:43:9: warning: arithmetic on a pointer to void is a GNU extension [-Wgnu-pointer-arith]
   43 |                         data += iov->iov_len;
      |                         ~~~~ ^
1 warning generated.
```

this change should address this warning by casting a `void*` pointer to
`char*` pointer before performing arithmetic operation on it.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 months agoMerge pull request #62023 from Kushal-deb/user-friendly_error_handling_for_invalid_os...
Adam King [Fri, 25 Apr 2025 15:11:31 +0000 (11:11 -0400)]
Merge pull request #62023 from Kushal-deb/user-friendly_error_handling_for_invalid_osd_device_paths

cephadm: Provide user friendly error message if osd device path is invalid

Reviewed-by: Adam King <adking@redhat.com>
2 months agoMerge pull request #62895 from cyx1231st/wip-seastore-omap-link-init
Yingxin Cheng [Fri, 25 Apr 2025 14:41:02 +0000 (22:41 +0800)]
Merge pull request #62895 from cyx1231st/wip-seastore-omap-link-init

crimson/os/seastore/omap_manager: simplify maybe_init from tolerating duplicated calls

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
2 months agoMerge pull request #62938 from cyx1231st/wip-seastore-cleanup-paddr-types
Yingxin Cheng [Fri, 25 Apr 2025 12:55:31 +0000 (20:55 +0800)]
Merge pull request #62938 from cyx1231st/wip-seastore-cleanup-paddr-types

crimson/os/seastore: improve checks to the paddr types

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 months agoMerge pull request #62838 from cyx1231st/wip-seastore-simplify-cache-access-metrics
Yingxin Cheng [Fri, 25 Apr 2025 12:53:55 +0000 (20:53 +0800)]
Merge pull request #62838 from cyx1231st/wip-seastore-simplify-cache-access-metrics

crimson/os/seastore: simplify cache access metrics

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
2 months agoMerge pull request #56336 from pritha-srivastava/wip-rgw-d4n-next
Matt Benjamin [Fri, 25 Apr 2025 11:53:30 +0000 (07:53 -0400)]
Merge pull request #56336 from pritha-srivastava/wip-rgw-d4n-next

Wip rgw d4n next

2 months agoMerge pull request #56975 from aclamk/wip-aclamk-bs-compression-recompression
Adam Kupczyk [Fri, 25 Apr 2025 10:18:34 +0000 (12:18 +0200)]
Merge pull request #56975 from aclamk/wip-aclamk-bs-compression-recompression

os/bluestore: Recompression, part 4. Scanner, Estimator and core recompression.

2 months agodoc/radosgw: Fix section header level in config-ref.rst 62970/head
Ville Ojamo [Fri, 25 Apr 2025 09:00:20 +0000 (16:00 +0700)]
doc/radosgw: Fix section header level in config-ref.rst

The section named "QoS Settings" looks like it should not be a child of
the section "SSE-S3 Settings". Move it to be a sibling to it, on the
same level instead.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agodoc/radosgw: Fix section header levels in multisite-sync-policy.rst 62966/head
Ville Ojamo [Fri, 25 Apr 2025 07:16:52 +0000 (14:16 +0700)]
doc/radosgw: Fix section header levels in multisite-sync-policy.rst

The section header levels are reversed so the hierarchy in the TOC is
incorrect. Switch around the section header levels to make the TOC
hierarchy correct, for example individual examples are children of the
"Examples" section.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2 months agoMerge pull request #59673 from shraddhaag/availability-score-feature
Shraddha Agrawal [Fri, 25 Apr 2025 05:56:15 +0000 (11:26 +0530)]
Merge pull request #59673 from shraddhaag/availability-score-feature

monitor: add availability score feature

2 months agoMerge pull request #62937 from gbregman/main
Gil Bregman [Fri, 25 Apr 2025 05:34:07 +0000 (08:34 +0300)]
Merge pull request #62937 from gbregman/main

mgr/cephadm/nvmeof: Allow setting NVMEoF gateway huge pages count in the spec file

2 months agoMerge PR #62658 into main
Patrick Donnelly [Fri, 25 Apr 2025 02:41:14 +0000 (22:41 -0400)]
Merge PR #62658 into main

* refs/pull/62658/head:
libcephfs_proxy: Remove arithmetic on `void*`

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Xavi Hernandez <xhernandez@gmail.com>
2 months agocrimson/os/seastore/cache: init root as dirty 62938/head
Yingxin Cheng [Wed, 23 Apr 2025 14:05:35 +0000 (22:05 +0800)]
crimson/os/seastore/cache: init root as dirty

To simplify checks that root won't appear in lru.

Also, make sure root has a root paddr.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 months agocrimson/os/seastore: introduce strict paddr type checks in cache and transaction
Yingxin Cheng [Wed, 23 Apr 2025 09:30:24 +0000 (17:30 +0800)]
crimson/os/seastore: introduce strict paddr type checks in cache and transaction

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>