]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 months agomgr/dashboard: fixed nfs attach command 56388/head
Ivo Almeida [Thu, 14 Mar 2024 16:14:25 +0000 (16:14 +0000)]
mgr/dashboard: fixed nfs attach command

Fixes: https://tracker.ceph.com/issues/64933
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit db724a8fef183f6f5200bc0e93428a19c69d1342)

16 months agoMerge pull request #56365 from rhcs-dashboard/wip-65037-squid
Nizamudeen A [Fri, 22 Mar 2024 10:14:11 +0000 (15:44 +0530)]
Merge pull request #56365 from rhcs-dashboard/wip-65037-squid

squid: mgr/dashboard: fix M retention frequency display

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #56371 from rhcs-dashboard/wip-65047-squid
Ivo Almeida [Fri, 22 Mar 2024 09:41:11 +0000 (09:41 +0000)]
Merge pull request #56371 from rhcs-dashboard/wip-65047-squid

squid: mgr/dashboard: fix retention add for subvolume

Reviewed-by: afreen23 <NOT@FOUND>
16 months agomgr/dashboard: fix retention add for subvolume 56371/head
Ivo Almeida [Wed, 21 Feb 2024 13:02:19 +0000 (13:02 +0000)]
mgr/dashboard: fix retention add for subvolume

- Added parameters for subvolume and subvolume group when adding a new
snap schedule.
- Added call to remove retention policies when removing a snap schedule
  in case it is the last one with same path

Fixes: https://tracker.ceph.com/issues/64524
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit 80e1207f4b536fe6edbc81e61cbf951e135eba54)

16 months agomgr/dashboard: fix M retention frequency display 56365/head
Ivo Almeida [Tue, 19 Mar 2024 13:13:17 +0000 (13:13 +0000)]
mgr/dashboard: fix M retention frequency display

Fix snap schedule list monthly retention frequency display

Fixes: https://tracker.ceph.com/issues/64982
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit 0bd8d3b6bc8ecbe99e22545549a63de3444e5f75)

16 months agoMerge pull request #56339 from zdover23/wip-doc-2024-03-20-backport-56333-to-squid
Zac Dover [Thu, 21 Mar 2024 02:03:17 +0000 (12:03 +1000)]
Merge pull request #56339 from zdover23/wip-doc-2024-03-20-backport-56333-to-squid

squid: doc/cephfs: fix architecture link to correct relative path

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agoMerge pull request #56267 from zdover23/wip-doc-2024-08-19-backport-56240-to-squid
Zac Dover [Thu, 21 Mar 2024 02:02:53 +0000 (12:02 +1000)]
Merge pull request #56267 from zdover23/wip-doc-2024-08-19-backport-56240-to-squid

squid: doc/rados: update common.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agoMerge pull request #56210 from joscollin/wip-64918-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:55:46 +0000 (08:55 -0700)]
Merge pull request #56210 from joscollin/wip-64918-squid

squid: qa: enhance labeled perf counters test for cephfs-mirror

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #56051 from lxbsz/wip-64585
Yuri Weinstein [Wed, 20 Mar 2024 15:54:03 +0000 (08:54 -0700)]
Merge pull request #56051 from lxbsz/wip-64585

squid: mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #56030 from vshankar/wip-64617-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:51:18 +0000 (08:51 -0700)]
Merge pull request #56030 from vshankar/wip-64617-squid

squid: mds: check file layout in mknod

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #56017 from vshankar/wip-64758-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:46:49 +0000 (08:46 -0700)]
Merge pull request #56017 from vshankar/wip-64758-squid

squid: mds: relax certain asserts in mdlog replay thread

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #55997 from dparmar18/wip-64741-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:46:08 +0000 (08:46 -0700)]
Merge pull request #55997 from dparmar18/wip-64741-squid

squid: client: do not proceed with I/O if filehandle is invalid

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #55989 from joscollin/wip-64744-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:45:32 +0000 (08:45 -0700)]
Merge pull request #55989 from joscollin/wip-64744-squid

squid: mds: fix `dump dir` indicate dir is not cached

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #55940 from neesingh-rh/wip-64701-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:44:50 +0000 (08:44 -0700)]
Merge pull request #55940 from neesingh-rh/wip-64701-squid

squid: mgr/volumes: support to reject CephFS clones if cloner threads are not available

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #55830 from kotreshhr/wip-64583-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:24:13 +0000 (08:24 -0700)]
Merge pull request #55830 from kotreshhr/wip-64583-squid

squid: qa: Fix fs/full suite

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #55805 from anoopcs9/wip-64566-squid
Yuri Weinstein [Wed, 20 Mar 2024 15:23:28 +0000 (08:23 -0700)]
Merge pull request #55805 from anoopcs9/wip-64566-squid

squid: client: Fix return in removexattr for xattrs from `system.` namespace

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agodoc/cephfs: fix architecture link to correct relative path 56339/head
molpako [Wed, 20 Mar 2024 09:43:42 +0000 (18:43 +0900)]
doc/cephfs: fix architecture link to correct relative path

Signed-off-by: molpako <35787116+molpako@users.noreply.github.com>
(cherry picked from commit ceeb1ca4b38dc307e493b04a59d5d07fed23971f)

16 months agoMerge pull request #56253 from rhcs-dashboard/wip-64929-squid
Pedro Gonzalez Gomez [Wed, 20 Mar 2024 07:47:25 +0000 (08:47 +0100)]
Merge pull request #56253 from rhcs-dashboard/wip-64929-squid

squid: mgr/dashboard: ceph authenticate user from fs

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #56229 from adk3798/squid-docs-typo-replace-osd
Adam King [Tue, 19 Mar 2024 20:55:36 +0000 (16:55 -0400)]
Merge pull request #56229 from adk3798/squid-docs-typo-replace-osd

squid: doc: cephadm/services/osd: fix typo

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Zac Dover <zac.dover@proton.me>
16 months agoMerge pull request #55927 from ajarr/wip-64669-squid
Ilya Dryomov [Tue, 19 Mar 2024 13:47:57 +0000 (14:47 +0100)]
Merge pull request #55927 from ajarr/wip-64669-squid

squid: qa: add diff-continuous and compare-mirror-image tests to rbd and krbd suites respectively

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
16 months agoMerge pull request #56194 from vshankar/wip-64924-squid
Venky Shankar [Tue, 19 Mar 2024 13:21:28 +0000 (18:51 +0530)]
Merge pull request #56194 from vshankar/wip-64924-squid

squid: mds: disable `defer_client_eviction_on_laggy_osds' by default

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
16 months agoqa/suites: add diff-continuous and compare-mirror-image tests 55927/head
Ramana Raja [Thu, 29 Feb 2024 17:12:19 +0000 (12:12 -0500)]
qa/suites: add diff-continuous and compare-mirror-image tests

... to rbd and krbd suites respectively.

This allows the compare-mirror-image tests introduced in ea3a567
to be run against various kernel branches, e.g., testing branch.
And allows diff_continuous test in rbd_suite to run against distro
kernel.

Fixes: https://tracker.ceph.com/issues/64574
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 92b254138dd43755490392ffcf5ebca04872e116)

16 months agoqa/suites/rbd: rename nbd folder to device folder
Ramana Raja [Thu, 29 Feb 2024 16:55:08 +0000 (11:55 -0500)]
qa/suites/rbd: rename nbd folder to device folder

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit af43f6162464a20625319a2783a104f7032ba21e)

16 months agodoc/rados: update common.rst 56267/head
Zac Dover [Sun, 17 Mar 2024 09:27:11 +0000 (19:27 +1000)]
doc/rados: update common.rst

Clarify some overwritten paragraphs in
doc/rados/configuration/common.rst. Cf.
https://github.com/ceph/ceph/pull/50795/files#r1153897231.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 233b670704d15c3a69b8d91885b60f3fb101ec58)

16 months agoMerge pull request #56261 from zdover23/wip-doc-2024-03-19-backport-56247-to-squid
Zac Dover [Mon, 18 Mar 2024 17:39:03 +0000 (03:39 +1000)]
Merge pull request #56261 from zdover23/wip-doc-2024-03-19-backport-56247-to-squid

squid: docs/rbd: fix typo in arg name

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agodocs/rbd: fix typo in arg name 56261/head
N Balachandran [Mon, 18 Mar 2024 04:02:39 +0000 (09:32 +0530)]
docs/rbd: fix typo in arg name

Replace "{image-}" with "{image-id}" in the "rbd trash rm"
command description.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit f3eb489520fd4fae057e61275d16c6c8fd596f3f)

docs/rbd: replace introspect with inspect

Replace "introspect" with "inspect" in the rbd basic commands
description.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit ebf2f60f784728c04d8ec59015d666bafcef8218)

docs/rbd: typo in "retrieving image information"

Replace "for the image" with "of the image".

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 4fd5c134536d652ae1f9e05ecf52cb81adb3b850)

16 months agoMerge pull request #56255 from zdover23/wip-doc-2024-03-18-backport-56248-to-squid
Anthony D'Atri [Mon, 18 Mar 2024 14:05:49 +0000 (10:05 -0400)]
Merge pull request #56255 from zdover23/wip-doc-2024-03-18-backport-56248-to-squid

squid: doc/rbd: minor changes to the rbd man page

16 months agodoc/rbd: minor changes to the rbd man page 56255/head
N Balachandran [Mon, 18 Mar 2024 12:22:47 +0000 (17:52 +0530)]
doc/rbd: minor changes to the rbd man page

Fixes typos and grammar for some commands. Adds
additional details for some commandds.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5dcff6a4b8d835fc55e454af977dc5ebad99d37f)

16 months agoMerge pull request #56251 from guits/wip-64931-squid
Guillaume Abrioux [Mon, 18 Mar 2024 10:38:23 +0000 (11:38 +0100)]
Merge pull request #56251 from guits/wip-64931-squid

squid: node-proxy: fix RedFishClient.logout() method

16 months agomgr/dashboard: ceph authenticate user from fs 56253/head
Pedro Gonzalez Gomez [Fri, 1 Mar 2024 12:43:12 +0000 (13:43 +0100)]
mgr/dashboard: ceph authenticate user from fs

Fixes: https://tracker.ceph.com/issues/64660
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 19a9f79b5f218d8cb757579bf8c0f5d610dde3a8)

16 months agonode-proxy: support more Location value formats 56251/head
Guillaume Abrioux [Fri, 15 Mar 2024 14:20:29 +0000 (14:20 +0000)]
node-proxy: support more Location value formats

After some tests, it turns out that depending on the hardware,
the header 'Location' which is returned by the server after logged can be different.
I could notice the following:

either:

Location: scheme://address:port/redfish/v1/SessionService/Session

or

Location: /redfish/v1/SessionService/Session

a previous tracker [1] was opened because I thought only the first one existed, which is wrong.

Fixes: https://tracker.ceph.com/issues/64951
[1] https://tracker.ceph.com/issues/64894

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d7ccf26983c41344a12f33b2a30fc79b65cc548f)

16 months agonode-proxy: fix RedFishClient.logout() method
Guillaume Abrioux [Wed, 13 Mar 2024 13:32:59 +0000 (13:32 +0000)]
node-proxy: fix RedFishClient.logout() method

the endpoint passed down to util.query() is wrong:
is passes the full url (scheme://addr:port/path) where it should only
pass the path. The cause is that RedFishClient.login() basically stores
the value of the Location header in `self.location`.

The consequence of this is that it makes the client unable to properly logout.

Fixes: https://tracker.ceph.com/issues/64894
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit b1d828d1d2f31c02f225bb375d915353582d158a)

16 months agoMerge pull request #56125 from cbodley/wip-64834-squid
Casey Bodley [Sun, 17 Mar 2024 14:34:57 +0000 (14:34 +0000)]
Merge pull request #56125 from cbodley/wip-64834-squid

squid: RGW - Swift retarget needs bucket set on object

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
16 months agoMerge pull request #56144 from cbodley/wip-64876-squid
Casey Bodley [Sun, 17 Mar 2024 14:34:32 +0000 (14:34 +0000)]
Merge pull request #56144 from cbodley/wip-64876-squid

squid: rgw_lc:  replace strftime w/fmt and chrono:calendar

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
16 months agoMerge pull request #56156 from yuvalif/wip-64887-squid
Casey Bodley [Sun, 17 Mar 2024 14:34:08 +0000 (14:34 +0000)]
Merge pull request #56156 from yuvalif/wip-64887-squid

squid: rgw/kafka: set message timeout to 5 seconds

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #56181 from ivancich/wip-64909-squid
Casey Bodley [Sun, 17 Mar 2024 14:33:47 +0000 (14:33 +0000)]
Merge pull request #56181 from ivancich/wip-64909-squid

squid: rgw: rgw-restore-bucket-index -- sort uses specified temp dir

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
16 months agoMerge pull request #56216 from idryomov/wip-63770-squid
Ilya Dryomov [Sat, 16 Mar 2024 18:41:57 +0000 (19:41 +0100)]
Merge pull request #56216 from idryomov/wip-63770-squid

squid: librbd: account for discards that truncate in ObjectListSnapsRequest

Reviewed-by: Ramana Raja <rraja@redhat.com>
16 months agoMerge pull request #55761 from ajarr/wip-64553-squid
Ilya Dryomov [Sat, 16 Mar 2024 18:07:05 +0000 (19:07 +0100)]
Merge pull request #55761 from ajarr/wip-64553-squid

squid: qa: Add tests to validate synced images on rbd-mirror

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
16 months agoMerge pull request #56234 from zdover23/wip-doc-2024-03-16-backport-56182-to-squid
Anthony D'Atri [Sat, 16 Mar 2024 01:32:47 +0000 (21:32 -0400)]
Merge pull request #56234 from zdover23/wip-doc-2024-03-16-backport-56182-to-squid

squid: doc/glossary: add "librados" entry

16 months agodoc/glossary: add "librados" entry 56234/head
Zac Dover [Thu, 14 Mar 2024 06:29:09 +0000 (16:29 +1000)]
doc/glossary: add "librados" entry

Add a "librados" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2a93a8e837a42559f8a81c6fd9274b24f4fdf7f6)

16 months agodoc: cephadm/services/osd: fix typo 56229/head
Lorenz Bausch [Wed, 13 Mar 2024 16:26:51 +0000 (17:26 +0100)]
doc: cephadm/services/osd: fix typo

Signed-off-by: Lorenz Bausch <info@lorenzbausch.de>
(cherry picked from commit d513f1ca69d38f0d7eb40a2d68275caed322cc68)

16 months agoMerge pull request #55715 from cbodley/wip-64541-squid
Casey Bodley [Fri, 15 Mar 2024 14:27:23 +0000 (14:27 +0000)]
Merge pull request #55715 from cbodley/wip-64541-squid

squid: rgw: RGWSI_SysObj_Cache::remove() invalidates after successful delete

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
16 months agorgwlc: implement Filter size limit checks 56144/head
Matt Benjamin [Tue, 24 Oct 2023 21:59:34 +0000 (17:59 -0400)]
rgwlc: implement Filter size limit checks

i.e., this implements ObjectSizeGreaterThan and ObjectSizeLessThan
for supported expiration and transition actions.

Fixes: https://tracker.ceph.com/issues/63304
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit c9b19be15362c63526e92f4d968f942a40cab150)

16 months agorgwlc: implement NewerNoncurrentVersions
Matt Benjamin [Mon, 23 Oct 2023 18:57:33 +0000 (14:57 -0400)]
rgwlc: implement NewerNoncurrentVersions

Per AWS doc, this value controls "how many noncurrent versions
Amazon S3 will retain." [1]  We understand this to mean, retain
NewerNoncurrentVersions of any object, regardless of expiration.

Removed unused RGWLifecycleConfiguration::has_same_action() (cleanup)

[1] https://docs.aws.amazon.com/AmazonS3/latest/API/API_NoncurrentVersionExpiration.html.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit a4313e77a31c5165254068b53dfac3d277b0a6a8)

16 months agoMerge pull request #56207 from zdover23/wip-doc-2024-03-15-backport-56188-to-squid
Zac Dover [Fri, 15 Mar 2024 11:03:48 +0000 (21:03 +1000)]
Merge pull request #56207 from zdover23/wip-doc-2024-03-15-backport-56188-to-squid

squid: doc/rbd: add clone mapping command

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agotest/librbd: add DiffIterateTruncate and DiffIterateWriteAndTruncate 56216/head
Ilya Dryomov [Tue, 5 Mar 2024 20:05:22 +0000 (21:05 +0100)]
test/librbd: add DiffIterateTruncate and DiffIterateWriteAndTruncate

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d84485ec534ccf42327242a9141906f4881c030e)

16 months agolibrbd: don't clip expanded diff on truncate in ObjectListSnapsRequest
Ilya Dryomov [Wed, 28 Feb 2024 13:20:16 +0000 (14:20 +0100)]
librbd: don't clip expanded diff on truncate in ObjectListSnapsRequest

If the diff was expanded due to LIST_SNAPS_FLAG_WHOLE_OBJECT, clipping
it when handling a truncate is wrong -- when subtracting that interval,
we either split the expanded extent into two or chop off a piece of it.
However the point of LIST_SNAPS_FLAG_WHOLE_OBJECT is to report a single
extent covering the entire object.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0ebca5fe22d976f1a17f8078f20a47c49a057edb)

16 months agolibrados/snap_set_diff: ignore truncates above size at start
Ilya Dryomov [Sun, 18 Feb 2024 10:46:15 +0000 (11:46 +0100)]
librados/snap_set_diff: ignore truncates above size at start

Because currently calc_snap_set_diff() only ever appends to the running
diff, an excessive (either too large or completely bogus) zero extent
is reported in cases where an object is first expanded (with a snapshot
taken at that point) and then truncated but still above the size of the
object as of the starting snapshot.

Fixes: https://tracker.ceph.com/issues/63770
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5b11fb314abefea390c5663c33e9e1ace6179974)

16 months agoMerge pull request #56155 from rhcs-dashboard/wip-64884-squid
Ivo Almeida [Fri, 15 Mar 2024 10:03:08 +0000 (10:03 +0000)]
Merge pull request #56155 from rhcs-dashboard/wip-64884-squid

squid: mgr/dashboard: fix snap schedule time format

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agomgr/vol: don't import IndexException since it's unused 55940/head
Rishabh Dave [Mon, 4 Mar 2024 11:41:21 +0000 (17:11 +0530)]
mgr/vol: don't import IndexException since it's unused

Introduced-by: 079f722c37ef6cc8bd3cc26c49ae119dd83431f9
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit b4c1d552aa4066efdda3493192927cb780693469)

16 months agodoc/rbd: add clone mapping command 56207/head
Zac Dover [Thu, 14 Mar 2024 08:37:23 +0000 (18:37 +1000)]
doc/rbd: add clone mapping command

Add a command that explains how to map a formatted clone when the parent
image and the formatted clone have different encryption types.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d34c1879c8886ec7f19c7a93490c4736ae9a6d20)

16 months agoMerge pull request #56185 from zdover23/wip-doc-2024-03-14-backport-56160-to-squid
Zac Dover [Thu, 14 Mar 2024 19:44:55 +0000 (05:44 +1000)]
Merge pull request #56185 from zdover23/wip-doc-2024-03-14-backport-56160-to-squid

squid: doc/rbd: add map information for clone images to rbd-encryption.rst

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agomds: disable `defer_client_eviction_on_laggy_osds' by default 56194/head
Venky Shankar [Mon, 4 Mar 2024 13:23:53 +0000 (18:53 +0530)]
mds: disable `defer_client_eviction_on_laggy_osds' by default

This config can result in a single client holding up mds to service
other clients since once a client is deferred from eviction due to
laggy OSD(s), a new clients cap acquire request can be possibly
blocked until the other laggy client resumes operation, i.e., when
the laggy OSD is considered non-laggy anymore.

Disable the config by default till the issue is fixed.

Fixes: http://tracker.ceph.com/issues/64685
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 109de8bdab86e1adaad580d9e7322c18fa01bc09)

16 months agoqa: enhance labeled perf counters test for cephfs-mirror 56210/head
Jos Collin [Thu, 29 Feb 2024 10:50:03 +0000 (16:20 +0530)]
qa: enhance labeled perf counters test for cephfs-mirror

Implements checks for labeled perf counters in the appropriate tests.
This patch verifies snaps_synced, snaps_renamed, snaps_deleted and sync_failures metrics are
updated correctly based on the tests.

Fixes: https://tracker.ceph.com/issues/64486
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 7b7e5d4221389ce077780450d78a4a1e6a3d0a43)

16 months agodoc/rbd: add map information for clone images to rbd-encryption.rst 56185/head
N Balachandran [Wed, 13 Mar 2024 11:57:49 +0000 (17:27 +0530)]
doc/rbd: add map information for clone images to rbd-encryption.rst

Add information on the arguments required when mapping the
formatted clone of an encrypted parent image.

Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 7a2e324a6e1c3e145d3b1e04e6f006defbe0e0b4)

16 months agorgw: rgw-restore-bucket-index -- sort uses specified temp dir 56181/head
J. Eric Ivancich [Mon, 11 Mar 2024 21:19:40 +0000 (17:19 -0400)]
rgw: rgw-restore-bucket-index -- sort uses specified temp dir

The sort command sometimes makes use of temporary files. When the user
specifies a directory to be used for temp files, have the sort command
use that same directory.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit a14dad152c651ab8048f9e10898d4d2cc61b0d42)

16 months agorgw/kafka: set message timeout to 5 seconds 56156/head
Yuval Lifshitz [Tue, 5 Mar 2024 10:14:06 +0000 (10:14 +0000)]
rgw/kafka: set message timeout to 5 seconds

also increase the idle timeout to 30 seconds.
test instructions:
https://gist.github.com/yuvalif/33487bff19883e3409caa8a843a0b353

Fixes: https://tracker.ceph.com/issues/64710
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit 1c13850f24dbb90c33a12c6da338956c2e83811b)

16 months agomgr/dashboard: fix snap schedule time format 56155/head
Ivo Almeida [Mon, 11 Mar 2024 15:09:57 +0000 (15:09 +0000)]
mgr/dashboard: fix snap schedule time format

Fixes: https://tracker.ceph.com/issues/64831
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit a2942f01ae9bde76c6d562374a0bd8aceeee317e)

16 months agoMerge pull request #56116 from rhcs-dashboard/wip-64825-squid
Nizamudeen A [Wed, 13 Mar 2024 06:21:50 +0000 (11:51 +0530)]
Merge pull request #56116 from rhcs-dashboard/wip-64825-squid

squid: mgr/dashboard: fix snap schedule list toggle cols

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #56043 from cbodley/wip-64795-squid
Casey Bodley [Wed, 13 Mar 2024 01:49:22 +0000 (01:49 +0000)]
Merge pull request #56043 from cbodley/wip-64795-squid

squid: rgw: compatibility issues on BucketPublicAccessBlock

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
16 months agorgw_lc: replace strftime w/fmt and chrono:calendar
Matt Benjamin [Mon, 19 Feb 2024 14:01:48 +0000 (09:01 -0500)]
rgw_lc:  replace strftime w/fmt and chrono:calendar

It's reliably claimed that std::strftime is not
mt-safe, and this would be a likely root cause of
intermittent scrambled expiration header output cases
that have been reported.

Fixes: https://tracker.ceph.com/issues/63973
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 96a5cbb9aa47ed1a2b51e720475ebc08012cb4cc)

16 months agoMerge pull request #56036 from cbodley/wip-64768-squid
Casey Bodley [Tue, 12 Mar 2024 17:29:00 +0000 (17:29 +0000)]
Merge pull request #56036 from cbodley/wip-64768-squid

squid: rgw_sigv4: handle '0;' as trailer-chunk boundary

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
16 months agoMerge pull request #56037 from cbodley/wip-64764-squid
Casey Bodley [Tue, 12 Mar 2024 15:41:23 +0000 (15:41 +0000)]
Merge pull request #56037 from cbodley/wip-64764-squid

squid: rgw/beast: Enable SSL session-id reuse speedup mechanism

Reviewed-by: Mark Kogan <mkogan@redhat.com>
16 months agoMerge pull request #55871 from cbodley/wip-64661-squid
Casey Bodley [Tue, 12 Mar 2024 14:14:06 +0000 (14:14 +0000)]
Merge pull request #55871 from cbodley/wip-64661-squid

squid: rgw/auth: do_aws4_auth_completion() catches exceptions

Reviewed-by: Ali Maredia <amaredia@redhat.com>
16 months agoMerge pull request #55876 from cbodley/wip-64664-squid
Casey Bodley [Tue, 12 Mar 2024 14:13:55 +0000 (14:13 +0000)]
Merge pull request #55876 from cbodley/wip-64664-squid

squid: src/rgw: fix for the multipart interface in the WORM function

Reviewed-by: Ali Maredia <amaredia@redhat.com>
16 months agoMerge pull request #56048 from cbodley/wip-qa-rgw-squid-tests
Casey Bodley [Tue, 12 Mar 2024 14:13:43 +0000 (14:13 +0000)]
Merge pull request #56048 from cbodley/wip-qa-rgw-squid-tests

squid: qa/rgw: point rgw test repos at ceph-squid release branch

Reviewed-by: Ali Maredia <amaredia@redhat.com>
16 months agoMerge pull request #55653 from cbodley/wip-64493-squid
Casey Bodley [Tue, 12 Mar 2024 14:13:28 +0000 (14:13 +0000)]
Merge pull request #55653 from cbodley/wip-64493-squid

squid: rgw/user: add 'active' flag to RGWAccessKey

Reviewed-by: Ali Maredia <amaredia@redhat.com>
16 months agoMerge pull request #56009 from ivancich/wip-64773-squid
Casey Bodley [Tue, 12 Mar 2024 12:37:08 +0000 (12:37 +0000)]
Merge pull request #56009 from ivancich/wip-64773-squid

squid: rgw: make rgw-restore-bucket-index more robust

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #55816 from rhcs-dashboard/wip-64625-squid
afreen23 [Tue, 12 Mar 2024 10:58:43 +0000 (16:28 +0530)]
Merge pull request #55816 from rhcs-dashboard/wip-64625-squid

squid: mgr/dashboard: fix snap schedule date format

Reviewed-by: Afreen <afreen23.git@gmail.com>
16 months agoMerge pull request #55785 from rhcs-dashboard/wip-64594-squid
Pedro Gonzalez Gomez [Tue, 12 Mar 2024 07:07:41 +0000 (08:07 +0100)]
Merge pull request #55785 from rhcs-dashboard/wip-64594-squid

squid: mgr/dashboard: fix volume creation with multiple hosts

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #56126 from adk3798/wip-64838-squid
Nizamudeen A [Tue, 12 Mar 2024 06:09:14 +0000 (11:39 +0530)]
Merge pull request #56126 from adk3798/wip-64838-squid

squid: mgr/dashboard: debugging make check failure

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #56129 from zdover23/wip-doc-2024-03-12-backport-56113-to-squid
Anthony D'Atri [Mon, 11 Mar 2024 23:01:33 +0000 (19:01 -0400)]
Merge pull request #56129 from zdover23/wip-doc-2024-03-12-backport-56113-to-squid

squid: doc/cephadm: Improve multiple files

16 months agoqa/workunits/rbd: switch rbd-mirror workunits to bash 55761/head
Ilya Dryomov [Sat, 9 Mar 2024 21:53:44 +0000 (22:53 +0100)]
qa/workunits/rbd: switch rbd-mirror workunits to bash

By making use of here strings in commit ea3a567f7f03 ("qa/workunits:
make wait_for_status_in_pool_dir() reentrant") we grew a dependency on
bash.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 166a2362378b1ff93e43f483f354c428fd6cef9e)

16 months agoMerge pull request #55941 from galsalomon66/wip-64694-squid
Casey Bodley [Mon, 11 Mar 2024 17:33:09 +0000 (17:33 +0000)]
Merge pull request #55941 from galsalomon66/wip-64694-squid

squid: rgw/s3select: Wip 64694 squid

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #55842 from ivancich/wip-squid-manifest
Casey Bodley [Mon, 11 Mar 2024 17:31:03 +0000 (17:31 +0000)]
Merge pull request #55842 from ivancich/wip-squid-manifest

squid: rgw: add new `object manifest` sub-command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agodoc/cephadm: Improve multiple files 56129/head
Anthony D'Atri [Mon, 11 Mar 2024 07:04:47 +0000 (03:04 -0400)]
doc/cephadm: Improve multiple files

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 800dd29e60fcd2bcd27db56d3fe45c58ddf10c8a)

16 months agomgr/dashboard: debugging make check failure 56126/head
Nizamudeen A [Mon, 4 Mar 2024 12:52:48 +0000 (18:22 +0530)]
mgr/dashboard: debugging make check failure

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 958c60d8a74e3c38abe043e7f2cfbe4224cfb411)

16 months agoRGW - Swift retarget needs bucket set on object 56125/head
Daniel Gryniewicz [Thu, 16 Jun 2022 15:46:24 +0000 (11:46 -0400)]
RGW - Swift retarget needs bucket set on object

When a bucket list is retargeted to an object get, then the object may
not yet have it's bucket set.  Ensure the bucket is set on the object.

Fixes: https://tracker.ceph.com/issues/56029
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
(cherry picked from commit 2d4a3ca5c94908a6865dce0192677d8346e1f848)

16 months agoMerge pull request #56060 from rhcs-dashboard/wip-64808-squid
Pedro Gonzalez Gomez [Mon, 11 Mar 2024 13:10:34 +0000 (14:10 +0100)]
Merge pull request #56060 from rhcs-dashboard/wip-64808-squid

squid: mgr/dashboard: add snap schedule M, Y frequencies

Reviewed-by: afreen23 <NOT@FOUND>
16 months agomgr/dashboard: fix snap schedule list toggle cols 56116/head
Ivo Almeida [Fri, 8 Mar 2024 11:40:41 +0000 (11:40 +0000)]
mgr/dashboard: fix snap schedule list toggle cols

Added isInvisible property to CdColumnTable interface to hide column
from 'toggle columns' drop down checkboxes.

Fixes: https://tracker.ceph.com/issues/64813
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit 1b77baea8dd0781fa897ec6c1f1e06c57a265ed7)

16 months agoMerge pull request #56110 from zdover23/wip-doc-2024-03-11-backport-56091-to-squid
Anthony D'Atri [Mon, 11 Mar 2024 07:06:00 +0000 (03:06 -0400)]
Merge pull request #56110 from zdover23/wip-doc-2024-03-11-backport-56091-to-squid

squid: doc/cephadm: improve host-management.rst

16 months agodoc/cephadm: improve host-management.rst 56110/head
Anthony D'Atri [Sun, 10 Mar 2024 19:49:35 +0000 (15:49 -0400)]
doc/cephadm: improve host-management.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 9fb51bb537e8bd9ea60633091acfc48a58262c3b)

16 months agoMerge pull request #56072 from zdover23/wip-doc-2024-03-09-backport-56068-to-squid
zdover23 [Sat, 9 Mar 2024 13:38:53 +0000 (23:38 +1000)]
Merge pull request #56072 from zdover23/wip-doc-2024-03-09-backport-56068-to-squid

squid: doc/glossary: add "Crimson" entry

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
16 months agodoc/glossary: add "Crimson" entry 56072/head
Zac Dover [Fri, 8 Mar 2024 17:17:59 +0000 (03:17 +1000)]
doc/glossary: add "Crimson" entry

Add a "Crimson" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b31e061cc087b31a7e9e841dd21e7403a2197378)

16 months agoMerge pull request #56039 from zdover23/wip-doc-2024-03-08-backport-56010-to-squid
zdover23 [Sat, 9 Mar 2024 07:20:51 +0000 (17:20 +1000)]
Merge pull request #56039 from zdover23/wip-doc-2024-03-08-backport-56010-to-squid

squid: doc/start: add Slack invite link

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agoMerge pull request #55998 from guits/wip-64749-squid
Adam King [Fri, 8 Mar 2024 19:59:45 +0000 (14:59 -0500)]
Merge pull request #55998 from guits/wip-64749-squid

squid: mgr/node-proxy: handle 'None' statuses returned by RedFish

Reviewed-by: Adam King <adking@redhat.com>
16 months agoMerge pull request #56056 from zdover23/wip-doc-2024-03-08-backport-56045-to-squid
Anthony D'Atri [Fri, 8 Mar 2024 15:59:42 +0000 (10:59 -0500)]
Merge pull request #56056 from zdover23/wip-doc-2024-03-08-backport-56045-to-squid

squid: doc/rados: restore PGcalc tool

16 months agomgr/dashboard: add snap schedule M, Y frequencies 56060/head
Ivo Almeida [Mon, 26 Feb 2024 11:56:18 +0000 (11:56 +0000)]
mgr/dashboard: add snap schedule M, Y frequencies

Added M and Y (month and year) repeat frequencies to snap schedule
create form.

Fixes: https://tracker.ceph.com/issues/64614
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit be3bb09cca7ff8d10a36a59702bb16fd10aba84e)

16 months agodoc/rados: restore PGcalc tool 56056/head
Zac Dover [Thu, 7 Mar 2024 17:29:50 +0000 (03:29 +1000)]
doc/rados: restore PGcalc tool

Restore the PGcalc tool to the documentation suite.

Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit eaaf72253123de1a66f163f651046817faa97a1a)

16 months agomds: allow lock state to be LOCK_MIX_SYNC in replica for filelock 56051/head
Xiubo Li [Tue, 28 Nov 2023 03:21:38 +0000 (11:21 +0800)]
mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock

When the auth MDS is transmitting state from LOCK_MIX to LOCK_SYNC
it will transmit the state to a intermidiate state LOCK_MIX_SYNC.
Then notifies the replicate MDSs and waits for the acks. But just
in case for some reasons the replicate MDSs couldn't successfully
transmit the state from LOCK_MIX to LOCK_MIX_SYNC and then
LOCK_MIX_SYNC2. And just the auth MDS failover or restart and
then resend the notification.

Fixes: https://tracker.ceph.com/issues/54833
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit f50693f62387e48c5c07ba913f2d384de0fe2d5c)

16 months agoqa/rgw: point rgw test repos at ceph-squid release branch 56048/head
Casey Bodley [Thu, 7 Mar 2024 21:08:05 +0000 (16:08 -0500)]
qa/rgw: point rgw test repos at ceph-squid release branch

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw: return 204 on bucket public access block deletion 56043/head
Seena Fallah [Tue, 20 Feb 2024 14:54:06 +0000 (15:54 +0100)]
rgw: return 204 on bucket public access block deletion

According to AWS doc (https://docs.aws.amazon.com/AmazonS3/latest/API/API_DeletePublicAccessBlock.html#API_DeletePublicAccessBlock_ResponseSyntax) 204 shall be returned on delete request.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 48a454971c9979dfd9a95cc9619ca864aeda26a5)

16 months agorgw: return 404 on no bucket public access block
Seena Fallah [Mon, 19 Feb 2024 17:23:07 +0000 (18:23 +0100)]
rgw: return 404 on no bucket public access block

Return 404 when there is no public access block on the bucket.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 146d4d98698d48dcbc0f036de0793e0a5f9bb8a6)

16 months agorgw: fix the op in GetBucketPublicAccessBlock verify_permission
Seena Fallah [Mon, 19 Feb 2024 17:20:44 +0000 (18:20 +0100)]
rgw: fix the op in GetBucketPublicAccessBlock verify_permission

s3GetBucketPublicAccessBlock needs to be checked for RGWGetBucketPublicAccessBlock operation.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 54bc5eba002cff04e5c4e25168aeb2408ba100b2)

16 months agorgw: fix root element for GetPublicAccessBlock
Seena Fallah [Mon, 19 Feb 2024 17:17:52 +0000 (18:17 +0100)]
rgw: fix root element for GetPublicAccessBlock

From the AWS doc (https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetPublicAccessBlock.html) it needs to be PublicAccessBlockConfiguration.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit db74c10e008caeb7092eb4c1268cbd6f044afa19)

16 months agodoc/start: add Slack invite link 56039/head
Zac Dover [Thu, 7 Mar 2024 03:01:47 +0000 (13:01 +1000)]
doc/start: add Slack invite link

Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dee319e61204b2ee9ac13562c2c7075ef0f2ea4b)

16 months agoMerge pull request #56011 from zdover23/wip-doc-2024-03-07-backport-55995-to-squid
Anthony D'Atri [Thu, 7 Mar 2024 15:34:54 +0000 (10:34 -0500)]
Merge pull request #56011 from zdover23/wip-doc-2024-03-07-backport-55995-to-squid

squid: doc/architecture: correct typo

16 months agorgw/beast: enablment of SSL session-id reuse speedup mechanism 56037/head
Mark Kogan [Tue, 5 Mar 2024 14:48:56 +0000 (16:48 +0200)]
rgw/beast: enablment of SSL session-id reuse speedup mechanism

Enable the OpenSSL session-id reuse acceleration mechanism that is described in:

https://www.openssl.org/docs/man1.0.2/man3/SSL_CTX_set_session_id_context.html
SSL_CTX_set_session_id_context, SSL_set_session_id_context - set context
within which session can be reused (server side only)

Fixes: https://tracker.ceph.com/issues/64719
Signed-off-by: Mark Kogan <mkogan@redhat.com>
(cherry picked from commit 6fb4c5d0c0694c9cfdbf0ed729d9f95886a0673f)

16 months agoMerge pull request #55926 from idryomov/wip-pr-55897-squid
Ilya Dryomov [Thu, 7 Mar 2024 14:00:39 +0000 (15:00 +0100)]
Merge pull request #55926 from idryomov/wip-pr-55897-squid

squid: src/seastar: update seastar submodule to fix FTBFS

Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>
16 months agorgw_sigv4: handle '0;' as trailer-chunk boundary 56036/head
matt benjamin [Sat, 2 Mar 2024 18:49:52 +0000 (13:49 -0500)]
rgw_sigv4: handle '0;' as trailer-chunk boundary

https://tracker.ceph.com/issues/64676

Signed-off-by: matt benjamin <mbenjamin@redhat.com>
(cherry picked from commit ef1111a17084f6672fd40e366f92f8168a09d0a0)