]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Nizamudeen A [Thu, 7 Mar 2024 08:43:54 +0000 (14:13 +0530)]
mgr/dashboard: disable applitools e2e
Temporarily disabling this so the CI could turn green. Meanwhile I'll
research for a proper way to handle the applitools e2es which I'll track
on https://tracker.ceph.com/issues/64783
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
09c50063a3763fc5d29f604a9daeb844252a31da )
Ivo Almeida [Fri, 15 Mar 2024 10:03:08 +0000 (10:03 +0000)]
Merge pull request #56155 from rhcs-dashboard/wip-64884-squid
squid: mgr/dashboard: fix snap schedule time format
Reviewed-by: Nizamudeen A <nia@redhat.com>
Zac Dover [Thu, 14 Mar 2024 19:44:55 +0000 (05:44 +1000)]
Merge pull request #56185 from zdover23/wip-doc-2024-03-14-backport-56160-to-squid
squid: doc/rbd: add map information for clone images to rbd-encryption.rst
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
N Balachandran [Wed, 13 Mar 2024 11:57:49 +0000 (17:27 +0530)]
doc/rbd: add map information for clone images to rbd-encryption.rst
Add information on the arguments required when mapping the
formatted clone of an encrypted parent image.
Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit
7a2e324a6e1c3e145d3b1e04e6f006defbe0e0b4 )
Ivo Almeida [Mon, 11 Mar 2024 15:09:57 +0000 (15:09 +0000)]
mgr/dashboard: fix snap schedule time format
Fixes: https://tracker.ceph.com/issues/64831
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit
a2942f01ae9bde76c6d562374a0bd8aceeee317e )
Nizamudeen A [Wed, 13 Mar 2024 06:21:50 +0000 (11:51 +0530)]
Merge pull request #56116 from rhcs-dashboard/wip-64825-squid
squid: mgr/dashboard: fix snap schedule list toggle cols
Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Casey Bodley [Wed, 13 Mar 2024 01:49:22 +0000 (01:49 +0000)]
Merge pull request #56043 from cbodley/wip-64795-squid
squid: rgw: compatibility issues on BucketPublicAccessBlock
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 17:29:00 +0000 (17:29 +0000)]
Merge pull request #56036 from cbodley/wip-64768-squid
squid: rgw_sigv4: handle '0;' as trailer-chunk boundary
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 15:41:23 +0000 (15:41 +0000)]
Merge pull request #56037 from cbodley/wip-64764-squid
squid: rgw/beast: Enable SSL session-id reuse speedup mechanism
Reviewed-by: Mark Kogan <mkogan@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 14:14:06 +0000 (14:14 +0000)]
Merge pull request #55871 from cbodley/wip-64661-squid
squid: rgw/auth: do_aws4_auth_completion() catches exceptions
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 14:13:55 +0000 (14:13 +0000)]
Merge pull request #55876 from cbodley/wip-64664-squid
squid: src/rgw: fix for the multipart interface in the WORM function
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 14:13:43 +0000 (14:13 +0000)]
Merge pull request #56048 from cbodley/wip-qa-rgw-squid-tests
squid: qa/rgw: point rgw test repos at ceph-squid release branch
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 14:13:28 +0000 (14:13 +0000)]
Merge pull request #55653 from cbodley/wip-64493-squid
squid: rgw/user: add 'active' flag to RGWAccessKey
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Tue, 12 Mar 2024 12:37:08 +0000 (12:37 +0000)]
Merge pull request #56009 from ivancich/wip-64773-squid
squid: rgw: make rgw-restore-bucket-index more robust
Reviewed-by: Casey Bodley <cbodley@redhat.com>
afreen23 [Tue, 12 Mar 2024 10:58:43 +0000 (16:28 +0530)]
Merge pull request #55816 from rhcs-dashboard/wip-64625-squid
squid: mgr/dashboard: fix snap schedule date format
Reviewed-by: Afreen <afreen23.git@gmail.com>
Pedro Gonzalez Gomez [Tue, 12 Mar 2024 07:07:41 +0000 (08:07 +0100)]
Merge pull request #55785 from rhcs-dashboard/wip-64594-squid
squid: mgr/dashboard: fix volume creation with multiple hosts
Reviewed-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Tue, 12 Mar 2024 06:09:14 +0000 (11:39 +0530)]
Merge pull request #56126 from adk3798/wip-64838-squid
squid: mgr/dashboard: debugging make check failure
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Anthony D'Atri [Mon, 11 Mar 2024 23:01:33 +0000 (19:01 -0400)]
Merge pull request #56129 from zdover23/wip-doc-2024-03-12-backport-56113-to-squid
squid: doc/cephadm: Improve multiple files
Casey Bodley [Mon, 11 Mar 2024 17:33:09 +0000 (17:33 +0000)]
Merge pull request #55941 from galsalomon66/wip-64694-squid
squid: rgw/s3select: Wip 64694 squid
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Mon, 11 Mar 2024 17:31:03 +0000 (17:31 +0000)]
Merge pull request #55842 from ivancich/wip-squid-manifest
squid: rgw: add new `object manifest` sub-command
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Anthony D'Atri [Mon, 11 Mar 2024 07:04:47 +0000 (03:04 -0400)]
doc/cephadm: Improve multiple files
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
800dd29e60fcd2bcd27db56d3fe45c58ddf10c8a )
Nizamudeen A [Mon, 4 Mar 2024 12:52:48 +0000 (18:22 +0530)]
mgr/dashboard: debugging make check failure
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
958c60d8a74e3c38abe043e7f2cfbe4224cfb411 )
Pedro Gonzalez Gomez [Mon, 11 Mar 2024 13:10:34 +0000 (14:10 +0100)]
Merge pull request #56060 from rhcs-dashboard/wip-64808-squid
squid: mgr/dashboard: add snap schedule M, Y frequencies
Reviewed-by: afreen23 <NOT@FOUND>
Ivo Almeida [Fri, 8 Mar 2024 11:40:41 +0000 (11:40 +0000)]
mgr/dashboard: fix snap schedule list toggle cols
Added isInvisible property to CdColumnTable interface to hide column
from 'toggle columns' drop down checkboxes.
Fixes: https://tracker.ceph.com/issues/64813
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit
1b77baea8dd0781fa897ec6c1f1e06c57a265ed7 )
Anthony D'Atri [Mon, 11 Mar 2024 07:06:00 +0000 (03:06 -0400)]
Merge pull request #56110 from zdover23/wip-doc-2024-03-11-backport-56091-to-squid
squid: doc/cephadm: improve host-management.rst
Anthony D'Atri [Sun, 10 Mar 2024 19:49:35 +0000 (15:49 -0400)]
doc/cephadm: improve host-management.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
9fb51bb537e8bd9ea60633091acfc48a58262c3b )
zdover23 [Sat, 9 Mar 2024 13:38:53 +0000 (23:38 +1000)]
Merge pull request #56072 from zdover23/wip-doc-2024-03-09-backport-56068-to-squid
squid: doc/glossary: add "Crimson" entry
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Zac Dover [Fri, 8 Mar 2024 17:17:59 +0000 (03:17 +1000)]
doc/glossary: add "Crimson" entry
Add a "Crimson" entry to the glossary.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
b31e061cc087b31a7e9e841dd21e7403a2197378 )
zdover23 [Sat, 9 Mar 2024 07:20:51 +0000 (17:20 +1000)]
Merge pull request #56039 from zdover23/wip-doc-2024-03-08-backport-56010-to-squid
squid: doc/start: add Slack invite link
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Adam King [Fri, 8 Mar 2024 19:59:45 +0000 (14:59 -0500)]
Merge pull request #55998 from guits/wip-64749-squid
squid: mgr/node-proxy: handle 'None' statuses returned by RedFish
Reviewed-by: Adam King <adking@redhat.com>
Anthony D'Atri [Fri, 8 Mar 2024 15:59:42 +0000 (10:59 -0500)]
Merge pull request #56056 from zdover23/wip-doc-2024-03-08-backport-56045-to-squid
squid: doc/rados: restore PGcalc tool
Ivo Almeida [Mon, 26 Feb 2024 11:56:18 +0000 (11:56 +0000)]
mgr/dashboard: add snap schedule M, Y frequencies
Added M and Y (month and year) repeat frequencies to snap schedule
create form.
Fixes: https://tracker.ceph.com/issues/64614
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit
be3bb09cca7ff8d10a36a59702bb16fd10aba84e )
Zac Dover [Thu, 7 Mar 2024 17:29:50 +0000 (03:29 +1000)]
doc/rados: restore PGcalc tool
Restore the PGcalc tool to the documentation suite.
Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
eaaf72253123de1a66f163f651046817faa97a1a )
Casey Bodley [Thu, 7 Mar 2024 21:08:05 +0000 (16:08 -0500)]
qa/rgw: point rgw test repos at ceph-squid release branch
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Seena Fallah [Tue, 20 Feb 2024 14:54:06 +0000 (15:54 +0100)]
rgw: return 204 on bucket public access block deletion
According to AWS doc (https://docs.aws.amazon.com/AmazonS3/latest/API/API_DeletePublicAccessBlock.html#API_DeletePublicAccessBlock_ResponseSyntax) 204 shall be returned on delete request.
Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit
48a454971c9979dfd9a95cc9619ca864aeda26a5 )
Seena Fallah [Mon, 19 Feb 2024 17:23:07 +0000 (18:23 +0100)]
rgw: return 404 on no bucket public access block
Return 404 when there is no public access block on the bucket.
Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit
146d4d98698d48dcbc0f036de0793e0a5f9bb8a6 )
Seena Fallah [Mon, 19 Feb 2024 17:20:44 +0000 (18:20 +0100)]
rgw: fix the op in GetBucketPublicAccessBlock verify_permission
s3GetBucketPublicAccessBlock needs to be checked for RGWGetBucketPublicAccessBlock operation.
Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit
54bc5eba002cff04e5c4e25168aeb2408ba100b2 )
Seena Fallah [Mon, 19 Feb 2024 17:17:52 +0000 (18:17 +0100)]
rgw: fix root element for GetPublicAccessBlock
From the AWS doc (https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetPublicAccessBlock.html) it needs to be PublicAccessBlockConfiguration.
Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit
db74c10e008caeb7092eb4c1268cbd6f044afa19 )
Zac Dover [Thu, 7 Mar 2024 03:01:47 +0000 (13:01 +1000)]
doc/start: add Slack invite link
Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
dee319e61204b2ee9ac13562c2c7075ef0f2ea4b )
Anthony D'Atri [Thu, 7 Mar 2024 15:34:54 +0000 (10:34 -0500)]
Merge pull request #56011 from zdover23/wip-doc-2024-03-07-backport-55995-to-squid
squid: doc/architecture: correct typo
Mark Kogan [Tue, 5 Mar 2024 14:48:56 +0000 (16:48 +0200)]
rgw/beast: enablment of SSL session-id reuse speedup mechanism
Enable the OpenSSL session-id reuse acceleration mechanism that is described in:
https://www.openssl.org/docs/man1.0.2/man3/SSL_CTX_set_session_id_context.html
SSL_CTX_set_session_id_context, SSL_set_session_id_context - set context
within which session can be reused (server side only)
Fixes: https://tracker.ceph.com/issues/64719
Signed-off-by: Mark Kogan <mkogan@redhat.com>
(cherry picked from commit
6fb4c5d0c0694c9cfdbf0ed729d9f95886a0673f )
Ilya Dryomov [Thu, 7 Mar 2024 14:00:39 +0000 (15:00 +0100)]
Merge pull request #55926 from idryomov/wip-pr-55897-squid
squid: src/seastar: update seastar submodule to fix FTBFS
Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>
matt benjamin [Sat, 2 Mar 2024 18:49:52 +0000 (13:49 -0500)]
rgw_sigv4: handle '0;' as trailer-chunk boundary
https://tracker.ceph.com/issues/64676
Signed-off-by: matt benjamin <mbenjamin@redhat.com>
(cherry picked from commit
ef1111a17084f6672fd40e366f92f8168a09d0a0 )
Nizamudeen A [Thu, 7 Mar 2024 04:31:27 +0000 (10:01 +0530)]
Merge pull request #55992 from rhcs-dashboard/wip-64731-squid
squid: mgr/dashboard: fixed cephfs mount command
Reviewed-by: Nizamudeen A <nia@redhat.com>
Zac Dover [Wed, 6 Mar 2024 11:40:10 +0000 (21:40 +1000)]
doc/architecture: correct typo
s/client/clients/ where necessary, and add a link to the glossary.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
ae08855cf870173dce2a47a28f3bbb22e7ae0ca2 )
J. Eric Ivancich [Fri, 1 Mar 2024 23:54:12 +0000 (18:54 -0500)]
rgw: make rgw-restore-bucket-index more robust
This experimental tool write a series of temporary files, the combined
size of which is roughly proportional to some combination of the
number of objects in the bucket and their respective sizes. Previously
the script stored all temporary files in /tmp, which may not be
sufficiently large in many cases.
There are now two enhancements. First, using the "-t" command-line
argument, the directory for temporary files can be specified. Second,
if the script consumes all available space on the file system
containing the temporary directory, an error message to that effect is
displayed, so the user understands what corrective action to take.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit
a8cf37b6e8e33c53d9be4cc1998d3b2f80700fbd )
Anthony D'Atri [Wed, 6 Mar 2024 22:22:29 +0000 (17:22 -0500)]
Merge pull request #56001 from zdover23/wip-doc-2024-03-07-backport-55982-to-squid
squid: doc/dev: edit teuthology workflow
Zac Dover [Wed, 6 Mar 2024 07:15:20 +0000 (17:15 +1000)]
doc/dev: edit teuthology workflow
Improve a couple of sentences in
doc/dev/developer_guide_testing_integration_tests/tests-integration-testing-teutology-workflow.rst.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
51796e80f35da8ca13b72f31eeafefd4c1e40773 )
Guillaume Abrioux [Tue, 5 Mar 2024 10:05:18 +0000 (10:05 +0000)]
mgr/node-proxy: handle 'None' statuses returned by RedFish
Looks like RedFish might return 'None' values for some attributes.
for instance:
```
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/AHCI.SL.6-1/Drives/Disk.Direct.0-0:AHCI.SL.6-1 -H "X-Auth-Token:
3264251c28191fa5e7c9ebec49ef90fc " | jq .Status
{
"Health": "OK",
"HealthRollup": "OK",
"State": "Enabled"
}
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/NonRAID.Slot.2-1/Drives/Disk.Bay.0:Enclosure.Internal.0-1:NonRAID.Slot.2-1 -H "X-Auth-Token:
3264251c28191fa5e7c9ebec49ef90fc " | jq .Status
{
"Health": null,
"HealthRollup": null,
"State": "Enabled"
}
[root@ceph-node-01 ~]#
```
Although this seems to be a bug from RedFish, we need to handle
the case when it happens otherwise it makes the mgr orchestrator module
throw an error.
The idea here is to create a new status "unknown" when we can't fetch the
real status of a component.
Fixes: https://tracker.ceph.com/issues/64712
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit
cc279a3dd23d9219e508b80512f363a4ae577392 )
Ivo Almeida [Tue, 5 Mar 2024 12:37:21 +0000 (12:37 +0000)]
mgr/dashboard: fixed cephfs mount command
Fixes: https://tracker.ceph.com/issues/64716
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit
eeb09b19581d353fb68f86bb4c2871f026a35c29 )
Gal Salomon [Sun, 3 Mar 2024 12:44:49 +0000 (14:44 +0200)]
using the it.length() for segment processing.
s3select submodule
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit
8fedb30c1bd6cd393becf88f8d2fe07ea9c6040c )
Gal Salomon [Fri, 1 Mar 2024 12:48:13 +0000 (14:48 +0200)]
add a fix related to RGW crash upon compression (assert is replaced by exception)
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit
9d8f5d7132741c996a3f66d62a8ec9e9a34fa0c0 )
Gal Salomon [Tue, 13 Feb 2024 15:47:26 +0000 (17:47 +0200)]
adding recent update: json-output and more
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit
f50385ef71a3d0ac175018cb070dbf2e767e6ed3 )
Anthony D'Atri [Tue, 5 Mar 2024 00:53:54 +0000 (19:53 -0500)]
Merge pull request #55935 from zdover23/wip-doc-2024-03-05-backport-55918-to-squid
squid: doc/rados: link to pg setting commands
Anthony D'Atri [Tue, 5 Mar 2024 00:52:44 +0000 (19:52 -0500)]
Merge pull request #55932 from zdover23/wip-doc-2024-03-05-backport-55924-to-squid
squid: doc/architecture: remove pleonasm
Zac Dover [Mon, 4 Mar 2024 10:41:16 +0000 (20:41 +1000)]
doc/rados: link to pg setting commands
Link to the instructions for manually setting the number of PGs per
pool, from the mention of placement groups. These instructions are
included here in response to a request from Ronen Friedman on the
occasion of the removal of links to the PGcalc (see
https://github.com/ceph/ceph/pull/55899#pullrequestreview-
1912940118 ).
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
9da81b87ca161370c869b49f5d4e6b50edd54a0e )
Zac Dover [Mon, 4 Mar 2024 13:41:20 +0000 (23:41 +1000)]
doc/architecture: remove pleonasm
Remove the word "detailed" in a sentence immediately following a
sentence containing the word "detail".
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
7791509741d8c21e273a46374a087dcca53a2816 )
Ilya Dryomov [Mon, 4 Mar 2024 18:29:38 +0000 (19:29 +0100)]
Merge pull request #55893 from petrutlucian94/wip-64675-squid
squid: rbd-wnbd: use a single daemon process per host
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Matan Breizman [Sun, 3 Mar 2024 09:45:56 +0000 (09:45 +0000)]
src/seastar: update seastar submodule to fix FTBFS
See: https://github.com/ceph/seastar/commit/
d382f247629a7349afc0cea495a1cd0502dc0b22
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit
945b18195465583334cb88ba69c12bbf42aedd6d )
Casey Bodley [Mon, 4 Mar 2024 17:25:45 +0000 (17:25 +0000)]
Merge pull request #55873 from cbodley/wip-64663-squid
squid: unittest-seastar-socket: tolerate connection_reset in test_unexpected_down
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Ilya Dryomov [Mon, 4 Mar 2024 17:04:00 +0000 (18:04 +0100)]
Merge pull request #55907 from idryomov/wip-64589-squid
squid: crimson: update seastar submodule to fix prometheus build error
Reviewed-by: Samuel Just <sjust@redhat.com>
Samuel Just [Fri, 1 Mar 2024 20:00:32 +0000 (20:00 +0000)]
crimson/.../interruptible_future: remove SEASTAR_CONCEPT guard
Seastar commit
8dc3398a removed this macro, no longer necessary.
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
2806cdb15109c391c828b3419e9d141991d4003d )
Samuel Just [Fri, 1 Mar 2024 19:10:00 +0000 (19:10 +0000)]
src/seastar: update seastar submodule to fix prometheus build failure
Fixes: https://tracker.ceph.com/issues/64589
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
7f42b1d0b7295c2b62d204d14ebe38b6654ba0ac )
Anthony D'Atri [Sun, 3 Mar 2024 13:07:35 +0000 (08:07 -0500)]
Merge pull request #55900 from zdover23/wip-doc-2024-03-03-backport-55899-to-squid
squid: doc/rados: remove PGcalc from docs
Zac Dover [Sun, 3 Mar 2024 10:28:00 +0000 (20:28 +1000)]
doc/rados: remove PGcalc from docs
Remove mention of the "PG calc" tool from the documentation. I have
removed all mention of this in one fell swoop to help posterity restore
mention of this tool if we decide we need to do so.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
ccb851d2a431647124754e1252df66ed11d0e900 )
Lucian Petrut [Tue, 26 Sep 2023 11:52:31 +0000 (11:52 +0000)]
rbd-wnbd: use the right AdminSocket instance
The rbd-wnbd daemon currently caches one rados context per cluster.
However, it's registering hooks against the global context
admin socket, which won't be available. For this reason,
the "rbd-wnbd stats" command no longer works.
To address this issue, we'll ensure that rbd-wnbd sets command hooks
against the right admin socket instance, leveraging the image
context.
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit
a14003c492ad26ed4eef13e3d73e42212dd2bd93 )
Lucian Petrut [Tue, 26 Sep 2023 08:00:19 +0000 (08:00 +0000)]
rbd-wnbd: adjust admin socket hook to accept image path
For each rbd-wnbd mapping we set an admin socket hook that can
be used to retrieve IO stats.
Now that the same daemon is reused for multiple mappings, we need
to distinguish the images when receiving a "stats" request.
For this reason, we'll add the image identifier to "wnbd stats"
admin socket commands.
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit
83d58ab307063b4a37f3a297af2b0e6ba27e84dc )
Lucian Petrut [Wed, 2 Aug 2023 09:50:37 +0000 (09:50 +0000)]
qa: update rbd-wnbd test, retrying image rm operations
The "rbd-wnbd unmap" command is currently telling the WNBD driver
to remove the mapping without contacting the rbd-wnbd daemon
and waiting for it to perform its cleanup.
For this reason, attempting to delete the image immediately after
unmapping it can fail due to existing watchers.
As a temporary solution, we'll retry the image remove operation.
At a later time, we'll update the "rbd-wnbd unmap" command to go
through the rbd-wnbd daemon, ensuring that all the necessary
cleanup is performed before returning.
While at it, we're dropping a redundant LOG.error call so that we
won't print expected exceptions.
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit
0d73d31b6f92d45c602d704b39d11d11536b0a93 )
Lucian Petrut [Wed, 19 Jul 2023 12:32:40 +0000 (12:32 +0000)]
rbd-wnbd: update registry settings handling
This commit will store the mapping config in the Windows registry
only after initializing the mapping. This ensures that we aren't
replacing the registry settings for already mapped images.
We'll also check if the registry setting was added by us before
cleaning it up.
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit
5f9c69d53c522f3b939c91c974cedb9fdd085a60 )
Lucian Petrut [Mon, 12 Jun 2023 13:16:39 +0000 (13:16 +0000)]
rbd-wnbd: use one daemon process per host
We're currently using one rbd-wnbd process per image mapping.
Since OSD connections aren't shared across those processes,
we end up with an excessive amount of TCP sessions, potentially
exceeding Windows limits:
https://ask.cloudbase.it/question/3598/ceph-for-windows-tcp-session-count/
In order to improve rbd-wnbd's scalability, we're going to use
a single process per host (unless "-f" is passed when mapping the
image, in which case the daemon will run as part of the same
process). This allows OSD sessions to be shared across image
mappings.
Another advantage is that the "ceph-rbd" service starts faster,
especially when having a large number of image mappings.
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit
661c55002db8bc91037d8150278dacb9a1cfe46b )
Lucian Petrut [Mon, 12 Jun 2023 08:00:40 +0000 (08:00 +0000)]
rbd-wnbd: introduce RbdMapping class
We're moving most of the WNBD mapping handling to a separate
class called RbdMapping. This simplifies cleanup and makes it
easier to reuse.
The WnbdHandler class covers WNBD specific operations and IO
callbacks while the RbdMapping wrapper will take care of RBD
operations.
A subsequent change will make use of it while switching from
one process per mapping to a single process per host.
While at it, we're also moving the rbd-wnbd config helpers
to separate files.
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit
96e8850ff3b6661c86eb361051282c8d66ca2031 )
Anthony D'Atri [Fri, 1 Mar 2024 23:59:06 +0000 (18:59 -0500)]
Merge pull request #55879 from zdover23/wip-doc-2024-03-02-backport-55869-to-squid
squid: doc/install: add manual RADOSGW install procedure
Zac Dover [Fri, 1 Mar 2024 12:11:14 +0000 (22:11 +1000)]
doc/install: add manual RADOSGW install procedure
Add a manual RADOSGW installation procedure to
doc/install/manual-deployment.rst. This procedure was developed by Janne
Johansson and reported to the ceph-users mailing list on 29 Jan 2024
here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/LB3YRIKAPOHXYCW7MKLVUJPYWYRQVARU/
Co-authored-by: Janne Johansson <icepic.dz@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
565bc9503838906995fa48f59debcd2843775b18 )
Casey Bodley [Fri, 1 Mar 2024 15:15:27 +0000 (10:15 -0500)]
rgw: remove unused object lock stuff from CompleteMultipart
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
1576c1f5b98ecc838b47a916199e3cae8c925acb )
Matt Benjamin [Wed, 13 Dec 2023 18:53:46 +0000 (13:53 -0500)]
rgw: don't overwrite target attrs checking mpu info
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit
97445bb6ea24275de5eb050b55207cad237c81f8 )
daijufang [Mon, 4 Dec 2023 07:46:29 +0000 (07:46 +0000)]
src/rgw: fix for the multipart interface in the WORM function
1. Save the WORM configuration information in the initialization chunk information for use when merging chunks.
2. Support x-amz-bypass-governance-retention when merging chunks.
Fixes: https://tracker.ceph.com/issues/63724
Signed-off-by: daijufang <daijufang_yewu@cmss.chinamobile.com>
(cherry picked from commit
3a65a0ad14fb3c4d836441a417d594826fb6e711 )
Samuel Just [Fri, 16 Feb 2024 21:40:17 +0000 (21:40 +0000)]
unittest-seastar-socket: tolerate connection_reset in test_unexpected_down
Fixes: https://tracker.ceph.com/issues/64457
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
e84518e63806ca5beef57d995923dcd3698276e9 )
Samuel Just [Fri, 16 Feb 2024 00:04:05 +0000 (00:04 +0000)]
unittest-seastar-socket: debug to error on unexpected return from dispatch_rw_bounded
Related: https://tracker.ceph.com/issues/64457
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
66969c07dc0cd5e0f01685ec19de26dae09279f5 )
Casey Bodley [Fri, 23 Feb 2024 14:02:29 +0000 (09:02 -0500)]
rgw/auth: do_aws4_auth_completion() catches exceptions
AWSv4ComplMulti::complete() throws exceptions on errors, but nothing
catches these
Fixes: https://tracker.ceph.com/issues/64549
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
f953c419d6992c8124f3e123ae8030d6a45ffd1a )
Nizamudeen A [Fri, 1 Mar 2024 05:14:14 +0000 (10:44 +0530)]
Merge pull request #55826 from afreen23/wip-64639-squid
squid: mgr/dashboard: fix roles page for roles without policies
Reviewed-by: Nizamudeen A <nia@redhat.com>
Anthony D'Atri [Fri, 1 Mar 2024 01:35:08 +0000 (20:35 -0500)]
Merge pull request #55851 from zdover23/wip-doc-2024-03-01-backport-55834-to-squid
squid: doc/dev: edit internals.rst
Zac Dover [Thu, 29 Feb 2024 07:40:57 +0000 (17:40 +1000)]
doc/dev: edit internals.rst
Edit doc/dev/internals.rst. Make a few sentences pithier.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
e16ab1df72c3640db907e377da7ca97ce3eaa26e )
Anthony D'Atri [Thu, 29 Feb 2024 23:44:36 +0000 (18:44 -0500)]
Merge pull request #55848 from zdover23/wip-doc-2024-03-01-backport-55835-to-squid
squid: doc/glossary: improve "MDS" entry
Zac Dover [Thu, 29 Feb 2024 08:08:10 +0000 (18:08 +1000)]
doc/glossary: improve "MDS" entry
Improve the entry for "MDS" in doc/glossary.rst by linking to the
"ceph-mds" man page and mentioning the relationship between clients and
MDS (or MDSes).
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
2c6983d8b4e841f2bfbc4e4f82bb0e41e10aec7e )
Casey Bodley [Thu, 29 Feb 2024 15:45:33 +0000 (15:45 +0000)]
Merge pull request #55654 from cbodley/wip-64501-squid
squid: rgw/datalog: RGWDataChangesLog::add_entry() uses null_yield
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Casey Bodley [Thu, 29 Feb 2024 15:44:46 +0000 (15:44 +0000)]
Merge pull request #55791 from cbodley/wip-64601-squid
squid: test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
J. Eric Ivancich [Fri, 9 Feb 2024 17:27:00 +0000 (12:27 -0500)]
rgw: if head object does not have data, still include in `object manifest`
In order to enable users who might like to use `radosgw-admin object
manifest ...` to get a complete list of raw objects that comprise the
RGW object, we'll include the head object when it includes not
data. It will be indicated with an "index" of -1.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit
575362d826f8f58832a2bb865b9dc73c474f4fe1 )
J. Eric Ivancich [Fri, 9 Feb 2024 03:46:37 +0000 (22:46 -0500)]
rgw: add new `object manifest` sub-command
Adds a new sub-command to radosgw-admin to list the manifest, which
are the rados objects that contain the RGW object's data.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit
cd068b831dc8cf665577db40563a2a6a03b6c4c0 )
Casey Bodley [Thu, 29 Feb 2024 13:05:01 +0000 (13:05 +0000)]
Merge pull request #55673 from BBoozmen/oozmen_squid_backport_55286
squid: backport: rgw/lc: decorating log events with more details
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Nizamudeen A [Thu, 29 Feb 2024 11:09:53 +0000 (16:39 +0530)]
Merge pull request #55810 from rhcs-dashboard/wip-64609-squid
squid: mgr/dashboard: fix subvolume group edit
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Tue, 27 Feb 2024 07:18:56 +0000 (12:48 +0530)]
mgr/dashboard: fix roles page for roles without policies
If there is no permission policies attached to a role, it fails the
UI with an exception.
Fixes: https://tracker.ceph.com/issues/64588
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
5f3f31921c9f3ed909a94f287bfd4cc3f0987649 )
Ivo Almeida [Wed, 28 Feb 2024 09:53:57 +0000 (09:53 +0000)]
mgr/dashboard: fix snap schedule date format
Fixes: https://tracker.ceph.com/issues/64613
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit
11fdcf800b14b5edbd2c02f2a6cfac72d174b3e9 )
Casey Bodley [Wed, 28 Feb 2024 15:00:20 +0000 (15:00 +0000)]
Merge pull request #55728 from cbodley/wip-squid-pr-55627
squid: rgw: set log_data_change to true during link olh only in multisite config
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Ivo Almeida [Mon, 19 Feb 2024 12:42:34 +0000 (12:42 +0000)]
mgr/dashboard: fix subvolume group edit
Fixes: https://tracker.ceph.com/issues/64487
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit
8aaa0bca47fa49073e797ee427bcec282ef1adbe )
Anthony D'Atri [Tue, 27 Feb 2024 23:51:59 +0000 (18:51 -0500)]
Merge pull request #55798 from zdover23/wip-doc-2024-02-28-backport-55782-to-squid
squid: doc/rados: add "change public network" procedure
Zac Dover [Mon, 26 Feb 2024 10:03:48 +0000 (20:03 +1000)]
doc/rados: add "change public network" procedure
Add a procedure to /doc/rados/operations/add-or-rm-mons.rst that
explains how to change the public_network in a Ceph cluster deployed
with cephadm. This procedure was developed by Eugen Block, and can be
seen in its original form here:
https://heiterbiswolkig.blogs.nde.ag/2024/02/22/cephadm-change-public-network/
Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
0b6739a4aa2dd931d97b8af9b3a352969f8767c2 )
Casey Bodley [Mon, 26 Feb 2024 14:38:52 +0000 (09:38 -0500)]
test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler
1ms sleeps are generally below the timer's resolution. increase run_for()
durations to 50ms to make the tests far less sensitive to timing. in
practice, none of the sleeps actually wait the full 50ms
Fixes: https://tracker.ceph.com/issues/64568
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
b4f3ddfe4385c12baa0f44fff9d2708c445625d3 )
Pedro Gonzalez Gomez [Thu, 22 Feb 2024 10:06:21 +0000 (11:06 +0100)]
mgr/dashboard: fix volume creation with multiple hosts
Fixes: https://tracker.ceph.com/issues/64559
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit
4313f9a59c676067ca23242808c8e87068d0d953 )
Pedro Gonzalez Gomez [Tue, 27 Feb 2024 10:39:05 +0000 (11:39 +0100)]
Merge pull request #55703 from afreen23/wip-64529-squid
squid: mgr/dashboard: Handle errors for /api/osd/settings
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: ivoalmeida <NOT@FOUND>
zdover23 [Mon, 26 Feb 2024 10:25:58 +0000 (20:25 +1000)]
Merge pull request #55753 from zdover23/wip-doc-2024-02-26-backport-55683-to-squid
squid: doc/man/8/mount.ceph.rst: add more mount options
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>