Merge pull request #56267 from zdover23/wip-doc-2024-08-19-backport-56240-to-squid

squid: doc/rados: update common.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #56210 from joscollin/wip-64918-squid

squid: qa: enhance labeled perf counters test for cephfs-mirror

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #56051 from lxbsz/wip-64585

squid: mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #56030 from vshankar/wip-64617-squid

squid: mds: check file layout in mknod

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #56017 from vshankar/wip-64758-squid

squid: mds: relax certain asserts in mdlog replay thread

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55997 from dparmar18/wip-64741-squid

squid: client: do not proceed with I/O if filehandle is invalid

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55989 from joscollin/wip-64744-squid

squid: mds: fix `dump dir` indicate dir is not cached

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55940 from neesingh-rh/wip-64701-squid

squid: mgr/volumes: support to reject CephFS clones if cloner threads are not available

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55830 from kotreshhr/wip-64583-squid

squid: qa: Fix fs/full suite

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55805 from anoopcs9/wip-64566-squid

squid: client: Fix return in removexattr for xattrs from `system.` namespace

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #56253 from rhcs-dashboard/wip-64929-squid

squid: mgr/dashboard: ceph authenticate user from fs

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #56229 from adk3798/squid-docs-typo-replace-osd

squid: doc: cephadm/services/osd: fix typo

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #55927 from ajarr/wip-64669-squid

squid: qa: add diff-continuous and compare-mirror-image tests to rbd and krbd suites respectively

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #56194 from vshankar/wip-64924-squid

squid: mds: disable `defer_client_eviction_on_laggy_osds' by default

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

qa/suites: add diff-continuous and compare-mirror-image tests

... to rbd and krbd suites respectively.

This allows the compare-mirror-image tests introduced in ea3a567
to be run against various kernel branches, e.g., testing branch.
And allows diff_continuous test in rbd_suite to run against distro
kernel.

Fixes: https://tracker.ceph.com/issues/64574
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 92b254138dd43755490392ffcf5ebca04872e116)

qa/suites/rbd: rename nbd folder to device folder

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit af43f6162464a20625319a2783a104f7032ba21e)

doc/rados: update common.rst

Clarify some overwritten paragraphs in
doc/rados/configuration/common.rst. Cf.
https://github.com/ceph/ceph/pull/50795/files#r1153897231.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 233b670704d15c3a69b8d91885b60f3fb101ec58)

Merge pull request #56261 from zdover23/wip-doc-2024-03-19-backport-56247-to-squid

squid: docs/rbd: fix typo in arg name

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

docs/rbd: fix typo in arg name

Replace "{image-}" with "{image-id}" in the "rbd trash rm"
command description.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit f3eb489520fd4fae057e61275d16c6c8fd596f3f)

docs/rbd: replace introspect with inspect

Replace "introspect" with "inspect" in the rbd basic commands
description.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit ebf2f60f784728c04d8ec59015d666bafcef8218)

docs/rbd: typo in "retrieving image information"

Replace "for the image" with "of the image".

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 4fd5c134536d652ae1f9e05ecf52cb81adb3b850)

Merge pull request #56255 from zdover23/wip-doc-2024-03-18-backport-56248-to-squid

squid: doc/rbd: minor changes to the rbd man page

doc/rbd: minor changes to the rbd man page

Fixes typos and grammar for some commands. Adds
additional details for some commandds.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5dcff6a4b8d835fc55e454af977dc5ebad99d37f)

Merge pull request #56251 from guits/wip-64931-squid

squid: node-proxy: fix RedFishClient.logout() method

mgr/dashboard: ceph authenticate user from fs

Fixes: https://tracker.ceph.com/issues/64660
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 19a9f79b5f218d8cb757579bf8c0f5d610dde3a8)

node-proxy: support more Location value formats

After some tests, it turns out that depending on the hardware,
the header 'Location' which is returned by the server after logged can be different.
I could notice the following:

either:

Location: scheme://address:port/redfish/v1/SessionService/Session

or

Location: /redfish/v1/SessionService/Session

a previous tracker [1] was opened because I thought only the first one existed, which is wrong.

Fixes: https://tracker.ceph.com/issues/64951
[1] https://tracker.ceph.com/issues/64894

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d7ccf26983c41344a12f33b2a30fc79b65cc548f)

node-proxy: fix RedFishClient.logout() method

the endpoint passed down to util.query() is wrong:
is passes the full url (scheme://addr:port/path) where it should only
pass the path. The cause is that RedFishClient.login() basically stores
the value of the Location header in `self.location`.

The consequence of this is that it makes the client unable to properly logout.

Fixes: https://tracker.ceph.com/issues/64894
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit b1d828d1d2f31c02f225bb375d915353582d158a)

Merge pull request #56125 from cbodley/wip-64834-squid

squid: RGW - Swift retarget needs bucket set on object

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #56144 from cbodley/wip-64876-squid

squid: rgw_lc:  replace strftime w/fmt and chrono:calendar

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #56156 from yuvalif/wip-64887-squid

squid: rgw/kafka: set message timeout to 5 seconds

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #56181 from ivancich/wip-64909-squid

squid: rgw: rgw-restore-bucket-index -- sort uses specified temp dir

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>

Merge pull request #56216 from idryomov/wip-63770-squid

squid: librbd: account for discards that truncate in ObjectListSnapsRequest

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #55761 from ajarr/wip-64553-squid

squid: qa: Add tests to validate synced images on rbd-mirror

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #56234 from zdover23/wip-doc-2024-03-16-backport-56182-to-squid

squid: doc/glossary: add "librados" entry

doc/glossary: add "librados" entry

Add a "librados" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2a93a8e837a42559f8a81c6fd9274b24f4fdf7f6)

doc: cephadm/services/osd: fix typo

Signed-off-by: Lorenz Bausch <info@lorenzbausch.de>
(cherry picked from commit d513f1ca69d38f0d7eb40a2d68275caed322cc68)

Merge pull request #55715 from cbodley/wip-64541-squid

squid: rgw: RGWSI_SysObj_Cache::remove() invalidates after successful delete

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

rgwlc: implement Filter size limit checks

i.e., this implements ObjectSizeGreaterThan and ObjectSizeLessThan
for supported expiration and transition actions.

Fixes: https://tracker.ceph.com/issues/63304
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit c9b19be15362c63526e92f4d968f942a40cab150)

rgwlc: implement NewerNoncurrentVersions

Per AWS doc, this value controls "how many noncurrent versions
Amazon S3 will retain." [1]  We understand this to mean, retain
NewerNoncurrentVersions of any object, regardless of expiration.

Removed unused RGWLifecycleConfiguration::has_same_action() (cleanup)

[1] https://docs.aws.amazon.com/AmazonS3/latest/API/API_NoncurrentVersionExpiration.html.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit a4313e77a31c5165254068b53dfac3d277b0a6a8)

Merge pull request #56207 from zdover23/wip-doc-2024-03-15-backport-56188-to-squid

squid: doc/rbd: add clone mapping command

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

test/librbd: add DiffIterateTruncate and DiffIterateWriteAndTruncate

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d84485ec534ccf42327242a9141906f4881c030e)

librbd: don't clip expanded diff on truncate in ObjectListSnapsRequest

If the diff was expanded due to LIST_SNAPS_FLAG_WHOLE_OBJECT, clipping
it when handling a truncate is wrong -- when subtracting that interval,
we either split the expanded extent into two or chop off a piece of it.
However the point of LIST_SNAPS_FLAG_WHOLE_OBJECT is to report a single
extent covering the entire object.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0ebca5fe22d976f1a17f8078f20a47c49a057edb)

librados/snap_set_diff: ignore truncates above size at start

Because currently calc_snap_set_diff() only ever appends to the running
diff, an excessive (either too large or completely bogus) zero extent
is reported in cases where an object is first expanded (with a snapshot
taken at that point) and then truncated but still above the size of the
object as of the starting snapshot.

Fixes: https://tracker.ceph.com/issues/63770
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5b11fb314abefea390c5663c33e9e1ace6179974)

Merge pull request #56155 from rhcs-dashboard/wip-64884-squid

squid: mgr/dashboard: fix snap schedule time format

Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/vol: don't import IndexException since it's unused

Introduced-by: 079f722c37ef6cc8bd3cc26c49ae119dd83431f9
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit b4c1d552aa4066efdda3493192927cb780693469)

doc/rbd: add clone mapping command

Add a command that explains how to map a formatted clone when the parent
image and the formatted clone have different encryption types.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d34c1879c8886ec7f19c7a93490c4736ae9a6d20)

Merge pull request #56185 from zdover23/wip-doc-2024-03-14-backport-56160-to-squid

squid: doc/rbd: add map information for clone images to rbd-encryption.rst

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

mds: disable `defer_client_eviction_on_laggy_osds' by default

This config can result in a single client holding up mds to service
other clients since once a client is deferred from eviction due to
laggy OSD(s), a new clients cap acquire request can be possibly
blocked until the other laggy client resumes operation, i.e., when
the laggy OSD is considered non-laggy anymore.

Disable the config by default till the issue is fixed.

Fixes: http://tracker.ceph.com/issues/64685
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 109de8bdab86e1adaad580d9e7322c18fa01bc09)

qa: enhance labeled perf counters test for cephfs-mirror

Implements checks for labeled perf counters in the appropriate tests.
This patch verifies snaps_synced, snaps_renamed, snaps_deleted and sync_failures metrics are
updated correctly based on the tests.

Fixes: https://tracker.ceph.com/issues/64486
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 7b7e5d4221389ce077780450d78a4a1e6a3d0a43)

doc/rbd: add map information for clone images to rbd-encryption.rst

Add information on the arguments required when mapping the
formatted clone of an encrypted parent image.

Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 7a2e324a6e1c3e145d3b1e04e6f006defbe0e0b4)

rgw: rgw-restore-bucket-index -- sort uses specified temp dir

The sort command sometimes makes use of temporary files. When the user
specifies a directory to be used for temp files, have the sort command
use that same directory.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit a14dad152c651ab8048f9e10898d4d2cc61b0d42)

rgw/kafka: set message timeout to 5 seconds

also increase the idle timeout to 30 seconds.
test instructions:
https://gist.github.com/yuvalif/33487bff19883e3409caa8a843a0b353

Fixes: https://tracker.ceph.com/issues/64710
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit 1c13850f24dbb90c33a12c6da338956c2e83811b)

mgr/dashboard: fix snap schedule time format

Fixes: https://tracker.ceph.com/issues/64831
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit a2942f01ae9bde76c6d562374a0bd8aceeee317e)

Merge pull request #56116 from rhcs-dashboard/wip-64825-squid

squid: mgr/dashboard: fix snap schedule list toggle cols

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #56043 from cbodley/wip-64795-squid

squid: rgw: compatibility issues on BucketPublicAccessBlock

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

rgw_lc:  replace strftime w/fmt and chrono:calendar

It's reliably claimed that std::strftime is not
mt-safe, and this would be a likely root cause of
intermittent scrambled expiration header output cases
that have been reported.

Fixes: https://tracker.ceph.com/issues/63973
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 96a5cbb9aa47ed1a2b51e720475ebc08012cb4cc)

Merge pull request #56036 from cbodley/wip-64768-squid

squid: rgw_sigv4: handle '0;' as trailer-chunk boundary

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #56037 from cbodley/wip-64764-squid

squid: rgw/beast: Enable SSL session-id reuse speedup mechanism

Reviewed-by: Mark Kogan <mkogan@redhat.com>

Merge pull request #55871 from cbodley/wip-64661-squid

squid: rgw/auth: do_aws4_auth_completion() catches exceptions

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #55876 from cbodley/wip-64664-squid

squid: src/rgw: fix for the multipart interface in the WORM function

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #56048 from cbodley/wip-qa-rgw-squid-tests

squid: qa/rgw: point rgw test repos at ceph-squid release branch

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #55653 from cbodley/wip-64493-squid

squid: rgw/user: add 'active' flag to RGWAccessKey

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #56009 from ivancich/wip-64773-squid

squid: rgw: make rgw-restore-bucket-index more robust

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #55816 from rhcs-dashboard/wip-64625-squid

squid: mgr/dashboard: fix snap schedule date format

Reviewed-by: Afreen <afreen23.git@gmail.com>

Merge pull request #55785 from rhcs-dashboard/wip-64594-squid

squid: mgr/dashboard: fix volume creation with multiple hosts

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #56126 from adk3798/wip-64838-squid

squid: mgr/dashboard: debugging make check failure

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #56129 from zdover23/wip-doc-2024-03-12-backport-56113-to-squid

squid: doc/cephadm: Improve multiple files

qa/workunits/rbd: switch rbd-mirror workunits to bash

By making use of here strings in commit ea3a567f7f03 ("qa/workunits:
make wait_for_status_in_pool_dir() reentrant") we grew a dependency on
bash.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 166a2362378b1ff93e43f483f354c428fd6cef9e)

Merge pull request #55941 from galsalomon66/wip-64694-squid

squid: rgw/s3select: Wip 64694 squid

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #55842 from ivancich/wip-squid-manifest

squid: rgw: add new `object manifest` sub-command

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc/cephadm: Improve multiple files

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 800dd29e60fcd2bcd27db56d3fe45c58ddf10c8a)

mgr/dashboard: debugging make check failure

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 958c60d8a74e3c38abe043e7f2cfbe4224cfb411)

RGW - Swift retarget needs bucket set on object

When a bucket list is retargeted to an object get, then the object may
not yet have it's bucket set.  Ensure the bucket is set on the object.

Fixes: https://tracker.ceph.com/issues/56029
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
(cherry picked from commit 2d4a3ca5c94908a6865dce0192677d8346e1f848)

Merge pull request #56060 from rhcs-dashboard/wip-64808-squid

squid: mgr/dashboard: add snap schedule M, Y frequencies

Reviewed-by: afreen23 <NOT@FOUND>

mgr/dashboard: fix snap schedule list toggle cols

Added isInvisible property to CdColumnTable interface to hide column
from 'toggle columns' drop down checkboxes.

Fixes: https://tracker.ceph.com/issues/64813
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit 1b77baea8dd0781fa897ec6c1f1e06c57a265ed7)

Merge pull request #56110 from zdover23/wip-doc-2024-03-11-backport-56091-to-squid

squid: doc/cephadm: improve host-management.rst

doc/cephadm: improve host-management.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 9fb51bb537e8bd9ea60633091acfc48a58262c3b)

Merge pull request #56072 from zdover23/wip-doc-2024-03-09-backport-56068-to-squid

squid: doc/glossary: add "Crimson" entry

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>

doc/glossary: add "Crimson" entry

Add a "Crimson" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b31e061cc087b31a7e9e841dd21e7403a2197378)

Merge pull request #56039 from zdover23/wip-doc-2024-03-08-backport-56010-to-squid

squid: doc/start: add Slack invite link

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #55998 from guits/wip-64749-squid

squid: mgr/node-proxy: handle 'None' statuses returned by RedFish

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #56056 from zdover23/wip-doc-2024-03-08-backport-56045-to-squid

squid: doc/rados: restore PGcalc tool

mgr/dashboard: add snap schedule M, Y frequencies

Added M and Y (month and year) repeat frequencies to snap schedule
create form.

Fixes: https://tracker.ceph.com/issues/64614
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit be3bb09cca7ff8d10a36a59702bb16fd10aba84e)

doc/rados: restore PGcalc tool

Restore the PGcalc tool to the documentation suite.

Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit eaaf72253123de1a66f163f651046817faa97a1a)

mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock

When the auth MDS is transmitting state from LOCK_MIX to LOCK_SYNC
it will transmit the state to a intermidiate state LOCK_MIX_SYNC.
Then notifies the replicate MDSs and waits for the acks. But just
in case for some reasons the replicate MDSs couldn't successfully
transmit the state from LOCK_MIX to LOCK_MIX_SYNC and then
LOCK_MIX_SYNC2. And just the auth MDS failover or restart and
then resend the notification.

Fixes: https://tracker.ceph.com/issues/54833
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit f50693f62387e48c5c07ba913f2d384de0fe2d5c)

qa/rgw: point rgw test repos at ceph-squid release branch

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: return 204 on bucket public access block deletion

According to AWS doc (https://docs.aws.amazon.com/AmazonS3/latest/API/API_DeletePublicAccessBlock.html#API_DeletePublicAccessBlock_ResponseSyntax) 204 shall be returned on delete request.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 48a454971c9979dfd9a95cc9619ca864aeda26a5)

rgw: return 404 on no bucket public access block

Return 404 when there is no public access block on the bucket.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 146d4d98698d48dcbc0f036de0793e0a5f9bb8a6)

rgw: fix the op in GetBucketPublicAccessBlock verify_permission

s3GetBucketPublicAccessBlock needs to be checked for RGWGetBucketPublicAccessBlock operation.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 54bc5eba002cff04e5c4e25168aeb2408ba100b2)

rgw: fix root element for GetPublicAccessBlock

From the AWS doc (https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetPublicAccessBlock.html) it needs to be PublicAccessBlockConfiguration.

Fixes: https://tracker.ceph.com/issues/64492
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit db74c10e008caeb7092eb4c1268cbd6f044afa19)

doc/start: add Slack invite link

Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dee319e61204b2ee9ac13562c2c7075ef0f2ea4b)

Merge pull request #56011 from zdover23/wip-doc-2024-03-07-backport-55995-to-squid

squid: doc/architecture: correct typo

rgw/beast: enablment of SSL session-id reuse speedup mechanism

Enable the OpenSSL session-id reuse acceleration mechanism that is described in:

https://www.openssl.org/docs/man1.0.2/man3/SSL_CTX_set_session_id_context.html
SSL_CTX_set_session_id_context, SSL_set_session_id_context - set context
within which session can be reused (server side only)

Fixes: https://tracker.ceph.com/issues/64719
Signed-off-by: Mark Kogan <mkogan@redhat.com>
(cherry picked from commit 6fb4c5d0c0694c9cfdbf0ed729d9f95886a0673f)

Merge pull request #55926 from idryomov/wip-pr-55897-squid

squid: src/seastar: update seastar submodule to fix FTBFS

Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>

rgw_sigv4: handle '0;' as trailer-chunk boundary

https://tracker.ceph.com/issues/64676

Signed-off-by: matt benjamin <mbenjamin@redhat.com>
(cherry picked from commit ef1111a17084f6672fd40e366f92f8168a09d0a0)

mds: check file layout in mknod
Fixes: https://tracker.ceph.com/issues/64061
Signed-off-by: Xue Yantao <xueyantao2114@163.com>
(cherry picked from commit e913e5c6ce51753724e00491fab4de64502952f3)

mds: relax certain asserts in mdlog replay thread

The calls to journaler->is_readable() and journaler->get_error()
in MDLog::_replay_thread() will drop Journaler::lock between
invocations, so, theoretically, its possible that the initial check:

  // loop
  int r = 0;
  while (1) {
    // wait for read?
    while (!journaler->is_readable() &&
       journaler->get_read_pos() < journaler->get_write_pos() &&
       !journaler->get_error()) {
      C_SaferCond readable_waiter;
      journaler->wait_for_readable(&readable_waiter);
      r = readable_waiter.wait();
    }
    if (journaler->get_error()) {
      r = journaler->get_error();
      dout(0) << "_replay journaler got error " << r << ", aborting" << dendl;

journaler->is_readable() returned true, thereby breaking out of
the (inner) while loop and by passing the journaler->get_error()
check, and by the time this hits the next set of checks:

    if (!journaler->is_readable() &&
    journaler->get_read_pos() == journaler->get_write_pos())
      break;

    ceph_assert(journaler->is_readable() || mds->is_daemon_stopping());

It's possible that the journal is unreadable due to some error that
happened during prefetch. In short, these checks are racy.

So, remove these racy assert check along with journaler->is_readable()
check when validating the journal end and rely on the next iteration
of reading the journal for error handling.

Fixes: http://tracker.ceph.com/issues/57048
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 90393de9690b3e2234f7bd0ed0fb91c39e15e818)

Merge pull request #55992 from rhcs-dashboard/wip-64731-squid

squid: mgr/dashboard: fixed cephfs mount command

Reviewed-by: Nizamudeen A <nia@redhat.com>

doc/architecture: correct typo

s/client/clients/ where necessary, and add a link to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ae08855cf870173dce2a47a28f3bbb22e7ae0ca2)

rgw: make rgw-restore-bucket-index more robust

This experimental tool write a series of temporary files, the combined
size of which is roughly proportional to some combination of the
number of objects in the bucket and their respective sizes. Previously
the script stored all temporary files in /tmp, which may not be
sufficiently large in many cases.

There are now two enhancements. First, using the "-t" command-line
argument, the directory for temporary files can be specified. Second,
if the script consumes all available space on the file system
containing the temporary directory, an error message to that effect is
displayed, so the user understands what corrective action to take.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit a8cf37b6e8e33c53d9be4cc1998d3b2f80700fbd)

Merge pull request #56001 from zdover23/wip-doc-2024-03-07-backport-55982-to-squid

squid: doc/dev: edit teuthology workflow

doc/dev: edit teuthology workflow

Improve a couple of sentences in
doc/dev/developer_guide_testing_integration_tests/tests-integration-testing-teutology-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 51796e80f35da8ca13b72f31eeafefd4c1e40773)