]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
11 months agoMerge pull request #58933 from cbodley/wip-67269-squid
Casey Bodley [Thu, 1 Aug 2024 15:38:05 +0000 (16:38 +0100)]
Merge pull request #58933 from cbodley/wip-67269-squid

squid: rgw/rgw_rados: fix server side-copy orphans tail-objects

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
11 months agoMerge pull request #58977 from zdover23/wip-doc-2024-08-01-backport-58899-to-squid
Anthony D'Atri [Thu, 1 Aug 2024 12:17:06 +0000 (08:17 -0400)]
Merge pull request #58977 from zdover23/wip-doc-2024-08-01-backport-58899-to-squid

squid: doc/glossary: add "Prometheus"

11 months agoMerge pull request #58973 from zdover23/wip-doc-2024-08-01-backport-58972-to-squid
Anthony D'Atri [Thu, 1 Aug 2024 12:05:57 +0000 (08:05 -0400)]
Merge pull request #58973 from zdover23/wip-doc-2024-08-01-backport-58972-to-squid

squid: doc: Improve doc/radosgw/placement.rst

11 months agodoc/glossary: add "Prometheus" 58977/head
Zac Dover [Mon, 29 Jul 2024 10:19:02 +0000 (20:19 +1000)]
doc/glossary: add "Prometheus"

Add a glossary entry for "Prometheus".

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1a76464999cb2d2cc748d69e1bb0567544a0bb8b)

11 months agodoc: Improve doc/radosgw/placement.rst 58973/head
Anthony D'Atri [Wed, 31 Jul 2024 22:41:53 +0000 (18:41 -0400)]
doc: Improve doc/radosgw/placement.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 5890a156524b8d1fe3a51ea1c76d800e5903a01c)

11 months agoMerge pull request #58401 from sseshasa/wip-66807-squid
Yuri Weinstein [Wed, 31 Jul 2024 22:52:18 +0000 (15:52 -0700)]
Merge pull request #58401 from sseshasa/wip-66807-squid

squid: qa/tasks: Initialize 'monitoring_profiles' spec to an empty dict

Reviewed-by: Neha Ojha <nojha@redhat.com>
11 months agoMerge pull request #58314 from cbodley/wip-66724
Yuri Weinstein [Wed, 31 Jul 2024 22:51:17 +0000 (15:51 -0700)]
Merge pull request #58314 from cbodley/wip-66724

squid: build: Make boost_url a list

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
11 months agoMerge pull request #58890 from Matan-B/wip-matanb-logentry-string-1
Casey Bodley [Wed, 31 Jul 2024 13:34:28 +0000 (14:34 +0100)]
Merge pull request #58890 from Matan-B/wip-matanb-logentry-string-1

squid: common: fix string creation from '0' in LogEntry

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58840 from Matan-B/wip-58464-squid
Matan Breizman [Wed, 31 Jul 2024 08:39:22 +0000 (11:39 +0300)]
Merge pull request #58840 from Matan-B/wip-58464-squid

squid: crimson: peering event processing fixes,  wait for async operations started during peering events

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58826 from Matan-B/wip-57125-squid
Matan Breizman [Wed, 31 Jul 2024 08:38:34 +0000 (11:38 +0300)]
Merge pull request #58826 from Matan-B/wip-57125-squid

squid: crimson/osd/pg: reset the snap mapper's backend when pg interval changes

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58947 from zdover23/wip-doc-2024-07-31-backport-58946-to-squid
Anthony D'Atri [Wed, 31 Jul 2024 01:48:38 +0000 (21:48 -0400)]
Merge pull request #58947 from zdover23/wip-doc-2024-07-31-backport-58946-to-squid

squid: doc/rados/operations: remove vanity cluster name reference from crush…

11 months agodoc/rados/operations: remove vanity cluster name reference from crush-map.rst 58947/head
Anthony D'Atri [Wed, 31 Jul 2024 00:45:11 +0000 (20:45 -0400)]
doc/rados/operations: remove vanity cluster name reference from crush-map.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 62562ec65e3c1cc040a57ab77fc219e0aad25651)

11 months agoMerge pull request #58940 from zdover23/wip-doc-2024-07-31-backport-58922-to-squid
Anthony D'Atri [Wed, 31 Jul 2024 00:50:03 +0000 (20:50 -0400)]
Merge pull request #58940 from zdover23/wip-doc-2024-07-31-backport-58922-to-squid

squid: doc/cephadm: edit "Using Custom Images"

11 months agoMerge pull request #58943 from zdover23/wip-doc-2024-07-31-backport-58908-to-squid
Anthony D'Atri [Wed, 31 Jul 2024 00:48:14 +0000 (20:48 -0400)]
Merge pull request #58943 from zdover23/wip-doc-2024-07-31-backport-58908-to-squid

squid: doc/glossary: add "ceph-fuse" entry

11 months agoMerge pull request #58937 from zdover23/wip-doc-2024-07-31-backport-58918-to-squid
Anthony D'Atri [Wed, 31 Jul 2024 00:38:25 +0000 (20:38 -0400)]
Merge pull request #58937 from zdover23/wip-doc-2024-07-31-backport-58918-to-squid

squid: doc/dev: improve basic-workflow.rst

11 months agodoc/glossary: add "ceph-fuse" entry 58943/head
Zac Dover [Mon, 29 Jul 2024 15:50:13 +0000 (01:50 +1000)]
doc/glossary: add "ceph-fuse" entry

Add a "ceph-fuse" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d1c049d24befedc396221dafcc66db8c40acf5ab)

11 months agodoc/cephadm: edit "Using Custom Images" 58940/head
Zac Dover [Tue, 30 Jul 2024 07:33:55 +0000 (17:33 +1000)]
doc/cephadm: edit "Using Custom Images"

Edit the section "Using Custom Images" in
doc/cephadm/services/monitoring.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e99fc5c82fd698c222a489a1ebc26c8fcbca321d)

11 months agoMerge pull request #58763 from smanjara/wip-67025-squid
Casey Bodley [Tue, 30 Jul 2024 22:31:28 +0000 (23:31 +0100)]
Merge pull request #58763 from smanjara/wip-67025-squid

squid: rgw/multisite: don't retain RGW_ATTR_OBJ_REPLICATION_TRACE attr on copy_object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agodoc/dev: improve basic-workflow.rst 58937/head
Zac Dover [Tue, 30 Jul 2024 06:07:04 +0000 (16:07 +1000)]
doc/dev: improve basic-workflow.rst

Make various improvements to doc/dev/developer_guide/basic-workflow.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b81d6af1b488cdb87143e13da519d70c3a090679)

11 months agoMerge pull request #58658 from rzarzynski/wip-bug-66268-squid
Yuri Weinstein [Tue, 30 Jul 2024 18:14:40 +0000 (11:14 -0700)]
Merge pull request #58658 from rzarzynski/wip-bug-66268-squid

squid: mgr: Convert the last_event_detail data_type to std::string

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Saumay Agrawal <saumay.agrawal@gmail.com>
11 months agoMerge pull request #57805 from rzarzynski/wip-bug-61948-squid
Laura Flores [Tue, 30 Jul 2024 18:02:31 +0000 (13:02 -0500)]
Merge pull request #57805 from rzarzynski/wip-bug-61948-squid

squid: mon, osd, *: expose upmap-primary in OSDMap::get_features()

11 months agoshrink the object-size used for orphan-list test by a factor of 100 from 5100MB ... 58933/head
Gabriel BenHanokh [Tue, 23 Jul 2024 11:02:06 +0000 (11:02 +0000)]
shrink the object-size used for orphan-list test by a factor of 100 from 5100MB -> 51MB

Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
(cherry picked from commit 01a9cfba444f03f378113833a13fdbd40835886b)

11 months agoRGW - Fix copy_obj handling of obj_ctx
Daniel Gryniewicz [Thu, 27 Jun 2024 16:40:38 +0000 (12:40 -0400)]
RGW - Fix copy_obj handling of obj_ctx

Fixes: https://tracker.ceph.com/issues/66286
(Line added by Gabriel)

In RadosStore, the source and dest objects in the copy_object() call
used to share an obj_ctx.  When obj_ctx was removed from the SAL API,
they each got their own, but RGWRados::copy_obj() still assumed they
shared one.

Pass in each one separately, and use the correct one for further calls.

Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
(cherry picked from commit 111c54a19dc12b84cda785feddb0a0ba483b1f77)

11 months agoFixes: https://tracker.ceph.com/issues/66286
Gabriel BenHanokh [Sun, 23 Jun 2024 15:54:22 +0000 (15:54 +0000)]
Fixes: https://tracker.ceph.com/issues/66286
Improve display of ref_count in the rados commandline utility

New test cases were added to detect behavior after server side copy in the following cases:
1) delete original only
2) delete destination only
3) delete original then delete destination (this will lead to orphaned tail-objects without the changes made in this PR)
d) delete destination then delete original (this will lead to orphaned tail-objects without the changes made in this PR)

Add call to GC between tests to help control the used disk space since we keep writing huge files of 5GB each
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
(cherry picked from commit d496d20c803590d41d711e446feab41476c0f20c)

11 months agoMerge pull request #58829 from Matan-B/wip-57709-squid
Matan Breizman [Tue, 30 Jul 2024 14:46:45 +0000 (17:46 +0300)]
Merge pull request #58829 from Matan-B/wip-57709-squid

squid: crimson/os/seastore: avoid getting wrong logical extents through "parent-invalid" lba mappings

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58827 from Matan-B/wip-56150-squid
Matan Breizman [Tue, 30 Jul 2024 14:46:03 +0000 (17:46 +0300)]
Merge pull request #58827 from Matan-B/wip-56150-squid

squid: qa/suites/crimson-rados: add seastore

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58643 from hualongfeng/wip_qat_zlib_data_format_squid
Casey Bodley [Tue, 30 Jul 2024 12:37:11 +0000 (13:37 +0100)]
Merge pull request #58643 from hualongfeng/wip_qat_zlib_data_format_squid

Squid Compressor: Add data format(QZ_DEFLATE_GZIP_EXT) for QAT Zlib

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #58906 from Matan-B/wip-58256-squid
Matan Breizman [Tue, 30 Jul 2024 08:20:55 +0000 (11:20 +0300)]
Merge pull request #58906 from Matan-B/wip-58256-squid

squid: crimson/osd: adding osdmap subscribe

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58833 from Matan-B/wip-58225-squid
Matan Breizman [Tue, 30 Jul 2024 08:14:04 +0000 (11:14 +0300)]
Merge pull request #58833 from Matan-B/wip-58225-squid

squid: crimson/osd/osd_operation: fix dump_historic_slow_ops command works

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58691 from ljflores/wip-67055-squid
Laura Flores [Tue, 30 Jul 2024 03:05:38 +0000 (22:05 -0500)]
Merge pull request #58691 from ljflores/wip-67055-squid

squid: qa: suppress Leak_StillReachable mon leak in centos 9 jobs

11 months agoMerge pull request #58803 from ljflores/wip-67160-squid
Laura Flores [Tue, 30 Jul 2024 03:02:34 +0000 (22:02 -0500)]
Merge pull request #58803 from ljflores/wip-67160-squid

squid: mon: validate also mons and osds on {rm-,}pg-upmap-primary

11 months agoMerge pull request #58909 from zdover23/wip-doc-2024-07-30-backport-58904-to-squid
Anthony D'Atri [Tue, 30 Jul 2024 00:12:34 +0000 (20:12 -0400)]
Merge pull request #58909 from zdover23/wip-doc-2024-07-30-backport-58904-to-squid

squid: doc/cephfs: edit "Dynamic Subtree Partitioning"

11 months agoMerge pull request #58851 from yuvalif/wip-66805-squid
Shilpa Jagannath [Mon, 29 Jul 2024 20:55:41 +0000 (13:55 -0700)]
Merge pull request #58851 from yuvalif/wip-66805-squid

squid: rgw/notification: Fix the caching issues of notification brokers, where the cache was not invalidated if topic attributes were changed

11 months agoMerge pull request #58794 from ivancich/wip-67156-squid
Yuri Weinstein [Mon, 29 Jul 2024 19:54:42 +0000 (12:54 -0700)]
Merge pull request #58794 from ivancich/wip-67156-squid

squid: test/rgw: address potential race condition in reshard testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #58854 from idryomov/wip-67051-squid
Yuri Weinstein [Mon, 29 Jul 2024 19:34:47 +0000 (12:34 -0700)]
Merge pull request #58854 from idryomov/wip-67051-squid

squid: qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
11 months agoMerge pull request #58801 from ljflores/wip-67128-squid
Yuri Weinstein [Mon, 29 Jul 2024 19:32:48 +0000 (12:32 -0700)]
Merge pull request #58801 from ljflores/wip-67128-squid

squid: osd: bump versions of decoders for upmap-primary

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
11 months agoMerge pull request #58610 from adk3798/wip-66789-squid
Adam King [Mon, 29 Jul 2024 17:45:41 +0000 (13:45 -0400)]
Merge pull request #58610 from adk3798/wip-66789-squid

squid: cephadm: disable ms_bind_ipv4 if we will enable ms_bind_ipv6

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #58609 from adk3798/wip-66787-squid
Adam King [Mon, 29 Jul 2024 17:44:45 +0000 (13:44 -0400)]
Merge pull request #58609 from adk3798/wip-66787-squid

squid: mgr: excute cmd 'ceph orch apply osd' returned without error info

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agodoc/cephfs: edit "Dynamic Subtree Partitioning" 58909/head
Zac Dover [Mon, 29 Jul 2024 11:17:44 +0000 (21:17 +1000)]
doc/cephfs: edit "Dynamic Subtree Partitioning"

Edit the section "Dynamic Subtree Partitioning" in
doc/cephfs/multimds.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d14119e37e01bd06eed668d9e3606a66ef205b30)

11 months agoMerge pull request #58901 from zdover23/wip-doc-2024-07-29-backport-58554-to-squid
Anthony D'Atri [Mon, 29 Jul 2024 14:26:18 +0000 (10:26 -0400)]
Merge pull request #58901 from zdover23/wip-doc-2024-07-29-backport-58554-to-squid

squid: docs: removed centos 8 and added squid to the build matrix

11 months agosuites: crimson basic adding wait for test 58906/head
Nitzan Mordechai [Tue, 25 Jun 2024 09:12:09 +0000 (09:12 +0000)]
suites: crimson basic adding wait for test

Fixes: https://tracker.ceph.com/issues/66381
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit a9de8be0f4633ac825f364f8b7ddcd4c4d5b6a2c)

11 months agocrimson/osd: adding osdmap subscribe
Nitzan Mordechai [Tue, 25 Jun 2024 09:06:45 +0000 (09:06 +0000)]
crimson/osd: adding osdmap subscribe

when committed osdmap is complete, it will check if should restart.
in case we shouldn't restart but we are still active, we need
the next osdmap to continue the process.

Fixes: https://tracker.ceph.com/issues/66381
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit 74297e6abac2868afc5edc6765c2284319091de2)

11 months agoMerge pull request #58832 from Matan-B/wip-58396-squid
Matan Breizman [Mon, 29 Jul 2024 12:50:21 +0000 (15:50 +0300)]
Merge pull request #58832 from Matan-B/wip-58396-squid

squid: suite/crimson: enable stats tests

Reviewed-by: NitzanMordhai <nmordech@redhat.com>
11 months agoMerge pull request #58821 from Matan-B/wip-57359-squid-v2
Matan Breizman [Mon, 29 Jul 2024 12:50:02 +0000 (15:50 +0300)]
Merge pull request #58821 from Matan-B/wip-57359-squid-v2

squid: vstart.sh: add options to set number of alien threads, and number of cpu cores for alien threads

Reviewed-by: NitzanMordhai <nmordech@redhat.com>
11 months agoMerge pull request #58886 from Matan-B/wip-58510-squid
Matan Breizman [Mon, 29 Jul 2024 12:44:03 +0000 (15:44 +0300)]
Merge pull request #58886 from Matan-B/wip-58510-squid

squid: crimson: PG stats are not synced between osds after object update

Reviewed-by: NitzanMordhai <nmordech@redhat.com>
11 months agoMerge pull request #58888 from Matan-B/wip-58694-squid
Matan Breizman [Mon, 29 Jul 2024 12:41:52 +0000 (15:41 +0300)]
Merge pull request #58888 from Matan-B/wip-58694-squid

squid: crimson/osd/recovery_backend: cleanup PGBackend::temp_contents when pg interval changes

Reviewed-by: NitzanMordhai <nmordech@redhat.com>
11 months agoMerge pull request #58702 from Matan-B/wip-66917-squid
Matan Breizman [Mon, 29 Jul 2024 12:31:00 +0000 (15:31 +0300)]
Merge pull request #58702 from Matan-B/wip-66917-squid

squid: seastar: fix makecheck error: missing 'typename'

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #58836 from Matan-B/wip-58357-squid
Matan Breizman [Mon, 29 Jul 2024 12:25:37 +0000 (15:25 +0300)]
Merge pull request #58836 from Matan-B/wip-58357-squid

squid: crimson/os/seastore/btree: interrupt transactions immediately when getting children

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58834 from Matan-B/wip-58250-squid
Matan Breizman [Mon, 29 Jul 2024 12:23:59 +0000 (15:23 +0300)]
Merge pull request #58834 from Matan-B/wip-58250-squid

squid: crimson/os/seastore: write ool extents without padding

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58831 from Matan-B/wip-57828-squid
Matan Breizman [Mon, 29 Jul 2024 12:22:11 +0000 (15:22 +0300)]
Merge pull request #58831 from Matan-B/wip-57828-squid

squid: crimson/os/seastore/btree: improve lba pointer related UT checks

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58824 from Matan-B/wip-58099-squid
Matan Breizman [Mon, 29 Jul 2024 12:16:46 +0000 (15:16 +0300)]
Merge pull request #58824 from Matan-B/wip-58099-squid

squid: crimson: fix ObjectContext::_with_lock to only unlock if lock is taken

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58823 from Matan-B/wip-57691-squid
Matan Breizman [Mon, 29 Jul 2024 12:16:19 +0000 (15:16 +0300)]
Merge pull request #58823 from Matan-B/wip-57691-squid

squid: crimson/osd/osd_operations/client_request_common: `PeeringState::needs_recovery()` may fail if the object is under backfill

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58822 from Matan-B/wip-57147-squid
Matan Breizman [Mon, 29 Jul 2024 12:15:48 +0000 (15:15 +0300)]
Merge pull request #58822 from Matan-B/wip-57147-squid

squid: crimson/osd/pg_recovery: skip unfound objects when recovering the primary

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58819 from Matan-B/wip-57367-squid
Matan Breizman [Mon, 29 Jul 2024 12:13:39 +0000 (15:13 +0300)]
Merge pull request #58819 from Matan-B/wip-57367-squid

squid: crimson/osd/osd_operations/client_request: check "can_serve_replica_reads" before getting obc

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agodocs: removed centos 8 and added squid to the build matrix 58901/head
Yuri Weinstein [Fri, 12 Jul 2024 13:42:02 +0000 (06:42 -0700)]
docs: removed centos 8 and added squid to the build matrix

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 8761bbe16c2a6d19e136254c26d1d67ebe839e3b)

11 months agorgw: fixup compressor_message didn't store in some cases 58643/head
hualong feng [Fri, 14 Jun 2024 07:50:53 +0000 (15:50 +0800)]
rgw: fixup compressor_message didn't store in some cases

When I upload a object to RGW by multipart, the head object
xattr(user.rgw.compression) don't have compressor_message
when the value should be valid and part object xattr
have the value.

Signed-off-by: Feng,Hualong <hualong.feng@intel.com>
(cherry picked from commit 8a20dff09f9bba26ecbc7ae5d76a2f720d0746f2)

11 months agocompressor: Change data formt to QZ_DEFLATE_GZIP_EXT for QAT zlib
hualong feng [Thu, 6 Jun 2024 07:53:03 +0000 (15:53 +0800)]
compressor: Change data formt to QZ_DEFLATE_GZIP_EXT for QAT zlib

QAT zlib 'QZ_DEFLATE_RAW' data format cannot decompress
by QAT hardware. So here we replace 'QZ_DEFLATE_GZIP_EXT' data
format with 'QZ_DEFLATE_RAW'.

'QZ_DEFLATE_GZIP_EXT' data format need to add gz_header
by deflateSetHeader() in QATzip. And it leads multi stream
in one compression for hardware buffer. So the windows bit
is important information for decompression, which related to
if the inflate remove header.

Add busy_polling setting for reducing latency

Signed-off-by: Feng,Hualong <hualong.feng@intel.com>
(cherry picked from commit 855c5d6826dabba0093e65e34be14a2fb1581dd0)

11 months agoMerge pull request #58892 from zdover23/wip-doc-2024-07-28-backport-58884-to-squid
Anthony D'Atri [Sun, 28 Jul 2024 14:12:33 +0000 (10:12 -0400)]
Merge pull request #58892 from zdover23/wip-doc-2024-07-28-backport-58884-to-squid

squid: doc/cephfs: fix "OSD capabilities" link

11 months agodoc/cephfs: fix "OSD capabilities" link 58892/head
Zac Dover [Sun, 28 Jul 2024 07:27:53 +0000 (17:27 +1000)]
doc/cephfs: fix "OSD capabilities" link

Fix a broken link from the "OSD capabilites" reference on
doc/cephfs/client-auth.rst.

Fixes: https://tracker.ceph.com/issues/67218
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 74b03a8cb2f196171b10d8cbde27324240649e70)

11 months agocommon: fix string creation from '0' in LogEntry 58890/head
Ronen Friedman [Sun, 3 Mar 2024 14:30:59 +0000 (16:30 +0200)]
common: fix string creation from '0' in LogEntry

C++23 disallows conversion from 'int' to 'string'.
That includes returning '0' from a function that returns a string.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit b854bfcc70ff372cd087c068e0302d36ad86391f)
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
11 months agocrimson/osd/recovery_backend: fix RecoveryBackend::temp_contents usage 58888/head
Xuehan Xu [Sat, 20 Jul 2024 08:17:47 +0000 (16:17 +0800)]
crimson/osd/recovery_backend: fix RecoveryBackend::temp_contents usage

All temp objects are added *only* to PGBackend::temp_content.
cleaning RecoveryBackend::temp_contents (which is always empty) instead
of PGBackend::temp_contents is wrong.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 71ba42693e7334f3905fb7a45a29caa16e5e8a58)

11 months agocrimson/osd/pg: update PG stats on handle_rep_op 58886/head
sajibreadd [Wed, 10 Jul 2024 12:27:02 +0000 (18:27 +0600)]
crimson/osd/pg: update PG stats on handle_rep_op
Fixes: https://tracker.ceph.com/issues/61761
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
(cherry picked from commit 82ae96fa86b7f83067ec42538ac48da0a77afffd)

11 months agoMerge pull request #58875 from zdover23/wip-doc-2024-07-27-backport-58867-to-squid
Anthony D'Atri [Sat, 27 Jul 2024 01:12:35 +0000 (21:12 -0400)]
Merge pull request #58875 from zdover23/wip-doc-2024-07-27-backport-58867-to-squid

squid: doc/cephfs: fix "file layouts" link

11 months agoMerge pull request #58782 from cbodley/wip-67098-squid
Shilpa Jagannath [Fri, 26 Jul 2024 22:06:36 +0000 (15:06 -0700)]
Merge pull request #58782 from cbodley/wip-67098-squid

squid: rgw/iam: CreateRole ignores EEXIST after forwarded request

11 months agoMerge pull request #58714 from Svelar/wip-67071-squid
Shilpa Jagannath [Fri, 26 Jul 2024 22:06:18 +0000 (15:06 -0700)]
Merge pull request #58714 from Svelar/wip-67071-squid

squid: rgw/amqp: lock erase and create connection before emplace

11 months agoMerge pull request #58197 from kchheda3/wip-66591-squid
Yuri Weinstein [Fri, 26 Jul 2024 17:13:46 +0000 (10:13 -0700)]
Merge pull request #58197 from kchheda3/wip-66591-squid

squid: rgw/lifecycle-notification: Do not block lc processing for notification errors.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #58873 from afreen23/wip-67202-squid
Nizamudeen A [Fri, 26 Jul 2024 14:29:04 +0000 (19:59 +0530)]
Merge pull request #58873 from afreen23/wip-67202-squid

squid: mgr/dashboard: Add initiators

Reviewed-by: Nizamudeen A <nia@redhat.com>
11 months agodoc/cephfs: fix "file layouts" link 58875/head
Zac Dover [Fri, 26 Jul 2024 07:15:12 +0000 (17:15 +1000)]
doc/cephfs: fix "file layouts" link

Fix a broken link to the "File Layouts" page on
doc/cephfs/client-auth.rst.

Fixes: https://tracker.ceph.com/issues/67190
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6bb5ce94c6a2cbfdf978a66d00f428ad4cd4c312)

11 months agomgr/dashboard: Add initiators add/update in dashboard 58873/head
Afreen Misbah [Wed, 10 Jul 2024 11:24:20 +0000 (16:54 +0530)]
mgr/dashboard: Add initiators add/update in dashboard

Fixes  https://tracker.ceph.com/issues/66907

- add one or more initiators
- remove one or more initiators
- introduces two new UI routers for the above two

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit 1f82dc8b8f1b5ca17caa69fbbb99554b5a659591)

11 months agoMerge pull request #58857 from idryomov/wip-67097-squid
Ilya Dryomov [Fri, 26 Jul 2024 07:47:43 +0000 (09:47 +0200)]
Merge pull request #58857 from idryomov/wip-67097-squid

squid: qa/suites/krbd: stress test for recovering from watch errors for -o exclusive

Reviewed-by: Ramana Raja <rraja@redhat.com>
11 months agoMerge pull request #58779 from aaSharma14/wip-67101-squid
Aashish Sharma [Fri, 26 Jul 2024 05:43:26 +0000 (11:13 +0530)]
Merge pull request #58779 from aaSharma14/wip-67101-squid

squid: mgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview grafana dashboard

Reviewed-by: Nizamudeen A <nia@redhat.com>
11 months agoMerge pull request #58849 from rhcs-dashboard/squid-expand-cluster-navigation-fix
naman munet [Fri, 26 Jul 2024 05:34:28 +0000 (11:04 +0530)]
Merge pull request #58849 from rhcs-dashboard/squid-expand-cluster-navigation-fix

squid: mgr/dashboard: expand-cluster back navigation fix

11 months agoMerge pull request #58848 from rhcs-dashboard/squid-multisite-e2e-fixes
naman munet [Fri, 26 Jul 2024 05:33:59 +0000 (11:03 +0530)]
Merge pull request #58848 from rhcs-dashboard/squid-multisite-e2e-fixes

squid: mgr/dashboard: multisite e2e test case fix

11 months agoMerge pull request #58863 from zdover23/wip-doc-2024-07-26-backport-58838-to-squid
Anthony D'Atri [Fri, 26 Jul 2024 00:35:39 +0000 (20:35 -0400)]
Merge pull request #58863 from zdover23/wip-doc-2024-07-26-backport-58838-to-squid

squid: doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks

11 months agodoc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks 58863/head
Ilya Dryomov [Thu, 25 Jul 2024 07:48:10 +0000 (09:48 +0200)]
doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks

This is due to both using the same name for the lock at the RADOS level
("rbd_lock").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2e83b77c9f610f42765266ff4d4d7bc2a635eac8)

11 months agoMerge pull request #58418 from ceph/squid-release
Josh Durgin [Thu, 25 Jul 2024 17:30:36 +0000 (10:30 -0700)]
Merge pull request #58418 from ceph/squid-release

v19.1.0

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
11 months agoqa/suites/krbd: override extra_system_packages directly on install task 58857/head
Ilya Dryomov [Wed, 24 Jul 2024 06:47:51 +0000 (08:47 +0200)]
qa/suites/krbd: override extra_system_packages directly on install task

Follow commit c61cb16223fa ("qa/suites/rbd: override
extra_system_packages directly on install task").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2a9f92f23472dfcb1cb0fabc8572a28e6e5dd91a)

11 months agoqa/suites/krbd: stress test for recovering from watch errors for -o exclusive
Ilya Dryomov [Wed, 24 Jul 2024 06:44:46 +0000 (08:44 +0200)]
qa/suites/krbd: stress test for recovering from watch errors for -o exclusive

This is based on a test added in commit 237aa221ebad ("qa/suites/krbd:
stress test for recovering from watch errors") for regular mappings.

Fixes: https://tracker.ceph.com/issues/67097
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8fee41da8b8cd250bbbd8490604193c0864c1295)

11 months agoqa/workunits/rbd: avoid caching effects in luks-encryption.sh 58854/head
Ilya Dryomov [Fri, 19 Jul 2024 17:35:28 +0000 (19:35 +0200)]
qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Commit 40f6f5224bce ("qa/workunits/rbd: fix issues in
luks-encryption.sh") did the right thing for reads, which solved
most of the issue.  However, it actually made a step in the opposite
direction for writes -- depending on the RBD cache settings, rbd-nbd
virtual devices can behave as physical devices with a volatile write
cache, so fsync is required.

While at it, involving O_DIRECT for reads isn't needed outside of
test_encryption_format().

Fixes: https://tracker.ceph.com/issues/67051
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9e1c0342e9931e898d795d47f923edd3b4324f4a)

11 months agorgw/notification doc: doc: Update pendingreleasenotes for notification. 58851/head
kchheda3 [Mon, 3 Jun 2024 18:44:31 +0000 (14:44 -0400)]
rgw/notification doc: doc: Update pendingreleasenotes for notification.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit 85fc96b0cd271b6c1de6db2e406586a6dda05248)

11 months agorgw/notification: Use topic attributes from topic rados object to create Pushendpoint...
kchheda3 [Tue, 28 May 2024 20:50:33 +0000 (16:50 -0400)]
rgw/notification: Use topic attributes from topic rados object to create Pushendpoint and stop calling RGWPubSubEndpoint::create for every event.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit c8f7d311ecc24befe985dd39391b38f5f1b60510)

 Conflicts:
src/rgw/driver/rados/rgw_notify.cc

11 months agoFixes: https://tracker.ceph.com/issues/67074 58849/head
Naman Munet [Mon, 22 Jul 2024 09:52:55 +0000 (15:22 +0530)]
Fixes: https://tracker.ceph.com/issues/67074
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit 6241be164dc1f764b66bf63ca4e42a4f3931c07a)

11 months agoMerge pull request #58608 from adk3798/wip-66648-squid
Adam King [Thu, 25 Jul 2024 11:19:05 +0000 (07:19 -0400)]
Merge pull request #58608 from adk3798/wip-66648-squid

squid: mgr/rgw: fix error handling in rgw zone create

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #58611 from adk3798/wip-66892-squid
Adam King [Thu, 25 Jul 2024 11:17:08 +0000 (07:17 -0400)]
Merge pull request #58611 from adk3798/wip-66892-squid

squid: mgr/rgw: fix setting rgw realm token in secondary site rgw spec

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #58612 from adk3798/wip-66958-squid
Adam King [Thu, 25 Jul 2024 11:16:10 +0000 (07:16 -0400)]
Merge pull request #58612 from adk3798/wip-66958-squid

squid: cephadm: turn off cgroups_split setting  when bootstrapping with --no-cgroups-split

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #58663 from adk3798/squid-cephadm-limit-shell-mounts
Adam King [Thu, 25 Jul 2024 11:15:19 +0000 (07:15 -0400)]
Merge pull request #58663 from adk3798/squid-cephadm-limit-shell-mounts

squid: cephadm: limit mounts for shell and ceph-volume commands

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoFixes: https://tracker.ceph.com/issues/67070 58848/head
Naman Munet [Mon, 22 Jul 2024 07:34:06 +0000 (13:04 +0530)]
Fixes: https://tracker.ceph.com/issues/67070
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit da784bc14ef6b68c35b02b6bf992d7546d1ec874)

11 months agocrimson/osd: execute PGListener async operations in order 58840/head
Samuel Just [Tue, 2 Jul 2024 22:27:55 +0000 (15:27 -0700)]
crimson/osd: execute PGListener async operations in order

- Adds ShardServices::singleton_orderer_t mechanism to ensure that
  OSDSingleton calls are completed in order.
- Updates ShardServices accessors invoked from PeeringListener handlers
  to use orderer.
- Updates PGListener handlers and complete_rctx to use orderer.

Fixes: https://tracker.ceph.com/issues/66316
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit e12e92c50fdd0288a7bfcf43c60fba5b938914a1)

11 months agocrimson/.../shard_services: add logging to local and remote reservers
Samuel Just [Fri, 12 Jul 2024 04:13:20 +0000 (04:13 +0000)]
crimson/.../shard_services: add logging to local and remote reservers

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit ee52b19adc507bb1268e175f442ebaa4c67cf863)

11 months agocrimson/.../pg: add logging to most PeeringState::Listener implementations
Samuel Just [Fri, 12 Jul 2024 00:00:00 +0000 (00:00 +0000)]
crimson/.../pg: add logging to most PeeringState::Listener implementations

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 2b3a17838431af1b19086b6c0b28c7a348958f6b)

11 months agocrimson/.../peering_event: complete_rctx under the PGPeeringPipeline::process stage
Samuel Just [Tue, 2 Jul 2024 23:34:52 +0000 (16:34 -0700)]
crimson/.../peering_event: complete_rctx under the PGPeeringPipeline::process stage

Otherwise, transactions and messages might be submitted out of order.

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 38ab28739e377059687c89e0b1d9637a55c70a7e)

11 months agocrimson/.../pg: factor out PG::complete_rctx
Samuel Just [Tue, 2 Jul 2024 22:50:47 +0000 (22:50 +0000)]
crimson/.../pg: factor out PG::complete_rctx

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 816c9e9e85024eb64aa9d6eccfb254b2d6556894)

11 months agocrimson/osd/pg: limit usage of async for peering state machine
Samuel Just [Thu, 27 Jun 2024 20:41:23 +0000 (20:41 +0000)]
crimson/osd/pg: limit usage of async for peering state machine

See comment and https://tracker.ceph.com/issues/66708.

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 0f32fc6080075e937e4cba752fd14bf3cc3be064)

11 months agoosd/PGLog,crimson/osd/pg: remove support for rebuild_missing_set_with_deletes_crimson
Samuel Just [Wed, 26 Jun 2024 03:16:28 +0000 (03:16 +0000)]
osd/PGLog,crimson/osd/pg: remove support for rebuild_missing_set_with_deletes_crimson

Reverts 9c2d11af5.

PeeringListener::rebuild_missing_set_with_deletes should only be invoked
upon advancing from an OSDMap where CEPH_OSDMAP_RECOVERY_DELETES is not
set to one where it is.  That shouldn't be possible for a crimson cluster
as CEPH_OSDMAP_RECOVERY_DELETES should be set as long as
require_osd_release >= luminous, which was quite a few versions ago.
OSDMonitor::create_initial() defaults to squid, or as old as quincy
with config options.

I'm not sure this actually worked as it uses get0() on
a seastar::future<>, which won't correctly deal with the thread-local
interrupt_cond created by the interruptor::async wrapper in
PG::do_peering_event.  Additionally,
PeeringListener::rebuild_missing_set_with_deletes would have been
invoked under PeeringState::on_new_interval() while processing an
AdvMap event, but PG::handle_advance_map doesn't actually invoke
peering_state.advance_map under seastar::async or interruptor::async.

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 4c58cb5872596d9f19b38a51c088e0d185f712e3)

11 months agocrimson/os/seastore/btree: interrupt transactions immediately when 58836/head
Xuehan Xu [Wed, 26 Jun 2024 12:58:35 +0000 (20:58 +0800)]
crimson/os/seastore/btree: interrupt transactions immediately when
getting children

Fixes: https://tracker.ceph.com/issues/66851
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit 5fc8b847c9b1705485b87af17d5af085a65eab04)

11 months agocrimson/os/seastore: encode ool records without padding 58834/head
Yingxin Cheng [Fri, 21 Jun 2024 05:49:41 +0000 (13:49 +0800)]
crimson/os/seastore: encode ool records without padding

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit 35085b94a1a7ca0af5f5088ecc73ebc9cafebb28)

11 months agocrimson/os/seastore/seastore_types: introduce record_type_t::OOL
Yingxin Cheng [Fri, 21 Jun 2024 05:48:32 +0000 (13:48 +0800)]
crimson/os/seastore/seastore_types: introduce record_type_t::OOL

And adjust size calculations for record_type_t::OOL, should be no actual
impact yet.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit c837cd07428b082cbe2726995f0a672c07544a31)

11 months agocrimson/os/seastore/seastore_types: rename record_t::type to trans_type
Yingxin Cheng [Thu, 20 Jun 2024 07:31:56 +0000 (15:31 +0800)]
crimson/os/seastore/seastore_types: rename record_t::type to trans_type

In order to introduce a different type.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit 927c29a177648c7e71fe5e78d34dc0b76343a09e)

11 months agocrimson/osd/osd_operation: fix dump_historic_slow_ops command works 58833/head
junxiang Mu [Mon, 24 Jun 2024 10:05:08 +0000 (18:05 +0800)]
crimson/osd/osd_operation: fix dump_historic_slow_ops command works

* Use two separate lists to store normal ops and slow ops, respectively

Fixes: https://tracker.ceph.com/issues/65531
Signed-off-by: junxiang Mu <1948535941@qq.com>
(cherry picked from commit 86ac61c68f2509c1df38016b26fb0174f5cfc9ad)

11 months agosuite/crimson: enable stats tests 58832/head
Nitzan Mordechai [Tue, 2 Jul 2024 11:37:41 +0000 (11:37 +0000)]
suite/crimson: enable stats tests

Fixes: https://tracker.ceph.com/issues/66382
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit d66d9f35d39174ac62450611fd8f9a15654ab99d)