]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Casey Bodley [Thu, 1 Aug 2024 15:38:05 +0000 (16:38 +0100)]
Merge pull request #58933 from cbodley/wip-67269-squid
squid: rgw/rgw_rados: fix server side-copy orphans tail-objects
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Anthony D'Atri [Thu, 1 Aug 2024 12:17:06 +0000 (08:17 -0400)]
Merge pull request #58977 from zdover23/wip-doc-2024-08-01-backport-58899-to-squid
squid: doc/glossary: add "Prometheus"
Anthony D'Atri [Thu, 1 Aug 2024 12:05:57 +0000 (08:05 -0400)]
Merge pull request #58973 from zdover23/wip-doc-2024-08-01-backport-58972-to-squid
squid: doc: Improve doc/radosgw/placement.rst
Zac Dover [Mon, 29 Jul 2024 10:19:02 +0000 (20:19 +1000)]
doc/glossary: add "Prometheus"
Add a glossary entry for "Prometheus".
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
1a76464999cb2d2cc748d69e1bb0567544a0bb8b )
Anthony D'Atri [Wed, 31 Jul 2024 22:41:53 +0000 (18:41 -0400)]
doc: Improve doc/radosgw/placement.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
5890a156524b8d1fe3a51ea1c76d800e5903a01c )
Yuri Weinstein [Wed, 31 Jul 2024 22:52:18 +0000 (15:52 -0700)]
Merge pull request #58401 from sseshasa/wip-66807-squid
squid: qa/tasks: Initialize 'monitoring_profiles' spec to an empty dict
Reviewed-by: Neha Ojha <nojha@redhat.com>
Yuri Weinstein [Wed, 31 Jul 2024 22:51:17 +0000 (15:51 -0700)]
Merge pull request #58314 from cbodley/wip-66724
squid: build: Make boost_url a list
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
Casey Bodley [Wed, 31 Jul 2024 13:34:28 +0000 (14:34 +0100)]
Merge pull request #58890 from Matan-B/wip-matanb-logentry-string-1
squid: common: fix string creation from '0' in LogEntry
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Wed, 31 Jul 2024 08:39:22 +0000 (11:39 +0300)]
Merge pull request #58840 from Matan-B/wip-58464-squid
squid: crimson: peering event processing fixes, wait for async operations started during peering events
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Wed, 31 Jul 2024 08:38:34 +0000 (11:38 +0300)]
Merge pull request #58826 from Matan-B/wip-57125-squid
squid: crimson/osd/pg: reset the snap mapper's backend when pg interval changes
Reviewed-by: Samuel Just <sjust@redhat.com>
Anthony D'Atri [Wed, 31 Jul 2024 01:48:38 +0000 (21:48 -0400)]
Merge pull request #58947 from zdover23/wip-doc-2024-07-31-backport-58946-to-squid
squid: doc/rados/operations: remove vanity cluster name reference from crush…
Anthony D'Atri [Wed, 31 Jul 2024 00:45:11 +0000 (20:45 -0400)]
doc/rados/operations: remove vanity cluster name reference from crush-map.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
62562ec65e3c1cc040a57ab77fc219e0aad25651 )
Anthony D'Atri [Wed, 31 Jul 2024 00:50:03 +0000 (20:50 -0400)]
Merge pull request #58940 from zdover23/wip-doc-2024-07-31-backport-58922-to-squid
squid: doc/cephadm: edit "Using Custom Images"
Anthony D'Atri [Wed, 31 Jul 2024 00:48:14 +0000 (20:48 -0400)]
Merge pull request #58943 from zdover23/wip-doc-2024-07-31-backport-58908-to-squid
squid: doc/glossary: add "ceph-fuse" entry
Anthony D'Atri [Wed, 31 Jul 2024 00:38:25 +0000 (20:38 -0400)]
Merge pull request #58937 from zdover23/wip-doc-2024-07-31-backport-58918-to-squid
squid: doc/dev: improve basic-workflow.rst
Zac Dover [Mon, 29 Jul 2024 15:50:13 +0000 (01:50 +1000)]
doc/glossary: add "ceph-fuse" entry
Add a "ceph-fuse" entry to the glossary.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
d1c049d24befedc396221dafcc66db8c40acf5ab )
Zac Dover [Tue, 30 Jul 2024 07:33:55 +0000 (17:33 +1000)]
doc/cephadm: edit "Using Custom Images"
Edit the section "Using Custom Images" in
doc/cephadm/services/monitoring.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
e99fc5c82fd698c222a489a1ebc26c8fcbca321d )
Casey Bodley [Tue, 30 Jul 2024 22:31:28 +0000 (23:31 +0100)]
Merge pull request #58763 from smanjara/wip-67025-squid
squid: rgw/multisite: don't retain RGW_ATTR_OBJ_REPLICATION_TRACE attr on copy_object
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Zac Dover [Tue, 30 Jul 2024 06:07:04 +0000 (16:07 +1000)]
doc/dev: improve basic-workflow.rst
Make various improvements to doc/dev/developer_guide/basic-workflow.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
b81d6af1b488cdb87143e13da519d70c3a090679 )
Yuri Weinstein [Tue, 30 Jul 2024 18:14:40 +0000 (11:14 -0700)]
Merge pull request #58658 from rzarzynski/wip-bug-66268-squid
squid: mgr: Convert the last_event_detail data_type to std::string
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Saumay Agrawal <saumay.agrawal@gmail.com>
Laura Flores [Tue, 30 Jul 2024 18:02:31 +0000 (13:02 -0500)]
Merge pull request #57805 from rzarzynski/wip-bug-61948-squid
squid: mon, osd, *: expose upmap-primary in OSDMap::get_features()
Gabriel BenHanokh [Tue, 23 Jul 2024 11:02:06 +0000 (11:02 +0000)]
shrink the object-size used for orphan-list test by a factor of 100 from 5100MB -> 51MB
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
(cherry picked from commit
01a9cfba444f03f378113833a13fdbd40835886b )
Daniel Gryniewicz [Thu, 27 Jun 2024 16:40:38 +0000 (12:40 -0400)]
RGW - Fix copy_obj handling of obj_ctx
Fixes: https://tracker.ceph.com/issues/66286
(Line added by Gabriel)
In RadosStore, the source and dest objects in the copy_object() call
used to share an obj_ctx. When obj_ctx was removed from the SAL API,
they each got their own, but RGWRados::copy_obj() still assumed they
shared one.
Pass in each one separately, and use the correct one for further calls.
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
(cherry picked from commit
111c54a19dc12b84cda785feddb0a0ba483b1f77 )
Gabriel BenHanokh [Sun, 23 Jun 2024 15:54:22 +0000 (15:54 +0000)]
Fixes: https://tracker.ceph.com/issues/66286
Improve display of ref_count in the rados commandline utility
New test cases were added to detect behavior after server side copy in the following cases:
1) delete original only
2) delete destination only
3) delete original then delete destination (this will lead to orphaned tail-objects without the changes made in this PR)
d) delete destination then delete original (this will lead to orphaned tail-objects without the changes made in this PR)
Add call to GC between tests to help control the used disk space since we keep writing huge files of 5GB each
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
(cherry picked from commit
d496d20c803590d41d711e446feab41476c0f20c )
Matan Breizman [Tue, 30 Jul 2024 14:46:45 +0000 (17:46 +0300)]
Merge pull request #58829 from Matan-B/wip-57709-squid
squid: crimson/os/seastore: avoid getting wrong logical extents through "parent-invalid" lba mappings
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Tue, 30 Jul 2024 14:46:03 +0000 (17:46 +0300)]
Merge pull request #58827 from Matan-B/wip-56150-squid
squid: qa/suites/crimson-rados: add seastore
Reviewed-by: Samuel Just <sjust@redhat.com>
Casey Bodley [Tue, 30 Jul 2024 12:37:11 +0000 (13:37 +0100)]
Merge pull request #58643 from hualongfeng/wip_qat_zlib_data_format_squid
Squid Compressor: Add data format(QZ_DEFLATE_GZIP_EXT) for QAT Zlib
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Matan Breizman [Tue, 30 Jul 2024 08:20:55 +0000 (11:20 +0300)]
Merge pull request #58906 from Matan-B/wip-58256-squid
squid: crimson/osd: adding osdmap subscribe
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Tue, 30 Jul 2024 08:14:04 +0000 (11:14 +0300)]
Merge pull request #58833 from Matan-B/wip-58225-squid
squid: crimson/osd/osd_operation: fix dump_historic_slow_ops command works
Reviewed-by: Samuel Just <sjust@redhat.com>
Laura Flores [Tue, 30 Jul 2024 03:05:38 +0000 (22:05 -0500)]
Merge pull request #58691 from ljflores/wip-67055-squid
squid: qa: suppress Leak_StillReachable mon leak in centos 9 jobs
Laura Flores [Tue, 30 Jul 2024 03:02:34 +0000 (22:02 -0500)]
Merge pull request #58803 from ljflores/wip-67160-squid
squid: mon: validate also mons and osds on {rm-,}pg-upmap-primary
Anthony D'Atri [Tue, 30 Jul 2024 00:12:34 +0000 (20:12 -0400)]
Merge pull request #58909 from zdover23/wip-doc-2024-07-30-backport-58904-to-squid
squid: doc/cephfs: edit "Dynamic Subtree Partitioning"
Shilpa Jagannath [Mon, 29 Jul 2024 20:55:41 +0000 (13:55 -0700)]
Merge pull request #58851 from yuvalif/wip-66805-squid
squid: rgw/notification: Fix the caching issues of notification brokers, where the cache was not invalidated if topic attributes were changed
Yuri Weinstein [Mon, 29 Jul 2024 19:54:42 +0000 (12:54 -0700)]
Merge pull request #58794 from ivancich/wip-67156-squid
squid: test/rgw: address potential race condition in reshard testing
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Mon, 29 Jul 2024 19:34:47 +0000 (12:34 -0700)]
Merge pull request #58854 from idryomov/wip-67051-squid
squid: qa/workunits/rbd: avoid caching effects in luks-encryption.sh
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 29 Jul 2024 19:32:48 +0000 (12:32 -0700)]
Merge pull request #58801 from ljflores/wip-67128-squid
squid: osd: bump versions of decoders for upmap-primary
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Adam King [Mon, 29 Jul 2024 17:45:41 +0000 (13:45 -0400)]
Merge pull request #58610 from adk3798/wip-66789-squid
squid: cephadm: disable ms_bind_ipv4 if we will enable ms_bind_ipv6
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Mon, 29 Jul 2024 17:44:45 +0000 (13:44 -0400)]
Merge pull request #58609 from adk3798/wip-66787-squid
squid: mgr: excute cmd 'ceph orch apply osd' returned without error info
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Zac Dover [Mon, 29 Jul 2024 11:17:44 +0000 (21:17 +1000)]
doc/cephfs: edit "Dynamic Subtree Partitioning"
Edit the section "Dynamic Subtree Partitioning" in
doc/cephfs/multimds.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
d14119e37e01bd06eed668d9e3606a66ef205b30 )
Anthony D'Atri [Mon, 29 Jul 2024 14:26:18 +0000 (10:26 -0400)]
Merge pull request #58901 from zdover23/wip-doc-2024-07-29-backport-58554-to-squid
squid: docs: removed centos 8 and added squid to the build matrix
Nitzan Mordechai [Tue, 25 Jun 2024 09:12:09 +0000 (09:12 +0000)]
suites: crimson basic adding wait for test
Fixes: https://tracker.ceph.com/issues/66381
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit
a9de8be0f4633ac825f364f8b7ddcd4c4d5b6a2c )
Nitzan Mordechai [Tue, 25 Jun 2024 09:06:45 +0000 (09:06 +0000)]
crimson/osd: adding osdmap subscribe
when committed osdmap is complete, it will check if should restart.
in case we shouldn't restart but we are still active, we need
the next osdmap to continue the process.
Fixes: https://tracker.ceph.com/issues/66381
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit
74297e6abac2868afc5edc6765c2284319091de2 )
Matan Breizman [Mon, 29 Jul 2024 12:50:21 +0000 (15:50 +0300)]
Merge pull request #58832 from Matan-B/wip-58396-squid
squid: suite/crimson: enable stats tests
Reviewed-by: NitzanMordhai <nmordech@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:50:02 +0000 (15:50 +0300)]
Merge pull request #58821 from Matan-B/wip-57359-squid-v2
squid: vstart.sh: add options to set number of alien threads, and number of cpu cores for alien threads
Reviewed-by: NitzanMordhai <nmordech@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:44:03 +0000 (15:44 +0300)]
Merge pull request #58886 from Matan-B/wip-58510-squid
squid: crimson: PG stats are not synced between osds after object update
Reviewed-by: NitzanMordhai <nmordech@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:41:52 +0000 (15:41 +0300)]
Merge pull request #58888 from Matan-B/wip-58694-squid
squid: crimson/osd/recovery_backend: cleanup PGBackend::temp_contents when pg interval changes
Reviewed-by: NitzanMordhai <nmordech@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:31:00 +0000 (15:31 +0300)]
Merge pull request #58702 from Matan-B/wip-66917-squid
squid: seastar: fix makecheck error: missing 'typename'
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:25:37 +0000 (15:25 +0300)]
Merge pull request #58836 from Matan-B/wip-58357-squid
squid: crimson/os/seastore/btree: interrupt transactions immediately when getting children
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:23:59 +0000 (15:23 +0300)]
Merge pull request #58834 from Matan-B/wip-58250-squid
squid: crimson/os/seastore: write ool extents without padding
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:22:11 +0000 (15:22 +0300)]
Merge pull request #58831 from Matan-B/wip-57828-squid
squid: crimson/os/seastore/btree: improve lba pointer related UT checks
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:16:46 +0000 (15:16 +0300)]
Merge pull request #58824 from Matan-B/wip-58099-squid
squid: crimson: fix ObjectContext::_with_lock to only unlock if lock is taken
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:16:19 +0000 (15:16 +0300)]
Merge pull request #58823 from Matan-B/wip-57691-squid
squid: crimson/osd/osd_operations/client_request_common: `PeeringState::needs_recovery()` may fail if the object is under backfill
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:15:48 +0000 (15:15 +0300)]
Merge pull request #58822 from Matan-B/wip-57147-squid
squid: crimson/osd/pg_recovery: skip unfound objects when recovering the primary
Reviewed-by: Samuel Just <sjust@redhat.com>
Matan Breizman [Mon, 29 Jul 2024 12:13:39 +0000 (15:13 +0300)]
Merge pull request #58819 from Matan-B/wip-57367-squid
squid: crimson/osd/osd_operations/client_request: check "can_serve_replica_reads" before getting obc
Reviewed-by: Samuel Just <sjust@redhat.com>
Yuri Weinstein [Fri, 12 Jul 2024 13:42:02 +0000 (06:42 -0700)]
docs: removed centos 8 and added squid to the build matrix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit
8761bbe16c2a6d19e136254c26d1d67ebe839e3b )
hualong feng [Fri, 14 Jun 2024 07:50:53 +0000 (15:50 +0800)]
rgw: fixup compressor_message didn't store in some cases
When I upload a object to RGW by multipart, the head object
xattr(user.rgw.compression) don't have compressor_message
when the value should be valid and part object xattr
have the value.
Signed-off-by: Feng,Hualong <hualong.feng@intel.com>
(cherry picked from commit
8a20dff09f9bba26ecbc7ae5d76a2f720d0746f2 )
hualong feng [Thu, 6 Jun 2024 07:53:03 +0000 (15:53 +0800)]
compressor: Change data formt to QZ_DEFLATE_GZIP_EXT for QAT zlib
QAT zlib 'QZ_DEFLATE_RAW' data format cannot decompress
by QAT hardware. So here we replace 'QZ_DEFLATE_GZIP_EXT' data
format with 'QZ_DEFLATE_RAW'.
'QZ_DEFLATE_GZIP_EXT' data format need to add gz_header
by deflateSetHeader() in QATzip. And it leads multi stream
in one compression for hardware buffer. So the windows bit
is important information for decompression, which related to
if the inflate remove header.
Add busy_polling setting for reducing latency
Signed-off-by: Feng,Hualong <hualong.feng@intel.com>
(cherry picked from commit
855c5d6826dabba0093e65e34be14a2fb1581dd0 )
Anthony D'Atri [Sun, 28 Jul 2024 14:12:33 +0000 (10:12 -0400)]
Merge pull request #58892 from zdover23/wip-doc-2024-07-28-backport-58884-to-squid
squid: doc/cephfs: fix "OSD capabilities" link
Zac Dover [Sun, 28 Jul 2024 07:27:53 +0000 (17:27 +1000)]
doc/cephfs: fix "OSD capabilities" link
Fix a broken link from the "OSD capabilites" reference on
doc/cephfs/client-auth.rst.
Fixes: https://tracker.ceph.com/issues/67218
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
74b03a8cb2f196171b10d8cbde27324240649e70 )
Ronen Friedman [Sun, 3 Mar 2024 14:30:59 +0000 (16:30 +0200)]
common: fix string creation from '0' in LogEntry
C++23 disallows conversion from 'int' to 'string'.
That includes returning '0' from a function that returns a string.
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit
b854bfcc70ff372cd087c068e0302d36ad86391f )
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
Xuehan Xu [Sat, 20 Jul 2024 08:17:47 +0000 (16:17 +0800)]
crimson/osd/recovery_backend: fix RecoveryBackend::temp_contents usage
All temp objects are added *only* to PGBackend::temp_content.
cleaning RecoveryBackend::temp_contents (which is always empty) instead
of PGBackend::temp_contents is wrong.
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit
71ba42693e7334f3905fb7a45a29caa16e5e8a58 )
sajibreadd [Wed, 10 Jul 2024 12:27:02 +0000 (18:27 +0600)]
crimson/osd/pg: update PG stats on handle_rep_op
Fixes: https://tracker.ceph.com/issues/61761
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
(cherry picked from commit
82ae96fa86b7f83067ec42538ac48da0a77afffd )
Anthony D'Atri [Sat, 27 Jul 2024 01:12:35 +0000 (21:12 -0400)]
Merge pull request #58875 from zdover23/wip-doc-2024-07-27-backport-58867-to-squid
squid: doc/cephfs: fix "file layouts" link
Shilpa Jagannath [Fri, 26 Jul 2024 22:06:36 +0000 (15:06 -0700)]
Merge pull request #58782 from cbodley/wip-67098-squid
squid: rgw/iam: CreateRole ignores EEXIST after forwarded request
Shilpa Jagannath [Fri, 26 Jul 2024 22:06:18 +0000 (15:06 -0700)]
Merge pull request #58714 from Svelar/wip-67071-squid
squid: rgw/amqp: lock erase and create connection before emplace
Yuri Weinstein [Fri, 26 Jul 2024 17:13:46 +0000 (10:13 -0700)]
Merge pull request #58197 from kchheda3/wip-66591-squid
squid: rgw/lifecycle-notification: Do not block lc processing for notification errors.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Nizamudeen A [Fri, 26 Jul 2024 14:29:04 +0000 (19:59 +0530)]
Merge pull request #58873 from afreen23/wip-67202-squid
squid: mgr/dashboard: Add initiators
Reviewed-by: Nizamudeen A <nia@redhat.com>
Zac Dover [Fri, 26 Jul 2024 07:15:12 +0000 (17:15 +1000)]
doc/cephfs: fix "file layouts" link
Fix a broken link to the "File Layouts" page on
doc/cephfs/client-auth.rst.
Fixes: https://tracker.ceph.com/issues/67190
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
6bb5ce94c6a2cbfdf978a66d00f428ad4cd4c312 )
Afreen Misbah [Wed, 10 Jul 2024 11:24:20 +0000 (16:54 +0530)]
mgr/dashboard: Add initiators add/update in dashboard
Fixes https://tracker.ceph.com/issues/66907
- add one or more initiators
- remove one or more initiators
- introduces two new UI routers for the above two
Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit
1f82dc8b8f1b5ca17caa69fbbb99554b5a659591 )
Ilya Dryomov [Fri, 26 Jul 2024 07:47:43 +0000 (09:47 +0200)]
Merge pull request #58857 from idryomov/wip-67097-squid
squid: qa/suites/krbd: stress test for recovering from watch errors for -o exclusive
Reviewed-by: Ramana Raja <rraja@redhat.com>
Aashish Sharma [Fri, 26 Jul 2024 05:43:26 +0000 (11:13 +0530)]
Merge pull request #58779 from aaSharma14/wip-67101-squid
squid: mgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview grafana dashboard
Reviewed-by: Nizamudeen A <nia@redhat.com>
naman munet [Fri, 26 Jul 2024 05:34:28 +0000 (11:04 +0530)]
Merge pull request #58849 from rhcs-dashboard/squid-expand-cluster-navigation-fix
squid: mgr/dashboard: expand-cluster back navigation fix
naman munet [Fri, 26 Jul 2024 05:33:59 +0000 (11:03 +0530)]
Merge pull request #58848 from rhcs-dashboard/squid-multisite-e2e-fixes
squid: mgr/dashboard: multisite e2e test case fix
Anthony D'Atri [Fri, 26 Jul 2024 00:35:39 +0000 (20:35 -0400)]
Merge pull request #58863 from zdover23/wip-doc-2024-07-26-backport-58838-to-squid
squid: doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks
Ilya Dryomov [Thu, 25 Jul 2024 07:48:10 +0000 (09:48 +0200)]
doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks
This is due to both using the same name for the lock at the RADOS level
("rbd_lock").
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
2e83b77c9f610f42765266ff4d4d7bc2a635eac8 )
Josh Durgin [Thu, 25 Jul 2024 17:30:36 +0000 (10:30 -0700)]
Merge pull request #58418 from ceph/squid-release
v19.1.0
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Ilya Dryomov [Wed, 24 Jul 2024 06:47:51 +0000 (08:47 +0200)]
qa/suites/krbd: override extra_system_packages directly on install task
Follow commit
c61cb16223fa ("qa/suites/rbd: override
extra_system_packages directly on install task").
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
2a9f92f23472dfcb1cb0fabc8572a28e6e5dd91a )
Ilya Dryomov [Wed, 24 Jul 2024 06:44:46 +0000 (08:44 +0200)]
qa/suites/krbd: stress test for recovering from watch errors for -o exclusive
This is based on a test added in commit
237aa221ebad ("qa/suites/krbd:
stress test for recovering from watch errors") for regular mappings.
Fixes: https://tracker.ceph.com/issues/67097
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
8fee41da8b8cd250bbbd8490604193c0864c1295 )
Ilya Dryomov [Fri, 19 Jul 2024 17:35:28 +0000 (19:35 +0200)]
qa/workunits/rbd: avoid caching effects in luks-encryption.sh
Commit
40f6f5224bce ("qa/workunits/rbd: fix issues in
luks-encryption.sh") did the right thing for reads, which solved
most of the issue. However, it actually made a step in the opposite
direction for writes -- depending on the RBD cache settings, rbd-nbd
virtual devices can behave as physical devices with a volatile write
cache, so fsync is required.
While at it, involving O_DIRECT for reads isn't needed outside of
test_encryption_format().
Fixes: https://tracker.ceph.com/issues/67051
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
9e1c0342e9931e898d795d47f923edd3b4324f4a )
kchheda3 [Mon, 3 Jun 2024 18:44:31 +0000 (14:44 -0400)]
rgw/notification doc: doc: Update pendingreleasenotes for notification.
Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit
85fc96b0cd271b6c1de6db2e406586a6dda05248 )
kchheda3 [Tue, 28 May 2024 20:50:33 +0000 (16:50 -0400)]
rgw/notification: Use topic attributes from topic rados object to create Pushendpoint and stop calling RGWPubSubEndpoint::create for every event.
Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit
c8f7d311ecc24befe985dd39391b38f5f1b60510 )
Conflicts:
src/rgw/driver/rados/rgw_notify.cc
Naman Munet [Mon, 22 Jul 2024 09:52:55 +0000 (15:22 +0530)]
Fixes: https://tracker.ceph.com/issues/67074
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit
6241be164dc1f764b66bf63ca4e42a4f3931c07a )
Adam King [Thu, 25 Jul 2024 11:19:05 +0000 (07:19 -0400)]
Merge pull request #58608 from adk3798/wip-66648-squid
squid: mgr/rgw: fix error handling in rgw zone create
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Thu, 25 Jul 2024 11:17:08 +0000 (07:17 -0400)]
Merge pull request #58611 from adk3798/wip-66892-squid
squid: mgr/rgw: fix setting rgw realm token in secondary site rgw spec
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Thu, 25 Jul 2024 11:16:10 +0000 (07:16 -0400)]
Merge pull request #58612 from adk3798/wip-66958-squid
squid: cephadm: turn off cgroups_split setting when bootstrapping with --no-cgroups-split
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Thu, 25 Jul 2024 11:15:19 +0000 (07:15 -0400)]
Merge pull request #58663 from adk3798/squid-cephadm-limit-shell-mounts
squid: cephadm: limit mounts for shell and ceph-volume commands
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Naman Munet [Mon, 22 Jul 2024 07:34:06 +0000 (13:04 +0530)]
Fixes: https://tracker.ceph.com/issues/67070
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit
da784bc14ef6b68c35b02b6bf992d7546d1ec874 )
Samuel Just [Tue, 2 Jul 2024 22:27:55 +0000 (15:27 -0700)]
crimson/osd: execute PGListener async operations in order
- Adds ShardServices::singleton_orderer_t mechanism to ensure that
OSDSingleton calls are completed in order.
- Updates ShardServices accessors invoked from PeeringListener handlers
to use orderer.
- Updates PGListener handlers and complete_rctx to use orderer.
Fixes: https://tracker.ceph.com/issues/66316
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
e12e92c50fdd0288a7bfcf43c60fba5b938914a1 )
Samuel Just [Fri, 12 Jul 2024 04:13:20 +0000 (04:13 +0000)]
crimson/.../shard_services: add logging to local and remote reservers
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
ee52b19adc507bb1268e175f442ebaa4c67cf863 )
Samuel Just [Fri, 12 Jul 2024 00:00:00 +0000 (00:00 +0000)]
crimson/.../pg: add logging to most PeeringState::Listener implementations
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
2b3a17838431af1b19086b6c0b28c7a348958f6b )
Samuel Just [Tue, 2 Jul 2024 23:34:52 +0000 (16:34 -0700)]
crimson/.../peering_event: complete_rctx under the PGPeeringPipeline::process stage
Otherwise, transactions and messages might be submitted out of order.
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
38ab28739e377059687c89e0b1d9637a55c70a7e )
Samuel Just [Tue, 2 Jul 2024 22:50:47 +0000 (22:50 +0000)]
crimson/.../pg: factor out PG::complete_rctx
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
816c9e9e85024eb64aa9d6eccfb254b2d6556894 )
Samuel Just [Thu, 27 Jun 2024 20:41:23 +0000 (20:41 +0000)]
crimson/osd/pg: limit usage of async for peering state machine
See comment and https://tracker.ceph.com/issues/66708.
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
0f32fc6080075e937e4cba752fd14bf3cc3be064 )
Samuel Just [Wed, 26 Jun 2024 03:16:28 +0000 (03:16 +0000)]
osd/PGLog,crimson/osd/pg: remove support for rebuild_missing_set_with_deletes_crimson
Reverts
9c2d11af5 .
PeeringListener::rebuild_missing_set_with_deletes should only be invoked
upon advancing from an OSDMap where CEPH_OSDMAP_RECOVERY_DELETES is not
set to one where it is. That shouldn't be possible for a crimson cluster
as CEPH_OSDMAP_RECOVERY_DELETES should be set as long as
require_osd_release >= luminous, which was quite a few versions ago.
OSDMonitor::create_initial() defaults to squid, or as old as quincy
with config options.
I'm not sure this actually worked as it uses get0() on
a seastar::future<>, which won't correctly deal with the thread-local
interrupt_cond created by the interruptor::async wrapper in
PG::do_peering_event. Additionally,
PeeringListener::rebuild_missing_set_with_deletes would have been
invoked under PeeringState::on_new_interval() while processing an
AdvMap event, but PG::handle_advance_map doesn't actually invoke
peering_state.advance_map under seastar::async or interruptor::async.
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit
4c58cb5872596d9f19b38a51c088e0d185f712e3 )
Xuehan Xu [Wed, 26 Jun 2024 12:58:35 +0000 (20:58 +0800)]
crimson/os/seastore/btree: interrupt transactions immediately when
getting children
Fixes: https://tracker.ceph.com/issues/66851
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
(cherry picked from commit
5fc8b847c9b1705485b87af17d5af085a65eab04 )
Yingxin Cheng [Fri, 21 Jun 2024 05:49:41 +0000 (13:49 +0800)]
crimson/os/seastore: encode ool records without padding
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit
35085b94a1a7ca0af5f5088ecc73ebc9cafebb28 )
Yingxin Cheng [Fri, 21 Jun 2024 05:48:32 +0000 (13:48 +0800)]
crimson/os/seastore/seastore_types: introduce record_type_t::OOL
And adjust size calculations for record_type_t::OOL, should be no actual
impact yet.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit
c837cd07428b082cbe2726995f0a672c07544a31 )
Yingxin Cheng [Thu, 20 Jun 2024 07:31:56 +0000 (15:31 +0800)]
crimson/os/seastore/seastore_types: rename record_t::type to trans_type
In order to introduce a different type.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
(cherry picked from commit
927c29a177648c7e71fe5e78d34dc0b76343a09e )
junxiang Mu [Mon, 24 Jun 2024 10:05:08 +0000 (18:05 +0800)]
crimson/osd/osd_operation: fix dump_historic_slow_ops command works
* Use two separate lists to store normal ops and slow ops, respectively
Fixes: https://tracker.ceph.com/issues/65531
Signed-off-by: junxiang Mu <1948535941@qq.com>
(cherry picked from commit
86ac61c68f2509c1df38016b26fb0174f5cfc9ad )
Nitzan Mordechai [Tue, 2 Jul 2024 11:37:41 +0000 (11:37 +0000)]
suite/crimson: enable stats tests
Fixes: https://tracker.ceph.com/issues/66382
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit
d66d9f35d39174ac62450611fd8f9a15654ab99d )