]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
11 months agocls/rbd: make group_snap_list return error if it failed
Mykola Golub [Fri, 16 Jul 2021 09:34:28 +0000 (10:34 +0100)]
cls/rbd: make group_snap_list return error if it failed

Signed-off-by: Mykola Golub <mgolub@suse.com>
Signed-off-by: N Balachandran <nibalach@redhat.com>
11 months agoMerge pull request #58677 from rhcs-dashboard/fix-cephfs-e2e-error
Nizamudeen A [Wed, 24 Jul 2024 04:10:06 +0000 (09:40 +0530)]
Merge pull request #58677 from rhcs-dashboard/fix-cephfs-e2e-error

mgr/test_orchestrator: add apply_mds command in the test_orch

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
11 months agoMerge pull request #58524 from zdover23/wip-doc-2024-07-11-cephfs-index
Zac Dover [Wed, 24 Jul 2024 03:04:57 +0000 (13:04 +1000)]
Merge pull request #58524 from zdover23/wip-doc-2024-07-11-cephfs-index

doc/cephfs: streamline a paragraph

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
11 months agoMerge pull request #58572 from VVoidV/lbr-fix-head-chunked-encoding
J. Eric Ivancich [Tue, 23 Jul 2024 22:30:02 +0000 (18:30 -0400)]
Merge pull request #58572 from VVoidV/lbr-fix-head-chunked-encoding

[RGW] Fix the handling of HEAD requests that do not comply with RFC standards

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #58665 from cbodley/wip-67012
J. Eric Ivancich [Tue, 23 Jul 2024 22:28:28 +0000 (18:28 -0400)]
Merge pull request #58665 from cbodley/wip-67012

rgw/iam: CreateRole ignores EEXIST after forwarded request

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
11 months agoMerge PR #58214 into main
Patrick Donnelly [Tue, 23 Jul 2024 20:01:31 +0000 (16:01 -0400)]
Merge PR #58214 into main

* refs/pull/58214/head:
qa/cephfs: ignore variant of MDS_UP_LESS_THAN_MAX

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
11 months agoMerge PR #58327 into main
Patrick Donnelly [Tue, 23 Jul 2024 19:56:56 +0000 (15:56 -0400)]
Merge PR #58327 into main

* refs/pull/58327/head:
cephfs-shell: excute cmd 'rmdir_helper' reported error

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
11 months agoMerge PR #57857 into main
Patrick Donnelly [Tue, 23 Jul 2024 19:55:49 +0000 (15:55 -0400)]
Merge PR #57857 into main

* refs/pull/57857/head:
qa: set debug_ms=2 for cephfs tests
msg: decrease the level to print the sending msgs from the protocol

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
11 months agoMerge pull request #58703 from kshtsk/wip-fix-unused-in-erasure-code
kyr [Tue, 23 Jul 2024 18:33:04 +0000 (20:33 +0200)]
Merge pull request #58703 from kshtsk/wip-fix-unused-in-erasure-code

erasure-code/clay: cleanup unused but set variable

11 months agoMerge pull request #58215 from badone/wip-tracker-59380-admin-socket-injectfull
Yuri Weinstein [Tue, 23 Jul 2024 17:57:08 +0000 (10:57 -0700)]
Merge pull request #58215 from badone/wip-tracker-59380-admin-socket-injectfull

qa/suites/rados: Cancel injectfull to allow cleanup

Reviewed-by: Neha Ojha <nojha@redhat.com>
11 months agoMerge pull request #57951 from mohit84/issue_66231
Yuri Weinstein [Tue, 23 Jul 2024 17:56:34 +0000 (10:56 -0700)]
Merge pull request #57951 from mohit84/issue_66231

AsyncMessenger: Don't decrease l_msgr_active_connections if it is negative

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
11 months agoMerge pull request #57797 from ajarr/wip-66011
Ilya Dryomov [Tue, 23 Jul 2024 17:52:40 +0000 (19:52 +0200)]
Merge pull request #57797 from ajarr/wip-66011

rbd: add `group snap info` command

Reviewed-by: N Balachandran <nibalach@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
11 months agoMerge pull request #57485 from sseshasa/wip-fix-validator-osd-down-grace-tmout
Yuri Weinstein [Tue, 23 Jul 2024 17:50:32 +0000 (10:50 -0700)]
Merge pull request #57485 from sseshasa/wip-fix-validator-osd-down-grace-tmout

qa/suites/rados/verify/validater: increase heartbeat grace timeout

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
11 months agoMerge PR #58276 into main
Venky Shankar [Tue, 23 Jul 2024 16:36:58 +0000 (22:06 +0530)]
Merge PR #58276 into main

* refs/pull/58276/head:
mds/QuiesceDbManager: get requested state of members before iterating through each quiesce set members

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
11 months agoMerge pull request #58709 from kshtsk/wip-assert-equal-please
kyr [Tue, 23 Jul 2024 14:26:53 +0000 (16:26 +0200)]
Merge pull request #58709 from kshtsk/wip-assert-equal-please

mgr/dashboard: use assertEqual in test_iscsi

11 months agoMerge pull request #58735 from yuvalif/wip-yuval-63786
Casey Bodley [Tue, 23 Jul 2024 11:47:21 +0000 (12:47 +0100)]
Merge pull request #58735 from yuvalif/wip-yuval-63786

test/cls_2pc_queue: fix multi-threaded access to non-atomic counter

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #58745 from cyx1231st/wip-fix-blk-aio-compile-issue
Igor Fedotov [Tue, 23 Jul 2024 09:07:01 +0000 (12:07 +0300)]
Merge pull request #58745 from cyx1231st/wip-fix-blk-aio-compile-issue

blk/aio: fix compile issue when HAVE_LIBURING isn't defined

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
11 months agotest/cls_2pc_queue: fix multi-threaded access to non-atomic variables 58735/head
Yuval Lifshitz [Mon, 22 Jul 2024 16:10:55 +0000 (16:10 +0000)]
test/cls_2pc_queue: fix multi-threaded access to non-atomic variables

Fixes: https://tracker.ceph.com/issues/63786
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
11 months agoMerge pull request #58367 from xxhdx1985126/wip-seastore-lba-mapping-iterator
Yingxin [Tue, 23 Jul 2024 05:50:02 +0000 (13:50 +0800)]
Merge pull request #58367 from xxhdx1985126/wip-seastore-lba-mapping-iterator

crimson/os/seastore/cached_extent: add the "refresh" ability to lba mappings

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
11 months agoblk/aio: fix compile issue when HAVE_LIBURING isn't defined 58745/head
Yingxin Cheng [Tue, 23 Jul 2024 03:22:59 +0000 (11:22 +0800)]
blk/aio: fix compile issue when HAVE_LIBURING isn't defined

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
11 months agoMerge pull request #57782 from myoungwon/wip-nvme-pi
Yingxin [Tue, 23 Jul 2024 02:13:54 +0000 (10:13 +0800)]
Merge pull request #57782 from myoungwon/wip-nvme-pi

crimson/os/seastore: add checksum offload to RBM

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
11 months agoMerge pull request #58705 from gitkenan/crimsonDocChanges
Zac Dover [Mon, 22 Jul 2024 18:58:39 +0000 (04:58 +1000)]
Merge pull request #58705 from gitkenan/crimsonDocChanges

doc/dev/crimson: making it more user-friendly, re-arranging chapters and fixing typos

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
11 months agoMerge pull request #58275 from NitzanMordhai/wip-nitzn-host-thraser-fix-min-in-checks
Laura Flores [Mon, 22 Jul 2024 18:22:30 +0000 (13:22 -0500)]
Merge pull request #58275 from NitzanMordhai/wip-nitzn-host-thraser-fix-min-in-checks

suites: host thrasher should check min_in before thrashing host

11 months agoMerge pull request #58393 from NitzanMordhai/wip-nitzan-old-client-thrasher-slow...
Laura Flores [Mon, 22 Jul 2024 18:19:12 +0000 (13:19 -0500)]
Merge pull request #58393 from NitzanMordhai/wip-nitzan-old-client-thrasher-slow-ops-ignorelist

suites: thrash old client missing SLOW_OPS in the ignore-list

11 months agoMerge pull request #58277 from NitzanMordhai/wip-nitzan-upgrade-suites-quincy-ignore...
Laura Flores [Mon, 22 Jul 2024 18:15:50 +0000 (13:15 -0500)]
Merge pull request #58277 from NitzanMordhai/wip-nitzan-upgrade-suites-quincy-ignore-list-adding

suites/upgrade/quincy-x: update the ignore list

11 months agoMerge pull request #58600 from zdover23/wip-doc-2024-07-16-dev-guide-basic-workflow
Zac Dover [Mon, 22 Jul 2024 18:00:49 +0000 (04:00 +1000)]
Merge pull request #58600 from zdover23/wip-doc-2024-07-16-dev-guide-basic-workflow

doc/dev: add formatting to basic workflow

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
11 months agorbd: add group snap info command 57797/head
Ramana Raja [Tue, 18 Jun 2024 21:32:24 +0000 (17:32 -0400)]
rbd: add group snap info command

... to show information about a group snapshot.

And also include group snap ID in `group snap ls` output.

Fixes: https://tracker.ceph.com/issues/66011
Signed-off-by: Ramana Raja <rraja@redhat.com>
11 months agoMerge pull request #58725 from zdover23/wip-doc-2024-07-23-dev-dev-guide-basic-workflow
Zac Dover [Mon, 22 Jul 2024 15:53:21 +0000 (01:53 +1000)]
Merge pull request #58725 from zdover23/wip-doc-2024-07-23-dev-dev-guide-basic-workflow

doc/dev_guide: add needs-upgrade-testing label info

Reviewed-by: Laura Flores <lflores@ibm.com>
11 months agodoc/dev_guide: add needs-upgrade-testing label info 58725/head
Zac Dover [Mon, 22 Jul 2024 15:36:53 +0000 (01:36 +1000)]
doc/dev_guide: add needs-upgrade-testing label info

Add an explanation of the "needs-upgrade-testing" label and explain when
to use it.

Laura is the true author of this text.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
11 months agodoc/dev/crimson: clarify and rearrange for userability 58705/head
gitkenan [Sun, 21 Jul 2024 22:02:47 +0000 (23:02 +0100)]
doc/dev/crimson: clarify and rearrange for userability

Signed-off-by: gitkenan <kenan.mth@gmail.com>
11 months agoMerge pull request #56517 from gukaifeng/doc-amend
Zac Dover [Mon, 22 Jul 2024 13:19:06 +0000 (23:19 +1000)]
Merge pull request #56517 from gukaifeng/doc-amend

doc/start/os-recommendations: remove 16.2.z support for CentOS 7

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
11 months agoMerge pull request #58353 from pereman2/bad-collection-objectstore
Pere Diaz Bou [Mon, 22 Jul 2024 11:57:20 +0000 (13:57 +0200)]
Merge pull request #58353 from pereman2/bad-collection-objectstore

tools/objectstore: check for wrong coll open_collection

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
11 months agoMerge pull request #57002 from aclamk/wip-aclamk-bs-storetest-expand-synthetic
Adam Kupczyk [Mon, 22 Jul 2024 11:48:06 +0000 (13:48 +0200)]
Merge pull request #57002 from aclamk/wip-aclamk-bs-storetest-expand-synthetic

Improved structure for objectstore unit tests.

11 months agodoc/start/os-recommendations: remove 16.2.z support for CentOS 7 56517/head
gukaifeng [Tue, 2 Apr 2024 07:28:04 +0000 (15:28 +0800)]
doc/start/os-recommendations: remove 16.2.z support for CentOS 7

11 months agoMerge pull request #58639 from zdover23/wip-doc-2024-07-17-start-os-recommendations 58717/head
Zac Dover [Mon, 22 Jul 2024 08:28:39 +0000 (18:28 +1000)]
Merge pull request #58639 from zdover23/wip-doc-2024-07-17-start-os-recommendations

doc/start: add tested container host oses

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
11 months agodoc/start: add tested container host oses 58639/head
Zac Dover [Wed, 17 Jul 2024 06:18:58 +0000 (16:18 +1000)]
doc/start: add tested container host oses

Add a list of OSes that have been tested as container hosts. This commit
is added in response to a request made by Josh Durgin on Slack.

Signed-off-by: Zac Dover <zac.dover@proton.me>
11 months agomgr/dashboard: use assertEqual in test_iscsi 58709/head
Kyr Shatskyy [Mon, 22 Jul 2024 07:33:02 +0000 (09:33 +0200)]
mgr/dashboard: use assertEqual in test_iscsi

Python asks in multiple places to use assertEqual instead of
assertEquals:

  DeprecationWarning: Please use assertEqual instead.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
11 months agocrimson/os/seastore/btree: drop unused lines 58367/head
Xuehan Xu [Thu, 18 Jul 2024 13:17:53 +0000 (21:17 +0800)]
crimson/os/seastore/btree: drop unused lines

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
11 months agocrimson/os/seastore/cached_extent: add the "refresh" ability to lba
Xuehan Xu [Mon, 1 Jul 2024 05:58:18 +0000 (13:58 +0800)]
crimson/os/seastore/cached_extent: add the "refresh" ability to lba
mappings

So that we don't have to re-iterate through the whole lba tree to get
a "parent-viewable" mapping in most cases.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
11 months agocrimson/os/seastore: rename PhysicalNodeMapping::is_parent_valid() to
Xuehan Xu [Sun, 30 Jun 2024 09:51:41 +0000 (17:51 +0800)]
crimson/os/seastore: rename PhysicalNodeMapping::is_parent_valid() to
PhysicalNodeMapping::is_parent_viewable()

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
11 months agocrimson/os/seastore/btree: add copy_source->pending links to FixedKVNode
Xuehan Xu [Sat, 29 Jun 2024 13:23:33 +0000 (21:23 +0800)]
crimson/os/seastore/btree: add copy_source->pending links to FixedKVNode

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
11 months agocrimson/os/seastore/cbj: skip crc calculation for cbj header if device supports the... 57782/head
myoungwon oh [Thu, 18 Jul 2024 07:41:05 +0000 (07:41 +0000)]
crimson/os/seastore/cbj: skip crc calculation for cbj header if device supports the checksum offload

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agocrimson/os/seastore: disable crc calculation if end to end data protection is enabled
Myoungwon Oh [Thu, 4 Jul 2024 09:04:38 +0000 (18:04 +0900)]
crimson/os/seastore: disable crc calculation if end to end data protection is enabled

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agocrimson/os/seastore/rbm: add handle_exception() to pass_through_io()
myoungwon oh [Fri, 12 Jul 2024 04:13:13 +0000 (04:13 +0000)]
crimson/os/seastore/rbm: add handle_exception() to pass_through_io()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agocrimson/os/seastore: remove multistream related codes
myoungwon oh [Thu, 13 Jun 2024 06:07:56 +0000 (06:07 +0000)]
crimson/os/seastore: remove multistream related codes

Current codes allow the device to allocate multiple namespace without specific policy
if the nvme device report that it is capable of mutistream functionality.
So, this commit removes the multistream related code, leaving it as a TODO.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agocrimson/os/seastore: add nvme_read and nvme_write to be used when end to end data...
myoungwon oh [Tue, 28 May 2024 10:35:45 +0000 (10:35 +0000)]
crimson/os/seastore: add nvme_read and nvme_write to be used when end to end data protection is enabled

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agocrimson/os/seastore/rbm: turn on end-to-end-data-protection during mkfs if possible
myoungwon oh [Mon, 27 May 2024 09:32:56 +0000 (09:32 +0000)]
crimson/os/seastore/rbm: turn on end-to-end-data-protection during mkfs if possible

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agocrimson/os/seastore: replace rbm_metadata_header_t with rbm_superblock_t
myoungwon oh [Thu, 20 Jun 2024 05:32:15 +0000 (05:32 +0000)]
crimson/os/seastore: replace rbm_metadata_header_t with rbm_superblock_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
11 months agoerasure-code/clay: cleanup unused but set variable count_retrieved_sub_chunks 58703/head
kshtsk [Sun, 21 Jul 2024 11:12:42 +0000 (11:12 +0000)]
erasure-code/clay: cleanup unused but set variable count_retrieved_sub_chunks

Addresses clang 17 error:

/home/rocky/ceph/src/erasure-code/clay/ErasureCodeClay.cc:481:7: error: variable 'count_retrieved_sub_chunks' set but not used [-Werror,-Wunused-but-set-variable]

Signed-off-by: kshtsk <kyrylo.shatskyy@clyso.com>
11 months agoMerge pull request #58452 from Matan-B/wip-matanb-seastar-july7
Matan Breizman [Sun, 21 Jul 2024 11:19:04 +0000 (14:19 +0300)]
Merge pull request #58452 from Matan-B/wip-matanb-seastar-july7

seastar: update submodule

Reviewed-by: Samuel Just <sjust@redhat.com>
11 months agoMerge pull request #58256 from NitzanMordhai/wip-nitzan-wait-osd-admin-command
Matan Breizman [Sun, 21 Jul 2024 10:22:16 +0000 (13:22 +0300)]
Merge pull request #58256 from NitzanMordhai/wip-nitzan-wait-osd-admin-command

crimson/osd: adding osdmap subscribe

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
11 months agoMerge pull request #58700 from kshtsk/wip-fix-unused-in-msg-async-rdma
Kefu Chai [Sun, 21 Jul 2024 08:51:07 +0000 (16:51 +0800)]
Merge pull request #58700 from kshtsk/wip-fix-unused-in-msg-async-rdma

msg/async/rdma: cleanup unused variables

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
12 months agoMerge pull request #58688 from idryomov/wip-67051
Ilya Dryomov [Sun, 21 Jul 2024 07:01:32 +0000 (09:01 +0200)]
Merge pull request #58688 from idryomov/wip-67051

qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Reviewed-by: Mykola Golub <mgolub@suse.com>
12 months agomsg/async/rdma: cleanup unused variables 58700/head
kshtsk [Sat, 20 Jul 2024 23:55:22 +0000 (23:55 +0000)]
msg/async/rdma: cleanup unused variables

Fixes: 2fb8be43fa2a758cc7934f7a82a48ad2d47d1112
Signed-off-by: kshtsk <kyrylo.shatskyy@clyso.com>
12 months agoMerge pull request #58695 from pecastro/correct_mailing_list_instructions
Zac Dover [Sat, 20 Jul 2024 16:57:58 +0000 (02:57 +1000)]
Merge pull request #58695 from pecastro/correct_mailing_list_instructions

doc: Amend dev mailing list subscribe instructions.

Reviewed-by: Zac Dover <zac.dover@proton.me>
12 months agodoc: Amend dev mailing list subscribe instructions. 58695/head
Paulo E. Castro [Sat, 20 Jul 2024 16:32:17 +0000 (17:32 +0100)]
doc: Amend dev mailing list subscribe instructions.

Signed-off-by: Paulo E. Castro <pecastro@wormholenet.com>
12 months agoMerge pull request #58591 from idryomov/wip-aio-completion-prep-for-atomic-wait
Ilya Dryomov [Sat, 20 Jul 2024 09:05:47 +0000 (11:05 +0200)]
Merge pull request #58591 from idryomov/wip-aio-completion-prep-for-atomic-wait

librbd: fix inconsistency between AioCompletion is_complete() and wait_for_complete()

Reviewed-by: N Balachandran <nibalach@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58180 from guojidan/format
Ilya Dryomov [Sat, 20 Jul 2024 09:03:52 +0000 (11:03 +0200)]
Merge pull request #58180 from guojidan/format

rbd: add the validate of the format and clone_format

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
12 months agoqa/workunits/rbd: avoid caching effects in luks-encryption.sh 58688/head
Ilya Dryomov [Fri, 19 Jul 2024 17:35:28 +0000 (19:35 +0200)]
qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Commit 40f6f5224bce ("qa/workunits/rbd: fix issues in
luks-encryption.sh") did the right thing for reads, which solved
most of the issue.  However, it actually made a step in the opposite
direction for writes -- depending on the RBD cache settings, rbd-nbd
virtual devices can behave as physical devices with a volatile write
cache, so fsync is required.

While at it, involving O_DIRECT for reads isn't needed outside of
test_encryption_format().

Fixes: https://tracker.ceph.com/issues/67051
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
12 months agoMerge pull request #52639 from ljflores/wip-tracker-58925
Laura Flores [Fri, 19 Jul 2024 18:18:55 +0000 (13:18 -0500)]
Merge pull request #52639 from ljflores/wip-tracker-58925

qa: suppress Leak_StillReachable mon leak in centos 9 jobs

12 months agoMerge pull request #58671 from zdover23/wip-doc-2024-07-19-start-get-involved
Zac Dover [Fri, 19 Jul 2024 17:10:17 +0000 (03:10 +1000)]
Merge pull request #58671 from zdover23/wip-doc-2024-07-19-start-get-involved

doc/start: update mailing list links

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
12 months agoMerge pull request #58678 from cbodley/wip-doc-cephadm-quay-ci
Zac Dover [Fri, 19 Jul 2024 14:57:01 +0000 (00:57 +1000)]
Merge pull request #58678 from cbodley/wip-doc-cephadm-quay-ci

doc/cephadm/upgrade: ceph-ci containers are hosted at quay.ceph.io

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
12 months agodoc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io 58678/head
Casey Bodley [Fri, 19 Jul 2024 14:10:38 +0000 (10:10 -0400)]
doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

Signed-off-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #57737 from Svelar/asan_rgw_amqp
Yuval Lifshitz [Fri, 19 Jul 2024 13:47:35 +0000 (16:47 +0300)]
Merge pull request #57737 from Svelar/asan_rgw_amqp

rgw/amqp: lock erase and create connection before emplace

12 months agomgr/test_orchestrator: add apply_mds command in the test_orch 58677/head
Nizamudeen A [Fri, 19 Jul 2024 13:44:36 +0000 (19:14 +0530)]
mgr/test_orchestrator: add apply_mds command in the test_orch

so that when we are testing things with test_orchestrator as the orch
back-end and do volume creation, it won't raise the below error
```
2024-07-19T13:40:46.349+0000 7f2d11a00640  0 [test_orchestrator ERROR orchestrator._interface]
Traceback (most recent call last):
  File "/ceph/src/pybind/mgr/orchestrator/_interface.py", line 139, in wrapper
    return OrchResult(f(*args, **kwargs))
  File "/ceph/src/pybind/mgr/orchestrator/_interface.py", line 618, in apply
    return raise_if_exception(reduce(merge, [fns[spec.service_type](spec) for spec in specs], OrchResult([])))
  File "/ceph/src/pybind/mgr/orchestrator/_interface.py", line 618, in <listcomp>
    return raise_if_exception(reduce(merge, [fns[spec.service_type](spec) for spec in specs], OrchResult([])))
  File "/ceph/src/pybind/mgr/orchestrator/_interface.py", line 762, in apply_mds
    raise NotImplementedError()
NotImplementedError
2024-07-19T13:40:46.349+0000 7f2d11a00640  0 [volumes ERROR volumes.fs.fs_util] Failed to create MDS daemons
Traceback (most recent call last):
  File "/ceph/src/pybind/mgr/volumes/fs/fs_util.py", line 55, in create_mds
    orchestrator.raise_if_exception(completion)
  File "/ceph/src/pybind/mgr/orchestrator/_interface.py", line 242, in raise_if_exception
    raise e
NotImplementedError
2024-07-19T13:40:46.350+0000 7f2d11a00640  0 [volumes INFO volumes.module] Finishing _cmd_fs_volume_create(name:foo, placement:1 ) < "None"
2024-07-19T13:40:46.350+0000 7f2d11a00640  0 [dashboard ERROR exception] Internal Server Error
Traceback (most recent call last):
  File "/ceph/src/pybind/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
    return handler(*args, **kwargs)
  File "/usr/lib/python3.9/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/ceph/src/pybind/mgr/dashboard/controllers/_base_controller.py", line 263, in inner
    ret = func(*args, **kwargs)
  File "/ceph/src/pybind/mgr/dashboard/controllers/_rest_controller.py", line 193, in wrapper
    return func(*vpath, **params)
  File "/ceph/src/pybind/mgr/dashboard/controllers/cephfs.py", line 65, in create
    raise RuntimeError(
RuntimeError: Error creating volume foo with placement {'placement': {}, 'unmanaged': False}:
```

Fixes: https://tracker.ceph.com/issues/67044
Signed-off-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58662 from yuvalif/wip-yuval-64690-again
Yuval Lifshitz [Fri, 19 Jul 2024 13:42:39 +0000 (16:42 +0300)]
Merge pull request #58662 from yuvalif/wip-yuval-64690-again

test/rgw/amqp: skip TestAMQP.MaxConnections test

12 months agoMerge pull request #58656 from rhcs-dashboard/rgw-sync-policy-routing-fix
Nizamudeen A [Fri, 19 Jul 2024 13:25:42 +0000 (18:55 +0530)]
Merge pull request #58656 from rhcs-dashboard/rgw-sync-policy-routing-fix

mgr/dashboard: Rgw sync policy routing fix

Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #56331 from rhcs-dashboard/update-mon-stacks
Nizamudeen A [Fri, 19 Jul 2024 07:40:40 +0000 (13:10 +0530)]
Merge pull request #56331 from rhcs-dashboard/update-mon-stacks

mgr/cephadm: bump monitoring stacks versions

12 months agodoc/start: update mailing list links 58671/head
Zac Dover [Fri, 19 Jul 2024 06:44:44 +0000 (16:44 +1000)]
doc/start: update mailing list links

Update the User and Dev mailing list subscription links. This commit is
made in response to a request from Dan van der Ster.

Signed-off-by: Zac Dover <zac.dover@proton.me>
12 months agoMerge pull request #58636 from afreen23/wip-nvmeof-namespace
Nizamudeen A [Fri, 19 Jul 2024 05:59:42 +0000 (11:29 +0530)]
Merge pull request #58636 from afreen23/wip-nvmeof-namespace

mgr/dashboard: Add namespaces views in dashboard

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58519 from smanjara/wip-fix-copy-obj-replication
J. Eric Ivancich [Thu, 18 Jul 2024 20:02:58 +0000 (16:02 -0400)]
Merge pull request #58519 from smanjara/wip-fix-copy-obj-replication

rgw/multisite: don't retain RGW_ATTR_OBJ_REPLICATION_TRACE attr on copy_object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #56937 from Svelar/asan_bluestore_type
Yuri Weinstein [Thu, 18 Jul 2024 19:48:07 +0000 (12:48 -0700)]
Merge pull request #56937 from Svelar/asan_bluestore_type

bluestore/bluestore_types: avoid heap-buffer-overflow in another way to keep code uniformity

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #56352 from ifed01/wip-ifed-many-many-extents-read
Yuri Weinstein [Thu, 18 Jul 2024 19:47:09 +0000 (12:47 -0700)]
Merge pull request #56352 from ifed01/wip-ifed-many-many-extents-read

blk/aio: fix long batch (64+K entries) submission.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
12 months agoMerge pull request #54988 from Matan-B/wip-matanb-mapgap-fix
Yuri Weinstein [Thu, 18 Jul 2024 19:46:36 +0000 (12:46 -0700)]
Merge pull request #54988 from Matan-B/wip-matanb-mapgap-fix

osd/OSD: rewrite track_pools_and_pg_num_changes logic

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agoqa: suppress Leak_StillReachable mon leaks 52639/head
Laura Flores [Thu, 18 Jul 2024 15:52:58 +0000 (10:52 -0500)]
qa: suppress Leak_StillReachable mon leaks

These leaks came about when we changed the distro
from centos 8 to centos 9.

Fixes: https://tracker.ceph.com/issues/61774
Signed-off-by: Laura Flores <lflores@ibm.com>
12 months agorgw/iam: CreateRole ignores EEXIST after forwarded request 58665/head
Casey Bodley [Thu, 18 Jul 2024 13:48:40 +0000 (09:48 -0400)]
rgw/iam: CreateRole ignores EEXIST after forwarded request

when issued against a secondary zone in multisite, the CreateRole
request is first forwarded to the metadata master zone and created there

once that forwarded request succeeds, the secondary zone creates the
same role. between these two events, metadata sync may race to replicate
that role from the master. this causes the local role creation to fail
with EEXIST

ignore EEXIST errors from local role creation if we know that our
forwarded request succeeded

Fixes: https://tracker.ceph.com/issues/67012
Signed-off-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #57817 from phlogistonjohn/jjm-smb-sqlite
Adam King [Thu, 18 Jul 2024 14:58:16 +0000 (10:58 -0400)]
Merge pull request #57817 from phlogistonjohn/jjm-smb-sqlite

mgr/smb: add sqlite internal store backend for smb mgr module

Reviewed-by: Adam King <adking@redhat.com>
12 months agoMerge pull request #58518 from anoopcs9/smb-mgr-updates
Adam King [Thu, 18 Jul 2024 14:56:11 +0000 (10:56 -0400)]
Merge pull request #58518 from anoopcs9/smb-mgr-updates

mgr/smb: improvements to smb mgr module and docs

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agomgr/dashboard: Add namespaces views in dashboard 58636/head
Afreen Misbah [Tue, 16 Jul 2024 07:03:26 +0000 (12:33 +0530)]
mgr/dashboard: Add namespaces views in dashboard

Fixes https://tracker.ceph.com/issues/66990

- list namespaces
- create namespaces
- edit namespaces
- delete namespaces
- update NQN regex

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
12 months agoMerge pull request #58644 from rhcs-dashboard/fix-66994-main
Ankush Behl [Thu, 18 Jul 2024 13:24:29 +0000 (18:54 +0530)]
Merge pull request #58644 from rhcs-dashboard/fix-66994-main

mgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview grafana dashboard

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agoMerge pull request #58649 from cbodley/wip-64173
Casey Bodley [Thu, 18 Jul 2024 13:00:09 +0000 (14:00 +0100)]
Merge pull request #58649 from cbodley/wip-64173

rgw/rados: set_attrs() falls back to existing attrs for index update

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
12 months agomgr/dashboard: rgw sync policy routing fixes 58656/head
Naman Munet [Wed, 17 Jul 2024 10:04:55 +0000 (15:34 +0530)]
mgr/dashboard: rgw sync policy routing fixes

Fixes: https://tracker.ceph.com/issues/66977
Signed-off-by: Naman Munet <nmunet@redhat.com>
12 months agoMerge pull request #58173 from ronen-fr/wip-rf-targets-j13
Ronen Friedman [Thu, 18 Jul 2024 11:15:04 +0000 (14:15 +0300)]
Merge pull request #58173 from ronen-fr/wip-rf-targets-j13

osd/scrub: no shared scrub-job ownership between PGs and the scrub queue

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agotest/rgw/amqp: skip TestAMQP.MaxConnections test 58662/head
Yuval Lifshitz [Thu, 18 Jul 2024 11:11:25 +0000 (11:11 +0000)]
test/rgw/amqp: skip TestAMQP.MaxConnections test

not really a fix, mainly a workaround until we do
the amqp refactoring: https://tracker.ceph.com/issues/67011

Fixes: https://tracker.ceph.com/issues/64690
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
12 months agoMerge pull request #58555 from rhcs-dashboard/rgw-multisite-sync-pipe
Pedro Gonzalez Gomez [Thu, 18 Jul 2024 10:32:10 +0000 (12:32 +0200)]
Merge pull request #58555 from rhcs-dashboard/rgw-multisite-sync-pipe

 mgr/dashboard: RGW multisite sync pipe

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agoMerge pull request #58648 from afreen23/wip-nvmeof-listener
Nizamudeen A [Thu, 18 Jul 2024 06:48:09 +0000 (12:18 +0530)]
Merge pull request #58648 from afreen23/wip-nvmeof-listener

Allow listeners creation and deletion

Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58551 from xxhdx1985126/wip-66924
Yingxin [Thu, 18 Jul 2024 06:09:54 +0000 (14:09 +0800)]
Merge pull request #58551 from xxhdx1985126/wip-66924

crimson/os/seastore/transaction_manager: consider inconsistency between backrefs and lbas acceptable when cleaning segments

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
12 months agoMerge pull request #58441 from rhcs-dashboard/add-nfs-export-route
Ankush Behl [Thu, 18 Jul 2024 05:49:59 +0000 (11:19 +0530)]
Merge pull request #58441 from rhcs-dashboard/add-nfs-export-route

mgr/dashboard: add NFS export button for subvolume/ grp

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agodoc/cephfs: streamline a paragraph 58524/head
Zac Dover [Wed, 10 Jul 2024 23:15:38 +0000 (09:15 +1000)]
doc/cephfs: streamline a paragraph

Streamline a paragraph in doc/cephfs/index.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
12 months agoMerge pull request #57591 from aclamk/wip-aclamk-denc-compat-check
Radoslaw Zarzynski [Wed, 17 Jul 2024 23:52:42 +0000 (01:52 +0200)]
Merge pull request #57591 from aclamk/wip-aclamk-denc-compat-check

common, os/bluestore: Fix lack of checking for compat on DENC_START

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agomgr/dashboard: Create and delete listeners 58648/head
Afreen Misbah [Wed, 17 Jul 2024 10:16:23 +0000 (15:46 +0530)]
mgr/dashboard: Create and delete listeners

Fixes https://tracker.ceph.com/issues/66996

- list listener under subsystems
- delete listener
- create listener

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
12 months agomgr/dashboard: RGW multisite sync pipe 58555/head
Naman Munet [Thu, 11 Jul 2024 18:40:51 +0000 (00:10 +0530)]
mgr/dashboard: RGW multisite sync pipe

Fixes: https://tracker.ceph.com/issues/66926
Signed-off-by: Naman Munet <nmunet@redhat.com>
12 months agorgw/rados: set_attrs() falls back to existing attrs for index update 58649/head
Casey Bodley [Wed, 17 Jul 2024 14:28:08 +0000 (10:28 -0400)]
rgw/rados: set_attrs() falls back to existing attrs for index update

set_attrs() needs the ACLOwner, etag, content-type and storage class for
the bucket index update. if those attrs aren't being updated, consult
their existing attrs in state->attrset

Fixes: https://tracker.ceph.com/issues/64173
Signed-off-by: Casey Bodley <cbodley@redhat.com>
12 months agomgr/dashboard: add NFS export route from subvolume/subvolume grp 58441/head
Avan Thakkar [Fri, 5 Jul 2024 09:29:13 +0000 (14:59 +0530)]
mgr/dashboard: add NFS export route from subvolume/subvolume grp

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
12 months agomgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview... 58644/head
Aashish Sharma [Wed, 17 Jul 2024 09:07:49 +0000 (14:37 +0530)]
mgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview grafana dashboard

Fixes: https://tracker.ceph.com/issues/66994
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
12 months agoMerge pull request #57722 from sajibreadd/wip-62500
Adam Kupczyk [Wed, 17 Jul 2024 09:57:45 +0000 (11:57 +0200)]
Merge pull request #57722 from sajibreadd/wip-62500

os/bluestore: Warning added for slow operations and stalled read

12 months agolibrbd: get rid of AIO_STATE_CALLBACK in AioCompletion 58591/head
Ilya Dryomov [Mon, 15 Jul 2024 09:39:11 +0000 (11:39 +0200)]
librbd: get rid of AIO_STATE_CALLBACK in AioCompletion

After commit 002afa0fe375 ("librbd: avoid using lock within AIO
completion where possible"), the only method whose behavior would
change if AIO_STATE_CALLBACK is removed is is_complete() and it
actually needs fixing anyway: because of state != AIO_STATE_PENDING
test, is_complete() returns true both for AIO_STATE_CALLBACK and
AIO_STATE_COMPLETE, while wait_for_complete() still blocks on
AIO_STATE_CALLBACK and returns only on AIO_STATE_COMPLETE.  These
methods back public APIs, so this inconsistency is exposed to users.

If we move to setting state to AIO_STATE_COMPLETE at the top of
mark_complete_and_notify() (i.e. before event socket notification), the
transient state for callbacks can be eliminated entirely and the
inconsistency goes away.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
12 months agoMerge pull request #58571 from zdover23/wip-doc-2024-07-13-cephfs-mount-using-fuse
Zac Dover [Wed, 17 Jul 2024 07:24:43 +0000 (17:24 +1000)]
Merge pull request #58571 from zdover23/wip-doc-2024-07-13-cephfs-mount-using-fuse

doc/cephfs: improve mount-using-fuse

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agodoc/cephfs: improve mount-using-fuse 58571/head
Zac Dover [Sat, 13 Jul 2024 00:32:31 +0000 (10:32 +1000)]
doc/cephfs: improve mount-using-fuse

Improve the first twenty percent of doc/cephfs/mount-using-fuse.rst.
This commit changes the text so that it is clearer that FUSE is an
alternative to mounting CephFS with the kernel driver. This commit also
links to the kernel driver page from the "FUSE-mount" page.

Signed-off-by: Zac Dover <zac.dover@proton.me>
12 months agocrimson/os/seastore/transaction_manager: consider inconsistency between 58551/head
Xuehan Xu [Fri, 12 Jul 2024 10:14:53 +0000 (18:14 +0800)]
crimson/os/seastore/transaction_manager: consider inconsistency between
backrefs and lbas acceptable when cleaning segments

Consider the following scene:
1. Trans.A writes the final record of Segment S, in which it overwrite
   another extent E in the same segment S;
2. Before Trans.A "complete_commit", Trans.B tries to rewrite new
   records and roll the segments, which closes Segment S;
3. Before Trans.A "complete_commit", a new cleaner Transaction C tries
   to clean the segment;

In this scenario, C might see a part of extent E's laddr space mapped
to another location within the same segment S. This is actually a valid
case.

Fixes: https://tracker.ceph.com/issues/66924
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>