]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 months agorgw/notification: Support generating multisite sync delete events. 55795/head
kchheda3 [Tue, 27 Feb 2024 20:11:48 +0000 (15:11 -0500)]
rgw/notification: Support generating multisite sync delete events.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agorgw/notification: Make the Replication events to be aws compatible.
kchheda3 [Tue, 27 Feb 2024 19:24:43 +0000 (14:24 -0500)]
rgw/notification: Make the Replication events to be aws compatible.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agorgw/notification: Make the Lifecycle events AWS compatible
kchheda3 [Tue, 27 Feb 2024 19:06:47 +0000 (14:06 -0500)]
rgw/notification: Make the Lifecycle events AWS compatible

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agoMerge pull request #56077 from idryomov/wip-rbd-mirror-bash
Ilya Dryomov [Mon, 11 Mar 2024 17:19:36 +0000 (18:19 +0100)]
Merge pull request #56077 from idryomov/wip-rbd-mirror-bash

qa/workunits/rbd: switch rbd-mirror workunits to bash

16 months agoMerge pull request #56113 from anthonyeleven/moar-improvements
Anthony D'Atri [Mon, 11 Mar 2024 16:17:48 +0000 (12:17 -0400)]
Merge pull request #56113 from anthonyeleven/moar-improvements

doc/cephadm: Improve multiple files

16 months agoMerge pull request #56003 from prazumovsky/wip-63684-reef
Casey Bodley [Mon, 11 Mar 2024 15:32:45 +0000 (15:32 +0000)]
Merge pull request #56003 from prazumovsky/wip-63684-reef

RGW - Swift retarget needs bucket set on object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #55972 from ceph/wip-yuriw-release-18.2.2-main
Yuri Weinstein [Mon, 11 Mar 2024 15:05:56 +0000 (08:05 -0700)]
Merge pull request #55972 from ceph/wip-yuriw-release-18.2.2-main

doc: reef 18.2.2 release notes

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
16 months agoMerge pull request #55708 from Matan-B/wip-matanb-crimson-multicore-cluster-msgr
Matan Breizman [Mon, 11 Mar 2024 14:25:15 +0000 (16:25 +0200)]
Merge pull request #55708 from Matan-B/wip-matanb-crimson-multicore-cluster-msgr

crimson/osd/main: Enable multicore cluster messenger

Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
16 months agoMerge pull request #55866 from afreen23/fix-rgw-locking
Pedro Gonzalez Gomez [Mon, 11 Mar 2024 13:29:33 +0000 (14:29 +0100)]
Merge pull request #55866 from afreen23/fix-rgw-locking

mgr/dashboard: Locking improvements in bucket create form

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agodoc/cephadm: Improve multiple files 56113/head
Anthony D'Atri [Mon, 11 Mar 2024 07:04:47 +0000 (03:04 -0400)]
doc/cephadm: Improve multiple files

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
16 months agoMerge pull request #55920 from rhcs-dashboard/pytest-fix
Ernesto Puerta [Mon, 11 Mar 2024 10:20:26 +0000 (11:20 +0100)]
Merge pull request #55920 from rhcs-dashboard/pytest-fix

mgr/dashboard: debugging make check failure

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ronen-fr <NOT@FOUND>
Reviewed-by: Kefu Chai <kchai@redhat.com>
16 months agoMerge pull request #56063 from ivoalmeida/fix-snap-schedule-list-toggle-columns
Ivo Almeida [Mon, 11 Mar 2024 09:21:44 +0000 (09:21 +0000)]
Merge pull request #56063 from ivoalmeida/fix-snap-schedule-list-toggle-columns

mgr/dashboard: fix snap schedule list toggle cols

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
16 months agoMerge pull request #56091 from anthonyeleven/aad-tweak-cephadm
Anthony D'Atri [Mon, 11 Mar 2024 04:05:07 +0000 (00:05 -0400)]
Merge pull request #56091 from anthonyeleven/aad-tweak-cephadm

doc/cephadm: improve host-management.rst

16 months agodoc/cephadm: improve host-management.rst 56091/head
Anthony D'Atri [Sun, 10 Mar 2024 19:49:35 +0000 (15:49 -0400)]
doc/cephadm: improve host-management.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
16 months agoqa/workunits/rbd: switch rbd-mirror workunits to bash 56077/head
Ilya Dryomov [Sat, 9 Mar 2024 21:53:44 +0000 (22:53 +0100)]
qa/workunits/rbd: switch rbd-mirror workunits to bash

By making use of here strings in commit ea3a567f7f03 ("qa/workunits:
make wait_for_status_in_pool_dir() reentrant") we grew a dependency on
bash.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
16 months agoMerge pull request #56076 from zdover23/wip-doc-2024-03-10-glossary-crimson
Anthony D'Atri [Sun, 10 Mar 2024 16:01:43 +0000 (12:01 -0400)]
Merge pull request #56076 from zdover23/wip-doc-2024-03-10-glossary-crimson

doc/glossary: improve "Crimson" entry

16 months agocrimson/osd/osd: handle_scrub_message on any core 55708/head
Matan Breizman [Thu, 7 Mar 2024 09:49:34 +0000 (09:49 +0000)]
crimson/osd/osd: handle_scrub_message on any core

After enabling multicore cluster messenger, there is no
guarantee which core will handle the request.
See: OSDSingletonState::send_to_osd()

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
16 months agodoc/glossary: improve "Crimson" entry 56076/head
Zac Dover [Sun, 10 Mar 2024 10:43:52 +0000 (20:43 +1000)]
doc/glossary: improve "Crimson" entry

Improve the glossary entry for "Crimson" in accordance with Anthony
D'Atri's suggestions here:
https://github.com/ceph/ceph/pull/56068#discussion_r1518580402

Signed-off-by: Zac Dover <zac.dover@proton.me>
16 months agoMerge pull request #56068 from zdover23/wip-doc-2024-03-09-glossary-crimson
zdover23 [Sat, 9 Mar 2024 12:47:08 +0000 (22:47 +1000)]
Merge pull request #56068 from zdover23/wip-doc-2024-03-09-glossary-crimson

doc/glossary: add "Crimson" entry

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
16 months agodoc/glossary: add "Crimson" entry 56068/head
Zac Dover [Fri, 8 Mar 2024 17:17:59 +0000 (03:17 +1000)]
doc/glossary: add "Crimson" entry

Add a "Crimson" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
16 months agoMerge PR #56071 into main
Patrick Donnelly [Fri, 8 Mar 2024 23:13:27 +0000 (18:13 -0500)]
Merge PR #56071 into main

* refs/pull/56071/head:
qa: fix syntax bug with invalid 60 minute specification

Reviewed-by: Zack Cerza <zack@redhat.com>
16 months agoqa: fix syntax bug with invalid 60 minute specification 56071/head
Patrick Donnelly [Fri, 8 Mar 2024 19:39:17 +0000 (14:39 -0500)]
qa: fix syntax bug with invalid 60 minute specification

Use 8 minute cycles instead.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
16 months agoMerge pull request #55657 from ceph/wip-rgw-meta-topic wip-rgw-meta-topic
Casey Bodley [Fri, 8 Mar 2024 18:10:34 +0000 (18:10 +0000)]
Merge pull request #55657 from ceph/wip-rgw-meta-topic

rgw: replicate v2 topic/notification metadata

Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
16 months agoMerge pull request #56006 from afreen23/http-error-pools-page
Pedro Gonzalez Gomez [Fri, 8 Mar 2024 13:14:12 +0000 (14:14 +0100)]
Merge pull request #56006 from afreen23/http-error-pools-page

mgr/dashboard: handle infinite values for pools

16 months agomgr/dashboard: fix snap schedule list toggle cols 56063/head
Ivo Almeida [Fri, 8 Mar 2024 11:40:41 +0000 (11:40 +0000)]
mgr/dashboard: fix snap schedule list toggle cols

Added isInvisible property to CdColumnTable interface to hide column
from 'toggle columns' drop down checkboxes.

Fixes: https://tracker.ceph.com/issues/64813
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
16 months agoMerge pull request #55984 from xxhdx1985126/wip-rbd-cls-sparsify-test
Ilya Dryomov [Fri, 8 Mar 2024 11:26:13 +0000 (12:26 +0100)]
Merge pull request #55984 from xxhdx1985126/wip-rbd-cls-sparsify-test

test/cls_rbd/test_cls_rbd: change to check for 4KB-aligned sparse read

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
16 months agomgr/dashboard: handle infinite values for pools 56006/head
Afreen [Wed, 6 Mar 2024 20:22:16 +0000 (01:52 +0530)]
mgr/dashboard: handle infinite values for pools

Fixes https://tracker.ceph.com/issues/64724

Issue:
======
Json parsing is failing because of Infinity values present in pools
meteadata. "read_balance": {"score_acting": Infinity, "score_stable":
Infinity,}
Due to this entire pool list is not rendered.

Fix:
====
Added a handler for checking "inf" values and replacing them with a
string "Infinity" so that json parsing does not fail on frontend.

Signed-off-by: Afreen <afreen23.git@gmail.com>
16 months agoMerge pull request #56045 from zdover23/wip-doc-2024-03-07-pgcalc
zdover23 [Fri, 8 Mar 2024 08:42:19 +0000 (18:42 +1000)]
Merge pull request #56045 from zdover23/wip-doc-2024-03-07-pgcalc

doc/rados: restore PGcalc tool

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agoMerge pull request #55981 from xxhdx1985126/wip-64728
Yingxin [Fri, 8 Mar 2024 07:57:54 +0000 (15:57 +0800)]
Merge pull request #55981 from xxhdx1985126/wip-64728

crimson/os/seastore/collection_manager: allow empty-delta-buffer collection nodes

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
16 months agoMerge pull request #55888 from myoungwon/wip-seastore-cleanup-is-stable-fix
Yingxin [Fri, 8 Mar 2024 07:56:49 +0000 (15:56 +0800)]
Merge pull request #55888 from myoungwon/wip-seastore-cleanup-is-stable-fix

crimson/os/seastore: cleanup and use LBAMapping::is_stable()

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
16 months agomgr/dashboard: Locking improvements in bucket create form 55866/head
Afreen [Fri, 1 Mar 2024 07:26:25 +0000 (12:56 +0530)]
mgr/dashboard: Locking improvements in bucket create form

Fixes https://tracker.ceph.com/issues/64658
- Addition of help texts
- Addition of info/warnings related to modes and versioning
- change of Locking section layout
- renaming locking to 'Object Locking'
- changes default retention period to 10
- edit bucket only shows lock when its enabled

Signed-off-by: Afreen <afreen23.git@gmail.com>
16 months agodoc/rados: restore PGcalc tool 56045/head
Zac Dover [Thu, 7 Mar 2024 17:29:50 +0000 (03:29 +1000)]
doc/rados: restore PGcalc tool

Restore the PGcalc tool to the documentation suite.

Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
16 months agoMerge pull request #55652 from clwluvw/rgw-blockaccesspublic
Casey Bodley [Thu, 7 Mar 2024 16:02:39 +0000 (16:02 +0000)]
Merge pull request #55652 from clwluvw/rgw-blockaccesspublic

rgw: compatibility issues on BucketPublicAccessBlock

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #56010 from zdover23/wip-doc-2024-03-07-start-get-involved
Anthony D'Atri [Thu, 7 Mar 2024 15:31:55 +0000 (10:31 -0500)]
Merge pull request #56010 from zdover23/wip-doc-2024-03-07-start-get-involved

doc/start: add Slack invite link

16 months agoMerge pull request #55390 from qiuxinyidian/rgw-admin
Casey Bodley [Thu, 7 Mar 2024 15:12:07 +0000 (15:12 +0000)]
Merge pull request #55390 from qiuxinyidian/rgw-admin

rgw: add help info for radosgw-admin list object in bucket

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
16 months agoMerge pull request #56027 from Matan-B/wip-matanb-crimson-docs-walkthrough
Matan Breizman [Thu, 7 Mar 2024 13:29:29 +0000 (15:29 +0200)]
Merge pull request #56027 from Matan-B/wip-matanb-crimson-docs-walkthrough

doc/dev/crimson: add Code Walkthroughs

Reviewed-by: Rongqi Sun <sunrongqi@huawei.com>
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
16 months agoMerge pull request #55226 from rhcs-dashboard/fix-64080-main
Pedro Gonzalez Gomez [Thu, 7 Mar 2024 13:06:38 +0000 (14:06 +0100)]
Merge pull request #55226 from rhcs-dashboard/fix-64080-main

mgr/dashboard: Allow the user to add the access/secret key on zone edit and not on zone creation

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agodoc/dev/crimson: add Code Walkthroughs 56027/head
Matan Breizman [Thu, 7 Mar 2024 09:14:03 +0000 (09:14 +0000)]
doc/dev/crimson: add Code Walkthroughs

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
16 months agocrimson/os/seastore/collection_manager: allow empty-delta-buffer 55981/head
Xuehan Xu [Wed, 6 Mar 2024 05:49:43 +0000 (13:49 +0800)]
crimson/os/seastore/collection_manager: allow empty-delta-buffer
collection nodes

Fixes: https://tracker.ceph.com/issues/64728
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
16 months agoMerge pull request #55804 from rhcs-dashboard/nvmf-traddr-fix
Nizamudeen A [Thu, 7 Mar 2024 05:27:17 +0000 (10:57 +0530)]
Merge pull request #55804 from rhcs-dashboard/nvmf-traddr-fix

mgr/dashboard: listener addr is always none

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
16 months agoMerge pull request #55995 from zdover23/wip-doc-2024-03-06-architecture
zdover23 [Thu, 7 Mar 2024 03:17:53 +0000 (13:17 +1000)]
Merge pull request #55995 from zdover23/wip-doc-2024-03-06-architecture

doc/architecture: correct typo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agodoc/start: add Slack invite link 56010/head
Zac Dover [Thu, 7 Mar 2024 03:01:47 +0000 (13:01 +1000)]
doc/start: add Slack invite link

Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.

Signed-off-by: Zac Dover <zac.dover@proton.me>
16 months agotest/cls_rbd/test_cls_rbd: change to check for 4KB-aligned sparse read 55984/head
Xuehan Xu [Wed, 6 Mar 2024 07:42:58 +0000 (15:42 +0800)]
test/cls_rbd/test_cls_rbd: change to check for 4KB-aligned sparse read

SeaStore::fiemap() can only supported 4096-aligned sparse read.

Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
16 months agoMerge pull request #55967 from mkogan1/wip-rgw-ssl-ses-id-reuse
J. Eric Ivancich [Thu, 7 Mar 2024 01:53:13 +0000 (20:53 -0500)]
Merge pull request #55967 from mkogan1/wip-rgw-ssl-ses-id-reuse

rgw/beast: Enable SSL session-id reuse speedup mechanism

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #55895 from linuxbox2/wip-sigv4-boundary
J. Eric Ivancich [Thu, 7 Mar 2024 01:52:59 +0000 (20:52 -0500)]
Merge pull request #55895 from linuxbox2/wip-sigv4-boundary

rgw_sigv4: handle '0;' as trailer-chunk boundary

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #55885 from ivancich/wip-enhance-restore-bi
J. Eric Ivancich [Thu, 7 Mar 2024 01:52:31 +0000 (20:52 -0500)]
Merge pull request #55885 from ivancich/wip-enhance-restore-bi

rgw: make rgw-restore-bucket-index more robust

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
16 months agoMerge pull request #55977 from myoungwon/wip-allow-dirty-remap
Yingxin [Thu, 7 Mar 2024 01:39:02 +0000 (09:39 +0800)]
Merge pull request #55977 from myoungwon/wip-allow-dirty-remap

crimson/os/seastore: allow to remap the dirty extent

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
16 months agoMerge PR #55909 into main
Venky Shankar [Thu, 7 Mar 2024 01:36:39 +0000 (07:06 +0530)]
Merge PR #55909 into main

* refs/pull/55909/head:
qa/cephfs: add `MON_DOWN' and `deprecated feature inline_data' to ignorelist

Reviewed-by: Rishabh Dave <ridave@redhat.com>
16 months agoMerge PR #55908 into main
Venky Shankar [Thu, 7 Mar 2024 01:35:20 +0000 (07:05 +0530)]
Merge PR #55908 into main

* refs/pull/55908/head:
qa: ignore container checkpoint/restore related selinux denials for centos9
qa: use allowlist instead of whitelist for selinux denials

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
16 months agoMerge PR #55639 into main
Venky Shankar [Thu, 7 Mar 2024 01:33:51 +0000 (07:03 +0530)]
Merge PR #55639 into main

* refs/pull/55639/head:
mds: relax certain asserts in mdlog replay thread

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
16 months agoMerge pull request #56000 from cbodley/wip-64678
Casey Bodley [Wed, 6 Mar 2024 21:07:11 +0000 (21:07 +0000)]
Merge pull request #56000 from cbodley/wip-64678

rpm: disable system_qat for non-x86_64 arch

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
16 months agoRGW - Swift retarget needs bucket set on object 56003/head
Daniel Gryniewicz [Thu, 16 Jun 2022 15:46:24 +0000 (11:46 -0400)]
RGW - Swift retarget needs bucket set on object

When a bucket list is retargeted to an object get, then the object may
not yet have it's bucket set.  Ensure the bucket is set on the object.

Fixes: https://tracker.ceph.com/issues/56029
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
16 months agorpm: disable system_qat for non-x86_64 arch 56000/head
Casey Bodley [Wed, 6 Mar 2024 14:25:18 +0000 (09:25 -0500)]
rpm: disable system_qat for non-x86_64 arch

Fixes: https://tracker.ceph.com/issues/64678
Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge PR #55820 into main
Patrick Donnelly [Wed, 6 Mar 2024 13:58:43 +0000 (08:58 -0500)]
Merge PR #55820 into main

* refs/pull/55820/head:
qa/crontab: bring back nightlies of release branches
qa/crontab: update upgrade runs for squid/main
qa/crontab: update reef upgrade tests
qa/crontab: update quincy upgrade tests
qa/crontab: remove EOL branches
qa/crontab: add spacing
qa/crontab: update smoke tests for releases

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
16 months agoMerge pull request #55955 from guits/node-proxy-fixes-7.1-blockers-1
Adam King [Wed, 6 Mar 2024 13:37:45 +0000 (08:37 -0500)]
Merge pull request #55955 from guits/node-proxy-fixes-7.1-blockers-1

mgr/node-proxy: handle 'None' statuses returned by RedFish

Reviewed-by: Adam King <adking@redhat.com>
16 months agoMerge pull request #55536 from Matan-B/wip-crimson-snapmapper-get_next
Matan Breizman [Wed, 6 Mar 2024 13:19:40 +0000 (15:19 +0200)]
Merge pull request #55536 from Matan-B/wip-crimson-snapmapper-get_next

osd/SnapMapper: Crimson - fix OSDriver::get_next

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
16 months agorgw: add help info for radosgw-admin list object in bucket 55390/head
Zhipeng Li [Wed, 31 Jan 2024 08:59:58 +0000 (16:59 +0800)]
rgw: add help info for radosgw-admin list object in bucket
Fixes:https://tracker.ceph.com/issues/64264

Signed-off-by: Zhipeng Li <qiuxinyidian@gmail.com>
16 months agodoc/architecture: correct typo 55995/head
Zac Dover [Wed, 6 Mar 2024 11:40:10 +0000 (21:40 +1000)]
doc/architecture: correct typo

s/client/clients/ where necessary, and add a link to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
16 months agoMerge pull request #55982 from zdover23/wip-doc-2024-03-06-dev-developer-guide-testin...
Anthony D'Atri [Wed, 6 Mar 2024 10:51:46 +0000 (05:51 -0500)]
Merge pull request #55982 from zdover23/wip-doc-2024-03-06-dev-developer-guide-testing-integration-tests-workflow

doc/dev: edit teuthology workflow

16 months agoqa/cephfs: add `MON_DOWN' and `deprecated feature inline_data' to ignorelist 55909/head
Venky Shankar [Mon, 26 Feb 2024 05:42:07 +0000 (11:12 +0530)]
qa/cephfs: add `MON_DOWN' and `deprecated feature inline_data' to ignorelist

Fixes: http://tracker.ceph.com/issues/64746
Signed-off-by: Venky Shankar <vshankar@redhat.com>
16 months agoqa: ignore container checkpoint/restore related selinux denials for centos9 55908/head
Venky Shankar [Mon, 4 Mar 2024 01:15:11 +0000 (06:45 +0530)]
qa: ignore container checkpoint/restore related selinux denials for centos9

Fixes: http://tracker.ceph.com/issues/64616
Signed-off-by: Venky Shankar <vshankar@redhat.com>
16 months agoqa: use allowlist instead of whitelist for selinux denials
Venky Shankar [Mon, 4 Mar 2024 01:09:06 +0000 (06:39 +0530)]
qa: use allowlist instead of whitelist for selinux denials

https://github.com/ceph/teuthology/pull/1757 introduced this change,
however, qa/distros continued to use `whitelist' keyword.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
16 months agomgr/node-proxy: handle 'None' statuses returned by RedFish 55955/head
Guillaume Abrioux [Tue, 5 Mar 2024 10:05:18 +0000 (10:05 +0000)]
mgr/node-proxy: handle 'None' statuses returned by RedFish

Looks like RedFish might return 'None' values for some attributes.

for instance:

```
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/AHCI.SL.6-1/Drives/Disk.Direct.0-0:AHCI.SL.6-1 -H "X-Auth-Token: 3264251c28191fa5e7c9ebec49ef90fc"  | jq .Status
{
  "Health": "OK",
  "HealthRollup": "OK",
  "State": "Enabled"
}
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/NonRAID.Slot.2-1/Drives/Disk.Bay.0:Enclosure.Internal.0-1:NonRAID.Slot.2-1 -H "X-Auth-Token: 3264251c28191fa5e7c9ebec49ef90fc" | jq .Status
{
  "Health": null,
  "HealthRollup": null,
  "State": "Enabled"
}
[root@ceph-node-01 ~]#
```

Although this seems to be a bug from RedFish, we need to handle
the case when it happens otherwise it makes the mgr orchestrator module
throw an error.

The idea here is to create a new status "unknown" when we can't fetch the
real status of a component.

Fixes: https://tracker.ceph.com/issues/64712
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
16 months agoMerge pull request #52267 from xxhdx1985126/wip-crimson-pg-snapmapper-obj
Matan Breizman [Wed, 6 Mar 2024 09:00:59 +0000 (11:00 +0200)]
Merge pull request #52267 from xxhdx1985126/wip-crimson-pg-snapmapper-obj

crimson/osd: put snapmapper's key-value pairs into dedicated objs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
16 months agoMerge pull request #55910 from zhscn/fix-int-string
Matan Breizman [Wed, 6 Mar 2024 08:56:13 +0000 (10:56 +0200)]
Merge pull request #55910 from zhscn/fix-int-string

osd/SnapManager: Crimson - fix std::string constructed from 0

Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
16 months agoMerge pull request #55801 from xxhdx1985126/wip-counting-semaphore
Matan Breizman [Wed, 6 Mar 2024 08:54:49 +0000 (10:54 +0200)]
Merge pull request #55801 from xxhdx1985126/wip-counting-semaphore

crimson/os/alienstore: use homebrew counting_semaphore

Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>
16 months agoMerge PR #54202 into main
Venky Shankar [Wed, 6 Mar 2024 08:44:22 +0000 (14:14 +0530)]
Merge PR #54202 into main

* refs/pull/54202/head:
mds: fix `dump dir` indicate dir is not cached

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
16 months agoMerge PR #55457 into main
Venky Shankar [Wed, 6 Mar 2024 08:41:12 +0000 (14:11 +0530)]
Merge PR #55457 into main

* refs/pull/55457/head:
client: check for bad file handle in low level I/O APIs
client: check for bad file handle in ll_preadv_pwritev
client: add function to check if file handle exists
src/test: test async I/O with invalid/closed file handle

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge PR #55619 into main
Venky Shankar [Wed, 6 Mar 2024 08:39:23 +0000 (14:09 +0530)]
Merge PR #55619 into main

* refs/pull/55619/head:
client: fix leak of file handles

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
16 months agomgr/dashboard: Allow the user to add the access/secret key on zone edit 55226/head
Aashish Sharma [Thu, 18 Jan 2024 06:44:42 +0000 (12:14 +0530)]
mgr/dashboard: Allow the user to add the access/secret key on zone edit
and not on zone creation

Fixes: https://tracker.ceph.com/issues/64080
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
16 months agodoc/dev: edit teuthology workflow 55982/head
Zac Dover [Wed, 6 Mar 2024 07:15:20 +0000 (17:15 +1000)]
doc/dev: edit teuthology workflow

Improve a couple of sentences in
doc/dev/developer_guide_testing_integration_tests/tests-integration-testing-teutology-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
16 months agoMerge pull request #55954 from ivoalmeida/fix-cephfs-attach-command
Nizamudeen A [Wed, 6 Mar 2024 06:41:30 +0000 (12:11 +0530)]
Merge pull request #55954 from ivoalmeida/fix-cephfs-attach-command

mgr/dashboard: fixed cephfs mount command

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #54964 from rhcs-dashboard/add-prometheus-federation-cli
Nizamudeen A [Wed, 6 Mar 2024 06:29:08 +0000 (11:59 +0530)]
Merge pull request #54964 from rhcs-dashboard/add-prometheus-federation-cli

mgr/dashboard: add prometheus federation config for mullti-cluster monitoring

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: frittentheke <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/dashboard: fix nvmeof api documentation 55804/head
Nizamudeen A [Tue, 5 Mar 2024 10:39:25 +0000 (16:09 +0530)]
mgr/dashboard: fix nvmeof api documentation

From Aviv:
POST /api/nvmeof/hosts - the description of the command it wrong IMO. It is not about creating a host. It is about allowing a host X to access subsystem Y.
GET /api/nvmeof/hosts/{subsystem_nqn} - also the description is not accurate. The command lists all hosts that are allowed to access this subsystem.
DELETE /api/nvmeof/hosts/{subsystem_nqn}/{host_nqn} - again the description should be changed as above.
POST /api/nvmeof/namespace - bad formatting of the description
GET /api/nvmeof/subsystem - the description is wrong, should say - "List all NVMeoF subsystems". And it shouldn't get any param.
POST /api/nvmeof/subsystem - few issues here. The serial_number, and max_namespaces are optional (we need to mention that). Also it is missing the --enable-ha argument that is also optional.
Some commands are missing: log_level, connection.i

Fixes: https://tracker.ceph.com/issues/64714
Signed-off-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #55574 from ceph/feature-multi-cluster-management-monitoring
Nizamudeen A [Wed, 6 Mar 2024 04:56:29 +0000 (10:26 +0530)]
Merge pull request #55574 from ceph/feature-multi-cluster-management-monitoring

mgr/dashboard: introduce multi cluster management and monitoring in ceph dashboard

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #55946 from myoungwon/wip-less-verbose-rbm-test
Yingxin [Wed, 6 Mar 2024 02:00:30 +0000 (10:00 +0800)]
Merge pull request #55946 from myoungwon/wip-less-verbose-rbm-test

crimson/os/seastore: make less verbose log when testing performance on RBM

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
16 months agocrimson/os/seastore: allow to remap the dirty extent 55977/head
myoungwon oh [Wed, 6 Mar 2024 00:46:37 +0000 (00:46 +0000)]
crimson/os/seastore: allow to remap the dirty extent

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
16 months agodoc: reef 18.2.2 release notes 55972/head
Yuri Weinstein [Tue, 5 Mar 2024 16:47:45 +0000 (08:47 -0800)]
doc: reef 18.2.2 release notes

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
16 months agorgw/notifications: delete persistent queue only if topic is deleted 55657/head
Yuval Lifshitz [Tue, 13 Feb 2024 16:36:51 +0000 (16:36 +0000)]
rgw/notifications: delete persistent queue only if topic is deleted

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
16 months agorgw/notifications: handle migration state between v1 and v2
Yuval Lifshitz [Sat, 10 Feb 2024 16:38:30 +0000 (16:38 +0000)]
rgw/notifications: handle migration state between v1 and v2

test instructions:
https://gist.github.com/yuvalif/21449e301732b719cd1ed97c3eeeabb2

* during migration all topic and notification operations must fail with HTTP error code 503
* read operations should return the values of the v1 topics and notifications
* sending notifications should continue based on v1 values

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
16 months agorgw: move rgw_rest_pubsub.h out of driver/rados/
Casey Bodley [Tue, 13 Feb 2024 15:57:08 +0000 (10:57 -0500)]
rgw: move rgw_rest_pubsub.h out of driver/rados/

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/pubsub: topic apis forward post body
Casey Bodley [Mon, 12 Feb 2024 21:44:00 +0000 (16:44 -0500)]
rgw/pubsub: topic apis forward post body

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/topic: metadata handler adds/removes persistent queues
Casey Bodley [Thu, 18 Jan 2024 20:34:16 +0000 (15:34 -0500)]
rgw/topic: metadata handler adds/removes persistent queues

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/topic: remove unused RGWSI_Topic_RADOS
Casey Bodley [Wed, 10 Jan 2024 22:40:11 +0000 (17:40 -0500)]
rgw/topic: remove unused RGWSI_Topic_RADOS

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/topic: add rgwrados::topic interface for topic metadata
Casey Bodley [Wed, 10 Jan 2024 20:33:25 +0000 (15:33 -0500)]
rgw/topic: add rgwrados::topic interface for topic metadata

add a new interface for topic metadata that doesn't depend on metadata
backends. this low-level interface is used by both RadosStore and the
topic metadata handler

remove Driver::delete_bucket_topic_mapping() from sal because the omap
object is deleted internally by rgwrados::topic::remove()

remove the RGWRados::topics_pool_ctx member

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/topic: metadata key format in rgw_pubsub.h
Casey Bodley [Wed, 10 Jan 2024 22:07:27 +0000 (17:07 -0500)]
rgw/topic: metadata key format in rgw_pubsub.h

the format of topic metadata keys is agnostic to the backend, so the
parsing/formatting functions should be in rgw_pubsub.h

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw: paginate ListTopics
Casey Bodley [Tue, 9 Jan 2024 23:55:40 +0000 (18:55 -0500)]
rgw: paginate ListTopics

rename read_topics()/write_topics() to 'v1' and only call them from
internal v1 call paths

public get_topics() now calls read_topics_v1() for the v1 case, and does
the paginated listing with driver->meta_list_keys_next() for v2

RGWPSListTopicsOp now uses the NextToken request/response params with
the paginated get_topics(), limiting responses to 100 entries like AWS

'radosgw-admin topic list' also paginates the listing according to
--max-entries to avoid reading everything into memory at once

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/mdlog: add complete_entry() for most common usage
Casey Bodley [Fri, 5 Jan 2024 15:26:00 +0000 (10:26 -0500)]
rgw/mdlog: add complete_entry() for most common usage

metadata sync ignores entries other than MDLOG_STATUS_COMPLETE, so we
don't need to write separate prepare/complete entries. metadata
mutations can just call complete_entry() on success

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/metadata: add RGWMetadataLister abstraction
Casey Bodley [Sun, 3 Dec 2023 19:10:30 +0000 (14:10 -0500)]
rgw/metadata: add RGWMetadataLister abstraction

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw: RGWPubSub requires SiteConfig
Casey Bodley [Sun, 4 Feb 2024 20:17:47 +0000 (15:17 -0500)]
rgw: RGWPubSub requires SiteConfig

RGWPubSub constructor takes SiteConfig instead of zonegroup map

replace do_all_zonegroups_support_notification_v2() with a generic
function rgw::all_zonegroups_support() that handles non-realm
configurations too

remove unused sal::ZoneGroup::supports_feature()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/rados: RGWTopicMetadataHandler doesn't depend on RGWPubSub
Casey Bodley [Sun, 4 Feb 2024 19:04:11 +0000 (14:04 -0500)]
rgw/rados: RGWTopicMetadataHandler doesn't depend on RGWPubSub

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/rados: store SiteConfig with RGWServices
Casey Bodley [Sun, 4 Feb 2024 18:43:10 +0000 (13:43 -0500)]
rgw/rados: store SiteConfig with RGWServices

make the SiteConfig available to all of RGWRados via svc.site instead
of storing it in sal::RadosStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agoradosgw-admin: make SiteConfig available to commands
Casey Bodley [Sun, 4 Feb 2024 16:37:57 +0000 (11:37 -0500)]
radosgw-admin: make SiteConfig available to commands

Signed-off-by: Casey Bodley <cbodley@redhat.com>
16 months agorgw/multisite-notification: allow enabling v1/v2 in tests
Yuval Lifshitz [Thu, 28 Dec 2023 12:05:09 +0000 (12:05 +0000)]
rgw/multisite-notification: allow enabling v1/v2 in tests

v1 could be enabled only in local tests. teuthology tests would run with v2

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
16 months agotest/rgw/notifications: support running tests in multisite environment
Yuval Lifshitz [Thu, 21 Dec 2023 18:18:45 +0000 (18:18 +0000)]
test/rgw/notifications: support running tests in multisite environment

both locally and in teuthology

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
16 months agorgw/multisite-notification: Add integration test for bucket notifications in multisit...
kchheda3 [Mon, 11 Dec 2023 20:47:30 +0000 (15:47 -0500)]
rgw/multisite-notification: Add integration test for bucket notifications in multisite config.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agorgw/multisite-notification: Add omap object to store the mapping between bucket and...
kchheda3 [Thu, 21 Dec 2023 22:23:05 +0000 (17:23 -0500)]
rgw/multisite-notification: Add omap object to store the mapping between bucket and topics.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agorgw/multisite-notification: Add support to replicate bucket notifications in multisit...
kchheda3 [Tue, 5 Dec 2023 17:26:48 +0000 (12:26 -0500)]
rgw/multisite-notification: Add support to replicate bucket notifications in multisite config.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agorgw/multisite-notification: Add support to replicate topic creation in multisite...
kchheda3 [Mon, 27 Nov 2023 20:51:02 +0000 (15:51 -0500)]
rgw/multisite-notification: Add support to replicate topic creation  in multisite config

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
16 months agorgw/beast: enablment of SSL session-id reuse speedup mechanism 55967/head
Mark Kogan [Tue, 5 Mar 2024 14:48:56 +0000 (16:48 +0200)]
rgw/beast: enablment of SSL session-id reuse speedup mechanism

Enable the OpenSSL session-id reuse acceleration mechanism that is described in:

https://www.openssl.org/docs/man1.0.2/man3/SSL_CTX_set_session_id_context.html
SSL_CTX_set_session_id_context, SSL_set_session_id_context - set context
within which session can be reused (server side only)

Fixes: https://tracker.ceph.com/issues/64719
Signed-off-by: Mark Kogan <mkogan@redhat.com>