]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Casey Bodley [Mon, 6 Nov 2023 15:48:14 +0000 (15:48 +0000)]
Merge pull request #54050 from shreyanshjain7174/fix_62646
RadosGW: RGW Swift info not providing max_deletes_per_request in bulk_delete
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Mon, 6 Nov 2023 15:47:49 +0000 (15:47 +0000)]
Merge pull request #54174 from cbodley/wip-63306
rgw: fetch_remote_obj() uses uncompressed size for encrypted objects
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Casey Bodley [Mon, 6 Nov 2023 15:47:23 +0000 (15:47 +0000)]
Merge pull request #54213 from cbodley/wip-63333
rgw-check-policy: remove check for nonempty tenant
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Casey Bodley [Mon, 6 Nov 2023 15:37:16 +0000 (15:37 +0000)]
Merge pull request #50680 from linuxbox2/wip-notify-lctrans
rgwlc: dispatch S3 notifications on transition and mpu abort
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Nizamudeen A [Mon, 6 Nov 2023 15:19:58 +0000 (20:49 +0530)]
Merge pull request #54307 from rkachach/fix_issue_63326
mgr/dashboard: fix secure_monitoring_stack check
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Anthony D'Atri [Mon, 6 Nov 2023 14:05:00 +0000 (09:05 -0500)]
Merge pull request #54352 from zdover23/wip-doc-2023-11-06-rados-troubleshooting-mon-common-issues-formatting
doc/rados: format Q&A list in tshooting-mon.rst
Ilya Dryomov [Mon, 6 Nov 2023 13:51:27 +0000 (14:51 +0100)]
Merge pull request #54222 from nbalacha/deep_copy_logs
librbd: additional logs for deep-copy debugging
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
N Balachandran [Mon, 6 Nov 2023 08:57:59 +0000 (14:27 +0530)]
librbd: additional logs for debugging
Added image and object information to the deep_copy class constructors
debugging easier.
Signed-off-by: N Balachandran <nibalach@redhat.com>
Yingxin [Mon, 6 Nov 2023 08:36:10 +0000 (16:36 +0800)]
Merge pull request #54351 from cyx1231st/wip-seastore-cleanup-is-stable-cleanup-only
crimson/os/seastore: cleanup, be explicit about stable and stable_written
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Yuval Lifshitz [Mon, 6 Nov 2023 07:26:27 +0000 (09:26 +0200)]
Merge pull request #54347 from yuvalif/wip-yuval-coverity-y2k38
rgw: adding y2k38 annotations to supress coverity issues
reviewed-by: vedanshbhartia, idryomov
zdover23 [Mon, 6 Nov 2023 05:09:27 +0000 (15:09 +1000)]
Merge pull request #54286 from jnsaff/patch-1
doc: Update mount-using-fuse.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Nizamudeen A [Mon, 6 Nov 2023 05:00:35 +0000 (10:30 +0530)]
Merge pull request #54336 from adk3798/cephadm-dashboard-e2e-fedora-link
mgr/dashboard: update fedora link for dashboard-cephadm-e2e test
Reviewed-by: Nizamudeen A <nia@redhat.com>
Zac Dover [Mon, 6 Nov 2023 04:31:20 +0000 (14:31 +1000)]
doc/rados: format Q&A list in tshooting-mon.rst
Bold the questions in a Q&A list in the "Most Common Monitor Issues"
section of doc/rados/troubleshooting/troubleshooting-mon.rst.
Signed-off-by: Zac Dover <zac.dover@proton.me>
Yingxin Cheng [Fri, 3 Nov 2023 09:00:07 +0000 (17:00 +0800)]
crimson/os/seastore: cleanup, be explicit about stable and stable_written
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin [Mon, 6 Nov 2023 01:54:23 +0000 (09:54 +0800)]
Merge pull request #54325 from cyx1231st/wip-seastore-fix-seastore-pr-54036
crimson/os/seastore/transaction_manager: add the missing UNIT_TESTS_BUILT guard
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
zdover23 [Sun, 5 Nov 2023 16:05:47 +0000 (02:05 +1000)]
Merge pull request #54344 from zdover23/wip-doc-2023-11-05-rados-troubleshooting-mon-clock-skews-edit
doc/rados: edit t-mon.rst text
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Yuval Lifshitz [Sun, 5 Nov 2023 14:52:30 +0000 (16:52 +0200)]
rgw: adding y2k38 annotations to supress coverity issues
the supression comments must be directly above the line
where the issue is.
this is a followup on these commits:
edfb5b9049ee897779863d780bfbaa130a7fbc40
aca2668c88a048ab556c53411dcf2ccd43099d50
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
Zac Dover [Sun, 5 Nov 2023 12:28:39 +0000 (22:28 +1000)]
doc/rados: edit t-mon.rst text
Clarify the text in the "Clock Skew" section of
doc/rados/troubleshooting/troubleshooting-mon.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Anthony D'Atri [Sun, 5 Nov 2023 13:11:22 +0000 (08:11 -0500)]
Merge pull request #54343 from zdover23/wip-doc-2023-11-05-rados-troubleshooting-troubleshooting-mon-clock-skews-formatting
doc/rados: format Q&A list in t-mon.rst
Zac Dover [Sun, 5 Nov 2023 06:24:16 +0000 (16:24 +1000)]
doc/rados: format Q&A list in t-mon.rst
Format a Q&A list in doc/rados/troubleshooting/troubleshooting.rst, in
the "Clock Skews" section.
Signed-off-by: Zac Dover <zac.dover@proton.me>
Adam King [Sat, 4 Nov 2023 16:01:10 +0000 (12:01 -0400)]
Merge pull request #54104 from phlogistonjohn/jjm-cephadm-move-extract
cephadm: move extract_uid_gid function
Reviewed-by: Adam King <adking@redhat.com>
Adam King [Fri, 3 Nov 2023 23:56:34 +0000 (19:56 -0400)]
Merge pull request #54056 from rkachach/fix_issue_ci_for_rook
mgr/rook: adding e2e testing for rook orchestrator
reviewed-by: Nizamudeen A <nia@redhat.com>
Anthony D'Atri [Fri, 3 Nov 2023 23:28:26 +0000 (19:28 -0400)]
Merge pull request #54339 from aclamk/fix-aclamk-bs-reshard-doc-v2
doc/rados/configuration/bluestore-config-ref: Fix lowcase typo
Yuri Weinstein [Fri, 3 Nov 2023 22:57:09 +0000 (15:57 -0700)]
Merge pull request #51784 from muahdib69/rsachere_cache_ratios
osd: make _set_cache_sizes ratio aware of cache_kv_onode_ratio
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Adam Kupczyk [Fri, 3 Nov 2023 19:32:28 +0000 (20:32 +0100)]
doc/rados/configuration/bluestore-config-ref: Fix lowcase typo
Letter "O" got lowcased to "o".
Reverted that.
Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Adam King [Fri, 3 Nov 2023 17:55:44 +0000 (13:55 -0400)]
Merge pull request #54077 from adk3798/event-update-timestamp
mgr/cephadm: update timestamp on repeat daemon/service events
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Fri, 3 Nov 2023 17:42:51 +0000 (13:42 -0400)]
mgr/dashboard: update fedora link for dashboard-cephadm-e2e test
The old link points to a directory that now only contains a
README saying
---
ATTENTION
======================================
The contents of this directory have been moved to our archives available at:
http://archives.fedoraproject.org/pub/archive/fedora/
If you are having troubles finding something there please stop by #fedora-admin on irc.freenode.net
---
so I think we either need to start using a newer fedora or point
to the archive link. This commit is currently doing the latter.
Signed-off-by: Adam King <adking@redhat.com>
Anthony D'Atri [Fri, 3 Nov 2023 16:17:13 +0000 (12:17 -0400)]
Merge pull request #54331 from aclamk/fix-aclamk-bs-reshard-doc
Fixing example of BlueStore resharding.
Adam King [Fri, 3 Nov 2023 15:59:18 +0000 (11:59 -0400)]
Merge pull request #53747 from rkachach/fix_issue_12858
mgr/rook: Adding support to automatically discover storage classes on Rook cluster
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@ibm.com>
Adam Kupczyk [Fri, 3 Nov 2023 15:50:19 +0000 (16:50 +0100)]
doc/rados/configuration/bluestore-config-ref: Fix lowcase typo
Letters "L P" got lowcased to "l p".
Reverted that.
Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Matt Benjamin [Wed, 1 Nov 2023 16:10:28 +0000 (12:10 -0400)]
rgwlc: fix notification test imports
Found by Yuval Lifshitz review.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Wed, 11 Oct 2023 16:32:21 +0000 (12:32 -0400)]
rgwlc: send version_id with notifications
Also fix return value from handle_multipart_expiration bucket-entry
lambda.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 6 Oct 2023 13:01:06 +0000 (09:01 -0400)]
rgwlc: treat persistent notify reservation as failure as fatal
(Because that's consistent with what we have been doing for expiration.)
This is possibly a controversial choice, and it might be better to allow
setting a site policy, in future.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Thu, 5 Oct 2023 15:11:03 +0000 (11:11 -0400)]
rgwlc: fix remove expired for non-versioned case
Plus, reformat some adjacent code.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 10 Apr 2023 18:08:39 +0000 (14:08 -0400)]
rgwlc: split versioned and non-versioned transition notifications
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 10 Apr 2023 15:22:56 +0000 (11:22 -0400)]
rgwlc: constify notification event_type
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 10 Apr 2023 14:58:17 +0000 (10:58 -0400)]
rgwlc: remove extra handles to sal bucket and object
I missed the addition of those to lc_op_ctx.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 10 Apr 2023 12:03:44 +0000 (08:03 -0400)]
rgwlc: log error on failure to publish_commit
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 3 Feb 2023 21:46:05 +0000 (16:46 -0500)]
rgwlc: dispatch S3 notifications on transition and mpu abort
Fixes: https://tracker.ceph.com/issues/58641
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
John Mulligan [Thu, 19 Oct 2023 13:46:58 +0000 (09:46 -0400)]
cephadm: update extract_uid_gid function annotations & format
Update the type annotations of extract_uid_gid to the type annotations
form used in more recent python versions. Reformat the function.
Signed-off-by: John Mulligan <jmulligan@redhat.com>
John Mulligan [Thu, 19 Oct 2023 13:42:34 +0000 (09:42 -0400)]
cephadm: move extract_uid_gid func to container_types module
While extract_uid_gid isn't a perfect fit for container_types it is a
fairly fundamental function for working with containers in cephadm and
doesn't require anything beyond types in containers_types and that
module's existing imports. Moving extract_uid_gid should allow us to
more easily move other functions in the future.
Signed-off-by: John Mulligan <jmulligan@redhat.com>
Adam King [Fri, 3 Nov 2023 15:19:34 +0000 (11:19 -0400)]
Merge pull request #54081 from phlogistonjohn/jjm-cephadm-podman-props
cephadm: move some podman specific logic to Podman methods
Reviewed-by: Adam King <adking@redhat.com>
Adam King [Fri, 3 Nov 2023 15:16:46 +0000 (11:16 -0400)]
Merge pull request #53987 from diabolocom/main
cephadm: add option to install systemd unit only
Reviewed-by: Adam King <adking@redhat.com>
Redouane Kachach [Thu, 2 Nov 2023 12:00:34 +0000 (13:00 +0100)]
mgr/dashboard: fix secure_monitoring_stack check
Fixes: https://tracker.ceph.com/issues/63326
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
Casey Bodley [Fri, 3 Nov 2023 15:04:50 +0000 (15:04 +0000)]
Merge pull request #54274 from aliakseimakarau/patch-1
doc: Update dynamicresharding.rst
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jiffin Tony Thottan <jthottan@redhat.com>
Aliaksei Makarau [Tue, 31 Oct 2023 15:20:05 +0000 (16:20 +0100)]
doc: Update dynamicresharding.rst
"3, After resharding completed:" should be
"3. After resharding completed:"
Signed-off-by: Aliaksei Makarau <aliaksei.makarau@ibm.com>
Redouane Kachach [Fri, 3 Nov 2023 14:06:08 +0000 (15:06 +0100)]
mgr/rook: adding behave as testing python dependency
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
Rishabh Dave [Fri, 3 Nov 2023 12:39:52 +0000 (18:09 +0530)]
Merge pull request #53129 from rishabh-d-dave/xfstests-dev-deps
qa/cephfs: update dependencies for xfstests-dev
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Ilya Dryomov [Fri, 3 Nov 2023 11:55:02 +0000 (12:55 +0100)]
Merge pull request #48508 from pkalever/rbd-tests
qa/workunits/rbd: merge journal and snapshot test scripts
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Venky Shankar [Fri, 3 Nov 2023 11:29:36 +0000 (16:59 +0530)]
Merge pull request #50615 from batrick/i59119
mds: respawn standby-replay if read_pos is <= expire_pos
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Rishabh Dave [Fri, 3 Nov 2023 11:02:41 +0000 (16:32 +0530)]
Merge pull request #53611 from Patty8122/adding-useful-print
mds: Include more information in print statement in MDSRank.cc
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Rishabh Dave [Fri, 3 Nov 2023 11:01:13 +0000 (16:31 +0530)]
Merge pull request #53126 from tengjie5/origin/tmp2
cephfs-shell: getxattr fail while the xattr's length > 256
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Redouane Kachach [Tue, 17 Oct 2023 07:31:59 +0000 (09:31 +0200)]
mgr/rook: adding e2e version based on minikube
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
Yingxin Cheng [Fri, 3 Nov 2023 09:24:54 +0000 (17:24 +0800)]
crimson/os/seastore/transaction_manager: add the missing UNIT_TESTS_BUILT guard
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin [Fri, 3 Nov 2023 08:17:00 +0000 (16:17 +0800)]
Merge pull request #54036 from xxhdx1985126/wip-seastore-clone-remap-ut
crimson/os/seastore: add unittests for transaction manager's clone/remap/read_pin and fix bugs
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Gabriel Benhanokh [Fri, 3 Nov 2023 06:21:22 +0000 (08:21 +0200)]
Merge pull request #53132 from benhanokh/maintain_prefix_itr_2
osd/SnapMapper:maintain the prefix_itr between calls to SnapMapper::get_next_objects_to_trim()
zdover23 [Fri, 3 Nov 2023 06:16:50 +0000 (16:16 +1000)]
Merge pull request #54322 from bluikko/patch-22
doc/cephadm/services: remove excess rendered indentation in osd.rst
Reviewed-by: Zac Dover <zac.dover@proton.me>
Ville Ojamo [Fri, 3 Nov 2023 05:44:00 +0000 (12:44 +0700)]
doc/cephadm/services: remove excess rendered indentation in osd.rst
Start bash command blocks at the left margin, removing
excessive padding/indentation that would render the
block too much towards the right.
At the same time ident the source consistently:
- Two spaces for command blocks and output blocks.
- Four spaces for notes, code blocks.
There seems to be no uniform style for this, sometimes
commands are indented with three spaces but it would
seem two spaces is common. In the end it all renders
the same I guess.
Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
Nizamudeen A [Fri, 3 Nov 2023 05:05:18 +0000 (10:35 +0530)]
Merge pull request #54048 from rhcs-dashboard/rgw-bucket-policy
mgr/dashboard: get object bucket policies for a bucket
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
zdover23 [Fri, 3 Nov 2023 03:19:19 +0000 (13:19 +1000)]
Merge pull request #54303 from zdover23/wip-doc-2023-11-02-cephadm-troubleshooting-2-of-x
doc/cephadm: edit troubleshooting.rst (2 of x)
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Casey Bodley [Thu, 2 Nov 2023 21:08:07 +0000 (21:08 +0000)]
Merge pull request #54309 from linuxbox2/wip-fix-lockguard
rgwfile: fix lock_guard decl
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Patrick Donnelly [Thu, 2 Nov 2023 19:41:17 +0000 (15:41 -0400)]
Merge PR #47121 into main
* refs/pull/47121/head:
mds: ensure next replay is queued on req drop
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Patrick Donnelly [Thu, 2 Nov 2023 19:40:09 +0000 (15:40 -0400)]
Merge PR #53883 into main
* refs/pull/53883/head:
mon: fix mds metadata lost in one case.
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Thu, 2 Nov 2023 19:39:12 +0000 (15:39 -0400)]
Merge PR #53636 into main
* refs/pull/53636/head:
mds: do not simplify fragset
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Gabriel BenHanokh [Wed, 14 Dec 2022 12:55:19 +0000 (12:55 +0000)]
osd/SnapMapper: maintain the prefix_itr between calls to SnapMapper::get_next_objects_to_trim()
Maintain the prefix_itr between calls to SnapMapper::get_next_objects_to_trim() to prevent searching depleted prefixes.
We got 8 distinct hash prefixes used for searching objects owned by a given PG.
On each call to SnapMapper::get_next_objects_to_trim() we start from the first prefix even after all objects mapped to it were depleted.
This means that we will be searching for 1 non-existing prefix after the first prefix was depleted, 2 after the first two prefixes were depleted... and so on until we will search 7 non-existing prefixes after the first 7 prefixes were depleted.
This is a performance improvement PR only!
It maintains the existing behavior and does not try to fix/change any of the TRIM logic.
I added an extra step after the last object is trimmed doing a full scan of the DB and only if no object was found it will return ENOENT.
This should make the new code no-worse than existing code which returns ENOENT after a full scan found no object.
It should not impact performance in real life snaps as it should only happen once per-snap.
added snap-mapper tests to rados-test-suite
disabled osd_debug_trim_objects when running (SnapMapperTest, prefix_itr) to prevent asserts(as this code does illegal inserts into DELETED snaps)
Code beautifing
Disabled the assert as there is a corner case when we retrieve the last valid object/s in a snap
The prefix_itr is advanced past the last valid value (as we completed a full scan)
If the OSD will call get_next_objects_to_trim() before the retrieved object/s was processed and removed from the SnapMapper DB it won't be found by the next call (as the prefix_itr is invalid).
The object will be found in the second-pass which will seems as if it was added after the trim was started (which is illegal) and will trigger an ASSERT
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
Casey Bodley [Thu, 2 Nov 2023 18:01:46 +0000 (18:01 +0000)]
Merge pull request #54299 from ionutbalutoiu/fix-rgw-cloud-sync-multi-tenancy
rgw: fix cloud-sync multi-tenancy scenario
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Matt Benjamin [Thu, 2 Nov 2023 17:45:12 +0000 (13:45 -0400)]
rgwfile: fix lock_guard decl
Reported by Leonid Usov <leonid.usov@ibm.com>.
Fixes: https://tracker.ceph.com/issues/63409
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Casey Bodley [Thu, 2 Nov 2023 14:27:13 +0000 (14:27 +0000)]
Merge pull request #53828 from smanjara/wip-sync-error-trim
rgw/multisite: fix sync_error_trim command
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Zac Dover [Thu, 2 Nov 2023 06:07:39 +0000 (16:07 +1000)]
doc/cephadm: edit troubleshooting.rst (2 of x)
Edit doc/cephadm/troubleshooting.rst. This commit and the PR of which it
is a part was raised in response to https://github.com/ceph/ceph/pull/53976.
Co-authored-by: John Mulligan <jmulligan@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Prasanna Kumar Kalever [Mon, 17 Oct 2022 08:05:22 +0000 (13:35 +0530)]
qa/workunits/rbd: merge journal and snapshot test scripts
The idea is to avoid the maintenance of duplicate code in both the journal
and snapshot test scripts.
Usage:
RBD_MIRROR_MODE=journal rbd_mirror.sh
Use environment variable RBD_MIRROR_MODE to set the mode
Available modes: snapshot | journal
Fixes: https://tracker.ceph.com/issues/54312
Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
Igor Fedotov [Thu, 2 Nov 2023 12:21:05 +0000 (15:21 +0300)]
Merge pull request #49486 from ifed01/wip-ifed-fix-rados-pybind
pybind/rados: fix missed changes for PEP484 style type annotations
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Jaanus Torp [Wed, 1 Nov 2023 10:23:47 +0000 (12:23 +0200)]
doc/cephfs: edit mount-using-fuse.rst
Fixes missing dash that lead to unnecessary debugging.
Signed-off-by: Jaanus Torp <jaanus@saun.ee>
Ronen Friedman [Thu, 2 Nov 2023 10:27:46 +0000 (12:27 +0200)]
Merge pull request #53843 from ronen-fr/wip-rf-1b1
osd/scrub: reserve replicas in OSD order, one by one
Reviewed-by: Samuel Just <sjust@redhat.com>
Nizamudeen A [Tue, 17 Oct 2023 04:34:33 +0000 (10:04 +0530)]
mgr/dashboard: get object bucket policies for a bucket
Getting the bucket details will also fetch the bucket policy if its set.
Fixes: https://tracker.ceph.com/issues/63221
Signed-off-by: Nizamudeen A <nia@redhat.com>
Xuehan Xu [Tue, 31 Oct 2023 12:42:56 +0000 (20:42 +0800)]
crimson/os/seastore/lba_manager: rename clone_extent to clone_mapping
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Xuehan Xu [Mon, 16 Oct 2023 03:58:32 +0000 (11:58 +0800)]
crimson/os/seastore/lba_manager: hide lba mapping ref count update away
from users of TransactionManager
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Xuehan Xu [Mon, 16 Oct 2023 08:22:31 +0000 (16:22 +0800)]
test/crimson/seastore: add unittests for clone/remap/read_pin
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Xuehan Xu [Mon, 16 Oct 2023 08:19:52 +0000 (16:19 +0800)]
crimson/os/seastore/transaction_manager: indirect lba mappings should
always have the entire original mappings as their targets
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Samuel Just [Thu, 2 Nov 2023 01:53:28 +0000 (18:53 -0700)]
Merge pull request #52261 from myoungwon/wip-ceph-dedup-tool-snap-add
tool/ceph-dedup-tool: perform dedup on snapshotted object during sample dedup
Reviewed-by: Samuel Just <sjust@redhat.com>
Ionut Balutoiu [Wed, 1 Nov 2023 16:07:58 +0000 (18:07 +0200)]
rgw: fix cloud-sync multi-tenancy scenario
At the moment, we cannot set buckets prefixed with tenant ID in the
`source_bucket` field from cloud-sync profiles (non-trivial config):
https://docs.ceph.com/en/latest/radosgw/cloud-sync-module/#non-trivial-configuration
This is because the `do_find_profile` function only searches in the
profiles configured using `bucket.name`, and it ignores `bucket.tenant`.
This is problematic in the RGW multi-tenancy scenario:
https://docs.ceph.com/en/latest/radosgw/multitenancy/#rgw-multi-tenancy
At the moment, we can only configure bucket name in the profile
`source_bucket` field. In the multi-tenancy scenario, this would sync
all the buckets (from all the tenants).
Without this fix, we cannot configure a cloud-sync profile that syncs
all the buckets from a tenant to a particular S3 target.
For example, we cannot do this:
* `tenantA/test-bucket` -> S3 target A
* `tenantB/test-bucket` -> S3 target B
* `tenantC/test-bucket` -> S3 target C
We can only do this at the moment:
* `test-bucket` -> S3 target A
If `test-bucket` is present in both `tenantA` and `tenantB`, both
buckets will be synced to S3 target A.
The idea would be to be able to do this:
* `tenantA/*` -> S3 target A
* `tenantB/*` -> S3 target B
* `tenantC/*` -> S3 target C
If `test-bucket` is present in all tenants, each tenant bucket is
synced to its own S3 target.
Fixes: https://tracker.ceph.com/issues/63395
Signed-off-by: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
Yuri Weinstein [Wed, 1 Nov 2023 19:09:44 +0000 (12:09 -0700)]
Merge pull request #52545 from Matan-B/wip-matanb-trim-61962
osd/OSD: fix trim_maps() - possible leak on `skip_maps`
Reviewed-by: Samuel Just <sjust@redhat.com>
Yuri Weinstein [Wed, 1 Nov 2023 19:08:42 +0000 (12:08 -0700)]
Merge pull request #50081 from NitzanMordhai/wip-nitzan-subscription-manager-rocksdb-librados
qa/*/test_envlibrados_for_rocksdb.sh: subscribe repo
Reviewed-by: Laura Flores <lflores@redhat.com>
Samuel Just [Wed, 1 Nov 2023 17:45:39 +0000 (10:45 -0700)]
Merge pull request #52171 from myoungwon/wip-ceph-dedup-tool-improve-print
tool/ceph-dedup-tool: improve the progress report
Reviewed-by: Samuel Just <sjust@redhat.com>
Ilya Dryomov [Wed, 1 Nov 2023 17:18:40 +0000 (18:18 +0100)]
Merge pull request #53346 from linuxbox2/wip-build-fio
cmake: BuildFIO.cmake should not introduce -std=gnu++17
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Adam King [Wed, 1 Nov 2023 14:27:31 +0000 (10:27 -0400)]
Merge pull request #54141 from phlogistonjohn/jjm-cephadm-more-assertions
cephadm: add more deployment test assertions
Reviewed-by: Adam King <adking@redhat.com>
Matan Breizman [Wed, 1 Nov 2023 10:41:33 +0000 (12:41 +0200)]
Merge pull request #54040 from Matan-B/wip-wip-matanb-crimson-do_osd_ops_execute-v3
crimson/osd/pg: do_osd_ops_execute refactor
Reviewed-by: Samuel Just <sjust@redhat.com>
Ilya Dryomov [Wed, 1 Nov 2023 09:45:59 +0000 (10:45 +0100)]
Merge pull request #53535 from ajarr/wip-62891
qa/suites/rbd: add test to check rbd_support module recovery
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Ilya Dryomov [Wed, 1 Nov 2023 09:44:05 +0000 (10:44 +0100)]
Merge pull request #54251 from ajarr/wip-62994
mgr/rbd_support: fix recursive locking on CreateSnapshotRequests lock
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Igor Fedotov [Wed, 1 Nov 2023 09:38:06 +0000 (12:38 +0300)]
Merge pull request #47730 from ifed01/wip-ifed-alloc-logging
os/bluestore: assert on improper release in AvlAllocator
Reviewed-by: Pere Diaz Bou <pere-altea@hotmail.com>
Xuehan Xu [Mon, 16 Oct 2023 08:16:58 +0000 (16:16 +0800)]
test/crimson/seastore/lba_manager: skip indirect lba mappings
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Xuehan Xu [Mon, 16 Oct 2023 03:59:05 +0000 (11:59 +0800)]
crimson/os/seastore/lba_manager: copy intermediate_length when
dupicating lba mappings
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Xuehan Xu [Mon, 16 Oct 2023 03:57:39 +0000 (11:57 +0800)]
crimson/os/seastore/btree: drop unused lba mapping method
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
zdover23 [Wed, 1 Nov 2023 06:48:58 +0000 (16:48 +1000)]
Merge pull request #54281 from zdover23/wip-doc-2023-11-01-cephadm-troubleshooting-1-of-x
doc/cephadm: edit troubleshooting.rst (1 of x)
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
barakda [Wed, 1 Nov 2023 05:47:25 +0000 (07:47 +0200)]
Merge pull request #54262 from barakda/nvmeof-bump-version-v0.0.5
Update default nvmeof gw version to v0.0.5
Rishabh Dave [Wed, 1 Nov 2023 05:29:59 +0000 (10:59 +0530)]
Merge pull request #54210 from rishabh-d-dave/progress-submodule-update
add --progress flag to git submodule update commands
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Zac Dover [Wed, 1 Nov 2023 01:53:59 +0000 (11:53 +1000)]
doc/cephadm: edit troubleshooting.rst (1 of x)
Edit doc/cephadm/troubleshooting.rst. This commit and the PR of which it
is a part was raised in response to
https://github.com/ceph/ceph/pull/53976. The limits of reStructuredText
are particularly visible here in every instance of a BASH for-loop and
in every instance of a command stretched over multiple lines.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Casey Bodley [Tue, 31 Oct 2023 20:28:17 +0000 (20:28 +0000)]
Merge pull request #54226 from adamemerson/wip-build-experiment
build: Fix ARM build and make install-deps.sh more robust
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Tue, 31 Oct 2023 20:20:56 +0000 (20:20 +0000)]
Merge pull request #54216 from adamemerson/wip-fmt-felicity
build: fmt felicity
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Rishabh Dave [Thu, 26 Oct 2023 10:48:31 +0000 (16:18 +0530)]
cmake: add --progress flag to git submodule update commands
Ceph has lots of submodules that needs to be cloned before building
binaries from the repository. Seeing the progress when these submodules
are being cloned is useful, especially when developers/users have a
network issue or a slow network.
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Patrick Donnelly [Tue, 31 Oct 2023 17:22:19 +0000 (13:22 -0400)]
Merge PR #54272 into main
* refs/pull/54272/head:
cmake: do not issue CMAKE_BUILD_TYPE warning if set
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>