]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Zac Dover [Fri, 1 Mar 2024 12:11:14 +0000 (22:11 +1000)]
doc/install: add manual RADOSGW install procedure
Add a manual RADOSGW installation procedure to
doc/install/manual-deployment.rst. This procedure was developed by Janne
Johansson and reported to the ceph-users mailing list on 29 Jan 2024
here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/LB3YRIKAPOHXYCW7MKLVUJPYWYRQVARU/
Co-authored-by: Janne Johansson <icepic.dz@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Yingxin [Fri, 1 Mar 2024 05:48:10 +0000 (13:48 +0800)]
Merge pull request #55855 from xxhdx1985126/wip-seastore-interface
crimson/os/seastore: adjust SeaStore::_omap_set_kvs() params
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Xuehan Xu [Fri, 1 Mar 2024 02:32:32 +0000 (10:32 +0800)]
crimson/os/seastore: adjust SeaStore::_omap_set_kvs() params
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
zdover23 [Fri, 1 Mar 2024 00:13:46 +0000 (10:13 +1000)]
Merge pull request #55834 from zdover23/wip-doc-2024-02-29-dev-internals
doc/dev: edit internals.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
zdover23 [Thu, 29 Feb 2024 23:32:07 +0000 (09:32 +1000)]
Merge pull request #55835 from zdover23/wip-doc-2024-02-29-glossary-mds
doc/glossary: improve "MDS" entry
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Thu, 29 Feb 2024 08:08:10 +0000 (18:08 +1000)]
doc/glossary: improve "MDS" entry
Improve the entry for "MDS" in doc/glossary.rst by linking to the
"ceph-mds" man page and mentioning the relationship between clients and
MDS (or MDSes).
Signed-off-by: Zac Dover <zac.dover@proton.me>
Igor Fedotov [Thu, 29 Feb 2024 16:07:10 +0000 (19:07 +0300)]
Merge pull request #55594 from ifed01/wip-ifed-fix-64443
test/store_test: fix DeferredWrite test when prefer_deferred_size=0
Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>
Guillaume Abrioux [Thu, 29 Feb 2024 12:47:08 +0000 (13:47 +0100)]
Merge pull request #55534 from clwluvw/cephadm-device-class
cephadm: remove restriction for crush device classes
Zac Dover [Thu, 29 Feb 2024 07:40:57 +0000 (17:40 +1000)]
doc/dev: edit internals.rst
Edit doc/dev/internals.rst. Make a few sentences pithier.
Signed-off-by: Zac Dover <zac.dover@proton.me>
Yingxin [Thu, 29 Feb 2024 05:49:33 +0000 (13:49 +0800)]
Merge pull request #55806 from xxhdx1985126/wip-seastore-clone-attrs-omaps
crimson/os/seastore: copy attrs and omaps when cloning objects
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Nizamudeen A [Thu, 29 Feb 2024 05:48:24 +0000 (11:18 +0530)]
Merge pull request #55771 from rhcs-dashboard/e2e-fix
mgr/dashboard: fix roles page for roles without policies
Reviewed-by: afreen23 <NOT@FOUND>
Aashish Sharma [Thu, 29 Feb 2024 05:06:58 +0000 (10:36 +0530)]
Merge pull request #55510 from pcuzner/add-nvmeof-alerts
ceph-mixin: Update mixin to include alerts for the nvmeof gateway(s)
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Dan Mick [Thu, 29 Feb 2024 02:31:30 +0000 (18:31 -0800)]
Merge pull request #55822 from dmick/wip-release-build-prerelease-update
doc/dev/release-process.rst: modify for prerelease mechanism
Dan Mick [Wed, 28 Feb 2024 02:59:46 +0000 (18:59 -0800)]
doc/dev/release-process.rst: modify for prerelease mechanism
Signed-off-by: Dan Mick <dmick@redhat.com>
Adam King [Wed, 28 Feb 2024 20:10:21 +0000 (15:10 -0500)]
Merge pull request #55710 from rhcs-dashboard/nvmeof-prometheus-endpoint
cephadm/nvmeof: scrape nvmeof prometheus endpoint
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Paul Cuzner <pcuzner@ibm.com>
Adam King [Wed, 28 Feb 2024 19:34:11 +0000 (14:34 -0500)]
Merge pull request #55600 from adk3798/no-agent-workunits
qa/cephadm: don't test certain workunits with agent
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Wed, 28 Feb 2024 19:32:49 +0000 (14:32 -0500)]
Merge pull request #55588 from adk3798/rm-cluster-podman-auth
cephadm: rm podman-auth.json if removing last cluster
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Wed, 28 Feb 2024 19:30:10 +0000 (14:30 -0500)]
Merge pull request #55788 from rkachach/fix_issue_64596
doc: adding documentation for secure monitoring stack configuration
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Adam King [Wed, 28 Feb 2024 18:43:12 +0000 (13:43 -0500)]
Merge pull request #55620 from adk3798/cephadm-timeout-cancelled-error
mgr/cephadm: catch CancelledError in asyncio timeout handler
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Wed, 28 Feb 2024 18:41:06 +0000 (13:41 -0500)]
Merge pull request #55650 from adk3798/cephadm-ceph-exporter-sock-dir
cephadm: create ceph-exporter sock dir if it's not present
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Wed, 28 Feb 2024 18:26:45 +0000 (13:26 -0500)]
Merge pull request #55531 from roysahar/roys/wip-nvmeof-new-mount-for-logs
nvmeof: Add mount for log location
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Aviv Caro <Aviv.Caro@ibm.com>
Adam King [Wed, 28 Feb 2024 16:42:45 +0000 (11:42 -0500)]
Merge pull request #55273 from pcuzner/add-nvmeof-to-autotune
cephadm: Add nvmeof to autotuner calculation
Reviewed-by: Adam King <adking@redhat.com>
Adam King [Wed, 28 Feb 2024 16:41:22 +0000 (11:41 -0500)]
Merge pull request #53840 from rhcs-dashboard/add-health-check-haproxy
mgr/cephadm is not defining haproxy tcp healthchecks for Ganesha
Reviewed-by: Adam King <adking@redhat.com>
Pedro Gonzalez Gomez [Wed, 28 Feb 2024 16:35:24 +0000 (17:35 +0100)]
Merge pull request #55812 from ivoalmeida/add-snap-schedule-repeat-frequencies
mgr/dashboard: add snap schedule M, Y frequencies
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Venky Shankar [Wed, 28 Feb 2024 15:43:44 +0000 (21:13 +0530)]
Merge PR #55207 into main
* refs/pull/55207/head:
mds: check file layout in mknod
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Redouane Kachach [Tue, 27 Feb 2024 14:52:25 +0000 (15:52 +0100)]
doc: adding documentation for secure monitoring stack configuration
Fixes: https://tracker.ceph.com/issues/64596
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
Kamoltat (Junior) Sirivadhna [Wed, 28 Feb 2024 14:57:05 +0000 (09:57 -0500)]
Merge pull request #55794 from kamoltat/wip-ksirivad-ceph-backport-script
src/scripts/ceph-backport.sh: Add PR checklist
Reviewed by: Laura Flores <lfores@ibm.com>
Pedro Gonzalez Gomez [Wed, 28 Feb 2024 14:37:14 +0000 (15:37 +0100)]
Merge pull request #55809 from ivoalmeida/fix-snap-schedule-month
mgr/dashboard: fix snap schedule date format
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Ivo Almeida [Mon, 26 Feb 2024 11:56:18 +0000 (11:56 +0000)]
mgr/dashboard: add snap schedule M, Y frequencies
Added M and Y (month and year) repeat frequencies to snap schedule
create form.
Fixes: https://tracker.ceph.com/issues/64614
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
Ivo Almeida [Wed, 28 Feb 2024 09:53:57 +0000 (09:53 +0000)]
mgr/dashboard: fix snap schedule date format
Fixes: https://tracker.ceph.com/issues/64613
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
Xuehan Xu [Wed, 28 Feb 2024 05:42:04 +0000 (13:42 +0800)]
crimson/os/seastore: copy attrs and omaps when cloning objects
At present, we just copy attrs and omaps one by one, which is not
efficient but very important in terms of functionality especially for
the teuthology tests
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Nizamudeen A [Tue, 27 Feb 2024 07:18:56 +0000 (12:48 +0530)]
mgr/dashboard: fix roles page for roles without policies
If there is no permission policies attached to a role, it fails the
UI with an exception.
Fixes: https://tracker.ceph.com/issues/64588
Signed-off-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Wed, 28 Feb 2024 05:42:33 +0000 (11:12 +0530)]
Merge pull request #55757 from rhcs-dashboard/replace-piechart-panel-plugin-grafana
mgr/dashboard: replace piechart plugin charts with native pie chart panel
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Venky Shankar [Wed, 28 Feb 2024 04:02:42 +0000 (09:32 +0530)]
Merge PR #52258 into main
* refs/pull/52258/head:
client: check mds down status bofore getting mds_gid_t from mdsmap
mgr/dashboard: allow sending back error status code fetching clients fails
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Yingxin [Wed, 28 Feb 2024 03:38:16 +0000 (11:38 +0800)]
Merge pull request #55772 from xxhdx1985126/wip-seastore-attr-related-bug-fixes
crimson/os/seastore: two attrs related bug fixes
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
zdover23 [Tue, 27 Feb 2024 23:42:10 +0000 (09:42 +1000)]
Merge pull request #55782 from zdover23/wip-doc-2024-02-27-rados-operations-add-or-rm-mons
doc/rados: add "change public network" procedure
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Kamoltat (Junior) Sirivadhna [Tue, 27 Feb 2024 20:55:12 +0000 (15:55 -0500)]
Merge pull request #53222 from myoungwon/wip-62167
osd: check if adjacent clones are unreadable when rollback is called.
Reviewed-by: athanatos
Kamoltat (Junior) Sirivadhna [Tue, 27 Feb 2024 20:54:45 +0000 (15:54 -0500)]
Merge pull request #55147 from Matan-B/wip-matanb-skip-past-interval-cheeck
osd/PeeringState: introduce osd_skip_check_past_interval_bounds
Reviewed-by athanatos
Kamoltat (Junior) Sirivadhna [Tue, 27 Feb 2024 20:54:01 +0000 (15:54 -0500)]
Merge pull request #55227 from Svelar/wip-ci-clang
ARM CI: clang should >= 12 for supporting C++20
Reviewed by: Laura Flores <lajefl@gmail.com>
Kamoltat [Tue, 27 Feb 2024 19:21:57 +0000 (19:21 +0000)]
src/scripts/ceph-backport.sh: Add PR checklist
Signed-off-by: Kamoltat <ksirivad@redhat.com>
Yuri Weinstein [Tue, 27 Feb 2024 16:38:21 +0000 (08:38 -0800)]
Merge pull request #54872 from amathuria/wip-amat-mclock-adjust-deletion-cost
osd: Change PG Deletion cost for mClock
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Yuri Weinstein [Tue, 27 Feb 2024 16:37:34 +0000 (08:37 -0800)]
Merge pull request #52891 from kamoltat/wip-ksirivad-fix-59172
qa/tasks/ceph_manager.py: Rewrite test_pool_min_size
Reviewed-by: Samuel Just <sjust@redhat.com>
Casey Bodley [Tue, 27 Feb 2024 16:05:51 +0000 (16:05 +0000)]
Merge pull request #55760 from cbodley/wip-64568
test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Yantao xue [Tue, 30 Jan 2024 09:14:43 +0000 (17:14 +0800)]
mds: check file layout in mknod
Fixes: https://tracker.ceph.com/issues/64061
Signed-off-by: Xue Yantao <xueyantao2114@163.com>
Pedro Gonzalez Gomez [Tue, 27 Feb 2024 12:27:23 +0000 (13:27 +0100)]
Merge pull request #55752 from rhcs-dashboard/fix-vol-create
mgr/dashboard: fix volume creation with multiple hosts
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Zac Dover [Mon, 26 Feb 2024 10:03:48 +0000 (20:03 +1000)]
doc/rados: add "change public network" procedure
Add a procedure to /doc/rados/operations/add-or-rm-mons.rst that
explains how to change the public_network in a Ceph cluster deployed
with cephadm. This procedure was developed by Eugen Block, and can be
seen in its original form here:
https://heiterbiswolkig.blogs.nde.ag/2024/02/22/cephadm-change-public-network/
Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Xuehan Xu [Tue, 27 Feb 2024 08:27:58 +0000 (16:27 +0800)]
crimson/os/seastore: also remove xattrs when removing onodes
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Aashish Sharma [Mon, 26 Feb 2024 09:32:19 +0000 (15:02 +0530)]
mgr/dashboard: replace piechart plugin charts with native pie chart
panel
Fixes: https://tracker.ceph.com/issues/64579
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Xuehan Xu [Tue, 27 Feb 2024 08:18:57 +0000 (16:18 +0800)]
crimson/os/seastore: get_attrs should return all attrs
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Xuehan Xu [Tue, 27 Feb 2024 08:06:02 +0000 (16:06 +0800)]
crimson/os/seastore: attr related debug outputs
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Venky Shankar [Tue, 27 Feb 2024 05:53:13 +0000 (11:23 +0530)]
Merge PR #52859 into main
* refs/pull/52859/head:
qa: test cases to make sure invalid paths don't get updated
mgr/nfs: use helper to validate cephfs path
mgr/nfs: validate path before updating a cephfs export
mgr/nfs: add a helper to validate cephfs path
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Tue, 27 Feb 2024 05:50:54 +0000 (11:20 +0530)]
Merge PR #54687 into main
* refs/pull/54687/head:
mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Tue, 27 Feb 2024 05:47:13 +0000 (11:17 +0530)]
Merge PR #55435 into main
* refs/pull/55435/head:
qa: Fix fs/full suite
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Samuel Just [Mon, 26 Feb 2024 23:26:00 +0000 (15:26 -0800)]
Merge pull request #55751 from cyx1231st/wip-fix-test-socket
test/crimson/test_socket: complete write-side errors in test_unexpected_down()
Reviewed-by: Samuel Just <sjust@redhat.com>
Paul Cuzner [Thu, 15 Feb 2024 22:56:03 +0000 (11:56 +1300)]
ceph-mixins: Update MIB to include nvmeof notification
Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
Paul Cuzner [Tue, 13 Feb 2024 00:55:24 +0000 (13:55 +1300)]
ceph-mixins: Add test cases for nvmeof alerts
Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
Paul Cuzner [Tue, 13 Feb 2024 00:54:48 +0000 (13:54 +1300)]
ceph-mixins: nvmeof alerts added
Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
Paul Cuzner [Fri, 9 Feb 2024 04:00:28 +0000 (17:00 +1300)]
ceph-mixins: Add nvmeof alerts
Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
Adam King [Fri, 16 Feb 2024 16:24:32 +0000 (11:24 -0500)]
mgr/cephadm: catch CancelledError in asyncio timeout handler
Specifically, concurrent.futures.CancelledError. At least on
python 3.9, this error can be raised when certain commands
being run asynchronously fail. Not catching this results in
the whole cephadm module crashing with something like
Traceback (most recent call last):
File "/usr/share/ceph/mgr/cephadm/utils.py", line 94, in do_work
return f(*arg)
File "/usr/share/ceph/mgr/cephadm/serve.py", line 267, in refresh
r = self._refresh_facts(host)
File "/usr/share/ceph/mgr/cephadm/serve.py", line 370, in _refresh_facts
val = self.mgr.wait_async(self._run_cephadm_json(
File "/usr/share/ceph/mgr/cephadm/module.py", line 671, in wait_async
return self.event_loop.get_result(coro, timeout)
File "/usr/share/ceph/mgr/cephadm/ssh.py", line 64, in get_result
return future.result(timeout)
File "/lib64/python3.9/concurrent/futures/_base.py", line 444, in result
raise CancelledError()
concurrent.futures._base.CancelledError
Fixes: https://tracker.ceph.com/issues/64473
Signed-off-by: Adam King <adking@redhat.com>
Yuri Weinstein [Mon, 26 Feb 2024 15:47:57 +0000 (07:47 -0800)]
Merge pull request #54999 from Matan-B/wip-matanb-mon-osd-epochs
mon/OSDMonitor: fix get_min_last_epoch_clean()
Reviewed-by: Samuel Just <sjust@redhat.com>
Casey Bodley [Mon, 26 Feb 2024 14:38:52 +0000 (09:38 -0500)]
test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler
1ms sleeps are generally below the timer's resolution. increase run_for()
durations to 50ms to make the tests far less sensitive to timing. in
practice, none of the sleeps actually wait the full 50ms
Fixes: https://tracker.ceph.com/issues/64568
Signed-off-by: Casey Bodley <cbodley@redhat.com>
yite.gu [Mon, 29 Jan 2024 10:26:20 +0000 (18:26 +0800)]
client: check mds down status bofore getting mds_gid_t from mdsmap
Get mds_gid_t from up of MDSMap, will cause to core dump if target
mds_rank_t does not exist up map:
from: src/mds/MDSMap.h
const auto& get_info(mds_rank_t m) const {
return mds_info.at(up.at(m));
}
reproduct:
1. ceph fs fail <fs_name>
2. curl -X GET "example.com:8080/api/cephfs/1/clients" ...
up.at(m) will cause to core dump.
Fixes: https://tracker.ceph.com/issues/61844
Signed-off-by: Yite Gu <yitegu0@gmail.com>
Ilya Dryomov [Mon, 26 Feb 2024 09:17:25 +0000 (10:17 +0100)]
Merge pull request #55683 from lxbsz/wip-62837-new
doc/man/8/mount.ceph.rst: add more mount options
Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Yingxin [Mon, 26 Feb 2024 07:39:49 +0000 (15:39 +0800)]
Merge pull request #55705 from xxhdx1985126/wip-64535
crimson/os/seastore: fix wrong-positioned asserts
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Pedro Gonzalez Gomez [Thu, 22 Feb 2024 10:06:21 +0000 (11:06 +0100)]
mgr/dashboard: fix volume creation with multiple hosts
Fixes: https://tracker.ceph.com/issues/64559
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Yingxin Cheng [Mon, 26 Feb 2024 06:17:48 +0000 (14:17 +0800)]
test/crimson/test_socket: complete write-side errors in test_unexpected_down()
Related: https://tracker.ceph.com/issues/64457
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
zdover23 [Mon, 26 Feb 2024 05:20:40 +0000 (15:20 +1000)]
Merge pull request #55739 from zdover23/wip-doc-2024-02-26-glossary-omap
doc/glossary: Add "OMAP" to glossary
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Xiubo Li [Wed, 22 Nov 2023 08:13:08 +0000 (16:13 +0800)]
doc/man/8/mount.ceph.rst: add more mount options
Fixes: https://tracker.ceph.com/issues/62837
Signed-off-by: Xiubo Li <xiubli@redhat.com>
Paul Cuzner [Fri, 9 Feb 2024 03:56:58 +0000 (16:56 +1300)]
ceph-mixins: Add vars to support nvmeof alerts
Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
Zac Dover [Sun, 25 Feb 2024 21:14:25 +0000 (07:14 +1000)]
doc/glossary: Add "OMAP" to glossary
Add an entry for "OMAP" to the glossary. This commit represents only the
first improvement to the documentation of OMAP in the Ceph docs suite.
Signed-off-by: Zac Dover <zac.dover@proton.me>
Avan Thakkar [Thu, 22 Feb 2024 11:00:06 +0000 (16:30 +0530)]
cephadm/nvmeof: scrape nvmeof prometheus endpoint
Fixes: https://tracker.ceph.com/issues/64536
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Ilya Dryomov [Fri, 23 Feb 2024 22:47:42 +0000 (23:47 +0100)]
Merge pull request #54802 from ajarr/wip-61617
qa: Add tests to validate synced images on rbd-mirror
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Casey Bodley [Fri, 23 Feb 2024 18:11:03 +0000 (18:11 +0000)]
Merge pull request #55722 from cbodley/wip-64543
rgw/aio: avoid infinite recursion in aio_abstract()
Reviewed-by: Adam Emerson <aemerson@redhat.com>
zdover23 [Fri, 23 Feb 2024 17:04:53 +0000 (03:04 +1000)]
Merge pull request #55729 from zdover23/wip-doc-2024-02-24-rbd-nvmof-target-configure-list-repair
doc/rbd: repair ordered list
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Anthony D'Atri [Fri, 23 Feb 2024 17:02:57 +0000 (12:02 -0500)]
Merge pull request #55731 from zdover23/wip-doc-2024-02-24-dev-crimson
doc/dev: fix spelling in crimson.rst
Zac Dover [Fri, 23 Feb 2024 16:21:54 +0000 (02:21 +1000)]
doc/dev: fix spelling in crimson.rst
Repair a confusing sentence in doc/dev/crimson.rst.
Signed-off-by: Zac Dover <zac.dover@proton.me>
zdover23 [Fri, 23 Feb 2024 16:10:56 +0000 (02:10 +1000)]
Merge pull request #55699 from Svelar/seastore_doc
doc/crimson: cleanup duplicate seastore description
Reviewed-by: Zac Dover <zac.dover@proton.me>
Zac Dover [Fri, 23 Feb 2024 16:05:42 +0000 (02:05 +1000)]
doc/rbd: repair ordered list
Fix the numbering in an ordered list. The numbering was thrown off
because a ".. prompt" directive was improperly indented (it wasn't
indented at all).
See https://github.com/ceph/ceph/pull/55540#discussion_r1500051264
Signed-off-by: Zac Dover <zac.dover@proton.me>
Casey Bodley [Fri, 23 Feb 2024 16:01:24 +0000 (16:01 +0000)]
Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization
rgw/http/client-side: disable curl path normalization
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 23 Feb 2024 15:00:44 +0000 (15:00 +0000)]
Merge pull request #55627 from smanjara/wip-fix-log-op
rgw: don't pass log_op into link_olh during PutObject.
Reviewed-by: Jane Zhu <jzhu116@bloomberg.net>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Rixin Luo [Fri, 23 Feb 2024 02:22:18 +0000 (10:22 +0800)]
Merge pull request #55713 from tchaikov/wip-debian-control-tab
debian/control: replace <tab> with spaces
Casey Bodley [Thu, 22 Feb 2024 21:54:54 +0000 (16:54 -0500)]
rgw/aio: avoid infinite recursion in aio_abstract()
a recent regression from
320a2179a3c6c1981a0fd2494938515997c1bfad causes
aio_abstract() to recurse when given an empty optional_yield. this is
exposed by the librgw_file tests
Fixes: https://tracker.ceph.com/issues/64543
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Ilya Dryomov [Thu, 22 Feb 2024 20:48:00 +0000 (21:48 +0100)]
Merge pull request #55540 from oritwas/wip-doc-nvmeof
doc: Initial NVMe-oF gateway docs
Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Igor Fedotov [Thu, 22 Feb 2024 20:19:10 +0000 (23:19 +0300)]
Merge pull request #55700 from wanglinke521/wlk-bluefs-dev
os/bluestore: fix the problem of l_bluefs_log_compactions double recording
Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
Igor Fedotov [Thu, 22 Feb 2024 20:17:49 +0000 (23:17 +0300)]
Merge pull request #54992 from ifed01/wip-ifed-enforce-min-alloc-size
os/bluestore: introduce bluestore_debug_enforce_min_alloc_size config
Reviewed-by: Pere Diaz Bou <pere-altea@hotmail.com>
Samuel Just [Thu, 22 Feb 2024 18:45:39 +0000 (10:45 -0800)]
Merge pull request #55407 from xxhdx1985126/wip-64282
crimson/osd/shard_services: make sure that only up/acting members can create pgs
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Yuval Lifshitz [Thu, 22 Feb 2024 18:10:19 +0000 (20:10 +0200)]
Merge pull request #55688 from yuvalif/wip-yuval-split-notif-test
test/rgw/notifications: split tests between basic, kafka and amqp
reviewed-by: cbodley
Orit Wasserman [Mon, 12 Feb 2024 12:39:38 +0000 (14:39 +0200)]
doc: Add NVMe-oF gateway documentation
- Add nvmeof-initiator-esx.rst
- Add nvmeof-initiator-linux.rst
- Add nvmeof-initiators.rst
- Add nvmeof-overview.rst
- Add nvmeof-requirements.rst
- Add nvmeof-target-configure.rst
- Add links to rbd-integrations.rst
Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Orit Wasserman <owasserm@ibm.com>
Ramana Raja [Thu, 25 May 2023 16:48:12 +0000 (16:48 +0000)]
qa: Add tests to validate syncing of images using rbd-mirror
Introduce functional tests to validate that the images under
workloads are correctly mirrored between two clusters using snapshot
based mirroring.
Run workload on a primary image using a krbd or nbd client. Take
mirror snapshots of the image under workload. Unmount the mapped image
and calculate its MD5 checksum before demoting it. After demotion,
wait for the mirror status of the image to be 'up+unknown' in both
the clusters. This is to make sure that the non-primary image in the
other cluster is ready to be promoted. Now promote the non-primary
image in the other cluster. Map the promoted image and calculate its
MD5 checksum. Verify that the checksums of the demoted and promoted
images in the two clusters are the same.
The above test is run as part of two different workunits:
- a workunit that validates the syncing of multiple mirrored images
with workloads running on them
- another workunit that validates the syncing of a single mirrored
image with workload running on it and the image is set as primary
alternatively between the two clusters, as it happens during
failover and failback scenarios.
Fixes: https://tracker.ceph.com/issues/61617
Signed-off-by: Ramana Raja <rraja@redhat.com>
Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Christopher Hoffman <choffman@redhat.com>
Ramana Raja [Fri, 9 Feb 2024 00:32:37 +0000 (19:32 -0500)]
qa/workunits: make wait_for_status_in_pool_dir() reentrant
In rbd_mirror_helpers.sh, the `wait_for_status_in_pool_dir()` helper
stored `mirror image status` and `mirror pool status` command outputs
in files that could be shared over successive calls or calls from
multiple threads. Instead store the command outputs in local variables
to make `wait_for_status_in_pool_dir()` reentrant.
Signed-off-by: Ramana Raja <rraja@redhat.com>
Casey Bodley [Thu, 22 Feb 2024 16:37:13 +0000 (16:37 +0000)]
Merge pull request #55634 from cbodley/wip-64480
rgw: RGWSI_SysObj_Cache::remove() invalidates after successful delete
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Kefu Chai [Tue, 20 Feb 2024 16:07:00 +0000 (00:07 +0800)]
debian/control: replace <tab> with spaces
to be consistent with the rest of this file
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
Igor Fedotov [Wed, 13 Dec 2023 16:05:45 +0000 (19:05 +0300)]
os/bluestore: introduce bluestore_debug_enforce_min_alloc_size config
parameter.
This allows to override persistent min_alloc_size if needed.
This might be helpful to troubleshoot and work around issues like
https://tracker.ceph.com/issues/63618
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
Ronen Friedman [Thu, 22 Feb 2024 12:31:31 +0000 (14:31 +0200)]
Merge pull request #55583 from ronen-fr/wip-rf-hobject
osd: improve hobject_t::to_str() performance
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
wanglinke [Thu, 22 Feb 2024 02:19:56 +0000 (10:19 +0800)]
os/bluestore: fix bluefs perf counters about l_bluefs_log_compactions
In BlueFS::_compact_log_sync_LNF_LD,l_bluefs_log_compactions
is being counted two times.
Fixes: https://tracker.ceph.com/issues/64533
co-author: Jrchyang Yu <yuzhiqiang_yewu@cmss.chinamobile.com>
Signed-off-by: Wang Linke <wanglinke_yewu@cmss.chinamobile.com>
Yuval Lifshitz [Thu, 22 Feb 2024 09:58:00 +0000 (09:58 +0000)]
test/rgw/notifications: split tests between basic, kafka and amqp
see comment: https://tracker.ceph.com/issues/64184#note-3
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
Matan Breizman [Thu, 22 Feb 2024 09:29:19 +0000 (11:29 +0200)]
Merge pull request #55641 from Matan-B/wip-matanb-crimson-alien-buf-v2
crimson/osd/main: Enable multicore client messenger
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Xuehan Xu [Thu, 22 Feb 2024 09:03:43 +0000 (17:03 +0800)]
crimson/os/seastore: fix wrong-positioned asserts
Fixes: https://tracker.ceph.com/issues/64535
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
Nizamudeen A [Thu, 22 Feb 2024 04:50:09 +0000 (10:20 +0530)]
Merge pull request #55643 from afreen23/fix-62089
mgr/dashboard: Handle errors for /api/osd/settings
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Kefu Chai [Thu, 22 Feb 2024 02:47:29 +0000 (10:47 +0800)]
Merge pull request #55328 from rosinL/wip-fix-64117
cmake/AddCephTest: bind crimson unittest to different cores
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>