]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
13 months agodoc/rados: add stop monitor command 57851/head
Zac Dover [Mon, 3 Jun 2024 00:23:43 +0000 (10:23 +1000)]
doc/rados: add stop monitor command

Add the command for stopping a monitor to the procedure that explains
how to inject a monmap into a monitor.

Zac of the future: cf. 05 Aug 2023.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c032188d66539a78ab0e4de2a5f5fc4329927bf6)

13 months agoMerge pull request #57845 from zdover23/wip-doc-2024-06-04-backport-57839-to-reef
Anthony D'Atri [Mon, 3 Jun 2024 15:54:45 +0000 (11:54 -0400)]
Merge pull request #57845 from zdover23/wip-doc-2024-06-04-backport-57839-to-reef

reef: doc/start: Edit Beginner's Guide

13 months agodoc/start: Edit Beginner's Guide 57845/head
Zac Dover [Mon, 3 Jun 2024 13:43:47 +0000 (23:43 +1000)]
doc/start: Edit Beginner's Guide

Make some improvements to the basic text of the Beginner's Guide.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f484a156bed655909617f4e351b692d7a23d0e87)

13 months agoMerge pull request #57306 from idryomov/wip-65487-reef
Ilya Dryomov [Mon, 3 Jun 2024 14:02:12 +0000 (16:02 +0200)]
Merge pull request #57306 from idryomov/wip-65487-reef

reef: rbd-mirror: clean up stale pool replayers and callouts better

Reviewed-by: Ramana Raja <rraja@redhat.com>
13 months agoMerge pull request #57309 from idryomov/wip-65624-reef
Yuri Weinstein [Mon, 3 Jun 2024 13:56:08 +0000 (06:56 -0700)]
Merge pull request #57309 from idryomov/wip-65624-reef

reef: pybind/rbd: expose CLONE_FORMAT and FLATTEN image options

Reviewed-by: Ramana Raja <rraja@redhat.com>
13 months agoMerge pull request #57091 from idryomov/wip-65573-reef
Yuri Weinstein [Mon, 3 Jun 2024 13:55:32 +0000 (06:55 -0700)]
Merge pull request #57091 from idryomov/wip-65573-reef

reef: librbd: make group and group snapshot IDs more random

Reviewed-by: Mykola Golub <mgolub@suse.com>
13 months agoMerge pull request #57030 from idryomov/wip-65481-reef
Yuri Weinstein [Mon, 3 Jun 2024 13:54:40 +0000 (06:54 -0700)]
Merge pull request #57030 from idryomov/wip-65481-reef

reef: qa: fix krbd_msgr_segments and krbd_rxbounce failing on 8.stream

Reviewed-by: Ramana Raja <rraja@redhat.com>
13 months agoqa/workunits/rbd: wait for replaying status in bootstrap tests 57306/head
Ilya Dryomov [Mon, 6 May 2024 06:16:01 +0000 (08:16 +0200)]
qa/workunits/rbd: wait for replaying status in bootstrap tests

wait_for_replay_complete() doesn't wait for image status to get
updated.  This didn't matter previously because these tests are run on
two different pools and nothing else was following.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d1d848276f0a33b20482321088c8c7470a84d0b3)

Conflicts:
qa/workunits/rbd/rbd_mirror_bootstrap.sh [ commit 3fd8a0388735
  ("qa/workunits/rbd: merge journal and snapshot test scripts")
  not in reef ]

13 months agoMerge pull request #57822 from zdover23/wip-doc-2024-06-02-backport-57820-to-reef
Zac Dover [Sun, 2 Jun 2024 23:27:28 +0000 (09:27 +1000)]
Merge pull request #57822 from zdover23/wip-doc-2024-06-02-backport-57820-to-reef

reef: doc/start: Add Beginner's Guide

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/start: Add Beginner's Guide 57822/head
Zac Dover [Sun, 2 Jun 2024 11:06:25 +0000 (21:06 +1000)]
doc/start: Add Beginner's Guide

Add a Beginner's Guide to docs.ceph.com.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 91aafc6a7f72c105fbf3aa8419863e931d5b9e00)

13 months agoMerge pull request #57815 from zdover23/wip-doc-2024-06-01-backport-57804-to-reef
Anthony D'Atri [Sun, 2 Jun 2024 00:02:15 +0000 (20:02 -0400)]
Merge pull request #57815 from zdover23/wip-doc-2024-06-01-backport-57804-to-reef

reef: doc/cephfs: edit vstart warning text

13 months agodoc/cephfs: edit vstart warning text 57815/head
Zac Dover [Fri, 31 May 2024 12:19:59 +0000 (22:19 +1000)]
doc/cephfs: edit vstart warning text

Improve the English in the vstart warning in doc/cephfs/mantle.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9ce7f9bd6c006ede6e1d563f4273376e2dbc1d03)

13 months agoMerge pull request #57792 from zdover23/wip-doc-2024-05-30-backport-57790-to-reef
Anthony D'Atri [Fri, 31 May 2024 01:24:11 +0000 (21:24 -0400)]
Merge pull request #57792 from zdover23/wip-doc-2024-05-30-backport-57790-to-reef

reef: doc/cephfs: edit front matter in mantle.rst

13 months agodoc/cephfs: edit front matter in mantle.rst 57792/head
Zac Dover [Thu, 30 May 2024 13:28:56 +0000 (23:28 +1000)]
doc/cephfs: edit front matter in mantle.rst

Improve the structure and grammar of the front matter in the
doc/cephfs/mantle.rst file.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 559d4849ecd6f93b5812f3d8d0448115c5b5beab)

13 months agoMerge pull request #57658 from rhcs-dashboard/wip-65995-reef
Avan [Thu, 30 May 2024 10:01:02 +0000 (15:31 +0530)]
Merge pull request #57658 from rhcs-dashboard/wip-65995-reef

reef: exporter: fix regex for rgw sync metrics

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
13 months agoMerge pull request #57758 from zdover23/wip-doc-2024-05-29-backport-57753-to-reef
Zac Dover [Wed, 29 May 2024 13:50:00 +0000 (23:50 +1000)]
Merge pull request #57758 from zdover23/wip-doc-2024-05-29-backport-57753-to-reef

reef: doc/dev: add note about intro of perf counters

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/dev: add note about intro of perf counters 57758/head
Zac Dover [Tue, 28 May 2024 16:27:53 +0000 (02:27 +1000)]
doc/dev: add note about intro of perf counters

Add a note to the "perf counter" section of doc/dev/perf_counters.rst
that explains that this feature was introduced in the Reef release of
Ceph. This note will prevent us from accidentally backporting
perf-counter-related PRs to Quincy.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 55e41bc679aeee9119dc815b456bb76880f61ea2)

13 months agoMerge pull request #57750 from zdover23/wip-doc-2024-05-29-backport-57732-to-reef
Zac Dover [Tue, 28 May 2024 16:20:41 +0000 (02:20 +1000)]
Merge pull request #57750 from zdover23/wip-doc-2024-05-29-backport-57732-to-reef

doc/developer_guide: update doc about installing teuthology

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agoMerge pull request #57743 from zdover23/wip-doc-2024-05-28-backport-57720-to-reef
Zac Dover [Tue, 28 May 2024 16:19:29 +0000 (02:19 +1000)]
Merge pull request #57743 from zdover23/wip-doc-2024-05-28-backport-57720-to-reef

doc/cephfs: s/subvolumegroups/subvolume groups

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/developer_guide: update doc about installing teuthology 57750/head
Rishabh Dave [Mon, 27 May 2024 19:37:35 +0000 (01:07 +0530)]
doc/developer_guide: update doc about installing teuthology

There are 2 more ways to install teuthology. Approach with boostrap
script is easier and more convenient while other approach is more
elaborate but manual, document both of them. Don't delete the currently
documented approach because it lets users install teuthology
conveniently in a custom virtual environment. So, keep all three.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 899c481d4006a1231354de6633fd2806aa4bd5d2)

13 months agodoc/cephfs: s/subvolumegroups/subvolume groups 57743/head
Zac Dover [Mon, 27 May 2024 11:09:40 +0000 (21:09 +1000)]
doc/cephfs: s/subvolumegroups/subvolume groups

Use the term "subvolume groups" instead of "subvolumegroups" where the
term appears in plain English. The string "subvolumegroups" is correct
in commands, and remains unchanged.

Also add formatting to command output, to make clearer that the output
is indeed output.

Fixes: https://github.com/ceph/ceph/pull/57574#discussion_r1606988766
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b303417f653d149852e163bf3e2e3edf5c6b71a0)

13 months agoMerge pull request #57727 from idryomov/wip-labeler-rbd-reef
Ilya Dryomov [Tue, 28 May 2024 07:25:35 +0000 (09:25 +0200)]
Merge pull request #57727 from idryomov/wip-labeler-rbd-reef

reef: .github: sync the list of paths for rbd label, expand tests label to qa/*

Reviewed-by: Ramana Raja <rraja@redhat.com>
13 months agoMerge pull request #57736 from zdover23/wip-doc-2024-05-27-cephfs-metrics-reef-2
Zac Dover [Tue, 28 May 2024 04:10:35 +0000 (14:10 +1000)]
Merge pull request #57736 from zdover23/wip-doc-2024-05-27-cephfs-metrics-reef-2

reef: doc/cephfs: add metrics to left pane

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/cephfs: add metrics to left pane 57736/head
Zac Dover [Tue, 28 May 2024 02:59:16 +0000 (12:59 +1000)]
doc/cephfs: add metrics to left pane

Add a link to doc/cephfs/index.rst to cause "Metrics" to appear in the
left pane.

Signed-off-by: Zac Dover <zac.dover@proton.me>
13 months agoMerge pull request #57724 from zdover23/wip-doc-2024-05-27-backport-57628-to-reef
Zac Dover [Tue, 28 May 2024 01:12:07 +0000 (11:12 +1000)]
Merge pull request #57724 from zdover23/wip-doc-2024-05-27-backport-57628-to-reef

reef: doc: document metrics exported by CephFS

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
13 months agodoc: document metrics exported by CephFS 57724/head
Jos Collin [Wed, 22 May 2024 12:40:24 +0000 (18:10 +0530)]
doc: document metrics exported by CephFS

Fixes: https://tracker.ceph.com/issues/66173
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit f8f47852f309d2f8d6ea53a0650c7fbef2a70efa)

13 months agoMerge pull request #57734 from zdover23/wip-doc-2024-05-27-cephfs-metrics-reef
Zac Dover [Tue, 28 May 2024 00:59:36 +0000 (10:59 +1000)]
Merge pull request #57734 from zdover23/wip-doc-2024-05-27-cephfs-metrics-reef

reef: doc/dev: add target links to perf_counters.rst

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
13 months agodoc/dev: add target links to perf_counters.rst 57734/head
Zac Dover [Tue, 28 May 2024 00:49:35 +0000 (10:49 +1000)]
doc/dev: add target links to perf_counters.rst

Add target links to perf_counters.rst, to remedy the failure to backport
the docs changes in https://github.com/ceph/ceph/pull/53003.
(https://github.com/ceph/ceph/pull/53003 mixed code and docs changes, so
it is understandable why the backport was not achieved back in October,
when the merge to main occurred.)

Signed-off-by: Zac Dover <zac.dover@proton.me>
13 months ago.github: expand tests label to all files under qa 57727/head
Ilya Dryomov [Thu, 23 May 2024 16:15:08 +0000 (18:15 +0200)]
.github: expand tests label to all files under qa

The test job definition under qa/suites is an integral part of almost
any test.  Often, the test logic is split between the task or workunit
and respective snippet(s) under qa/suites.

Other files under qa are less used, but still related to nothing but
testing, so just add the label on all of it.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0543b9264f662cd25c059dff7252002fc6859d0d)

13 months ago.github: sync the list of paths for rbd label with CODEOWNERS
Ilya Dryomov [Tue, 23 Apr 2024 11:00:08 +0000 (13:00 +0200)]
.github: sync the list of paths for rbd label with CODEOWNERS

With https://github.com/actions/labeler/issues/483 still pending, do it
manually.

A couple of entries matching both files and directories were expanded
since, unlike fnmatch(3), minimatch treats slashes specially:

- src/include/rbd* -> src/include/rbd* src/include/rbd/**
- src/rbd*         -> src/rbd* src/rbd*/**
- src/test/rbd*    -> src/test/rbd* src/test/rbd*/**

A bunch of entries under src/tools were combined into:

- src/tools/rbd*/**

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 716996eff8ffde66f9b8404ee942189dbfeb5249)

13 months agoCODEOWNERS: assign ceph-rbd-mirror systemd service to RBD
Ilya Dryomov [Tue, 23 Apr 2024 10:57:49 +0000 (12:57 +0200)]
CODEOWNERS: assign ceph-rbd-mirror systemd service to RBD

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9d1302d780c64568c0aed0828217bcb5a8a5c575)

13 months agoMerge pull request #57707 from zdover23/wip-doc-2024-05-26-backport-57393-to-reef
Zac Dover [Mon, 27 May 2024 11:00:46 +0000 (21:00 +1000)]
Merge pull request #57707 from zdover23/wip-doc-2024-05-26-backport-57393-to-reef

reef: doc/man: add missing long option switches

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agoMerge pull request #57704 from zdover23/wip-doc-2024-05-26-backport-57701-to-reef
Zac Dover [Mon, 27 May 2024 11:00:19 +0000 (21:00 +1000)]
Merge pull request #57704 from zdover23/wip-doc-2024-05-26-backport-57701-to-reef

reef: doc/cephfs: disambiguate two sentences

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/man: add missing long option switches 57707/head
Patrick Donnelly [Fri, 10 May 2024 14:09:16 +0000 (10:09 -0400)]
doc/man: add missing long option switches

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit ad710c1f9395917310046a810176fca37b286fab)

13 months agodoc/cephfs: disambiguate two sentences 57704/head
Zac Dover [Sat, 25 May 2024 08:41:03 +0000 (18:41 +1000)]
doc/cephfs: disambiguate two sentences

Rewrite two sentences so that they are unambgiuously in the indicative
mood and not, as they previously seemed, in the imperative mood.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 32155e236085f64f7ea289f26be1274d5d2771fa)

13 months agoMerge pull request #57666 from zdover23/wip-doc-2024-05-24-backport-57567-to-reef
Zac Dover [Sat, 25 May 2024 08:28:38 +0000 (18:28 +1000)]
Merge pull request #57666 from zdover23/wip-doc-2024-05-24-backport-57567-to-reef

reef: doc/cephfs: edit "Cloning Snapshots" in fs-volumes.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agoMerge pull request #57663 from zdover23/wip-doc-2024-05-24-backport-57574-to-reef
Zac Dover [Sat, 25 May 2024 07:57:49 +0000 (17:57 +1000)]
Merge pull request #57663 from zdover23/wip-doc-2024-05-24-backport-57574-to-reef

reef: doc/cephfs: edit "Pinning Subvolumes..."

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agoMerge pull request #57669 from zdover23/wip-doc-2024-05-24-backport-57554-to-reef
Zac Dover [Sat, 25 May 2024 07:16:36 +0000 (17:16 +1000)]
Merge pull request #57669 from zdover23/wip-doc-2024-05-24-backport-57554-to-reef

reef: doc/cephfs: separate commands into sections

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/cephfs: edit "Cloning Snapshots" in fs-volumes.rst 57666/head
Zac Dover [Mon, 20 May 2024 11:55:16 +0000 (21:55 +1000)]
doc/cephfs: edit "Cloning Snapshots" in fs-volumes.rst

Edit the "Cloning Snapshots" section in doc/cephfs/fs-volumes.rst. This
commit represents only a grammar pass. A future commit (and future PR)
will separate this section into subsections by command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 69941180e9b1ff5f7f0eddfba670028aae93e333)

13 months agodoc/cephfs: edit "Pinning Subvolumes..." 57663/head
Zac Dover [Mon, 20 May 2024 15:07:14 +0000 (01:07 +1000)]
doc/cephfs: edit "Pinning Subvolumes..."

Edit the section "Pinning Subvolumes and Subvolume Groups" in
doc/cephfs/fs-volumes.rst. This is merely a grammar edit.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b319ead00e17a3a6d734e305454c8cfc403619ea)

13 months agoMerge pull request #57647 from zdover23/wip-doc-2024-05-23-backport-57633-to-reef
Zac Dover [Sat, 25 May 2024 07:07:26 +0000 (17:07 +1000)]
Merge pull request #57647 from zdover23/wip-doc-2024-05-23-backport-57633-to-reef

reef: doc: clarify use of location: in host spec

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam King <adking@redhat.com>
13 months agoMerge pull request #57644 from zdover23/wip-doc-2024-05-23-backport-57642-to-reef
Zac Dover [Thu, 23 May 2024 15:05:53 +0000 (01:05 +1000)]
Merge pull request #57644 from zdover23/wip-doc-2024-05-23-backport-57642-to-reef

reef: doc/dev/release-process.rst: note new 'project' arguments

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
13 months agodoc/cephfs: separate commands into sections 57669/head
Zac Dover [Mon, 20 May 2024 06:29:44 +0000 (16:29 +1000)]
doc/cephfs: separate commands into sections

Separate commands so that each command has its own subsection in the
section "FS Subvolumes" in the file doc/cephfs/fs-volumes.rst.
Previously, the list of commands for manipulating subvolumes was one
long, unbroken list and the beginning of one section could easily be
mistaken for the end of the previous section.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a84ec3a1c0f026f54d079509b5d6cafde032154c)

13 months agoexporter: fix regex for rgw sync metrics 57658/head
Avan Thakkar [Fri, 22 Mar 2024 21:52:53 +0000 (03:22 +0530)]
exporter: fix regex for rgw sync metrics

Fixes: https://tracker.ceph.com/issues/65091
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit d9d8cbeed5cb92a15727795ac5f63338e93d47a3)

13 months agodoc: clarify use of location: in host spec 57647/head
Matthew Vernon [Wed, 22 May 2024 15:31:33 +0000 (16:31 +0100)]
doc: clarify use of location: in host spec

It wasn't clear that you can specify more than one element of the CRUSH hierarchy in a spec file, nor that it might be useful to do so (e.g. to ensure the host ends up beneath the default root).

So update the text to make it clearer, and similarly the example.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit 2366391ccec0fb6d8a1c159d6e3cdf5ff4f1d603)

13 months agodoc/dev/release-process.rst: note new 'project' arguments 57644/head
Dan Mick [Wed, 22 May 2024 22:25:51 +0000 (15:25 -0700)]
doc/dev/release-process.rst: note new 'project' arguments

Support added to the release scripts (from ceph-build.git) to
work for ceph-iscsi, so 'project' must be passed to these scripts,
and will appear in the prerelease pathnames.  See also
https://github.com/ceph/ceph-build/pull/2243 and
https://github.com/ceph/ceph-container/pull/2210

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 7e64c6386e3571c657e0889ef12449e5b43f751a)

13 months agoMerge pull request #53717 from leonid-s-usov/bp/msg-wait/reef
Leonid S. Usov [Wed, 22 May 2024 14:25:32 +0000 (17:25 +0300)]
Merge pull request #53717 from leonid-s-usov/bp/msg-wait/reef

reef: msg/AsyncMessenger: re-evaluate the stop condition when woken up in 'wait()'

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
13 months agoMerge pull request #57219 from rhcs-dashboard/wip-65756-reef
Nizamudeen A [Wed, 22 May 2024 08:17:53 +0000 (04:17 -0400)]
Merge pull request #57219 from rhcs-dashboard/wip-65756-reef

reef: mgr/dashboard: exclude cloned-deleted RBD snaps

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
13 months agoqa/suites/krbd: krbd_rxbounce.sh needs g++ installed 57030/head
Ilya Dryomov [Sat, 13 Apr 2024 07:59:03 +0000 (09:59 +0200)]
qa/suites/krbd: krbd_rxbounce.sh needs g++ installed

It happens implicitly on Ubuntu, but not on CentOS Stream 8.

Fixes: https://tracker.ceph.com/issues/65481
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 16ad0d52c94ff0d0f92a7641f69d7739251be705)

13 months agoqa: krbd_msgr_segments.t: adapt to different vgremove outputs
Ilya Dryomov [Sat, 13 Apr 2024 07:44:21 +0000 (09:44 +0200)]
qa: krbd_msgr_segments.t: adapt to different vgremove outputs

Some versions of lvm put a dot at the end.

Fixes: https://tracker.ceph.com/issues/65481
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit b20951f189c6386a03fc399ead88acca6bd6e19d)

14 months agoMerge pull request #57543 from zdover23/wip-doc-2024-05-19-backport-57534-to-reef-2
Zac Dover [Sun, 19 May 2024 00:52:24 +0000 (10:52 +1000)]
Merge pull request #57543 from zdover23/wip-doc-2024-05-19-backport-57534-to-reef-2

reef: doc/cephfs: edit fs-volumes.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
14 months agodoc/cephfs: edit fs-volumes.rst (2 of x) 57543/head
Zac Dover [Fri, 17 May 2024 10:46:28 +0000 (20:46 +1000)]
doc/cephfs: edit fs-volumes.rst (2 of x)

Edit doc/cephfs/fs-volumes to the section "Cloning Snapshots" (but not
including the section "Cloning Snapshots".

Follows https://github.com/ceph/ceph/pull/57415

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0a3981a011d5e768ab8a5782884283b6650af28a)

14 months agoMerge pull request #57464 from idryomov/wip-51845-reef
Ilya Dryomov [Wed, 15 May 2024 11:06:14 +0000 (13:06 +0200)]
Merge pull request #57464 from idryomov/wip-51845-reef

reef: qa/suites/krbd: drop pre-single-major and move "layering only" coverage

Reviewed-by: Ramana Raja <rraja@redhat.com>
14 months agoqa/suites/krbd: rename no-object-map to no-exclusive-lock 57464/head
Ilya Dryomov [Mon, 13 May 2024 11:45:26 +0000 (13:45 +0200)]
qa/suites/krbd: rename no-object-map to no-exclusive-lock

Exclusive lock has always been disabled by this facet, so it might as
well be reflected in its name.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit ad6a95d8af42b1c3ed9d244c6161e5269356c7c9)

14 months agoqa/suites/krbd: move "layering only" coverage to fsx
Ilya Dryomov [Mon, 13 May 2024 11:31:17 +0000 (13:31 +0200)]
qa/suites/krbd: move "layering only" coverage to fsx

It makes much more sense there since it's where we actually create
clones and flatten them a lot.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 7b9f28e74325aad17c3774d594c3f0e1c4e25dc2)

14 months agoqa/suites/krbd: drop pre-single-major test
Ilya Dryomov [Sun, 12 May 2024 09:15:36 +0000 (11:15 +0200)]
qa/suites/krbd: drop pre-single-major test

Single-major mapping scheme was introduced in 2014 and became the
default in 2017.  It's getting increasingly difficult to build and,
more importantly, to boot a 10 year old kernel with recent userspace
(systemd, etc).  If someone is still running such a kernel, it's
really unlikely that they would have the most recent rbd CLI tool
installed.

Fixes: https://tracker.ceph.com/issues/51845
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 39a579144cd8b97dd338bfcf36c06ad4bcaed526)

14 months agoMerge pull request #57427 from zdover23/wip-doc-2024-05-13-backport-57420-to-reef
Anthony D'Atri [Sun, 12 May 2024 21:37:10 +0000 (17:37 -0400)]
Merge pull request #57427 from zdover23/wip-doc-2024-05-13-backport-57420-to-reef

reef: doc/cephfs: edit fs-volumes.rst (1 of x) followup

14 months agodoc/cephfs: edit fs-volumes.rst (1 of x) followup 57427/head
Zac Dover [Sun, 12 May 2024 01:39:34 +0000 (11:39 +1000)]
doc/cephfs: edit fs-volumes.rst (1 of x) followup

Include the suggestions for improving doc/cephfs/fs-volumes.rst made by
Anthony D'Atri here
https://github.com/ceph/ceph/pull/57415#discussion_r1597362110

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit cb700d804b4390fd9f55444dcfc04dfebac3a1bf)

14 months agoMerge pull request #57418 from zdover23/wip-doc-2024-05-12-backport-57415-to-reef
Zac Dover [Sun, 12 May 2024 20:54:40 +0000 (06:54 +1000)]
Merge pull request #57418 from zdover23/wip-doc-2024-05-12-backport-57415-to-reef

reef: doc/cephfs: edit fs-volumes.rst (1 of x)

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
14 months agoMerge pull request #57423 from zdover23/wip-doc-2024-05-12-backport-57421-to-reef
Anthony D'Atri [Sun, 12 May 2024 05:27:04 +0000 (01:27 -0400)]
Merge pull request #57423 from zdover23/wip-doc-2024-05-12-backport-57421-to-reef

reef: doc/dev: s/to asses/to assess/

14 months agodoc/dev: s/to asses/to assess/ 57423/head
Zac Dover [Sun, 12 May 2024 02:27:23 +0000 (12:27 +1000)]
doc/dev: s/to asses/to assess/

s/to asses/to assess/ in doc/deve/developer_guide/dash-devel.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 832358b072ec5cb4672de8a7a7aebf10a39fd0e5)

14 months agodoc/cephfs: edit fs-volumes.rst (1 of x) 57418/head
Zac Dover [Sat, 11 May 2024 04:57:23 +0000 (14:57 +1000)]
doc/cephfs: edit fs-volumes.rst (1 of x)

Edit doc/cephfs/fs-volumes to the section "FS Subvolumes" (but not
including the section "FS Subvolumes").

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0acbb278fc712c32334fd7340b887d2865dbfb86)

14 months agoMerge pull request #57365 from zdover23/wip-doc-2024-05-09-radosgw-bucketpolicy-reef
Zac Dover [Sat, 11 May 2024 23:04:58 +0000 (09:04 +1000)]
Merge pull request #57365 from zdover23/wip-doc-2024-05-09-radosgw-bucketpolicy-reef

reef: doc/radosgw: update Reef S3 action list

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
14 months agoMerge PR #57343 into reef
Patrick Donnelly [Sat, 11 May 2024 01:27:08 +0000 (21:27 -0400)]
Merge PR #57343 into reef

* refs/pull/57343/head:
reef: qa: do not use `fs authorize` for two fs
PendingReleaseNotes: add note on the client incompatibility health warning and feature bit
doc/cephfs: add client_mds_auth_caps client feature bit
doc/cephfs: add missing client feature bits
doc/cephfs: document MDS_CLIENTS_BROKEN_ROOTSQUASH health error
qa: add tests for MDS_CLIENTS_BROKEN_ROOTSQUASH
mds: raise health warning if client lacks feature for root_squash
mon/MDSMonitor: add note about missing metadata inclusion
mds: check relevant caps for fs include root_squash
mds: refactor out fs_name match in MDSAuthCaps
qa: test for root_squash with multiple caps
qa: pass kwargs to mount from remount
qa: simplify update_attrs and only update relevant keys
client: allow overriding client features

Tested-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
14 months agoMerge PR #57375 into reef
Patrick Donnelly [Sat, 11 May 2024 01:26:09 +0000 (21:26 -0400)]
Merge PR #57375 into reef

* refs/pull/57375/head:
cmake/arrow: don't treat warnings as errors

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
14 months agoMerge PR #57373 into reef
Patrick Donnelly [Sat, 11 May 2024 01:24:16 +0000 (21:24 -0400)]
Merge PR #57373 into reef

* refs/pull/57373/head:
mon/MDSMonitor: fix assert crash in `fs swap`

14 months agoMerge PR #57357 into reef
Patrick Donnelly [Sat, 11 May 2024 01:23:38 +0000 (21:23 -0400)]
Merge PR #57357 into reef

* refs/pull/57357/head:
ceph.spec.in: remove command-with-macro line

Reviewed-by: John Mulligan <jmulligan@redhat.com>
14 months agoreef: qa: do not use `fs authorize` for two fs 57343/head
Patrick Donnelly [Thu, 9 May 2024 01:38:56 +0000 (21:38 -0400)]
reef: qa: do not use `fs authorize` for two fs

This support was only recently added in squid.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
14 months agodoc/radosgw: update Reef S3 action list 57365/head
Zac Dover [Wed, 8 May 2024 22:25:26 +0000 (08:25 +1000)]
doc/radosgw: update Reef S3 action list

Update the list of S3 actions supported in the Reef release of Ceph.

Note: the list of S3 actions supported in Reef is not the list of S3
actions supported in Squid or in Quincy.

Co-authored-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
14 months agoMerge pull request #57336 from zdover23/wip-doc-2024-05-08-backport-57298-to-reef
Zac Dover [Fri, 10 May 2024 11:12:25 +0000 (21:12 +1000)]
Merge pull request #57336 from zdover23/wip-doc-2024-05-08-backport-57298-to-reef

reef: doc/mgr: edit "Overview" in dashboard.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
14 months agoMerge pull request #57296 from zdover23/wip-doc-2024-05-07-backport-57273-to-reef
Zac Dover [Fri, 10 May 2024 11:05:55 +0000 (21:05 +1000)]
Merge pull request #57296 from zdover23/wip-doc-2024-05-07-backport-57273-to-reef

reef: doc/mgr: edit "Resolve IP address to hostname before redirect"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
14 months agoMerge pull request #57371 from weirdwiz/wip-65880-reef
Avan [Fri, 10 May 2024 10:14:14 +0000 (15:44 +0530)]
Merge pull request #57371 from weirdwiz/wip-65880-reef

reef: exporter: handle exceptions gracefully

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
14 months agocmake/arrow: don't treat warnings as errors 57375/head
Casey Bodley [Wed, 24 Jan 2024 14:44:25 +0000 (09:44 -0500)]
cmake/arrow: don't treat warnings as errors

with arrow's default BUILD_WARNING_LEVEL, -Werror is added to cflags and
debug builds fail on a warning about _FORTIFY_SOURCE

Fixes: https://tracker.ceph.com/issues/63130
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 5c1a57a1afed1e4a632fb6df6de34ff9689460db)

14 months agomon/MDSMonitor: fix assert crash in `fs swap` 57373/head
Patrick Donnelly [Thu, 9 May 2024 13:07:28 +0000 (09:07 -0400)]
mon/MDSMonitor: fix assert crash in `fs swap`

Paxos is plugged differently between main and reef.

Fixes: f11cf2b6dc5974d0e63d83f50e4e18e828df8e8e
Fixes: https://tracker.ceph.com/issues/65883
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
14 months agoPendingReleaseNotes: add note on the client incompatibility health warning and featur...
Patrick Donnelly [Fri, 3 May 2024 00:45:43 +0000 (20:45 -0400)]
PendingReleaseNotes: add note on the client incompatibility health warning and feature bit

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit e70f005f1b2f4ba5466d254ec4a6432297d3fbf4)

14 months agodoc/cephfs: add client_mds_auth_caps client feature bit
Patrick Donnelly [Fri, 3 May 2024 00:46:17 +0000 (20:46 -0400)]
doc/cephfs: add client_mds_auth_caps client feature bit

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 536b47cbfc669b5a3f04d93964408a2258d05ad0)

14 months agodoc/cephfs: add missing client feature bits
Patrick Donnelly [Fri, 3 May 2024 00:38:19 +0000 (20:38 -0400)]
doc/cephfs: add missing client feature bits

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 79ba8970d7cbc714e160d5957bd849eede93e5a3)

14 months agodoc/cephfs: document MDS_CLIENTS_BROKEN_ROOTSQUASH health error
Patrick Donnelly [Thu, 2 May 2024 23:33:50 +0000 (19:33 -0400)]
doc/cephfs: document MDS_CLIENTS_BROKEN_ROOTSQUASH health error

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit b810bc9c54515b69aefffb36f1a47235b3c9125d)

14 months agoqa: add tests for MDS_CLIENTS_BROKEN_ROOTSQUASH
Patrick Donnelly [Fri, 3 May 2024 00:52:29 +0000 (20:52 -0400)]
qa: add tests for MDS_CLIENTS_BROKEN_ROOTSQUASH

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 9d0ab233d822668e88c873bc1314e984feaf1296)

14 months agomds: raise health warning if client lacks feature for root_squash
Patrick Donnelly [Fri, 3 May 2024 00:50:37 +0000 (20:50 -0400)]
mds: raise health warning if client lacks feature for root_squash

Rather than evict all clients lacking this feature bit, raise a health error
that pushes the administrator to address it. This avoids the surprise of having
all affected clients suddenly evicted in the cluster.

Fixes: https://tracker.ceph.com/issues/65733
Fixes: 954ed30
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 66ff5c9fc8d4664f18b2fa462e96e5548c35951f)

Conflicts:
src/messages/MMDSBeacon.h: missing health beacon type

14 months agomon/MDSMonitor: add note about missing metadata inclusion
Patrick Donnelly [Fri, 3 May 2024 00:49:22 +0000 (20:49 -0400)]
mon/MDSMonitor: add note about missing metadata inclusion

There is a "client_count" metadata on the health warning that apparently was
intended to be used for aggregating warnings but never was. Add a TODO item for
that.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 6517b704e311fd24dbf5bfbdec2ddd23b17d4092)

14 months agomds: check relevant caps for fs include root_squash
Patrick Donnelly [Wed, 1 May 2024 01:41:14 +0000 (21:41 -0400)]
mds: check relevant caps for fs include root_squash

When denying client reconnects because the MDS caps include root_squash and the
client features do not include CEPHFS_FEATURE_MDS_AUTH_CAPS_CHECK, ensure those
caps are only for the file system the MDS is joined to.

Fixes: https://tracker.ceph.com/issues/65733
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit f79ae86f2c23388f6ecc3177764735e071998e09)

14 months agomds: refactor out fs_name match in MDSAuthCaps
Patrick Donnelly [Thu, 2 May 2024 12:55:36 +0000 (08:55 -0400)]
mds: refactor out fs_name match in MDSAuthCaps

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 247b4fed28617c104473d1586b66a8735bff0411)

14 months agoqa: test for root_squash with multiple caps
Patrick Donnelly [Thu, 2 May 2024 01:08:57 +0000 (21:08 -0400)]
qa: test for root_squash with multiple caps

Where the client has root_squash for one cap but not for another. The fs
without root_squash should not necessarily reject the client.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit bccc8ceb471c441ec04d7eb2c353630f8c5ce843)

Conflicts:
qa/tasks/cephfs/test_admin.py: missing test

14 months agoqa: pass kwargs to mount from remount
Patrick Donnelly [Thu, 2 May 2024 02:06:54 +0000 (22:06 -0400)]
qa: pass kwargs to mount from remount

So we can pass mntargs.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit afcbfc040b56779e58563f715f26a0fe25e9f916)

14 months agoqa: simplify update_attrs and only update relevant keys
Patrick Donnelly [Thu, 2 May 2024 02:04:57 +0000 (22:04 -0400)]
qa: simplify update_attrs and only update relevant keys

So we can just pass the caller's kwargs to update_attrs.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 597ff3cb15e7a7ce527b35eb01d9958b755bbf01)

14 months agoclient: allow overriding client features
Patrick Donnelly [Thu, 2 May 2024 00:51:59 +0000 (20:51 -0400)]
client: allow overriding client features

For testing purposes.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit d9239f9375c1ae92a4990950f40078766bd912e8)

14 months agoexporter: handle exceptions gracefully 57371/head
Divyansh Kamboj [Tue, 30 Apr 2024 07:44:10 +0000 (13:14 +0530)]
exporter: handle exceptions gracefully

ceph exporter crahes, and fails to handle exceptions in
dump_asok_metrics(). add try and catch blocks to handle the exceptions gracefully.

Signed-off-by: Divyansh Kamboj <dkamboj@redhat.com>
(cherry picked from commit e442ee479987f339afdc333582b6b64c66ba6846)

14 months agoMerge pull request #55697 from pdvian/wip-63842-reef
Laura Flores [Thu, 9 May 2024 00:34:27 +0000 (19:34 -0500)]
Merge pull request #55697 from pdvian/wip-63842-reef

14 months agoceph.spec.in: remove command-with-macro line 57357/head
John Mulligan [Fri, 29 Mar 2024 18:04:33 +0000 (14:04 -0400)]
ceph.spec.in: remove command-with-macro line

A comment clearly left as a breadcrumb for a node-proxy manpage is
causing (intermittent) build failures. Remove the line and hope
the manpage is added if/when appropriate.

Fixes: 0dd73643649ddc2366e60de4fe6c078b6e112091
Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 5f25005dfbff51531989d121f26ecae308409356)

14 months agodoc/mgr: edit "Overview" in dashboard.rst 57336/head
Zac Dover [Mon, 6 May 2024 15:16:51 +0000 (01:16 +1000)]
doc/mgr: edit "Overview" in dashboard.rst

Edit and update the "Overview" section in doc/mgr/dashboard.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6cf06c60f7c3f87707c7dc47cde2346cec7cf00f)

14 months agotest/pybind: drop unnecessary data_pool=None arguments 57309/head
Ilya Dryomov [Wed, 1 May 2024 13:49:54 +0000 (15:49 +0200)]
test/pybind: drop unnecessary data_pool=None arguments

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 555601796000d83a37324c9f9b065d9c3aa48b8e)

14 months agopybind/rbd: adjust error message in deep_copy()
Ilya Dryomov [Wed, 1 May 2024 13:49:51 +0000 (15:49 +0200)]
pybind/rbd: adjust error message in deep_copy()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5986217c79f2fe01e21f6910affa896bd2516f02)

14 months agopybind/rbd: expose RBD_IMAGE_OPTION_FLATTEN option
Ilya Dryomov [Wed, 1 May 2024 13:49:47 +0000 (15:49 +0200)]
pybind/rbd: expose RBD_IMAGE_OPTION_FLATTEN option

It takes effect with deep_copy() and migration_prepare().

Fixes: https://tracker.ceph.com/issues/65624
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 39f207ff65a4eb10f67a2d4a8a4af1bad0d2e412)

Conflicts:
PendingReleaseNotes [ moved to >=18.2.4 section ]

14 months agopybind/rbd: expose RBD_IMAGE_OPTION_CLONE_FORMAT option
Ilya Dryomov [Sun, 28 Apr 2024 17:19:22 +0000 (19:19 +0200)]
pybind/rbd: expose RBD_IMAGE_OPTION_CLONE_FORMAT option

It takes effect with clone(), deep_copy() and migration_prepare().

Fixes: https://tracker.ceph.com/issues/65624
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 39fafe74625423e5d23a5f1bbd74e58ef9055573)

Conflicts:
PendingReleaseNotes [ moved to >=18.2.4 section ]

14 months agorbd-mirror: remove callout when destroying pool replayer
Ilya Dryomov [Wed, 24 Apr 2024 10:45:27 +0000 (12:45 +0200)]
rbd-mirror: remove callout when destroying pool replayer

If a pool replayer is removed in an error state (e.g. after failing to
connect to the remote cluster), its callout should be removed as well.
Otherwise, the error would persist causing "daemon health: ERROR"
status to be reported even after a new pool replayer is created and
started successfully.

Fixes: https://tracker.ceph.com/issues/65487
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit b7e79642d53c1802ae1202c3f013677fcfd26b1b)

14 months agorbd-mirror: shut down and remove pool replayer if peer changes
Ilya Dryomov [Wed, 24 Apr 2024 12:42:38 +0000 (14:42 +0200)]
rbd-mirror: shut down and remove pool replayer if peer changes

The code in Mirror::update_pool_replayers() responsible for shutting
down and removing stale pool replayers kicks in only in case the peer
is removed, but not if the peer changes.  However, the code responsible
for (re)starting pool replayers in the same method _does_ create and
start a new pool replayer in that case.  As a result, we can end up
with nearly identical pool replayers running at the same time, hogging
OS resources and confusing instance_id tracking logic and mirror status
reporting at the very least.

The root cause is that PeerSpec is matched normally (i.e. based on all
fields) when it comes to m_pool_replayers, and based only on UUID when
it comes to pool_peers.  This was missed in commit 5463e1a1e1b7
("rbd-mirror: extract optional peer mon_host/key values from MON").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit def93cb0ad93e3e27d7c4534f68c95ef922ab750)

14 months agodoc/mgr: edit "Resolve IP address to hostname before redirect" 57296/head
Zac Dover [Sun, 5 May 2024 19:12:55 +0000 (05:12 +1000)]
doc/mgr: edit "Resolve IP address to hostname before redirect"

Edit the section "Resolve IP address to hostname before redirect" in
doc/mgr/dashboard.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e0838daa9bc1d549a8da2b21608153c77b15455a)

14 months agoMerge pull request #56948 from adk3798/wip-65540-reef
Aashish Sharma [Mon, 6 May 2024 13:43:20 +0000 (19:13 +0530)]
Merge pull request #56948 from adk3798/wip-65540-reef

reef: ceph-mixin: Update mixin to include alerts for the nvmeof gateway(s)

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
14 months agoMerge pull request #57255 from aaSharma14/wip-65789-reef
Pedro Gonzalez Gomez [Mon, 6 May 2024 09:24:12 +0000 (11:24 +0200)]
Merge pull request #57255 from aaSharma14/wip-65789-reef

reef: mgr/dashboard: add prometheus federation config for mullti-cluster monitoring

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>