]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 months agoMerge branch 'wip-reef-raw-cluster-cmd' of https://github.com/vshankar/ceph into... wip-vshankar-testing1-reef-2024-02-29-1606
Venky Shankar [Thu, 29 Feb 2024 10:37:01 +0000 (16:07 +0530)]
Merge branch 'wip-reef-raw-cluster-cmd' of https://github.com/vshankar/ceph into wip-vshankar-testing1-reef-2024-02-29-1606

16 months agoMerge branch 'wip-64485-reef' of https://github.com/vshankar/ceph into wip-vshankar...
Venky Shankar [Thu, 29 Feb 2024 10:36:58 +0000 (16:06 +0530)]
Merge branch 'wip-64485-reef' of https://github.com/vshankar/ceph into wip-vshankar-testing1-reef-2024-02-29-1606

16 months agoMerge branch 'wip-63691-reef' of https://github.com/dparmar18/ceph into wip-vshankar...
Venky Shankar [Thu, 29 Feb 2024 10:36:57 +0000 (16:06 +0530)]
Merge branch 'wip-63691-reef' of https://github.com/dparmar18/ceph into wip-vshankar-testing1-reef-2024-02-29-1606

16 months agoMerge branch 'wip-64144-reef' of https://github.com/neesingh-rh/ceph into wip-vshanka...
Venky Shankar [Thu, 29 Feb 2024 10:36:56 +0000 (16:06 +0530)]
Merge branch 'wip-64144-reef' of https://github.com/neesingh-rh/ceph into wip-vshankar-testing1-reef-2024-02-29-1606

16 months agoMerge branch 'wip-64098-reef' of https://github.com/neesingh-rh/ceph into wip-vshanka...
Venky Shankar [Thu, 29 Feb 2024 10:36:55 +0000 (16:06 +0530)]
Merge branch 'wip-64098-reef' of https://github.com/neesingh-rh/ceph into wip-vshankar-testing1-reef-2024-02-29-1606

16 months agoMerge branch 'wip-63262' of https://github.com/lxbsz/ceph into wip-vshankar-testing1...
Venky Shankar [Thu, 29 Feb 2024 10:36:54 +0000 (16:06 +0530)]
Merge branch 'wip-63262' of https://github.com/lxbsz/ceph into wip-vshankar-testing1-reef-2024-02-29-1606

16 months agoreef: use raw_cluster_cmd instead of run_ceph_cmd 55836/head
Venky Shankar [Thu, 29 Feb 2024 10:31:24 +0000 (16:01 +0530)]
reef: use raw_cluster_cmd instead of run_ceph_cmd

Due to https://github.com/ceph/ceph/pull/50569 not being backported

Signed-off-by: Venky Shankar <vshankar@redhat.com>
16 months agoMerge pull request #55786 from rhcs-dashboard/wip-64595-reef
Nizamudeen A [Thu, 29 Feb 2024 10:32:18 +0000 (16:02 +0530)]
Merge pull request #55786 from rhcs-dashboard/wip-64595-reef

reef: mgr/dashboard: fix volume creation with multiple hosts

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #55665 from idryomov/wip-64423-reef
Yuri Weinstein [Wed, 28 Feb 2024 20:33:06 +0000 (12:33 -0800)]
Merge pull request #55665 from idryomov/wip-64423-reef

reef: librbd: fix split() for SparseExtent and SparseBufferlistExtent

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
16 months agoMerge pull request #55617 from trociny/wip-64464-reef
Yuri Weinstein [Wed, 28 Feb 2024 20:31:56 +0000 (12:31 -0800)]
Merge pull request #55617 from trociny/wip-64464-reef

reef: tools/rbd: make 'children' command support --image-id

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agoMerge pull request #55714 from ceph/wip-yuriw-p2p-reef
Yuri Weinstein [Wed, 28 Feb 2024 15:43:27 +0000 (07:43 -0800)]
Merge pull request #55714 from ceph/wip-yuriw-p2p-reef

qa/tests: added the initial reef-p2p suite

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agoMerge pull request #55799 from zdover23/wip-doc-2024-02-28-backport-55782-to-reef
Anthony D'Atri [Tue, 27 Feb 2024 23:51:36 +0000 (18:51 -0500)]
Merge pull request #55799 from zdover23/wip-doc-2024-02-28-backport-55782-to-reef

reef: doc/rados: add "change public network" procedure

16 months agodoc/rados: add "change public network" procedure 55799/head
Zac Dover [Mon, 26 Feb 2024 10:03:48 +0000 (20:03 +1000)]
doc/rados: add "change public network" procedure

Add a procedure to /doc/rados/operations/add-or-rm-mons.rst that
explains how to change the public_network in a Ceph cluster deployed
with cephadm. This procedure was developed by Eugen Block, and can be
seen in its original form here:
https://heiterbiswolkig.blogs.nde.ag/2024/02/22/cephadm-change-public-network/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0b6739a4aa2dd931d97b8af9b3a352969f8767c2)

16 months agoqa/tests: added the initial reef-p2p suite 55714/head
Yuri Weinstein [Thu, 22 Feb 2024 16:18:34 +0000 (08:18 -0800)]
qa/tests: added the initial reef-p2p suite

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
16 months agomgr/dashboard: fix volume creation with multiple hosts 55786/head
Pedro Gonzalez Gomez [Thu, 22 Feb 2024 10:06:21 +0000 (11:06 +0100)]
mgr/dashboard: fix volume creation with multiple hosts

Fixes: https://tracker.ceph.com/issues/64559
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 4313f9a59c676067ca23242808c8e87068d0d953)

16 months agoMerge pull request #55358 from ljflores/wip-revert-pr-55263
Laura Flores [Mon, 26 Feb 2024 18:47:42 +0000 (12:47 -0600)]
Merge pull request #55358 from ljflores/wip-revert-pr-55263

reef: Revert "doc/rados/operations: document `ceph balancer status detail`"

16 months agoMerge pull request #55754 from zdover23/wip-doc-2024-02-26-backport-55683-to-reef
zdover23 [Mon, 26 Feb 2024 10:26:04 +0000 (20:26 +1000)]
Merge pull request #55754 from zdover23/wip-doc-2024-02-26-backport-55683-to-reef

reef: doc/man/8/mount.ceph.rst: add more mount options

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agoMerge pull request #55704 from afreen23/wip-64528-reef
Nizamudeen A [Mon, 26 Feb 2024 09:40:05 +0000 (15:10 +0530)]
Merge pull request #55704 from afreen23/wip-64528-reef

reef: mgr/dashboard: Handle errors for /api/osd/settings

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agodoc/man/8/mount.ceph.rst: add more mount options 55754/head
Xiubo Li [Wed, 22 Nov 2023 08:13:08 +0000 (16:13 +0800)]
doc/man/8/mount.ceph.rst: add more mount options

Fixes: https://tracker.ceph.com/issues/62837
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit d5639cc670d248da7c84e6f2eaf73ce40bd93db4)

16 months agoMerge pull request #55749 from zdover23/wip-doc-2024-02-26-backport-55739-to-reef
Anthony D'Atri [Mon, 26 Feb 2024 06:09:10 +0000 (01:09 -0500)]
Merge pull request #55749 from zdover23/wip-doc-2024-02-26-backport-55739-to-reef

reef: doc/glossary: Add "OMAP" to glossary

16 months agodoc/glossary: Add "OMAP" to glossary 55749/head
Zac Dover [Sun, 25 Feb 2024 21:14:25 +0000 (07:14 +1000)]
doc/glossary: Add "OMAP" to glossary

Add an entry for "OMAP" to the glossary. This commit represents only the
first improvement to the documentation of OMAP in the Ceph docs suite.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1d8baa1d4c3583f4a8dc0f46d81f198a3d027e4d)

16 months agoMerge pull request #55737 from zdover23/wip-doc-2024-02-25-backport-55731-to-reef
Anthony D'Atri [Sun, 25 Feb 2024 05:57:54 +0000 (00:57 -0500)]
Merge pull request #55737 from zdover23/wip-doc-2024-02-25-backport-55731-to-reef

reef: doc/dev: fix spelling in crimson.rst

16 months agodoc/dev: fix spelling in crimson.rst 55737/head
Zac Dover [Fri, 23 Feb 2024 16:21:54 +0000 (02:21 +1000)]
doc/dev: fix spelling in crimson.rst

Repair a confusing sentence in doc/dev/crimson.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dfdb5e124a19e0c5ce1e7ba47e574e0504e7091f)

16 months agodoc: Revert "doc/rados/operations: document `ceph balancer status detail`" 55358/head
Laura Flores [Mon, 29 Jan 2024 17:18:54 +0000 (11:18 -0600)]
doc: Revert "doc/rados/operations: document `ceph balancer status detail`"

This reverts commit fdf274e25ab100bec038011b794dfd0bfd4f8667.

Signed-off-by: Laura Flores <lflores@ibm.com>
16 months agoMerge pull request #55732 from zdover23/wip-doc-2024-02-24-backport-55729-to-reef
Anthony D'Atri [Fri, 23 Feb 2024 17:31:54 +0000 (12:31 -0500)]
Merge pull request #55732 from zdover23/wip-doc-2024-02-24-backport-55729-to-reef

reef: doc/rbd: repair ordered list

16 months agodoc/rbd: repair ordered list 55732/head
Zac Dover [Fri, 23 Feb 2024 16:05:42 +0000 (02:05 +1000)]
doc/rbd: repair ordered list

Fix the numbering in an ordered list. The numbering was thrown off
because a ".. prompt" directive was improperly indented (it wasn't
indented at all).

See https://github.com/ceph/ceph/pull/55540#discussion_r1500051264

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6df12da2cd0946092fa49f8dbb7661e4487c3c22)

16 months agoMerge pull request #55730 from zdover23/wip-doc-2024-02-24-backport-55699-to-reef
Anthony D'Atri [Fri, 23 Feb 2024 17:02:28 +0000 (12:02 -0500)]
Merge pull request #55730 from zdover23/wip-doc-2024-02-24-backport-55699-to-reef

reef: doc/crimson: cleanup duplicate seastore description

16 months agodoc/crimson: cleanup duplicate seastore description 55730/head
Rongqi Sun [Thu, 22 Feb 2024 02:41:43 +0000 (10:41 +0800)]
doc/crimson: cleanup duplicate seastore description

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
(cherry picked from commit 8d766c57173cf6bdea0d8fcfa8fa3c1b61fd10ef)

16 months agoMerge pull request #55724 from zdover23/wip-doc-2024-02-23-backport-55540-to-reef
zdover23 [Fri, 23 Feb 2024 16:07:40 +0000 (02:07 +1000)]
Merge pull request #55724 from zdover23/wip-doc-2024-02-23-backport-55540-to-reef

reef: doc: Add NVMe-oF gateway documentation

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agoMerge pull request #55689 from mcv21/wip-63529-reef
Nizamudeen A [Fri, 23 Feb 2024 04:49:07 +0000 (10:19 +0530)]
Merge pull request #55689 from mcv21/wip-63529-reef

Reef: mgr/dashboard: Simplify authentication protocol

Reviewed-by: Daniel Persson <mailto.woden@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agodoc: Add NVMe-oF gateway documentation 55724/head
Orit Wasserman [Mon, 12 Feb 2024 12:39:38 +0000 (14:39 +0200)]
doc: Add NVMe-oF gateway documentation

- Add nvmeof-initiator-esx.rst
- Add nvmeof-initiator-linux.rst
- Add nvmeof-initiators.rst
- Add nvmeof-overview.rst
- Add nvmeof-requirements.rst
- Add nvmeof-target-configure.rst
- Add links to rbd-integrations.rst

Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Orit Wasserman <owasserm@ibm.com>
(cherry picked from commit 9f86c35a0d308c6ff24d3a033f5314ec86bf896b)

16 months agoMerge pull request #55706 from rkachach/fix_issue_64520
Redouane Kachach [Thu, 22 Feb 2024 15:06:44 +0000 (16:06 +0100)]
Merge pull request #55706 from rkachach/fix_issue_64520

reef: backport rook/mgr recent changes

16 months agomgr/rook: removing HostPattern references 55706/head
Redouane Kachach [Thu, 22 Feb 2024 09:36:40 +0000 (10:36 +0100)]
mgr/rook: removing HostPattern references

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/dashboard: Updated test dependencies 55689/head
Daniel Persson [Sun, 3 Dec 2023 09:46:56 +0000 (09:46 +0000)]
mgr/dashboard: Updated test dependencies

Seemed that the test dependencies was separated in two different requirements files
one for the testing and one for linting. Added the JWT dependency in the linting file
as well.

Signed-off-by: Daniel Persson <mailto.woden@gmail.com>
(cherry picked from commit 06765e648acb1676d5d563c631b8d8fc08b5323c)

16 months agomgr/dashboard: Changes suggested after review by @epuertat.
Daniel Persson [Sun, 3 Dec 2023 08:03:47 +0000 (08:03 +0000)]
mgr/dashboard: Changes suggested after review by @epuertat.

Move the JWT requirement to the test requirements file. Also remove JWT from ceph specification and debian build.

Signed-off-by: Daniel Persson <mailto.woden@gmail.com>
(cherry picked from commit c1ea66fe12f86e7a63681cba860fb91b1ea86e12)

16 months agomgr/dashboard: Simplify authentication protocol
Daniel Persson [Wed, 29 Nov 2023 09:39:51 +0000 (09:39 +0000)]
mgr/dashboard: Simplify authentication protocol
By removing the dependency to PyJWT we also remove the dependency to the cryptographic library which
in the dashboard module will create a crash. In newer implementations of the library PyO3 is used to run
rust code in order to encrypt with Elliptic Curves. This is never used in the dashboard communication so
a much simpler implementation where we only use the hmac sha256 algorithm to create the signed JWT message
could be used.

Fixes: https://forum.proxmox.com/threads/ceph-warning-post-upgrade-to-v8.129371
Signed-off-by: Daniel Persson <mailto.woden@gmail.com>
(cherry picked from commit c616a9d017b5fcc85bb5c1556bccf4c77cc3899e)

16 months agomgr/rook: adding empty calls to upgrade_ls and upgrade_status
Redouane Kachach [Thu, 22 Feb 2024 09:04:11 +0000 (10:04 +0100)]
mgr/rook: adding empty calls to upgrade_ls and upgrade_status

added empty calls to upgrade_ls and upgrade_status to avoid
dashboard errors when entering the view Cluster > Upgrade. Empty
calls are used because we don't support the upgrade functionality
in rook as we do for normal Ceph deployments. In case of rook user
has to follow a different process to upgrade Ceph.

Fixes: https://tracker.ceph.com/issues/64516
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/dashboard: Handle errors for /api/osd/settings 55704/head
Afreen [Tue, 13 Feb 2024 10:26:09 +0000 (15:56 +0530)]
mgr/dashboard: Handle errors for /api/osd/settings

Fixes https://tracker.ceph.com/issues/62089

issue:
=====
/api/osd/settings returns "TypeError: string indices must be
integers" sometimes.
The result is coming from `osd dump` command which instead of returning
an object returns an error message which then displays error on
dashboard.

fix:
====
Added a try-catch block to handle error and updated frontend code to
handle those

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 518bff9c7ed6f6756aff8aa8013c48a5bfdd7b32)

16 months agomgr/rook: raise an exception when user calls OSD related methods
Redouane Kachach [Thu, 22 Feb 2024 08:48:41 +0000 (09:48 +0100)]
mgr/rook: raise an exception when user calls OSD related methods

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/rook: removing all the code related to OSDs creation/removal
Redouane Kachach [Thu, 22 Feb 2024 08:48:06 +0000 (09:48 +0100)]
mgr/rook: removing all the code related to OSDs creation/removal
Fixes: https://tracker.ceph.com/issues/64211
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agoMerge pull request #55648 from zdover23/wip-doc-2024-02-20-backport-55637-to-reef
zdover23 [Wed, 21 Feb 2024 22:54:56 +0000 (08:54 +1000)]
Merge pull request #55648 from zdover23/wip-doc-2024-02-20-backport-55637-to-reef

reef: doc/cephfs: edit add-remove-mds

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
16 months agoMerge pull request #55581 from ivoalmeida/wip-63793-reef
Ivo Almeida [Wed, 21 Feb 2024 14:23:04 +0000 (11:23 -0300)]
Merge pull request #55581 from ivoalmeida/wip-63793-reef

reef: mgr/.dashboard: batch backport of cephfs snapshot schedule management

Reviewed-by: afreen23 <NOT@FOUND>
16 months agoMerge pull request #55680 from zdover23/wip-doc-2024-02-21-backport-55670-to-reef
Anthony D'Atri [Wed, 21 Feb 2024 00:59:18 +0000 (19:59 -0500)]
Merge pull request #55680 from zdover23/wip-doc-2024-02-21-backport-55670-to-reef

reef: doc/rados: fix broken links

16 months agoMerge pull request #55678 from zdover23/wip-doc-2024-02-21-backport-55677-to-reef
Anthony D'Atri [Tue, 20 Feb 2024 23:47:59 +0000 (18:47 -0500)]
Merge pull request #55678 from zdover23/wip-doc-2024-02-21-backport-55677-to-reef

reef: doc/rados/configuration/osd-config-ref: fix typo

16 months agodoc/rados: fix broken links 55680/head
Zac Dover [Tue, 20 Feb 2024 18:07:07 +0000 (04:07 +1000)]
doc/rados: fix broken links

Fix broken links in doc/rados/operations/add-or-rm-mons.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e2519367099461415248353d7c7725c0567511d)

16 months agodoc/rados/configuration/osd-config-ref: fix typo 55678/head
Pierre Riteau [Tue, 20 Feb 2024 21:54:01 +0000 (22:54 +0100)]
doc/rados/configuration/osd-config-ref: fix typo

Signed-off-by: Pierre Riteau <pierre@stackhpc.com>
(cherry picked from commit d25b6b9dd2cee81d33f2ad2f0718c6ccdeadbe2b)

16 months agoMerge pull request #55671 from zdover23/wip-doc-2024-02-21-backport-55667-to-reef
Anthony D'Atri [Tue, 20 Feb 2024 19:03:51 +0000 (14:03 -0500)]
Merge pull request #55671 from zdover23/wip-doc-2024-02-21-backport-55667-to-reef

reef: doc/radosgw: edit multisite.rst

16 months agodoc/radosgw: edit multisite.rst 55671/head
Zac Dover [Tue, 20 Feb 2024 12:06:11 +0000 (22:06 +1000)]
doc/radosgw: edit multisite.rst

Edit "Varieties of Multi-Site Configuration" in
doc/radosgw/multisite.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8af910f877d1c7b873c2a13cec5d4ea1a4de4a79)

16 months agolibrbd: refactor merge() for SparseBufferlistExtent 55665/head
Ilya Dryomov [Mon, 12 Feb 2024 12:07:22 +0000 (13:07 +0100)]
librbd: refactor merge() for SparseBufferlistExtent

- pass left.length + right.length instead of bl.length()
  for consistency and to avoid circumventing the assert in
  SparseBufferlistExtent constructor
- claim_append() takes an lvalue reference, no need to move
- follow the pattern used in split()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 69c18cfd291e63fbcd261d3cf20be8dfa0c7488d)

16 months agolibrbd: fix split() for SparseExtent and SparseBufferlistExtent
Ilya Dryomov [Mon, 12 Feb 2024 10:00:45 +0000 (11:00 +0100)]
librbd: fix split() for SparseExtent and SparseBufferlistExtent

SparseExtents and SparseBufferlist are typedefs for interval_map.  In
both cases, split() handler is broken: for the former the extent isn't
actually split and for the latter incorrect bufferlist is attached to
the split extent.

Fortunately, both SnapshotDelta as produced by ObjectListSnapsRequest
and SparseBufferlist used in a couple of places seem to be collections
where only disjoint intervals are inserted and splitting doesn't occur
(at least in the common case).  But still, this is a landmine waiting
for someone to step on it.

Fixes: https://tracker.ceph.com/issues/64423
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 746cb28449903ceec2fe3ffcfa5e925eb78eb7b2)

16 months agodoc/cephfs: edit add-remove-mds 55648/head
Zac Dover [Mon, 19 Feb 2024 08:41:45 +0000 (18:41 +1000)]
doc/cephfs: edit add-remove-mds

Disambiguate a note in doc/cephfs/add-remove-mds.rst to help readers
distinguish between cases in which they might want to use an automated
tool such as cephadm to deploy MDSes and cases in which they might want
to manually deploy MDSes.

See: https://github.com/ceph/ceph/pull/45639

Tracker: https://tracker.ceph.com/issues/54551

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 39ad6264aa1c97b04974e04046033887325ed2b2)

16 months agoqa: verify labelled replication perf metrics 55640/head
Venky Shankar [Wed, 14 Feb 2024 18:18:23 +0000 (13:18 -0500)]
qa: verify labelled replication perf metrics

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit f29dd57cd0a1f609f54d62f97025ec2d67979472)

 Conflicts:
qa/tasks/cephfs/test_mirroring.py

test_mirroring.py does not use run_ceph_cmd() in reef, so, adjust
for that.

16 months agoqa: test per-client labelled perf counters
Venky Shankar [Tue, 13 Feb 2024 16:13:28 +0000 (11:13 -0500)]
qa: test per-client labelled perf counters

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 36e24585d562d0023398196e715522cc8cf74fb3)

Conflicts:
    qa/tasks/cephfs/test_admin.py

Use time.sleep() instead of sleep() (via import).

16 months agomds: export per-client metrics as labelled perf counters
Venky Shankar [Mon, 12 Feb 2024 07:21:08 +0000 (02:21 -0500)]
mds: export per-client metrics as labelled perf counters

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 164c547edcff86ed7dbb0d398b6db54f71e3f9b8)

16 months agocephfs_mirror: add labeled replication performance metrics
Venky Shankar [Wed, 14 Feb 2024 12:28:58 +0000 (07:28 -0500)]
cephfs_mirror: add labeled replication performance metrics

Fixes: http://tracker.ceph.com/issues/63945
Signed-off-by: Jos Collin <jcollin@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 658ee6c40116e07f45085ad0df7ef33d3c8ed78e)

16 months agocephfs-mirror: typo ending bracket
Venky Shankar [Wed, 14 Feb 2024 12:27:39 +0000 (07:27 -0500)]
cephfs-mirror: typo ending bracket

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 4c14f143b59c96ecb2c23e5142829d47e2c03e22)

16 months agoMerge pull request #55635 from zdover23/wip-doc-2024-02-19-backport-55633-to-reef
Anthony D'Atri [Mon, 19 Feb 2024 12:57:16 +0000 (07:57 -0500)]
Merge pull request #55635 from zdover23/wip-doc-2024-02-19-backport-55633-to-reef

reef: doc/man: edit "manipulating the omap key"

16 months agoMerge PR #52751 into wip-61794-reef
Milind Changire [Mon, 19 Feb 2024 12:06:34 +0000 (17:36 +0530)]
Merge PR #52751 into wip-61794-reef

* refs/pull/52751/head:
PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
snap_schedule/tests: fix db upgrade issue
qa: add yaml for on demand subvol version testing
qa: add test cases for testing --subvol and --group arguments
mgr/volumes: conditionalize subvolume upgrade
mgr/volumes: ensure correct init of v1 subvol
mgr/snap_schedule: add subvol and subvol group arguments to cli
mds/snap_schedule: add subvolume group column management
mgr/volumes: add remote helper methods to fetch subvolume info
mgr/snap_schedule: catch all exceptions for cli

Reviewed-by: Venky Shankar <vshankar@redhat.com>
16 months agodoc/man: edit "manipulating the omap key" 55635/head
Zac Dover [Sun, 18 Feb 2024 06:01:46 +0000 (16:01 +1000)]
doc/man: edit "manipulating the omap key"

Edit the section "Manipulating the Object Map Key" in
doc/man/8/ceph-objectstore-tool.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 44ec668d43951c2710271fb3ca1799c4c4ded940)

16 months agotools/rbd: make 'children' command support --image-id 55617/head
Mykola Golub [Sun, 11 Feb 2024 09:43:30 +0000 (09:43 +0000)]
tools/rbd: make 'children' command support --image-id

Fixes: https://tracker.ceph.com/issues/64376
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
(cherry picked from commit 5442f7eb218ff9024365f3a28e4affb5add1ee1e)

Conflicts:
    PendingReleaseNotes [ moved to >=18.2.2 section ]

17 months agoMerge pull request #55630 from zdover23/wip-doc-2024-02-18-backport-55626-to-reef
Anthony D'Atri [Sun, 18 Feb 2024 04:59:23 +0000 (23:59 -0500)]
Merge pull request #55630 from zdover23/wip-doc-2024-02-18-backport-55626-to-reef

reef: doc/rados: add PG definition

17 months agodoc/rados: add PG definition 55630/head
Zac Dover [Sat, 17 Feb 2024 05:28:24 +0000 (15:28 +1000)]
doc/rados: add PG definition

Add a definition of Placement Groups to
doc/rados/operations/placement-groups.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 39c809b33fe27064277292b721639cbb144fac6a)

17 months agoMerge PR #55590 into reef
Patrick Donnelly [Fri, 16 Feb 2024 15:22:03 +0000 (10:22 -0500)]
Merge PR #55590 into reef

* refs/pull/55590/head:
qa: do upgrades from quincy and older reef minor releases

Reviewed-by: Venky Shankar <vshankar@redhat.com>
17 months agoMerge pull request #55613 from zdover23/wip-doc-2024-02-16-backport-55539-to-reef
Anthony D'Atri [Fri, 16 Feb 2024 14:58:36 +0000 (09:58 -0500)]
Merge pull request #55613 from zdover23/wip-doc-2024-02-16-backport-55539-to-reef

reef: doc/glossary: improve OSD definitions

17 months agoMerge pull request #55611 from zdover23/wip-doc-2024-02-16-backport-55585-to-reef
Anthony D'Atri [Fri, 16 Feb 2024 14:58:01 +0000 (09:58 -0500)]
Merge pull request #55611 from zdover23/wip-doc-2024-02-16-backport-55585-to-reef

reef: doc/rados: add link to pg blog post

17 months agodoc/glossary: improve OSD definitions 55613/head
Zac Dover [Mon, 12 Feb 2024 13:08:27 +0000 (23:08 +1000)]
doc/glossary: improve OSD definitions

Remove expletive construction from three OSD-id-related terms.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dec3d3730712bbc0994f5cbd1989761d64f93019)

17 months agodoc/rados: add link to pg blog post 55611/head
Zac Dover [Wed, 14 Feb 2024 15:32:40 +0000 (01:32 +1000)]
doc/rados: add link to pg blog post

Add a link in the "Placement Groups" section that links to Sage Weil's
April 5, 2019 blog post "New in Nautilus: PG merging and autotuning".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9344893e0857be8c6ae134f6d4d5e9057e2cb99e)

17 months agoMerge PR #54952 into reef
Patrick Donnelly [Thu, 15 Feb 2024 20:22:42 +0000 (15:22 -0500)]
Merge PR #54952 into reef

* refs/pull/54952/head:
qa: configure balancer for multi-mds workloads
qa: create qa subvolumes in named subvolumegroup
qa: do not rely on default max_mds value
qa: add automate_balance to dashboard qa schema
doc/cephfs: add docs for balance_automate
doc/cephfs: use bash prompt for shell code
mds: add balance_automate fs setting

Reviewed-by: Milind Changire <mchangir@redhat.com>
17 months agoMerge pull request #55603 from zdover23/wip-doc-2024-02-16-backport-55566-to-reef
Anthony D'Atri [Thu, 15 Feb 2024 19:54:12 +0000 (14:54 -0500)]
Merge pull request #55603 from zdover23/wip-doc-2024-02-16-backport-55566-to-reef

reef: doc/cephadm: correct nfs config pool name

17 months agoMerge pull request #55557 from zdover23/wip-doc-2024-02-13-backport-55546-to-reef
zdover23 [Thu, 15 Feb 2024 17:55:23 +0000 (03:55 +1000)]
Merge pull request #55557 from zdover23/wip-doc-2024-02-13-backport-55546-to-reef

reef: doc/glossary: Add link to CRUSH paper

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
17 months agodoc/cephadm: correct nfs config pool name 55603/head
Zac Dover [Tue, 13 Feb 2024 17:04:26 +0000 (03:04 +1000)]
doc/cephadm: correct nfs config pool name

s/nfs-ganesha/.nfs/ in doc/cephadm/services/nfs, in accordance with
information given to me by John Mulligan over Slack.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 574421aeec3bdd502c64e87102846e5181b18415)

17 months agoMerge pull request #55026 from idryomov/wip-63607-reef
Yuri Weinstein [Thu, 15 Feb 2024 17:02:29 +0000 (09:02 -0800)]
Merge pull request #55026 from idryomov/wip-63607-reef

reef: librados: make querying pools for selfmanaged snaps reliable

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
17 months agoMerge pull request #54595 from idryomov/wip-53593-reef
Yuri Weinstein [Thu, 15 Feb 2024 17:01:33 +0000 (09:01 -0800)]
Merge pull request #54595 from idryomov/wip-53593-reef

reef: osd: don't require RWEXCL lock for stat+write ops.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
17 months agoMerge pull request #54373 from batrick/wip-63456-reef
Yuri Weinstein [Thu, 15 Feb 2024 17:00:50 +0000 (09:00 -0800)]
Merge pull request #54373 from batrick/wip-63456-reef

reef: common: resolve config proxy deadlock using refcounted pointers

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
17 months agoMerge pull request #55538 from guits/reef-node-proxy-handle-fetch-oob-error
Guillaume Abrioux [Thu, 15 Feb 2024 14:35:38 +0000 (15:35 +0100)]
Merge pull request #55538 from guits/reef-node-proxy-handle-fetch-oob-error

(reef) node-proxy: improve http error handling in fetch_oob_details

17 months agoqa: do upgrades from quincy and older reef minor releases 55590/head
Patrick Donnelly [Thu, 15 Feb 2024 02:49:17 +0000 (21:49 -0500)]
qa: do upgrades from quincy and older reef minor releases

Fixes: https://tracker.ceph.com/issues/64441
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
17 months agotools/rados: just return instead of exit(1) in "rados cppool" handler 55026/head
Ilya Dryomov [Fri, 24 Nov 2023 18:53:48 +0000 (19:53 +0100)]
tools/rados: just return instead of exit(1) in "rados cppool" handler

Otherwise an occasional segfault occurs.  This instance was missed in
commit 2c149262888c ("tools/rados: always call rados.shutdown() before
exit()").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit de6635582b7615eb54800a616711073a3c7b0dbd)

17 months agoqa: make sure "rados cppool" requires --yes-i-really-mean-it for RBD
Ilya Dryomov [Thu, 23 Nov 2023 19:24:24 +0000 (20:24 +0100)]
qa: make sure "rados cppool" requires --yes-i-really-mean-it for RBD

Safeguards in rados CLI tool isn't really the subject of this test, but
it fits nicely.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2b135a2eb60e0dd5ab22d213d3d2435608c6a9d3)

17 months agolibrados: make querying pools for selfmanaged snaps reliable
Ilya Dryomov [Wed, 22 Nov 2023 13:39:13 +0000 (14:39 +0100)]
librados: make querying pools for selfmanaged snaps reliable

If get_pool_is_selfmanaged_snaps_mode() is invoked on a fresh RADOS
client instance that still lacks an osdmap, it returns false, same as
for "this pool is not in selfmanaged snaps mode".  The same happens if
the pool in question doesn't exist since the signature doesn't allow to
return an error.

The motivation for this API was to prevent users from running "rados
cppool" on a pool with unmanaged snapshots and deleting the original
thinking that they have a full copy.  Unfortunately, it's exactly
"rados cppool" that fell into this trap, so no warning is printed and
--yes-i-really-mean-it flag isn't enforced.

Fixes: https://tracker.ceph.com/issues/63607
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0999e63bfbbee46b8e19c3f05881eee64dba8b5e)

Conflicts:
PendingReleaseNotes [ moved to >=18.2.2 section ]

17 months agolibrados: clarify get_pool_is_selfmanaged_snaps_mode() semantics
Ilya Dryomov [Thu, 23 Nov 2023 19:35:41 +0000 (20:35 +0100)]
librados: clarify get_pool_is_selfmanaged_snaps_mode() semantics

Refer to the commit message of 8a9769a1d5fd ("librados: add
get_pool_is_selfmanaged_snaps_mode() function").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 54edc7955b0593423d2c03ca308b5e5fcdc528a3)

17 months agoMerge pull request #55474 from idryomov/wip-47287-reef
Yuri Weinstein [Wed, 14 Feb 2024 16:19:08 +0000 (08:19 -0800)]
Merge pull request #55474 from idryomov/wip-47287-reef

reef: librbd: return ENOENT from Snapshot::get_timestamp for nonexistent snap_id

Reviewed-by: Ramana Raja <rraja@redhat.com>
17 months agoMerge pull request #55427 from idryomov/wip-63341-reef
Yuri Weinstein [Wed, 14 Feb 2024 16:18:25 +0000 (08:18 -0800)]
Merge pull request #55427 from idryomov/wip-63341-reef

reef: librbd: improve rbd_diff_iterate2() performance in fast-diff mode

Reviewed-by: Mykola Golub <mgolub@suse.com>
17 months agoMerge pull request #55424 from petrutlucian94/wip-64294-reef
Yuri Weinstein [Wed, 14 Feb 2024 16:17:25 +0000 (08:17 -0800)]
Merge pull request #55424 from petrutlucian94/wip-64294-reef

reef: msg: update MOSDOp() to use ceph_tid_t instead of long

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
17 months agomgr/dashboard: added cephfs mount details 55581/head
Ivo Almeida [Mon, 12 Feb 2024 10:08:09 +0000 (10:08 +0000)]
mgr/dashboard: added cephfs mount details

Fixes: https://tracker.ceph.com/issues/64405
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: added subvolume and translations
Ivo Almeida [Thu, 8 Feb 2024 15:23:42 +0000 (15:23 +0000)]
mgr/dashboard: added subvolume and translations

This commit adds support for subvolume snap scheduling and translations for snap schedule repeat schedules and retention policies

Fixes: https://tracker.ceph.com/issues/64372
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: added delete and activation actions
Ivo Almeida [Wed, 7 Feb 2024 14:03:45 +0000 (14:03 +0000)]
mgr/dashboard: added delete and activation actions

Fixes: https://tracker.ceph.com/issues/64355
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: snapshot schedule edit form
Ivo Almeida [Thu, 1 Feb 2024 18:15:19 +0000 (18:15 +0000)]
mgr/dashboard: snapshot schedule edit form

Fixes: https://tracker.ceph.com/issues/64331
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: added dir search to snap schdl form
Ivo Almeida [Mon, 29 Jan 2024 10:58:43 +0000 (10:58 +0000)]
mgr/dashboard: added dir search to snap schdl form

Fixes: https://tracker.ceph.com/issues/64246
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: added snap schedule form
Ivo Almeida [Wed, 13 Dec 2023 01:08:52 +0000 (01:08 +0000)]
mgr/dashboard: added snap schedule form

Fixes: https://tracker.ceph.com/issues/63827
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: snap schedule module detect/eneable
Ivo Almeida [Sun, 10 Dec 2023 17:44:33 +0000 (17:44 +0000)]
mgr/dashboard: snap schedule module detect/eneable

Fixes: https://tracker.ceph.com/issues/63768
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
17 months agomgr/dashboard: added snap-schedule api and ui list
Ivo Almeida [Sat, 25 Nov 2023 19:10:35 +0000 (19:10 +0000)]
mgr/dashboard: added snap-schedule api and ui list

Fixes: https://tracker.ceph.com/issues/63767
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit acaad3555414aa1f1b4fa732af70612d50c5e883)

17 months agoMerge pull request #55571 from aaSharma14/wip-64048-reef
Nizamudeen A [Wed, 14 Feb 2024 09:47:04 +0000 (15:17 +0530)]
Merge pull request #55571 from aaSharma14/wip-64048-reef

reef: mgr/dashboard: increase the number of plottable graphs in charts

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
17 months agomgr/cephadm: add fullreport in ceph orch CLI (node-proxy) 55538/head
Guillaume Abrioux [Wed, 14 Feb 2024 09:02:50 +0000 (09:02 +0000)]
mgr/cephadm: add fullreport in ceph orch CLI (node-proxy)

This adds the `fullreport` category to the `ceph orch hardware status` CLI.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 056d4f7a3d4ca8564b374880551a574858e68395)

17 months agomgr/cephadm: conditionally deploy node-proxy
Guillaume Abrioux [Mon, 12 Feb 2024 16:20:42 +0000 (16:20 +0000)]
mgr/cephadm: conditionally deploy node-proxy

Only attempt to deploy the node-proxy agent when oob details
are provided for a given host.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 3ae32c44a7d1ea15bd3459a266b2dbf3c9f9a408)

17 months agonode-proxy: call time.sleep() after each reporter iteration
Guillaume Abrioux [Mon, 12 Feb 2024 14:25:24 +0000 (14:25 +0000)]
node-proxy: call time.sleep() after each reporter iteration

This makes sure time.sleep() is always call in the reporter loop.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 6fc3d861c5785aad76aa6bde6944e2bb317df4f3)

17 months agonode-proxy: improve http error handling in fetch_oob_details
Guillaume Abrioux [Mon, 12 Feb 2024 12:22:41 +0000 (12:22 +0000)]
node-proxy: improve http error handling in fetch_oob_details

This makes the daemon handle the error nicer in fetch_oob_details()

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 7bfe445e690d13eec8552f2ba88c9ff25ed3cf92)

17 months agoPendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule 52751/head
Milind Changire [Thu, 14 Dec 2023 07:25:08 +0000 (12:55 +0530)]
PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit b3ff5f794985c173ba87926f34e6d9793c5d5c67)
Signed-off-by: Milind Changire <mchangir@redhat.com>
17 months agosnap_schedule/tests: fix db upgrade issue
Milind Changire [Tue, 17 Oct 2023 04:36:48 +0000 (10:06 +0530)]
snap_schedule/tests: fix db upgrade issue

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit dfc35a4679495a3d7136927374e838409c29ab4a)
Signed-off-by: Milind Changire <mchangir@redhat.com>
17 months agoqa: add yaml for on demand subvol version testing
Milind Changire [Thu, 14 Dec 2023 11:01:05 +0000 (16:31 +0530)]
qa: add yaml for on demand subvol version testing

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 2533ac5b90f367dd55f61c1e95dee0e154940930)
Signed-off-by: Milind Changire <mchangir@redhat.com>
17 months agoqa: add test cases for testing --subvol and --group arguments
Milind Changire [Mon, 20 Nov 2023 10:39:57 +0000 (16:09 +0530)]
qa: add test cases for testing --subvol and --group arguments

Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 006c68f492044327594fbf7204774d7d7d4ee518)
Signed-off-by: Milind Changire <mchangir@redhat.com>