]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 months agomgr/cephadm: fix typo with vrrp_interfaces in keepalive setup 61904/head
Adam King [Wed, 5 Feb 2025 22:00:06 +0000 (17:00 -0500)]
mgr/cephadm: fix typo with vrrp_interfaces in keepalive setup

This was intended to be vrrp_interfaces, the variable actually
used later in the code. Instead, due to a typo, it was setting
a variable that is unused other than in the log line right after
it is set. Issue was introduced in
https://github.com/ceph/ceph/commit/58ddc4e20f7cead1f2594241450f4beb5230c746

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit b16fc92155e3f4bbf161610490b579e950584bbf)

4 months agoMerge pull request #61885 from zdover23/wip-doc-2025-02-19-backport-61867-to-reef
Anthony D'Atri [Wed, 19 Feb 2025 01:09:05 +0000 (20:09 -0500)]
Merge pull request #61885 from zdover23/wip-doc-2025-02-19-backport-61867-to-reef

reef: doc/mgr: Add root CA cert instructions to rgw.rst

4 months agodoc/mgr: Add root CA cert instructions to rgw.rst 61885/head
Anuradha Gadge [Tue, 18 Feb 2025 09:09:31 +0000 (14:39 +0530)]
doc/mgr: Add root CA cert instructions to rgw.rst

Add documentation for adding fs_id in root_ca_cert upgrade path

Fixes: https://tracker.ceph.com/issues/70014
Signed-off-by: Anuradha Gadge <anuradha.gadge@ibm.com>
(cherry picked from commit 76106dd9890fdbd9440a5f7de85e9d5de6d0a2b4)

doc/mgr: edit grammar and formatting of rgw.rst

Improve the grammar and correct the formatting of the "Upgrading root ca
certificates" procedure that was added to the documentation in https://github.com/ceph/ceph/pull/61867

Fixes: https://tracker.ceph.com/issues/70014
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7d9298e3de74e91db116c79a7087f559464ae52d)

5 months agoMerge pull request #60369 from neesingh-rh/wip-68590-reef
Hemanth [Tue, 18 Feb 2025 04:55:41 +0000 (10:25 +0530)]
Merge pull request #60369 from neesingh-rh/wip-68590-reef

reef: mgr/vol : shortening the name of helper method

5 months agoMerge pull request #61582 from dmick/wip-69716-reef
Dan Mick [Mon, 17 Feb 2025 22:20:32 +0000 (14:20 -0800)]
Merge pull request #61582 from dmick/wip-69716-reef

reef: container/build.sh: don't require repo creds on NO_PUSH

5 months agoMerge pull request #61581 from dmick/wip-69718-reef
Dan Mick [Mon, 17 Feb 2025 22:20:16 +0000 (14:20 -0800)]
Merge pull request #61581 from dmick/wip-69718-reef

reef: container/build.sh: fix up org vs. repo naming

5 months agoMerge pull request #61580 from dmick/wip-69720-reef
Dan Mick [Mon, 17 Feb 2025 22:19:56 +0000 (14:19 -0800)]
Merge pull request #61580 from dmick/wip-69720-reef

reef: container/Containerfile: replace CEPH_VERSION label for backward compat

5 months agoMerge pull request #61432 from cbodley/wip-69577-reef
Yuri Weinstein [Thu, 13 Feb 2025 16:07:15 +0000 (08:07 -0800)]
Merge pull request #61432 from cbodley/wip-69577-reef

reef: rgw: S3 Delete Bucket Policy should return 204 on success

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #58546 from smanjara/wip-66920-reef
Yuri Weinstein [Thu, 13 Feb 2025 16:05:38 +0000 (08:05 -0800)]
Merge pull request #58546 from smanjara/wip-66920-reef

reef: rgw/multisite: allow PutACL replication.

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 months agoMerge pull request #59375 from rishabh-d-dave/mds-fs-fail-reef
Hemanth [Thu, 13 Feb 2025 14:17:21 +0000 (19:47 +0530)]
Merge pull request #59375 from rishabh-d-dave/mds-fs-fail-reef

reef: qa/cephfs: use different config options to generate MDS_TRIM

5 months agoMerge pull request #57362 from batrick/wip-65870-reef
Hemanth [Thu, 13 Feb 2025 14:16:31 +0000 (19:46 +0530)]
Merge pull request #57362 from batrick/wip-65870-reef

reef: common/StackStringStream: update pointer to newly allocated memory in overflow()

5 months agoMerge pull request #61625 from prazumovsky/close-range-reef
Ilya Dryomov [Tue, 11 Feb 2025 11:17:45 +0000 (12:17 +0100)]
Merge pull request #61625 from prazumovsky/close-range-reef

reef: common: use close_range on Linux

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
5 months agoMerge pull request #61748 from zdover23/wip-doc-2025-02-11-backport-61739-to-reef
Anthony D'Atri [Tue, 11 Feb 2025 01:47:01 +0000 (20:47 -0500)]
Merge pull request #61748 from zdover23/wip-doc-2025-02-11-backport-61739-to-reef

reef: doc/cephadm: improve "Activate Existing OSDs".

5 months agodoc/cephadm: improve "Activate Existing OSDs". 61748/head
Zac Dover [Mon, 10 Feb 2025 08:12:34 +0000 (18:12 +1000)]
doc/cephadm: improve "Activate Existing OSDs".

Make three minor changes to doc/cephadm/services/osd.rst. These three
changes were suggested by Eugen Block, who reviewed this procedure after
developing it.

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit abc4a197f7849922bc6a1cd0a45e82f7e93a0a39)

5 months agoMerge pull request #61336 from idryomov/wip-69014-reef
Ilya Dryomov [Mon, 10 Feb 2025 18:34:20 +0000 (19:34 +0100)]
Merge pull request #61336 from idryomov/wip-69014-reef

reef: osd: optimize extent comparison in PrimaryLogPG

Reviewed-by: Laura Flores <lflores@redhat.com>
5 months agoMerge pull request #61345 from YiteGu/wip-69504-reef
SrinivasaBharathKanta [Mon, 10 Feb 2025 10:42:53 +0000 (16:12 +0530)]
Merge pull request #61345 from YiteGu/wip-69504-reef

reef: mon/scrub: log error details of store access failures

5 months agoMerge pull request #60004 from kamoltat/wip-68281-reef
SrinivasaBharathKanta [Mon, 10 Feb 2025 10:39:01 +0000 (16:09 +0530)]
Merge pull request #60004 from kamoltat/wip-68281-reef

reef: src/mon/ConnectionTracker.cc: Fix dump function

5 months agoMerge pull request #59193 from NitzanMordhai/wip-67502-reef
NitzanMordhai [Sun, 9 Feb 2025 08:07:28 +0000 (10:07 +0200)]
Merge pull request #59193 from NitzanMordhai/wip-67502-reef

reef: qa/tasks: watchdog should terminate thrasher

5 months agoMerge pull request #61644 from idryomov/wip-58185-reef
Yuri Weinstein [Sat, 8 Feb 2025 17:44:37 +0000 (09:44 -0800)]
Merge pull request #61644 from idryomov/wip-58185-reef

reef: librbd: stop filtering async request error codes

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 months agoMerge pull request #61729 from zdover23/wip-doc-2025-02-08-backport-61660-to-reef
Anthony D'Atri [Sat, 8 Feb 2025 13:35:33 +0000 (08:35 -0500)]
Merge pull request #61729 from zdover23/wip-doc-2025-02-08-backport-61660-to-reef

reef: doc/rados/operations: Improve pools.rst

5 months agoMerge pull request #61726 from zdover23/wip-doc-2025-02-08-backport-61685-to-reef
Anthony D'Atri [Sat, 8 Feb 2025 12:00:19 +0000 (07:00 -0500)]
Merge pull request #61726 from zdover23/wip-doc-2025-02-08-backport-61685-to-reef

reef: doc/cephadm: improve "Activate Existing OSDs"

5 months agoMerge branch 'reef' into wip-doc-2025-02-08-backport-61660-to-reef 61729/head
Anthony D'Atri [Sat, 8 Feb 2025 11:59:25 +0000 (06:59 -0500)]
Merge branch 'reef' into wip-doc-2025-02-08-backport-61660-to-reef

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
5 months agoMerge pull request #61731 from zdover23/wip-doc-2025-02-08-backport-61708-to-reef
Anthony D'Atri [Sat, 8 Feb 2025 11:56:38 +0000 (06:56 -0500)]
Merge pull request #61731 from zdover23/wip-doc-2025-02-08-backport-61708-to-reef

reef: doc: Clarify that there are no tertiary OSDs

5 months agodoc: Clarify that there are no tertiary OSDs 61731/head
Anthony D'Atri [Fri, 7 Feb 2025 15:08:38 +0000 (10:08 -0500)]
doc: Clarify that there are no tertiary OSDs

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit e261155a8a0234897803d38e899d10ec89b2b08f)

5 months agodoc/rados/operations: Improve pools.rst
Anthony D'Atri [Wed, 5 Feb 2025 16:34:38 +0000 (11:34 -0500)]
doc/rados/operations: Improve pools.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit b1e5da594a662e0037459489fbbd449685ad9854)

5 months agodoc/cephadm: improve "Activate Existing OSDs" 61726/head
Zac Dover [Fri, 7 Feb 2025 01:32:20 +0000 (11:32 +1000)]
doc/cephadm: improve "Activate Existing OSDs"

Improve the section "Activate Existing OSDs".

Supplement the information in the "Activate Existing OSDs" section with
a procedure developed by Eugen Block, here:
https://heiterbiswolkig.blogs.nde.ag/2025/02/06/cephadm-activate-existing-osds/

This procedure explains how to activate OSDs on a host that, for
whatever reason, has had to have its operating system reinstalled.

Co-authored by Eugen Block.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2de592e2f0b8b76aac706703dc44078d5ebb6ab8)

5 months agoMerge pull request #61602 from idryomov/wip-69679-reef
Ilya Dryomov [Fri, 7 Feb 2025 21:47:17 +0000 (22:47 +0100)]
Merge pull request #61602 from idryomov/wip-69679-reef

reef: mon/OSDMonitor: relax cap enforcement for unmanaged snapshots

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 months agoMerge pull request #61367 from cbodley/wip-67268-reef
Shilpa Jagannath [Thu, 6 Feb 2025 16:41:59 +0000 (08:41 -0800)]
Merge pull request #61367 from cbodley/wip-67268-reef

reef: rgw/rgw_rados: fix server side-copy orphans tail-objects

5 months agoMerge pull request #61329 from adamemerson/wip-66340-reef
Yuri Weinstein [Tue, 4 Feb 2025 21:21:18 +0000 (13:21 -0800)]
Merge pull request #61329 from adamemerson/wip-66340-reef

reef: rgw/multisite: Fix use-after-move in retry logic in logbacking

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #61630 from idryomov/zlib-fix-reef
Ilya Dryomov [Tue, 4 Feb 2025 14:17:15 +0000 (15:17 +0100)]
Merge pull request #61630 from idryomov/zlib-fix-reef

reef: win32_deps_build.sh: pin zlib tag

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
5 months agolibrbd: stop filtering async request error codes 61644/head
Ilya Dryomov [Wed, 29 Jan 2025 11:56:34 +0000 (12:56 +0100)]
librbd: stop filtering async request error codes

The roots of this go back to 2015 when snap create was changed to
filter EEXIST in commit 63f6c9bac9a4 ("librbd: fixed snap create race
conditions") and flatten respectively EINVAL in commit ef7e210c3f74
("librbd: better handling for duplicate flatten requests").  From there
this pattern made it to most other operations that can be proxied
including "rbd migration execute".

The motivation was to suppress generation of an "expected" error in
response to a duplicate async request notification for the operation.
However, doing this at the top of the handler (right before returning
to the caller) and for an error as generic as EINVAL is super fragile.
It's trivial for an error that is being filtered to sneak in with
a lower level change completely unnoticed.  For example, live migration
recently added NBD stream which is implemented on top of libnbd and it
turns out that some libnbd APIs return EINVAL on various occasions when
the NBD endpoint disappears and an error like ENOTCONN would make more
sense.  If this occurs during "rbd migration execute" operation, the
rest of librbd never learns that migration was disrupted and the image
is transitioned to MIGRATION_STATE_EXECUTED, thus handing a partially
imported (read: corrupted) image to the user.

Luckily, with commits 07fbc4b71df4 ("librbd: track complete async
operation requests") and 96bc20445afb ("librbd: track complete async
operation return code"), the scenario which originally prompted error
code filtering isn't an issue anymore.  Despite a few shortcomings
(e.g. when an async request notification is acked with result 0, it's
impossible to tell whether a) a new operation was kicked off, b) there
is an operation that is still in progress or c) it's for an operation
that completed earlier but hasn't "expired" yet), even just commit
07fbc4b71df4 by itself prevents a duplicate notification from kicking
off a second operation that could generate an error for something that
actually succeeded.  With that in mind, eradicate error code filtering
from Operations class.

Fixes: https://tracker.ceph.com/issues/58185
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit e4657cb2a2b087af0eae87ef32808b503e0e2051)

5 months agoMerge pull request #59923 from mchangir/wip-68076-reef
Milind Changire [Tue, 4 Feb 2025 09:49:01 +0000 (15:19 +0530)]
Merge pull request #59923 from mchangir/wip-68076-reef

reef: qa: relocate subvol creation overrides and test

5 months agoMerge pull request #60689 from vshankar/wip-68110-reef
Milind Changire [Tue, 4 Feb 2025 09:25:13 +0000 (14:55 +0530)]
Merge pull request #60689 from vshankar/wip-68110-reef

reef: mds: batch backtrace updates by pool-id when expiring a log segment

5 months agoMerge pull request #60390 from rishabh-d-dave/wip-68616-reef
Milind Changire [Tue, 4 Feb 2025 09:24:10 +0000 (14:54 +0530)]
Merge pull request #60390 from rishabh-d-dave/wip-68616-reef

reef: qa/cephfs: ignore when specific OSD is reported down during upgrade

5 months agoMerge pull request #60373 from anoopcs9/wip-68574-reef
Milind Changire [Tue, 4 Feb 2025 09:23:08 +0000 (14:53 +0530)]
Merge pull request #60373 from anoopcs9/wip-68574-reef

reef: client: Fix opening and reading of symlinks

5 months agoMerge pull request #60207 from kotreshhr/wip-68455-reef
Milind Changire [Tue, 4 Feb 2025 09:21:37 +0000 (14:51 +0530)]
Merge pull request #60207 from kotreshhr/wip-68455-reef

reef: mds: misc fixes for MDSAuthCaps code

5 months agoMerge pull request #60188 from kotreshhr/wip-68413-reef
Milind Changire [Tue, 4 Feb 2025 09:20:26 +0000 (14:50 +0530)]
Merge pull request #60188 from kotreshhr/wip-68413-reef

reef: mgr/status: Fix 'fs status' json output

5 months agoMerge pull request #59898 from joscollin/wip-68167-reef
Milind Changire [Tue, 4 Feb 2025 09:17:14 +0000 (14:47 +0530)]
Merge pull request #59898 from joscollin/wip-68167-reef

reef: cephfs-top: fix exceptions on small/large sized windows

5 months agoMerge pull request #59618 from batrick/wip-67837-reef
Milind Changire [Tue, 4 Feb 2025 09:15:38 +0000 (14:45 +0530)]
Merge pull request #59618 from batrick/wip-67837-reef

reef: qa: ignore warnings variations

5 months agoqa: ignore warnings variations 59618/head
Patrick Donnelly [Mon, 19 Aug 2024 13:04:18 +0000 (09:04 -0400)]
qa: ignore warnings variations

Fixes: https://tracker.ceph.com/issues/67601
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 782c88aa96cd4535e3eccd8bd9c25cc5d1dbe8c5)

Conflicts:
qa/cephfs/overrides/ignorelist_health.yaml: trivial

5 months agowin32_deps_build.sh: pin zlib tag 61630/head
Lucian Petrut [Mon, 3 Feb 2025 14:53:05 +0000 (14:53 +0000)]
win32_deps_build.sh: pin zlib tag

The zlib Windows build started to fail, probably because of this:
https://github.com/madler/zlib/issues/1038

  Cloning into 'zlib'...
  make: *** No rule to make target 'zconf.h', needed by 'adler32.o'.

We'll pin the zlib version for now to unblock the Windows build.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit ba9270dc9fe923bb9639a29328035e78ad4346c7)

5 months agoMerge pull request #61612 from adk3798/reef-ctr-label-ceph
Adam King [Mon, 3 Feb 2025 18:48:55 +0000 (13:48 -0500)]
Merge pull request #61612 from adk3798/reef-ctr-label-ceph

reef: container: add label ceph=True back

Reviewed-by: John Mulligan <jmulligan@redhat.com>
5 months agocommon: use close_range on Linux 61625/head
edef [Thu, 16 Mar 2023 09:43:58 +0000 (09:43 +0000)]
common: use close_range on Linux

Fix rook/rook#10110, which occurs when _SC_OPEN_MAX/RLIMIT_NOFILE is
set to very large values (2^30), leaving fork_function pegging a core
busylooping.

The glibc wrappers closefrom(3)/close_range(3) are not available before
glibc 2.34, so we invoke the syscall directly. When glibc 2.34 is old
enough to be a reasonable hard minimum dependency, we should switch to
using closefrom.

If we're not running on (recent enough) Linux, we fall back to the
existing approach.

Fixes: https://tracker.ceph.com/issues/59125
Signed-off-by: edef <edef@edef.eu>
(cherry picked from commit 1a33cefa1980a18b11479275c1f708c1de24ee37)

5 months agoqa: relocate subvol creation overrides and test 59923/head
Milind Changire [Tue, 14 May 2024 06:25:38 +0000 (11:55 +0530)]
qa: relocate subvol creation overrides and test

Fixes: https://tracker.ceph.com/issues/65829
Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit ef68253a87b764abedee71046a0e301d408ad11e)

5 months agothrashers: standardize stop and join method names 59193/head
Nitzan Mordechai [Tue, 2 Jul 2024 08:31:38 +0000 (08:31 +0000)]
thrashers: standardize stop and join method names

Thrashers that do not inherit from ThrasherGreenlet previously used a
method called do_join, which combined stop and join functionality. To
ensure consistency and clarity, we want all thrashers to use separate
stop, join, and stop_and_join methods.

This commit renames methods and implements missing stop and stop_and_join
methods in thrashers that did not inherit from ThrasherGreenlet.

Fixes: https://tracker.ceph.com/issues/66698
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit a035b5a22fb87794e65d112c0d21dcbd28b728ad)

5 months agoMerge pull request #61481 from NitzanMordhai/wip-69622-reef
NitzanMordhai [Mon, 3 Feb 2025 10:25:50 +0000 (12:25 +0200)]
Merge pull request #61481 from NitzanMordhai/wip-69622-reef

reef: test: ceph daemon command with asok path

5 months agoMerge pull request #61395 from NitzanMordhai/wip-nitzan-set-allow-ec-overwrites-wait
NitzanMordhai [Mon, 3 Feb 2025 10:25:30 +0000 (12:25 +0200)]
Merge pull request #61395 from NitzanMordhai/wip-nitzan-set-allow-ec-overwrites-wait

reef: (reintroduce) test/librados: fix LibRadosIoECPP.CrcZeroWrite

5 months agocontainer: add label ceph=True back 61612/head
John Mulligan [Tue, 21 Jan 2025 21:28:42 +0000 (16:28 -0500)]
container: add label ceph=True back

Add a label used by cephadm internally that was always set by
ceph-container [1] back to the new containerfile. This should
prevent issues with cephadm shell command thinking official ceph images
are not official ceph images.

[1] https://github.com/ceph/ceph-container/blob/30dc8b9a55f70a40983fd2da6ac31e1b9e977143/src/__DOCKERFILE_TRACEABILITY_LABELS__#L5

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit b4f4323e6ccacbff8899ef9b5c336b238101fe0e)

5 months agoMerge pull request #61526 from idryomov/wip-69619-reef
Yuri Weinstein [Fri, 31 Jan 2025 16:54:58 +0000 (08:54 -0800)]
Merge pull request #61526 from idryomov/wip-69619-reef

reef: librbd: clear ctx before initiating close in Image::{aio_,}close()

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 months agoMerge pull request #61169 from idryomov/wip-69319-reef
Yuri Weinstein [Fri, 31 Jan 2025 16:53:06 +0000 (08:53 -0800)]
Merge pull request #61169 from idryomov/wip-69319-reef

reef: rbd: open images in read-only mode for "rbd mirror pool status --verbose"

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 months agoMerge pull request #61604 from idryomov/wip-rbd-migration-https-doc-reef
Ilya Dryomov [Fri, 31 Jan 2025 11:07:22 +0000 (12:07 +0100)]
Merge pull request #61604 from idryomov/wip-rbd-migration-https-doc-reef

reef: doc/rbd: use https links in live import examples

Reviewed-by: Zac Dover <zac.dover@proton.me>
5 months agodoc/rbd: use https links in live import examples 61604/head
Ilya Dryomov [Thu, 30 Jan 2025 19:30:18 +0000 (20:30 +0100)]
doc/rbd: use https links in live import examples

Even though it's explicitly said that "http" stream can be used to
import via both HTTP and HTTPS, it can still be confusing that "type":
"http" is expected to go with "url": "https://...".  Switch example
URLs from HTTP to HTTPS to make it more obvious.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8666c5694eb61deb2b46b6b76274e58f637c068a)

5 months agoosd/OSDCap: fix misleading grammar comments 61602/head
Ilya Dryomov [Mon, 27 Jan 2025 11:29:54 +0000 (12:29 +0100)]
osd/OSDCap: fix misleading grammar comments

The restrictions on pool name and namespace have been independent of
each other for ages.  Specifying namespace[=]<namespace> doesn't require
specifying pool[=]<pool> like is currently suggested -- neither for
regular "allow" grants nor for "profile" grants.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d99367e1e03cbeefd33d7dd9405245e089c2237c)

5 months agomon/OSDMonitor: relax cap enforcement for unmanaged snapshots
Ilya Dryomov [Fri, 24 Jan 2025 19:47:11 +0000 (20:47 +0100)]
mon/OSDMonitor: relax cap enforcement for unmanaged snapshots

Since commit 4972e054b32c ("mon/OSDMonitor: enforce caps when
creating/deleting unmanaged snapshots"), a) write access to the MON
service, b) write access to the OSD service for a pool or c) permission
for "osd pool op unmanaged-snap" command for a pool is required.  For
"profile rbd" we configure read-only access to the MON service and rely
on write access to the OSD service, however the corresponding check in
is_osd_writable() is too strict.

A OSD cap like "profile rbd namespace=myns" or "allow w namespace=myns"
allows write access to myns namespace of any pool, but is_osd_writable()
disallows operations with unmanaged snapshots with such a cap because
its match.pool_namespace.pool_name.empty() is true.  This condition
appears to serve as the "doesn't include support for the application
tag" guard, but it should actually be match.pool_tag.is_match_all()
(or match.pool_tag.application.empty() if open-coded) -- no restriction
on the pool name doesn't automatically mean that there is a restriction
on the application tag.

Fixes: https://tracker.ceph.com/issues/69679
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5f3815e80028066fb3d6ae9b68d6b69045ab2bdf)

5 months agorgw/multisite: allow modified object acls to be replicated 58546/head
Shilpa Jagannath [Tue, 19 Mar 2024 14:59:35 +0000 (10:59 -0400)]
rgw/multisite: allow modified object acls to be replicated

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit f5f6194c07b40c50913e956e06aaa3709d4d53aa)

5 months agocontainer/build.sh: don't require repo creds on NO_PUSH 61582/head
Dan Mick [Fri, 24 Jan 2025 19:00:28 +0000 (11:00 -0800)]
container/build.sh: don't require repo creds on NO_PUSH

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit a745e07e7ee2de76f59b3798d2814bb6ba8f9cd2)

5 months agocontainer/build.sh: fix up org vs. repo naming 61581/head
Dan Mick [Thu, 23 Jan 2025 02:28:15 +0000 (18:28 -0800)]
container/build.sh: fix up org vs. repo naming

release builds were using the wrong container repo name because of
confused variable naming and inadequate separation.  Keep the hostname,
org name, and repo name in separate variables, and assemble the full
path with a version when tagging is done.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 1fb6137afe1638907d6b2d220a535a5619fa8886)

5 months agocontainer/Containerfile: replace CEPH_VERSION var for backward compat 61580/head
Dan Mick [Fri, 3 Jan 2025 03:15:54 +0000 (19:15 -0800)]
container/Containerfile: replace CEPH_VERSION var for backward compat

CEPH_VERSION used to be present in the env to hold the ref.  Other projects
relied on this.  Make life easier for them.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 3075894aab604ffdfb81d3eb1af675cdbc6aa776)

5 months agoMerge pull request #61507 from ivancich/wip-69652-reef
Yuri Weinstein [Thu, 30 Jan 2025 00:36:07 +0000 (16:36 -0800)]
Merge pull request #61507 from ivancich/wip-69652-reef

reef: msg: insert PriorityDispatchers in sorted position

Reviewed-by: Adam Emerson <aemerson@redhat.com>
5 months agoMerge pull request #59127 from k0ste/wip-61191-reef
Yuri Weinstein [Wed, 29 Jan 2025 23:26:59 +0000 (15:26 -0800)]
Merge pull request #59127 from k0ste/wip-61191-reef

reef: rgw/lua: add more info on package install errors

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
5 months agoMerge pull request #59126 from k0ste/wip-63969-reef
Yuri Weinstein [Wed, 29 Jan 2025 23:26:18 +0000 (15:26 -0800)]
Merge pull request #59126 from k0ste/wip-63969-reef

reef: rgw/iam: fix role deletion replication

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #59124 from k0ste/wip-65544-reef
Yuri Weinstein [Wed, 29 Jan 2025 23:25:32 +0000 (15:25 -0800)]
Merge pull request #59124 from k0ste/wip-65544-reef

reef: rgw: increase log level on abort_early

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #58070 from yuvalif/wip-66496-reef
Yuri Weinstein [Wed, 29 Jan 2025 23:24:49 +0000 (15:24 -0800)]
Merge pull request #58070 from yuvalif/wip-66496-reef

reef: rgw/admin/notification: add command to dump notifications

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #57229 from galsalomon66/wip-65245-reef
Yuri Weinstein [Wed, 29 Jan 2025 23:24:10 +0000 (15:24 -0800)]
Merge pull request #57229 from galsalomon66/wip-65245-reef

reef: rgw/s3select: s3select response handler refactor

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #56158 from yuvalif/wip-64885-reef
Yuri Weinstein [Wed, 29 Jan 2025 23:23:20 +0000 (15:23 -0800)]
Merge pull request #56158 from yuvalif/wip-64885-reef

reef: rgw/kafka: set message timeout to 5 seconds

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #61061 from k0ste/wip-69217-reef
Yuri Weinstein [Wed, 29 Jan 2025 16:12:59 +0000 (08:12 -0800)]
Merge pull request #61061 from k0ste/wip-69217-reef

reef: rgw: Delete stale entries in bucket indexes while deleting obj

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #61093 from shashalu/fix-data-corruption-ETIMEDOUT-reef
Casey Bodley [Wed, 29 Jan 2025 15:17:12 +0000 (10:17 -0500)]
Merge pull request #61093 from shashalu/fix-data-corruption-ETIMEDOUT-reef

reef: rgw: fix data corruption when rados op return ETIMEDOUT

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 months agoMerge pull request #61052 from cbodley/wip-69212-reef
Casey Bodley [Wed, 29 Jan 2025 15:16:34 +0000 (10:16 -0500)]
Merge pull request #61052 from cbodley/wip-69212-reef

reef: rgw: fix bucket link operation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #61557 from zdover23/wip-doc-2025-01-29-backport-61549-to-reef
Zac Dover [Wed, 29 Jan 2025 13:12:20 +0000 (23:12 +1000)]
Merge pull request #61557 from zdover23/wip-doc-2025-01-29-backport-61549-to-reef

reef: doc/radosgw: s/zonegroup/pools/

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
5 months agoMerge pull request #59705 from vshankar/wip-67375-reef
Milind Changire [Wed, 29 Jan 2025 12:31:16 +0000 (18:01 +0530)]
Merge pull request #59705 from vshankar/wip-67375-reef

reef: mon: fix `fs set down` to adjust max_mds only when cluster is not down

5 months agoMerge pull request #59920 from mchangir/wip-67827-reef
Milind Changire [Wed, 29 Jan 2025 11:06:59 +0000 (16:36 +0530)]
Merge pull request #59920 from mchangir/wip-67827-reef

reef: qa: failfast mount for better performance and unblock `fs volume ls`

https://tracker.ceph.com/projects/cephfs/wiki/Reef#wip-vshankar-testing-20250113141608-reef-debug

5 months agoMerge pull request #57560 from ceph/wip-lusov-asok-async-reef
Milind Changire [Wed, 29 Jan 2025 10:55:12 +0000 (16:25 +0530)]
Merge pull request #57560 from ceph/wip-lusov-asok-async-reef

reef: mds: don't stall the asok thread for flush commands

5 months agoMerge pull request #57177 from batrick/wip-65715-reef
Milind Changire [Wed, 29 Jan 2025 10:50:27 +0000 (16:20 +0530)]
Merge pull request #57177 from batrick/wip-65715-reef

reef: mds: inode_t flags may not be protected by the policylock during set_vxattr

5 months agoMerge pull request #60692 from vshankar/wip-67691-reef
Milind Changire [Wed, 29 Jan 2025 06:50:44 +0000 (12:20 +0530)]
Merge pull request #60692 from vshankar/wip-67691-reef

reef: mds: getattr just waits the xlock to be released by the previous client

5 months agoMerge pull request #59686 from vshankar/wip-67743-reef
Milind Changire [Wed, 29 Jan 2025 06:49:29 +0000 (12:19 +0530)]
Merge pull request #59686 from vshankar/wip-67743-reef

reef: qa: wait for file creation before changing mode

5 months agoMerge pull request #58982 from kotreshhr/wip-67294-reef
Milind Changire [Wed, 29 Jan 2025 06:48:22 +0000 (12:18 +0530)]
Merge pull request #58982 from kotreshhr/wip-67294-reef

reef: client: Fix leading / issue with mds_check_access

5 months agodoc/radosgw: s/zonegroup/pools/ 61557/head
Zac Dover [Tue, 28 Jan 2025 06:30:24 +0000 (16:30 +1000)]
doc/radosgw: s/zonegroup/pools/

s/zonegroup/pools/, where this change makes the text clearer.

This change was made in reponse to an upstream comment on
https://pad.ceph.com/p/Report_Documentation_Bugs.

Fixes: https://tracker.ceph.com/issues/69689
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ea576ccd037ee0336f01342c86ea9b1468f67cc3)

5 months agoMerge pull request #61112 from k0ste/wip-68735-reef
Adam Kupczyk [Tue, 28 Jan 2025 14:39:09 +0000 (15:39 +0100)]
Merge pull request #61112 from k0ste/wip-68735-reef

reef: os/bluestore: Fix BlueRocksEnv attempts to use POSIX

5 months agoMerge pull request #61237 from aaSharma14/wip-69291-reef
afreen23 [Tue, 28 Jan 2025 14:12:55 +0000 (19:42 +0530)]
Merge pull request #61237 from aaSharma14/wip-69291-reef

reef: mgr/dashboard: Fix Latency chart data units in rgw overview page

Reviewed-by: Afreen Misbah <afreen@ibm.com>
5 months agoMerge pull request #60850 from smanjara/wip-reef-boto-s3-client
Shilpa Jagannath [Tue, 28 Jan 2025 06:19:32 +0000 (22:19 -0800)]
Merge pull request #60850 from smanjara/wip-reef-boto-s3-client

reef: qa/multisite: add boto3.client to the library

5 months agoMerge pull request #60793 from smanjara/wip-69004-reef
Shilpa Jagannath [Tue, 28 Jan 2025 06:19:03 +0000 (22:19 -0800)]
Merge pull request #60793 from smanjara/wip-69004-reef

reef: rgw/multisite: metadata polling event based on unmodified mdlog_marker

5 months agoMerge pull request #60733 from ifed01/wip-ifed-tcmalloc-rgw-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:50:27 +0000 (10:50 -0800)]
Merge pull request #60733 from ifed01/wip-ifed-tcmalloc-rgw-reef

reef: rgw: link only radosgw with ALLOC_LIBS

Reviewed-by: Adam Emerson <aemerson@redhat.com>
5 months agoMerge pull request #60745 from satoru-takeuchi/wip-62757-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:47:11 +0000 (10:47 -0800)]
Merge pull request #60745 from satoru-takeuchi/wip-62757-reef

reef: rgw: when there are a large number of multiparts, the unorder list result may miss objects

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #59354 from k0ste/wip-63585-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:44:57 +0000 (10:44 -0800)]
Merge pull request #59354 from k0ste/wip-63585-reef

reef: rgw/notifications: cleanup all coroutines after sending the notification

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
5 months agoMerge pull request #59343 from k0ste/wip-61189-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:44:23 +0000 (10:44 -0800)]
Merge pull request #59343 from k0ste/wip-61189-reef

reef: rgw/lua: add lib64 to the package search path

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
5 months agoMerge pull request #59304 from yuvalif/wip-67608-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:43:26 +0000 (10:43 -0800)]
Merge pull request #59304 from yuvalif/wip-67608-reef

reef: test/rgw/notification: use real ip address instead of localhost

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #59258 from k0ste/wip-64551-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:42:23 +0000 (10:42 -0800)]
Merge pull request #59258 from k0ste/wip-64551-reef

reef: rgw/http/client-side: disable curl path normalization

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #59134 from k0ste/wip-63250-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:41:12 +0000 (10:41 -0800)]
Merge pull request #59134 from k0ste/wip-63250-reef

reef: rgw: fix user.rgw.user-policy attr remove by modify user

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #61160 from ivancich/wip-69296-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:36:27 +0000 (10:36 -0800)]
Merge pull request #61160 from ivancich/wip-69296-reef

reef: rgw: append query string to redirect URL if present

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #61133 from cbodley/wip-69298-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:35:57 +0000 (10:35 -0800)]
Merge pull request #61133 from cbodley/wip-69298-reef

reef: rgw/abortmp: Race condition on AbortMultipartUpload

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #61105 from cbodley/wip-69259-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:35:17 +0000 (10:35 -0800)]
Merge pull request #61105 from cbodley/wip-69259-reef

reef: <common> fix formatter buffer out-of-bounds

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #61022 from cbodley/wip-69180-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:32:03 +0000 (10:32 -0800)]
Merge pull request #61022 from cbodley/wip-69180-reef

reef: qa/rgw: bump keystone/barbican from 2023.1 to 2024.1

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 months agoMerge pull request #60977 from cbodley/wip-69147-reef
Yuri Weinstein [Mon, 27 Jan 2025 18:30:35 +0000 (10:30 -0800)]
Merge pull request #60977 from cbodley/wip-69147-reef

reef: test/rgw/multisite: add meta checkpoint after bucket creation

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 months agoMerge pull request #61458 from aaSharma14/wip-69597-reef
afreen23 [Mon, 27 Jan 2025 06:40:34 +0000 (12:10 +0530)]
Merge pull request #61458 from aaSharma14/wip-69597-reef

reef: mgr/dashboard: fix total objects/Avg object size in RGW Overview Page

Reviewed-by: Afreen Misbah <afreen@ibm.com>
5 months agoMerge pull request #61038 from rhcs-dashboard/wip-69194-reef
Nizamudeen A [Mon, 27 Jan 2025 06:19:52 +0000 (11:49 +0530)]
Merge pull request #61038 from rhcs-dashboard/wip-69194-reef

reef: mgr/dashboard: add a custom warning message when enabling feature

Reviewed-by: Afreen Misbah <afreen@ibm.com>
5 months agoMerge pull request #61236 from aaSharma14/wip-69222-reef
afreen23 [Mon, 27 Jan 2025 05:29:52 +0000 (10:59 +0530)]
Merge pull request #61236 from aaSharma14/wip-69222-reef

reef: mgr/dashboard: Update and correct zonegroup delete notification

Reviewed-by: Afreen Misbah <afreen@ibm.com>
5 months agoMerge pull request #61529 from zdover23/wip-doc-2025-01-27-backport-61525-to-reef
Anthony D'Atri [Sun, 26 Jan 2025 18:02:21 +0000 (13:02 -0500)]
Merge pull request #61529 from zdover23/wip-doc-2025-01-27-backport-61525-to-reef

reef: doc/cephadm: correct note

5 months agodoc/cephadm: correct note 61529/head
Zac Dover [Sun, 26 Jan 2025 05:11:16 +0000 (15:11 +1000)]
doc/cephadm: correct note

Correct the English in a note in doc/cephadm/host-management.rst.

This commit was made in response to
https://github.com/ceph/ceph/pull/50340, which corrected some of this
note in Quincy.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d15f1f6869465a8cc3191169f038217baecf2c4f)

5 months agolibrbd: clear ctx before initiating close in Image::{aio_,}close() 61526/head
Ilya Dryomov [Wed, 22 Jan 2025 19:34:11 +0000 (20:34 +0100)]
librbd: clear ctx before initiating close in Image::{aio_,}close()

Image::aio_close() must clear ctx before initiating close.  Otherwise
the provided callback may see a non-NULL ctx and attempt to close the
image again from Image destructor, leading to an invalid memory access
as ImageCtx and ImageState are both freed immediately after the image
is closed (i.e. before AioCompletion is completed and the callback is
executed).

The same adjustment is made to Image::close() just for consistency.

Fixes: https://tracker.ceph.com/issues/69619
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 61baa8793402d416289ff25535d6f9124da3cae9)

5 months agoMerge pull request #61522 from zdover23/wip-doc-2025-01-26-backport-61503-to-reef
Zac Dover [Sun, 26 Jan 2025 02:19:44 +0000 (12:19 +1000)]
Merge pull request #61522 from zdover23/wip-doc-2025-01-26-backport-61503-to-reef

reef: doc/cephfs: edit disaster-recovery-experts (6 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>