]> git.apps.os.sepia.ceph.com Git - ceph-ci.git/log
ceph-ci.git
3 weeks agoauth/cephx: session key type is set to client key type
Yehuda Sadeh [Thu, 6 Mar 2025 14:23:34 +0000 (09:23 -0500)]
auth/cephx: session key type is set to client key type

This ensures that the client supports the specific key type.

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>
(cherry picked from commit 36345741b1dee9482e40aa9db847375dacc73107)

3 weeks agoauth/cephx: switch default cipher to AES256KRB5
Yehuda Sadeh [Thu, 27 Feb 2025 22:09:26 +0000 (17:09 -0500)]
auth/cephx: switch default cipher to AES256KRB5

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>
(cherry picked from commit 2af51362afdd1da9f1195f3394716d09383a0c88)

3 weeks agoauth/cephx: modify client + server challenges hashing
Yehuda Sadeh [Thu, 27 Feb 2025 21:14:06 +0000 (16:14 -0500)]
auth/cephx: modify client + server challenges hashing

This applies when using ciphers that are not the original
AES-128 one. Use the hmac-sha256 hash now. With AES256KRB5
the original method of encrypting the combined challenges
doesn't work as the confounder randomizes the result.

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>
(cherry picked from commit 31c07fbbf3b8c911a51b41791d6b6265923acda2)

3 weeks agoceph-authtool: support --key-type param
Yehuda Sadeh [Thu, 27 Feb 2025 16:55:37 +0000 (11:55 -0500)]
ceph-authtool: support --key-type param

Also move the encryption handlers out of the ceph_context.
Handlers are now returned as a shared_ptr, to support the
creation of new handlers with different params (such as
the usage param).

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>
(cherry picked from commit 3085da064b838b52c638a9121187d1341b591066)

3 weeks agoauth/crypto: add support for aes256-hmac384-192
Yehuda Sadeh [Fri, 21 Feb 2025 21:18:58 +0000 (16:18 -0500)]
auth/crypto: add support for aes256-hmac384-192

Using the encryption standard set in RFC 8009. This is the
encryption that is used in Kerberos 5, so naming this variation
as AES256KRB5.

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>
(cherry picked from commit c259448c46b5235f0aa220cddb5d7e14f469b147)

3 weeks agoauth: propagate ceph context to encrypt/decrypt
Yehuda Sadeh [Mon, 24 Feb 2025 21:31:42 +0000 (16:31 -0500)]
auth: propagate ceph context to encrypt/decrypt

Signed-off-by: Yehuda Sadeh <ysadehwe@ibm.com>
(cherry picked from commit c73c75d34051cef09e9695dcf85a24a4d024faaf)

3 weeks agomsg/Dispatcher: simplify and optimize the `marrival` tree
Max Kellermann [Wed, 16 Oct 2024 10:51:04 +0000 (12:51 +0200)]
msg/Dispatcher: simplify and optimize the `marrival` tree

This replaces the two containers `marrival` and `marrival_map` which
needs lookups with one single `std::multiset` and eliminates all
lookups completely; only `add_arrival()` ever needs to walk the tree.

To do that, an iterator field is added to `class QueueItem` which is
later used to erase the `std::multiset` item.

This is not only simpler and faster, but also smaller: the resulting
binary is 2.5 kB smaller.

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 9276d24355d3484312af097209481e0163dbd2ff)

3 weeks agomsg/async/AsyncConnection: move the writeCallback instead of copying it
Max Kellermann [Tue, 8 Oct 2024 12:52:13 +0000 (14:52 +0200)]
msg/async/AsyncConnection: move the writeCallback instead of copying it

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 425fc4d21d33a8f1e7b47e7698a8c5b97bba71b3)

3 weeks agomsg/async/AsyncConnection: do not wrap writeCallback in `std::optional`
Max Kellermann [Tue, 8 Oct 2024 12:50:02 +0000 (14:50 +0200)]
msg/async/AsyncConnection: do not wrap writeCallback in `std::optional`

Since `std::function` is nullable and as an `operator bool()`, we can
easily eliminate the `std::optional` overhead.

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit c72dae9b6e4b37c508a3ebb1410172fb7c434e8a)

3 weeks agomsg/async/frames_v2: use zero-initialization instead of memset()
Max Kellermann [Fri, 4 Oct 2024 15:29:39 +0000 (17:29 +0200)]
msg/async/frames_v2: use zero-initialization instead of memset()

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 10a9914f848163a8fd74cdaa130cfb4d082cd45d)

3 weeks agomsg/async/Event: use zero-initialization instead of memset()
Max Kellermann [Fri, 4 Oct 2024 15:27:28 +0000 (17:27 +0200)]
msg/async/Event: use zero-initialization instead of memset()

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 7fcb8a8afaf5a61e525e8cbc01efae5b14f6cc4e)

3 weeks agomsg/Message: use zero-initialization instead of memset()
Max Kellermann [Fri, 4 Oct 2024 15:22:20 +0000 (17:22 +0200)]
msg/Message: use zero-initialization instead of memset()

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 62ebf16f71fa60fc01fb438c4316990da2239679)

3 weeks agomsg/async/ProtocolV2: eliminate redundant std::map lookups
Max Kellermann [Tue, 8 Oct 2024 10:41:45 +0000 (12:41 +0200)]
msg/async/ProtocolV2: eliminate redundant std::map lookups

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 6597d773611b6e74cacad5f2645ab6a8da99c634)

3 weeks agomsg/async/ProtocolV[12]: reverse the std::map sort order
Max Kellermann [Tue, 8 Oct 2024 10:48:03 +0000 (12:48 +0200)]
msg/async/ProtocolV[12]: reverse the std::map sort order

This allows eliminating one lookup in `_get_next_outgoing()` because
we can pass the iterator instead of the key to `erase()`.

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 342a25b9df13319ff6cd661eab1c546229ce0e14)

3 weeks agomsg/async/ProtocolV[12]: use `auto`
Max Kellermann [Tue, 8 Oct 2024 08:57:36 +0000 (10:57 +0200)]
msg/async/ProtocolV[12]: use `auto`

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit 988705a49b58dfd78a8cc7c1a865343f925a8c53)

3 weeks agomsg/async/ProtocolV[12]: use range-based `for`
Max Kellermann [Tue, 8 Oct 2024 08:58:44 +0000 (10:58 +0200)]
msg/async/ProtocolV[12]: use range-based `for`

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit a14384478648dcb712ad55c83e55a2be736b43b3)

3 weeks agomsg/async/ProtocolV1: use zero-initialization instead of memset()
Max Kellermann [Fri, 4 Oct 2024 15:28:43 +0000 (17:28 +0200)]
msg/async/ProtocolV1: use zero-initialization instead of memset()

Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
(cherry picked from commit cae1af38601df8fccd3d6b32714864bc4ada4334)

3 weeks agomsg/async: Encode message once features are set
Aishwarya Mathuria [Thu, 5 May 2022 03:02:51 +0000 (08:32 +0530)]
msg/async: Encode message once features are set

Modify send_message to check if features are set before trying to encode a
message.
If features are not set at this point, we will encode the message at a
later stage (in write_event) when the connection will be in ready state
which implies that the features will definitely be set.

Fixes: https://tracker.ceph.com/issues/52657
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
(cherry picked from commit 7268211161ba5d2c47464c19fb25555ae194841d)
(cherry picked from commit 542de25001d89a23d370fe99c2958b8bc38af436)

4 weeks agoMerge pull request #62918 from rishabh-d-dave/wip-71018-squid
Christopher Hoffman [Fri, 10 Oct 2025 18:17:25 +0000 (14:17 -0400)]
Merge pull request #62918 from rishabh-d-dave/wip-71018-squid

squid: mgr/vol: add command to get snapshot path

4 weeks agoMerge pull request #63222 from rishabh-d-dave/wip-71276-squid
Christopher Hoffman [Fri, 10 Oct 2025 18:13:25 +0000 (14:13 -0400)]
Merge pull request #63222 from rishabh-d-dave/wip-71276-squid

squid: mgr/vol: make "snapshot getpath" cmd work with v1 and legacy

4 weeks agoMerge pull request #64205 from rishabh-d-dave/wip-71854-squid
Christopher Hoffman [Fri, 10 Oct 2025 18:09:53 +0000 (14:09 -0400)]
Merge pull request #64205 from rishabh-d-dave/wip-71854-squid

squid: mgr/vol: include group name in subvolume's pool namespace name

4 weeks agoMerge pull request #65838 from phlogistonjohn/jjm-rmc-backport-squid
Dan Mick [Thu, 9 Oct 2025 16:39:36 +0000 (09:39 -0700)]
Merge pull request #65838 from phlogistonjohn/jjm-rmc-backport-squid

squid: run-make-check.sh: handle sudo and command that may not run in container

4 weeks agoMerge pull request #65444 from NitzanMordhai/wip-72919-squid
NitzanMordhai [Thu, 9 Oct 2025 05:51:42 +0000 (08:51 +0300)]
Merge pull request #65444 from NitzanMordhai/wip-72919-squid

squid: suites/rados/cephadm: typo in ignore list for still running message

4 weeks agoMerge pull request #65844 from phlogistonjohn/jjm-bwc-backports-s
David Galloway [Thu, 9 Oct 2025 00:22:56 +0000 (20:22 -0400)]
Merge pull request #65844 from phlogistonjohn/jjm-bwc-backports-s

squid: sync build-with-container patches from main

4 weeks agoscript/build-with-container: improve error handling for invalid distros
John Mulligan [Wed, 8 Oct 2025 20:41:36 +0000 (16:41 -0400)]
script/build-with-container: improve error handling for invalid distros

Instead of throwing a long obnoxious traceback at the user if the value
supplied to -d/--distro is invalid do something nicer. For example:
```
$ ./src/script/build-with-container.py -d trixy  -e build
usage: build-with-container.py [-h] [--help-build-steps]
build-with-container.py: error: argument --distro/-d: unknown distro: 'trixy' not in centos10, centos10stream, centos8, centos9, centos9stream, rocky9, rockylinux9, rocky10, rockylinux10, fedora41, fc41, fedora42, fc42, fedora43, fc43, ubuntu20.04, ubuntu-focal, focal, ubuntu22.04, ubuntu-jammy, jammy, ubuntu24.04, ubuntu-noble, noble, debian12, debian-bookworm, bookworm, debian13, debian-trixie, trixie

```

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 72f3ad9549e84bdba7bdfd97d2ede3c55e02f103)

4 weeks agoscript/build-with-container: add debian 13 (trixie)
John Mulligan [Wed, 8 Oct 2025 21:04:27 +0000 (17:04 -0400)]
script/build-with-container: add debian 13 (trixie)

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit a13fa091dd6bad35c44076cb7c46cb7bcc17a7ac)

4 weeks agoscript/build-with-container: add ubuntu 20.04 (focal)
John Mulligan [Wed, 8 Oct 2025 17:30:18 +0000 (13:30 -0400)]
script/build-with-container: add ubuntu 20.04 (focal)

Add ubuntu 20.04 (focal) to the available list of distro kinds.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 7c40f7bd07ac935d0657b9284118da8590a5cf0d)

4 weeks agoscript/build-with-container: add a pair of fedora distro versions
John Mulligan [Wed, 8 Oct 2025 14:28:30 +0000 (10:28 -0400)]
script/build-with-container: add a pair of fedora distro versions

Add fedora 42 and the soon-to-be-released fedora 43.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 76fe5ad298ee5626eeb63591a702e8f8cc9be7d0)

4 weeks agoscript/build-with-container: lightly organize the distro kind aliases
John Mulligan [Wed, 8 Oct 2025 14:26:58 +0000 (10:26 -0400)]
script/build-with-container: lightly organize the distro kind aliases

Do a tiny reorg of the distro kind aliases and container images to keep
the EL distros together and comment out each "section".

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 4430a5ad6be6f26309d5f5bea0e448a4bbd432e1)

4 weeks agoscript/build-with-container: be consistent with naming in distro kinds
John Mulligan [Wed, 8 Oct 2025 14:23:25 +0000 (10:23 -0400)]
script/build-with-container: be consistent with naming in distro kinds

Update the DistroKind enum and related items so that the naming is
applied consistently. That is: the canonical (no pun indented) form
of the name is "<name><version>" and codenames, such as "jammy" or
"bookworm" are aliases. This matches the previously existing code.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit ac11a80a63ab1909fbdf682d830acde96856f502)

4 weeks agosrc/script: add bookworm to build-with-container.py
Dan Mick [Tue, 7 Oct 2025 01:48:42 +0000 (18:48 -0700)]
src/script: add bookworm to build-with-container.py

..and its friend buildcontainer-setup.sh

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 34b497c2f3652e7d30c7b7476b711fd9f1f4ecac)

4 weeks agobuild-with-container: ensure npm dir is set up before configure
John Mulligan [Thu, 28 Aug 2025 23:39:06 +0000 (19:39 -0400)]
build-with-container: ensure npm dir is set up before configure

When the npm cache path option is passed the npm cache dir is passed
to all container `run` commands, ensure the dir has been created
before the first container command (configure) is used.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 79166af192ea0b4b982b56ce521516d5a29e7a0d)

4 weeks agorun-make-check.sh: handle sudo and command that may not run in container
John Mulligan [Tue, 18 Mar 2025 23:26:59 +0000 (19:26 -0400)]
run-make-check.sh: handle sudo and command that may not run in container

Work around a known failure that sudo is not expected to be present in
container images. Prepare to handle a failure to set a sysctl param.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 9f44155dff195015186315968a0a1e8ce925ed5d)

4 weeks agoinstall-deps: extract SUDO variable logic into a reusable function
John Mulligan [Sat, 15 Mar 2025 16:44:00 +0000 (12:44 -0400)]
install-deps: extract SUDO variable logic into a reusable function

While the function is pretty simple and could be copy-pasted I
prefer to extract things into functions to indicate that the
logic is used/repeated elsewhere to ward off making changes to
one copy vs the other.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit bbd7933598e11d84758a6f09fd176f47c744aaa2)

4 weeks agoMerge pull request #65462 from pdvian/wip-72853-squid
Yuri Weinstein [Mon, 6 Oct 2025 14:55:29 +0000 (07:55 -0700)]
Merge pull request #65462 from pdvian/wip-72853-squid

squid: mgr/DaemonState: Minimise time we hold the DaemonStateIndex lock

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 weeks agoMerge pull request #65214 from ifed01/wip-ifed-discard-threads-better-lifecycle-squi
Yuri Weinstein [Mon, 6 Oct 2025 14:52:59 +0000 (07:52 -0700)]
Merge pull request #65214 from ifed01/wip-ifed-discard-threads-better-lifecycle-squi

squid: blk/kernel: improve DiscardThread life cycle.

Reviewed-by: YiteGu <yitegu0@gmail.com>
4 weeks agoMerge pull request #65006 from mchangir/wip-72564-squid
Yuri Weinstein [Mon, 6 Oct 2025 14:51:59 +0000 (07:51 -0700)]
Merge pull request #65006 from mchangir/wip-72564-squid

squid: mgr: avoid explicit dropping of ref

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 weeks agoMerge pull request #65335 from abitdrag/wip-72817-squid
Ilya Dryomov [Sun, 5 Oct 2025 13:17:48 +0000 (15:17 +0200)]
Merge pull request #65335 from abitdrag/wip-72817-squid

squid: auth: msgr2 can return incorrect allowed_modes through AuthBadMethodFrame

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
5 weeks agoMerge pull request #64739 from VinayBhaskar-V/wip-72319-squid
Yuri Weinstein [Thu, 2 Oct 2025 17:27:31 +0000 (10:27 -0700)]
Merge pull request #64739 from VinayBhaskar-V/wip-72319-squid

squid: rbd-mirror: prevent image deletion if remote image is not primary

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 weeks agoMerge pull request #65665 from kchheda3/wip-73055-squid
Yuri Weinstein [Wed, 1 Oct 2025 18:31:45 +0000 (11:31 -0700)]
Merge pull request #65665 from kchheda3/wip-73055-squid

squid: rgw/account: bucket acls are not completely migrated once the user is migrated to an account

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 weeks agoMerge pull request #65709 from aaSharma14/wip-73293-squid
Aashish Sharma [Tue, 30 Sep 2025 05:15:24 +0000 (10:45 +0530)]
Merge pull request #65709 from aaSharma14/wip-73293-squid

squid: monitoring: fix MTU Mismatch alert rule and expr

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
5 weeks agoMerge pull request #65706 from rhcs-dashboard/wip-73274-squid
Pedro Gonzalez Gomez [Mon, 29 Sep 2025 11:52:15 +0000 (13:52 +0200)]
Merge pull request #65706 from rhcs-dashboard/wip-73274-squid

squid: mgr/dashboard: Blank entry for Storage Capacity in dashboard under Cluster > Expand Cluster > Review

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>
5 weeks agomonitoring: fix MTU Mismatch alert rule and expr
Aashish Sharma [Wed, 2 Jul 2025 11:05:14 +0000 (16:35 +0530)]
monitoring: fix MTU Mismatch alert rule and expr

Fixes: https://tracker.ceph.com/issues/73290
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit bee24dec441b9e6b263e4498c2ab333b0a60a52d)

Conflicts:
monitoring/ceph-mixin/prometheus_alerts.yml
monitoring/ceph-mixin/tests_alerts/test_alerts.yml
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list/active-alert-list.component.html
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list/active-alert-list.component.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-key-value/table-key-value.component.scss

5 weeks agorelease note: add note for change in format of name of pool...
Rishabh Dave [Tue, 3 Jun 2025 18:56:33 +0000 (00:26 +0530)]
release note: add note for change in format of name of pool...

namespace of CephFS volumes.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit f350d9800024661eecdfd7da6d57fa0e0324d981)

5 weeks agomgr/dashboard: Blank entry for Storage Capacity in dashboard under Cluster > Expand...
Naman Munet [Wed, 24 Sep 2025 07:23:40 +0000 (12:53 +0530)]
mgr/dashboard: Blank entry for Storage Capacity in dashboard under Cluster > Expand Cluster > Review

https://tracker.ceph.com/issues/73220

Signed-off-by: Naman Munet <naman.munet@ibm.com>
(cherry picked from commit a01909e7588c7ff757079475e3ea6f1dc3054db7)

6 weeks agoMerge pull request #64456 from cbodley/wip-72090-squid
Yuri Weinstein [Fri, 26 Sep 2025 16:08:49 +0000 (09:08 -0700)]
Merge pull request #64456 from cbodley/wip-72090-squid

squid: deb/mgr: remove deprecated distutils from ceph-mgr.requires

Reviewed-by: Nizamudeen A <nia@redhat.com>
6 weeks agoMerge pull request #65141 from mchangir/wip-70925-squid
Christopher Hoffman [Fri, 26 Sep 2025 16:07:55 +0000 (12:07 -0400)]
Merge pull request #65141 from mchangir/wip-70925-squid

squid: mds: fix heap-use-after-free in C_Flush_Journal

6 weeks agoMerge pull request #65620 from aaSharma14/wip-73167-squid
Aashish Sharma [Fri, 26 Sep 2025 14:07:55 +0000 (19:37 +0530)]
Merge pull request #65620 from aaSharma14/wip-73167-squid

squid: mgr/dashboard: fix zone update API forcing STANDARD storage class

Reviewed-by: Afreen Misbah <afreen@ibm.com>
6 weeks agoMerge pull request #65671 from aaSharma14/wip-73231-squid
Aashish Sharma [Fri, 26 Sep 2025 05:11:59 +0000 (10:41 +0530)]
Merge pull request #65671 from aaSharma14/wip-73231-squid

squid: monitoring: fix "In" OSDs in Cluster-Advanced grafana panel. Also change units from decbytes to bytes wherever used in the panel

Reviewed-by: Afreen Misbah <afreen@ibm.com>
6 weeks agorelease note: add a note for "snapshot getpath" command
Rishabh Dave [Mon, 7 Apr 2025 14:39:44 +0000 (20:09 +0530)]
release note: add a note for "snapshot getpath" command

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit a59b1fa431e2b546877c160beb5f67f2970776f0)

6 weeks agodoc/cephfs: add doc for "snapshot getpath" cmd
Rishabh Dave [Mon, 7 Apr 2025 14:36:33 +0000 (20:06 +0530)]
doc/cephfs: add doc for "snapshot getpath" cmd

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 9e40a5c8d7a5cd6e4c1929559c4c7e3411653de5)

6 weeks agoqa/cephfs: add tests for "subvolume snapshot getpath" cmd
Rishabh Dave [Mon, 7 Apr 2025 14:14:57 +0000 (19:44 +0530)]
qa/cephfs: add tests for "subvolume snapshot getpath" cmd

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 870cbf62d288ae09ea06a5da112ea62156336924)

6 weeks agomgr/vol: add command to get snapshot path
Rishabh Dave [Wed, 2 Apr 2025 15:25:32 +0000 (20:55 +0530)]
mgr/vol: add command to get snapshot path

Fixes: https://tracker.ceph.com/issues/70815
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 50d28992d99fcd67390815aa42f9da8ffaa82575)

Conflicts:
src/pybind/mgr/volumes/fs/volume.py
- Line where the original patch makes the change is slightly different
  in main compared to Squid branch, leading to conflict.

6 weeks agomonitoring/ceph_mixin: fix Cluster - Advanced OSD grafana panel
Aashish Sharma [Wed, 17 Sep 2025 06:58:16 +0000 (12:28 +0530)]
monitoring/ceph_mixin: fix Cluster - Advanced OSD grafana panel

1. Fixes the promql expr used to calculate "In" OSDs in
   ceph-cluster-advanced.json.
2. Fixes the color coding for the single state panels used in the OSDs
   grafana panel like "In", "Out" etc

Fixes: https://tracker.ceph.com/issues/72810
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 53a6856d603e0fe4ff31f76e19263a80359a9f1d)

6 weeks agoMerge pull request #65659 from ceph/wip-squid-noble
David Galloway [Wed, 24 Sep 2025 19:35:22 +0000 (15:35 -0400)]
Merge pull request #65659 from ceph/wip-squid-noble

squid: cmake: remove _FORTIFY_SOURCE define

6 weeks agoMerge pull request #64605 from cbodley/wip-72190-squid
Yuri Weinstein [Wed, 24 Sep 2025 18:42:50 +0000 (11:42 -0700)]
Merge pull request #64605 from cbodley/wip-72190-squid

squid: deb/cephadm: add explicit --home for cephadm user

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
6 weeks agorgw/account: bucket acls are not completely migrated once the user is migrated to...
kchheda3 [Wed, 3 Sep 2025 14:48:42 +0000 (10:48 -0400)]
rgw/account: bucket acls are not completely migrated once the user is migrated to an account

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit 23dc3697cfd309b4d8736ec99490cd57db621cf7)

6 weeks agocmake: remove _FORTIFY_SOURCE define
Casey Bodley [Wed, 3 Sep 2025 17:22:30 +0000 (13:22 -0400)]
cmake: remove _FORTIFY_SOURCE define

according to `dpkg-buildflags`, ubuntu 24 raised this value to
`-D_FORTIFY_SOURCE=3` which causes `error: "_FORTIFY_SOURCE" redefined`
compilation failures because Ceph itself adds `-D_FORTIFY_SOURCE=2`

`_FORTIFY_SOURCE` is a hardening option. both our rpm and debian builds
already specify that via environment variables, so Ceph's cmake should
leave it alone

Fixes: https://tracker.ceph.com/issues/72361
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 66bec97b0dc90b91f5be586351f52082beb6374a)

6 weeks agoMerge pull request #61166 from anoopcs9/wip-69306-squid
Rishabh Dave [Wed, 24 Sep 2025 13:42:42 +0000 (19:12 +0530)]
Merge pull request #61166 from anoopcs9/wip-69306-squid

squid: client: Handle empty pathnames for `ceph_chownat()` and `ceph_statxat()`

Reviewed-by: Rishabh Dave <ridave@redhat.com>
6 weeks agoMerge pull request #65636 from adk3798/squid-cephadm-pin-cheroot
Adam King [Tue, 23 Sep 2025 21:10:40 +0000 (17:10 -0400)]
Merge pull request #65636 from adk3798/squid-cephadm-pin-cheroot

squid: pybind/mgr: pin cheroot version in requirements-required.txt

Reviewed-by: John Mulligan <jmulligan@redhat.com>
6 weeks agoMerge pull request #65588 from adamemerson/wip-perfcounters-unique-string-squid
Yuri Weinstein [Tue, 23 Sep 2025 19:12:58 +0000 (12:12 -0700)]
Merge pull request #65588 from adamemerson/wip-perfcounters-unique-string-squid

squid: common: Allow PerfCounters to return a provided service ID

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 weeks agoMerge pull request #65556 from jzhu116-bloomberg/wip-72972-squid
Yuri Weinstein [Tue, 23 Sep 2025 19:12:09 +0000 (12:12 -0700)]
Merge pull request #65556 from jzhu116-bloomberg/wip-72972-squid

squid: rgw: discard olh_ attributes when copying object from a versioning-suspended bucket to a versioning-disabled bucket

Reviewed-by: Adam Emerson <aemerson@redhat.com>
6 weeks agomgr/dashboard: bump cheroot to > 10.0
Nizamudeen A [Fri, 19 Apr 2024 08:07:11 +0000 (13:37 +0530)]
mgr/dashboard: bump cheroot to > 10.0

Fixes: https://tracker.ceph.com/issues/55837
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 1ec74a8360d1c4abb39754320eba118d080e3499)

6 weeks agoclient: Gracefully handle empty pathname for statxat()
Anoop C S [Mon, 23 Sep 2024 07:06:55 +0000 (12:36 +0530)]
client: Gracefully handle empty pathname for statxat()

man statx(2)[1] says the following:
. . .
AT_EMPTY_PATH
    If pathname is an empty string, operate on the file referred to by
    dirfd (which may have been obtained using the open(2) O_PATH flag).
    In this case, dirfd can refer to any type of file, not just a
    directory.

    If dirfd is AT_FDCWD, the call operates on the current working
    directory.
. . .

Look out for an empty pathname and use the relative fd's inode in the
presence of AT_EMPTY_PATH flag before calling internal _getattr().

Fixes: https://tracker.ceph.com/issues/68189
Review with: git show -w

[1] https://www.man7.org/linux/man-pages/man2/statx.2.html

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>
(cherry picked from commit edd7fe76c4919bc243377c6d7aae20b0606b89c3)

Conflicts:
        src/client/Client.cc
- path_walk() refactor from https://github.com/ceph/ceph/pull/62095
  included the required core changes.

6 weeks agolibcephfs.h: Fix API documentation for ceph_statxat
Anoop C S [Thu, 17 Oct 2024 16:15:17 +0000 (21:45 +0530)]
libcephfs.h: Fix API documentation for ceph_statxat

flags parameter for ceph_statxat() API is supposed to accept only
AT_STATX_DONT_SYNC and AT_SYMLINK_NOFOLLOW. Modify the corresponding
documentation to reflect the acceptance of above two flags.

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>
(cherry picked from commit 92c5ab99b8dcaae56e4a92cfe72a7e3d343b8a0c)

6 weeks agoclient: Gracefully handle empty pathname for chownat()
Anoop C S [Fri, 20 Sep 2024 08:49:01 +0000 (14:19 +0530)]
client: Gracefully handle empty pathname for chownat()

man fchownat(2)[1] says the following:
. . .
AT_EMPTY_PATH (since Linux 2.6.39)
    If pathname is an empty string, operate on the file referred to by
    dirfd (which may have been obtained using the open(2) O_PATH flag).
    In this case, dirfd can refer to any type of file, not just a
    directory. If dirfd is AT_FDCWD, the call operates on the current
    working directory.
. . .

Look out for an empty pathname and use the relative fd's inode in the
presence of AT_EMPTY_PATH flag before calling internal _setattr().

Fixes: https://tracker.ceph.com/issues/68189
Review with: git show -w

[1] https://www.man7.org/linux/man-pages/man2/fchownat.2.html

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>
(cherry picked from commit 829f38899226fcd1f603ba446b018f53c5b0921d)

Conflicts:
        src/client/Client.cc
- path_walk() refactor from https://github.com/ceph/ceph/pull/62095
  included the required core changes.

6 weeks agoMerge pull request #65639 from zdover23/wip-doc-2025-09-23-squid-remove-cloud-restore-rst
Casey Bodley [Tue, 23 Sep 2025 13:24:28 +0000 (09:24 -0400)]
Merge pull request #65639 from zdover23/wip-doc-2025-09-23-squid-remove-cloud-restore-rst

squid: doc/radosgw: remove cloud-restore from squid

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 weeks agoMerge pull request #61451 from anoopcs9/wip-69556-squid
Rishabh Dave [Tue, 23 Sep 2025 12:10:57 +0000 (17:40 +0530)]
Merge pull request #61451 from anoopcs9/wip-69556-squid

squid: mds: Fix invalid access of mdr->dn[0].back()

Reviewed-by: Rishabh Dave <ridave@redhat.com>
6 weeks agoMerge pull request #62391 from neesingh-rh/wip-70416-squid
Rishabh Dave [Tue, 23 Sep 2025 12:10:47 +0000 (17:40 +0530)]
Merge pull request #62391 from neesingh-rh/wip-70416-squid

squid: cephfs-shell: add option to remove xattr

Reviewed-by: Rishabh Dave <ridave@redhat.com>
6 weeks agoMerge pull request #64652 from rishabh-d-dave/wip-72200-squid
Rishabh Dave [Tue, 23 Sep 2025 12:10:35 +0000 (17:40 +0530)]
Merge pull request #64652 from rishabh-d-dave/wip-72200-squid

squid: mgr/vol: keep and show clone source info

Reviewed-by: Rishabh Dave <ridave@redhat.com>
6 weeks agoMerge pull request #65279 from joscollin/wip-67809-squid
Rishabh Dave [Tue, 23 Sep 2025 12:10:25 +0000 (17:40 +0530)]
Merge pull request #65279 from joscollin/wip-67809-squid

squid: mds: add more debug logs and log events

Reviewed-by: Rishabh Dave <ridave@redhat.com>
6 weeks agoMerge pull request #65280 from joscollin/wip-69369-squid
Rishabh Dave [Tue, 23 Sep 2025 12:09:50 +0000 (17:39 +0530)]
Merge pull request #65280 from joscollin/wip-69369-squid

squid: qa: use a larger timeout for kernel_untar_build workunit

Reviewed-by: Rishabh Dave <ridave@redhat.com>
6 weeks agotest/rbd-mirror: eliminate a race in ResyncRequestedRemoteNotPrimary
VinayBhaskar-V [Wed, 30 Jul 2025 10:10:27 +0000 (10:10 +0000)]
test/rbd-mirror: eliminate a race in ResyncRequestedRemoteNotPrimary

Adjust the wait_for_notification call in TestMockImageReplayerSnapshotReplayer.ResyncRequestedRemoteNotPrimary
to expect 2 notifications instead of 1. This allows the test to correctly wait for both expected events
i.e for finish_sync() and handle_replay_complete(locker, -EREMOTEIO, "remote image demoted"), ensuring the
replayer transitions to STATE_COMPLETE and is_replaying() returns false as intended.

Fixes: https://tracker.ceph.com/issues/72325
Signed-off-by: VinayBhaskar-V <vvarada@redhat.com>
(cherry picked from commit b5a013f6170bb4445da8f5469243e4869b760a81)

6 weeks agorbd-mirror: prevent image deletion if remote image is not primary
VinayBhaskar-V [Tue, 13 May 2025 20:25:44 +0000 (01:55 +0530)]
rbd-mirror: prevent image deletion if remote image is not primary

A resync on a mirrored image may incorrectly results in the local
image being deleted even when the remote image is no longer primary.
This issue can occur under the following conditions:
* if  resync is requested on the secondary before the remote image has
  been fully demoted
* if the demotion of the primary image is not mirrored
  due to the rbd-mirror daemon being offline.

This can be fixed by ensuring that image deletion during a resync is
only allowed when the remote image is confirmed to be primary.

This commit fixes the issue only for snapshot based mirroring mode

Fixes: https://tracker.ceph.com/issues/70948
Signed-off-by: VinayBhaskar-V <vvarada@redhat.com>
(cherry picked from commit e14afbc95a5fb8f5a33e7ea23a035992b966d671)

6 weeks agoMerge pull request #63019 from batrick/wip-71094-squid
Jos Collin [Tue, 23 Sep 2025 03:09:30 +0000 (08:39 +0530)]
Merge pull request #63019 from batrick/wip-71094-squid

squid: mds: check for snapshots on parent snaprealms

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 weeks agoMerge pull request #62499 from batrick/wip-70663-squid
Jos Collin [Tue, 23 Sep 2025 02:43:42 +0000 (08:13 +0530)]
Merge pull request #62499 from batrick/wip-70663-squid

squid:  client: ll_walk will process absolute paths as relative

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 weeks agoMerge pull request #65629 from phlogistonjohn/jjm-s-65514
David Galloway [Tue, 23 Sep 2025 02:27:19 +0000 (19:27 -0700)]
Merge pull request #65629 from phlogistonjohn/jjm-s-65514

squid: build-with-container: add argument groups to organize options

6 weeks agodoc/radosgw: remove cloud-restore from squid
Zac Dover [Tue, 23 Sep 2025 02:09:52 +0000 (12:09 +1000)]
doc/radosgw: remove cloud-restore from squid

Remove doc/radosgw/cloud-restore.rst from the Squid branch.

cloud-restore does not appear in index.rst, so its removal from
index.rst is unnecessary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
6 weeks agoMerge pull request #64090 from vshankar/wip-cephfs-client-fixes-squid
Jos Collin [Tue, 23 Sep 2025 02:06:52 +0000 (07:36 +0530)]
Merge pull request #64090 from vshankar/wip-cephfs-client-fixes-squid

squid: client: cephfs user-space client fixes

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 weeks agopybind/mgr: pin cheroot version in requirements-required.txt
Adam King [Mon, 22 Sep 2025 21:05:07 +0000 (17:05 -0400)]
pybind/mgr: pin cheroot version in requirements-required.txt

With python 3.10 (didn't seem to happen with python 3.12) the
pybind/mgr/cephadm/tests/test_node_proxy.py test times out.
This appears to be related to a new release of the cheroot
package and a github issues describing the same problem
we're seeing has been opened by another user
https://github.com/cherrypy/cheroot/issues/769

It is worth noting that the workaround described in that
issue does also work for us. If you add

```
import cheroot
cheroot.server.HTTPServer._serve_unservicable = lambda: None
```

after the existing imports in test_node_proxy.py the
test hanging issue also disappears. Also worth noting the
particular pin of

cheroot~=10.0

was chosen as it matches the existing pin being used
in pybind/mgr/dashboard/constraints.txt

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 6231955b5d00ae6b3630ee94e85b2449092ef0fe)

6 weeks agoMerge pull request #61274 from kotreshhr/wip-68940-squid
Jos Collin [Tue, 23 Sep 2025 01:41:10 +0000 (07:11 +0530)]
Merge pull request #61274 from kotreshhr/wip-68940-squid

squid: ceph-fuse: Improve fuse mount usage message

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 weeks agoMerge pull request #62517 from salieri11/wip-70631-squid
Jos Collin [Tue, 23 Sep 2025 01:36:49 +0000 (07:06 +0530)]
Merge pull request #62517 from salieri11/wip-70631-squid

squid: mds: add MDS asok command for dumping stray directories

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 weeks agoMerge pull request #65133 from chrisphoffman/wip-72645-squid
Jos Collin [Tue, 23 Sep 2025 01:28:13 +0000 (06:58 +0530)]
Merge pull request #65133 from chrisphoffman/wip-72645-squid

squid: client: use path supplied in statfs

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 weeks agobuild-with-container: add argument groups to organize options
John Mulligan [Fri, 12 Sep 2025 17:52:25 +0000 (13:52 -0400)]
build-with-container: add argument groups to organize options

Use the argparse add_argument_group feature to organize the mass of
arguments into more sensible categories. Hopefully, someone reading
over the `--help` output can now more easily see options that
are useful rather than being overwhelmed by a wall of text.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 71a1be4dd0aea004da56c2f518ee70a281a3f7d3)

6 weeks agomgr/dashboard: fix zone update API forcing STANDARD storage class
Aashish Sharma [Thu, 18 Sep 2025 10:59:52 +0000 (16:29 +0530)]
mgr/dashboard: fix zone update API forcing STANDARD storage class

The zone update REST API (`edit_zone`) always attempted to configure a
placement target for the `STANDARD` storage class, even when the request
was intended for a different storage class name.
This caused failures in deployments where `STANDARD` is not defined.

Changes:
Club add placement target and add storage class methods into one single
add_placement_targets_storage_class_zone method which takes the storage
class as a param as well alongside the rest of the placement params.

Fixes: https://tracker.ceph.com/issues/73105
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 135f3adb4973be493925839e946e7a5fc75e7d5c)

7 weeks agomgr/vol: move reusable parts from async_cloner
Rishabh Dave [Wed, 14 Feb 2024 09:52:47 +0000 (15:22 +0530)]
mgr/vol: move reusable parts from async_cloner

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 8c536f78907fe1d42e1df612604d5872019b501d)

Conflicts:
src/pybind/mgr/volumes/fs/async_cloner.py
src/pybind/mgr/volumes/fs/operations/versions/subvolume_v1.py
- commit 8c536f78907f was missing which led to conflict.

7 weeks agorgw: Record the `service_unique_id`, if present, in the SrviceMap
Adam C. Emerson [Mon, 8 Sep 2025 18:19:20 +0000 (14:19 -0400)]
rgw: Record the `service_unique_id`, if present, in the SrviceMap

For consistency and ease associating the two.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
(cherry picked from commit 3a94a7b2ed02d20b2bc839b283e60cf4778f69e4)
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
7 weeks agocommon: Allow PerfCounters to return a provided service ID
Adam C. Emerson [Fri, 5 Sep 2025 15:31:40 +0000 (11:31 -0400)]
common: Allow PerfCounters to return a provided service ID

Dashboard has asked for a unique identifier that can be associated
with services. This commit provides a component of that
functionality. Enforcing uniqueness is beyond the scope of this PR and
is the responsibility of cluster setup and orchestration. The scope of
uniqueness is a matter of policy and up to the design of cluster setup
and orchestration software.

We provide the `--service_unique_id` argument that can be passed on
the command line when executing a Ceph service that uses
`global_init`. If non-empty, a `service_unique_id` section is added to
the PerfCounters dump for that service. This section has a single
entry whose name is set to the argument of `service_unique_id` and
whose value is arbitrary. If unspecified or empty, no
`service_unique_id` section is added.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
(cherry picked from commit 6dc322421f7a3758251fe29e3f35934231358011)
Conflicts:
src/common/options/global.yaml.in
 - Preceding options not in Squid

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
7 weeks agoMerge pull request #65219 from cbodley/wip-72715-squid
Yuri Weinstein [Thu, 18 Sep 2025 15:20:45 +0000 (08:20 -0700)]
Merge pull request #65219 from cbodley/wip-72715-squid

squid: rgw/s3: remove 'aws-chunked' from Content-Encoding response

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 weeks agoMerge pull request #62051 from k0ste/wip-65923-squid
Yuri Weinstein [Thu, 18 Sep 2025 15:19:59 +0000 (08:19 -0700)]
Merge pull request #62051 from k0ste/wip-65923-squid

squid: CephContext: acquire _fork_watchers_lock in notify_post_fork()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
7 weeks agoMerge pull request #63720 from batrick/wip-71554-squid
Christopher Hoffman [Wed, 17 Sep 2025 15:17:39 +0000 (11:17 -0400)]
Merge pull request #63720 from batrick/wip-71554-squid

squid: test/libcephfs: copy DT_NEEDED entries from input libraries

7 weeks agoMerge pull request #64936 from pritha-srivastava/wip-72464-squid
anrao19 [Wed, 17 Sep 2025 05:22:12 +0000 (10:52 +0530)]
Merge pull request #64936 from pritha-srivastava/wip-72464-squid

squid: rgw: check all JWKS for STS

7 weeks agorgw: discard olh_ attributes when copying object from a versioning-suspended bucket...
Jane Zhu [Wed, 20 Aug 2025 18:38:23 +0000 (18:38 +0000)]
rgw: discard olh_ attributes when copying object from a versioning-suspended bucket to a versioning-disabled bucket

Signed-off-by: Jane Zhu <jzhu116@bloomberg.net>
(cherry picked from commit 3fed58f43c3cb3977130926a2d1bca551deefade)

7 weeks agoMerge pull request #65550 from stackhpc/doc-balancer-squid
Anthony D'Atri [Tue, 16 Sep 2025 20:48:05 +0000 (15:48 -0500)]
Merge pull request #65550 from stackhpc/doc-balancer-squid

squid: doc: Fixes a typo in balancer operations

7 weeks agodoc: Fixes a typo in balancer operations
Tyler Brekke [Tue, 24 Jun 2025 19:12:33 +0000 (12:12 -0700)]
doc: Fixes a typo in balancer operations

Signed-off-by: Tyler Brekke <tbrekke@digitalocean.com>
(cherry picked from commit b038b8093d01a5e676ffa419607489a79261ef29)

7 weeks agoMerge pull request #65486 from tobias-urdin/squid-rgw-admin-bucket-pagination
Adam Emerson [Tue, 16 Sep 2025 19:32:01 +0000 (15:32 -0400)]
Merge pull request #65486 from tobias-urdin/squid-rgw-admin-bucket-pagination

squid: rgw/admin: Add max-entries and marker to bucket list

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
7 weeks agoMerge pull request #59922 from mchangir/wip-68077-squid
Milind Changire [Mon, 15 Sep 2025 07:08:33 +0000 (12:38 +0530)]
Merge pull request #59922 from mchangir/wip-68077-squid

squid: qa: relocate subvol creation overrides and test

7 weeks agoMerge pull request #61857 from batrick/wip-69956-squid
Milind Changire [Mon, 15 Sep 2025 07:02:56 +0000 (12:32 +0530)]
Merge pull request #61857 from batrick/wip-69956-squid

squid: mds: do not schedule quiesce for non-head imported inodes

7 weeks agoMerge pull request #64539 from batrick/wip-72163-squid
Milind Changire [Mon, 15 Sep 2025 07:01:59 +0000 (12:31 +0530)]
Merge pull request #64539 from batrick/wip-72163-squid

squid:  mds: nudge log for unstable locks after early reply

7 weeks agoMerge pull request #65492 from rhcs-dashboard/wip-72987-squid
afreen23 [Mon, 15 Sep 2025 07:01:44 +0000 (12:31 +0530)]
Merge pull request #65492 from rhcs-dashboard/wip-72987-squid

squid: mgr/dashboard : Fixed mirrored image usage info bar

Reviewed-by: Afreen Misbah <afreen@ibm.com>