]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 weeks agodo_cmake: use Python 3.12 on ubuntu >= 24 squid-pyyaml 66691/head
Kefu Chai [Fri, 14 Feb 2025 10:53:58 +0000 (18:53 +0800)]
do_cmake: use Python 3.12 on ubuntu >= 24

the "official" Python shipped along with Ubuntu 24.04 (Noble Numbat) is
Python 3.12. And some of our building have been upgraded to Ubuntu
24.04. But we are still using Python 3.10 on Ubuntu >= 22, this breaks
the build. And CMake fails like:

```
CMake Error at /usr/share/cmake-3.28/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find Python3 (missing: Python3_EXECUTABLE Python3_INCLUDE_DIRS
  Python3_LIBRARIES Interpreter Development Development.Module
  Development.Embed) (Required is exact version "3.10")

      Reason given by package:
          Interpreter: Wrong version for the interpreter "/bin/python3"

Call Stack (most recent call first):
  /usr/share/cmake-3.28/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
  cmake/modules/FindPython/Support.cmake:3863 (find_package_handle_standard_args)
  cmake/modules/FindPython3.cmake:545 (include)
  CMakeLists.txt:597 (find_package)
```

This build failure should also happen on developers who build Ceph on
Ubuntu >= 24.

In this change, we use Python 3.12 on Ubuntu >= 24

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 4df368381d3a7c09cdc4859eb52b5d29d206aa5a)

2 weeks agoinstall-deps: Update Pyyaml version
Brad Hubbard [Thu, 7 Mar 2024 04:13:11 +0000 (14:13 +1000)]
install-deps: Update Pyyaml version

Move to 6.0.1 to overcome https://github.com/yaml/pyyaml/issues/601

Fixes: https://tracker.ceph.com/issues/63591
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 7863d297eaf03a57ce910ab7f7a08e22789ed8d8)

3 weeks agoMerge pull request #66289 from henrichter/wip-73704-squid
Yuri Weinstein [Wed, 10 Dec 2025 22:51:16 +0000 (14:51 -0800)]
Merge pull request #66289 from henrichter/wip-73704-squid

squid: rgw: beast add ssl hot-reload

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 weeks agoMerge pull request #62055 from k0ste/wip-68956-squid
Dhairya Parmar [Wed, 10 Dec 2025 11:04:17 +0000 (16:34 +0530)]
Merge pull request #62055 from k0ste/wip-68956-squid

squid: mds: session in the importing state cannot be cleared if an export subtree task is interrupted while the state of importer is acking

4 weeks agoMerge pull request #64954 from batrick/wip-72515-squid
Dhairya Parmar [Wed, 10 Dec 2025 11:03:35 +0000 (16:33 +0530)]
Merge pull request #64954 from batrick/wip-72515-squid

squid: mds: skip charmap handler check for MDS requests

4 weeks agoMerge pull request #65449 from rishabh-d-dave/wip-70174-squid
Dhairya Parmar [Wed, 10 Dec 2025 11:02:57 +0000 (16:32 +0530)]
Merge pull request #65449 from rishabh-d-dave/wip-70174-squid

squid: qa/cephfs: ignore warning that pg is stuck peering for upgrade jobs

4 weeks agoMerge pull request #66471 from joscollin/wip-73879-squid
Dhairya Parmar [Wed, 10 Dec 2025 11:02:31 +0000 (16:32 +0530)]
Merge pull request #66471 from joscollin/wip-73879-squid

squid: cephfs: fix monclient not subscribed monmap/config

4 weeks agoMerge pull request #66472 from joscollin/wip-73872-squid
Dhairya Parmar [Wed, 10 Dec 2025 11:02:03 +0000 (16:32 +0530)]
Merge pull request #66472 from joscollin/wip-73872-squid

squid: cephfs: MDCache request cleanup

4 weeks agoMerge pull request #66473 from joscollin/wip-73870-squid
Dhairya Parmar [Wed, 10 Dec 2025 11:01:26 +0000 (16:31 +0530)]
Merge pull request #66473 from joscollin/wip-73870-squid

squid: client: account for mixed quotas in statfs

4 weeks agoMerge pull request #64747 from kshtsk/wip-72330-squid
kyr [Tue, 9 Dec 2025 15:03:47 +0000 (16:03 +0100)]
Merge pull request #64747 from kshtsk/wip-72330-squid

squid: qa/tasks/ceph_manager: population must be a sequence

5 weeks agoqa/cephfs: ignore warning that pg is stuck peering for upgrade jobs 65449/head
Rishabh Dave [Tue, 18 Feb 2025 12:30:03 +0000 (18:00 +0530)]
qa/cephfs: ignore warning that pg is stuck peering for upgrade jobs

Health warning "pg .* is stuck peering" is seen while Ceph cluster is
under the upgrade process during fs/upgrade QA job. Being an expected
warning, it should be added to the ignorelist.

And besides this one, we already ignore more severe warnings ("pg is
stuck inactive" and "pg is degrarded") for fs/upgrade jobs.

Fixes: https://tracker.ceph.com/issues/70023
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 9748de76e02254c6dc284dcc20ec5d5761760dcb)

Conflicts:
qa/cephfs/overrides/pg_health.yaml
- Line before the point where the patch was to be applied is different
  comapred to main branch.

5 weeks agotest: Add statfs test case for mixed quotas 66473/head
Christopher Hoffman [Fri, 10 Oct 2025 15:10:33 +0000 (15:10 +0000)]
test: Add statfs test case for mixed quotas

Signed-off-by: Christopher Hoffman <choffman@redhat.com>
(cherry picked from commit 2b057ec7bb40855e3be3cb0de12b63f8c10b450e)

5 weeks agoclient: account for mixed quotas in statfs
Christopher Hoffman [Fri, 10 Oct 2025 14:47:08 +0000 (14:47 +0000)]
client: account for mixed quotas in statfs

In statfs, when the quota root for a dir is discovered,
it uses that dir to base values for max_files and max_bytes.

This can be an issue when a dir is found with only one of two potential quota
fields. Take for instance, a dir with only max_files set and parent dir
has only max_bytes set. During a statfs call, it will then use the max_files
value for provided dir, but does not have a value for max_bytes. In this case,
this behavior will cause the size of the filesystem to be displayed.

Instead, find the quota root for max_files and max_bytes separately. This will
allow for mixed quotas to inherit missing values from its parent. In the above
example, max_files from current dir and max_bytes from parent dir will be
displayed.

Fixes: https://tracker.ceph.com/issues/73487
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
(cherry picked from commit dd02ea9b18502b87ce815eba4286ae3516e334b3)

5 weeks agomds: MDCache: check validity of mdr requests before dispatching 66472/head
Abhishek Lekshmanan [Tue, 1 Apr 2025 10:07:56 +0000 (12:07 +0200)]
mds: MDCache: check validity of mdr requests before dispatching

Ignore null requests

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@cern.ch>
(cherry picked from commit 75cd8c074f37de2a492177c54b3ef1879ab87637)

5 weeks agomds: MDCache request cleanup handles potential null mdr
Abhishek Lekshmanan [Tue, 1 Apr 2025 10:04:09 +0000 (12:04 +0200)]
mds: MDCache request cleanup handles potential null mdr

In cases where there is a single element in a batch_op_map,new_batch_head
is a nullptr, when this is retried at Finisher we'd hit one of the asserts when
dereferencing

Fixes: https://tracker.ceph.com/issues/70769
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@cern.ch>
(cherry picked from commit e63f8cc54d03dbdd147cdd2c301adef119a640da)

5 weeks agocephfs: make sure mon authenticate before objecter start 66471/head
wangshaohui.0512 [Fri, 8 Aug 2025 10:23:47 +0000 (18:23 +0800)]
cephfs: make sure mon authenticate before objecter start

Signed-off-by: Shaohui Wang <wangshaohui.0512@bytedance.com>
(cherry picked from commit 1de46f335ea21c7369c67a021da79f3c7e929e66)

5 weeks agotests: add a test case for cephfs SingletonClient
wangshaohui.0512 [Fri, 8 Aug 2025 10:03:05 +0000 (18:03 +0800)]
tests: add a test case for cephfs SingletonClient

In SingletonClient::init(), objecter->start() called before
monc->authenticate(), it makes conns of monc authencated before
monc->authenticate() called if mons reply faster, in this case,
monc will not subsribe monmap/config.

Signed-off-by: Shaohui Wang <wangshaohui.0512@bytedance.com>
(cherry picked from commit 8cce3277edcb819e5e61a67948f35e5c5358379d)

 Conflicts:
src/test/client/CMakeLists.txt
    - syncio.cc and fscrypt_conf.cc not backported to squid

6 weeks agoMerge pull request #66357 from k0ste/wip-70542-squid
Igor Fedotov [Sat, 22 Nov 2025 15:22:21 +0000 (18:22 +0300)]
Merge pull request #66357 from k0ste/wip-70542-squid

squid: os/bluestore: Disable invoking unittest_deferred

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
6 weeks agomds: skip charmap handler check for MDS requests 64954/head
Patrick Donnelly [Mon, 4 Aug 2025 19:43:18 +0000 (15:43 -0400)]
mds: skip charmap handler check for MDS requests

The MDS uses a rename request to move the primary link to a remote link. For
these requests, there will be no session.

Fixes: https://tracker.ceph.com/issues/72349
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
(cherry picked from commit ca35c0de42861352bee4cfaeda6e83a7aa0bd094)

6 weeks agoqa: test for charmap handling on reintegration
Patrick Donnelly [Mon, 4 Aug 2025 19:48:38 +0000 (15:48 -0400)]
qa: test for charmap handling on reintegration

The MDS uses a rename request to move the primary link to a remote link. For
these requests, there will be no session.

Fixes: https://tracker.ceph.com/issues/72349
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
(cherry picked from commit 5d983a46b010144b71f8c5d092d30a4942d8e6e7)

6 weeks agoos/bluestore: Disable invoking unittest_deferred 66357/head
Adam Kupczyk [Tue, 29 Oct 2024 08:08:31 +0000 (08:08 +0000)]
os/bluestore: Disable invoking unittest_deferred

There is no value in invoking unittest_deferred expect via
run_test_deferred.sh script.

Fixes: https://tracker.ceph.com/issues/68718
Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 163d8297bd566d25a6897f3b9be0d97f95c3c12b)

6 weeks agomds: client is evicted when an export subtree task is interrupted 62055/head
Zhansong Gao [Mon, 3 Jul 2023 09:18:14 +0000 (17:18 +0800)]
mds: client is evicted when an export subtree task is interrupted

The importer will force open some sessions provided by the exporter but the client does not know about
the new sessions until the exporter notifies it, and the notifications cannot be sent if the exporter
is interrupted. The client does not renew the sessions regularly that it does not know about, so the client
will be evicted by the importer after `session_autoclose` seconds (300 seconds by default).

The sessions that are forced opened in the importer need to be closed when the import process is reversed.

Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
(cherry picked from commit 00b0711188f34ef4ea5c31f39bc70cf1fafbd907)

6 weeks agoqa: add test for importer's unexpected client eviction after an export subtree task...
Zhansong Gao [Mon, 3 Jul 2023 08:42:34 +0000 (16:42 +0800)]
qa: add test for importer's unexpected client eviction after an export subtree task is interrupted

Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
(cherry picked from commit f23bd5d0995e4e52e0ac43c7e8a112cd2faf9f27)

6 weeks agomds: session in the importing state cannot be cleared if an export subtree task is...
Zhansong Gao [Fri, 26 May 2023 04:20:17 +0000 (12:20 +0800)]
mds: session in the importing state cannot be cleared if an export subtree task is interrupted while the state of importer is acking

The related sessions in the importer are in the importing state(`Session::is_importing` return true) when the state of importer is `acking`,
`Migrator::import_reverse` called by `MDCache::handle_resolve` should reverse the process to clear the importing state if the exporter restarts
at this time, but it doesn't do that actually because of its bug. And it will cause these sessions to not be cleared when the client is
unmounted(evicted or timeout) until the mds is restarted.

The bug in `import_reverse` is that it contains the code to handle state `IMPORT_ACKING` but it will never be executed because
the state is modified to `IMPORT_ABORTING` at the beginning. Move `stat.state = IMPORT_ABORTING` to the end of import_reverse
so that it can handle the state `IMPORT_ACKING`.

Fixes: https://tracker.ceph.com/issues/61459
Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
(cherry picked from commit 057c5b1610c11ad8cc6d0cde43bee1306228275b)

6 weeks agoqa: add test for importer's session cleanup after an export subtree task is interrupted
Zhansong Gao [Fri, 26 May 2023 04:58:42 +0000 (12:58 +0800)]
qa: add test for importer's session cleanup after an export subtree task is interrupted

Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
(cherry picked from commit eccaf85294ae80bb76b75f30d74957c6bf03745b)

6 weeks agomds: the assert should be before the journal entry submit otherwise it's racy
Zhansong Gao [Fri, 16 Jun 2023 04:30:40 +0000 (12:30 +0800)]
mds: the assert should be before the journal entry submit otherwise it's racy

Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
(cherry picked from commit 11a4303d66fa0355c890a478b33ccc90ee68f6d3)

6 weeks agomds: add `importing_count` to session dump
Zhansong Gao [Fri, 26 May 2023 04:25:10 +0000 (12:25 +0800)]
mds: add `importing_count` to session dump

Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
(cherry picked from commit 79a33025d506c9a90520633492285bc047ef31f5)

6 weeks agoMerge pull request #66003 from cbodley/wip-73598-squid
Casey Bodley [Thu, 20 Nov 2025 19:00:18 +0000 (14:00 -0500)]
Merge pull request #66003 from cbodley/wip-73598-squid

squid: rgw: fix 'bucket rm --bypass-gc' for copied objects

Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>
6 weeks agoMerge pull request #66152 from ivancich/wip-73747-squid
J. Eric Ivancich [Thu, 20 Nov 2025 16:52:01 +0000 (11:52 -0500)]
Merge pull request #66152 from ivancich/wip-73747-squid

squid: rgw: fix `radosgw-admin object unlink ...`

Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>
Reviewed-by: Jane Zhu <jzhu116@bloomberg.net>
6 weeks agorgw: fix 'bucket rm --bypass-gc' for copied objects 66003/head
Casey Bodley [Fri, 3 Oct 2025 16:24:18 +0000 (12:24 -0400)]
rgw: fix 'bucket rm --bypass-gc' for copied objects

the `--bypass-gc` argument to `radosgw-admin bucket rm` causes us to
call `RadosBucket::remove_bypass_gc()`, which loops over the tail
objects and removes each with `RGWRados::delete_raw_obj_aio()`

however, this was removing the objects with `cls_rgw_remove_obj()`,
which is for head objects, not tails. tail objects must be removed with
`cls_refcount_put()`, which preserves them until the last copy is
removed

rename `delete_raw_obj_aio()` to `delete_tail_obj_aio()` to clarify its
purpose

Fixes: https://tracker.ceph.com/issues/73348
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1fba459071da9f7ec13defe2c666f0df8174c8da)

6 weeks agoMerge pull request #66104 from shraddhaag/wip-73694-squid
Shraddha Agrawal [Thu, 20 Nov 2025 12:27:57 +0000 (17:57 +0530)]
Merge pull request #66104 from shraddhaag/wip-73694-squid

squid: tasks/cbt_performance: Tolerate exceptions during performance data up…

6 weeks agotasks/cbt_performance: Tolerate exceptions during performance data updates 66104/head
Nitzan Mordechai [Wed, 22 Oct 2025 05:41:56 +0000 (05:41 +0000)]
tasks/cbt_performance: Tolerate exceptions during performance data updates

If an exception occurs during the POST request to update CBT performance,
log the error instead of failing the entire job. This ensures that
intermittent update failures do not block the main workflow.

Fixes: https://tracker.ceph.com/issues/68843
Signed-off-by: Nitzan Mordechai <nmordech@ibm.com>
(cherry picked from commit b47880f82de436776acab7ff13fb5e6496e49170)

6 weeks agoMerge pull request #66033 from thuvh/bug-kafka-expected-sizes
anrao19 [Thu, 20 Nov 2025 09:11:12 +0000 (14:41 +0530)]
Merge pull request #66033 from thuvh/bug-kafka-expected-sizes

squid: rgw-test: fix bug kafka unexpected keyword argument 'expected_sizes'

6 weeks agorgw: fix `radosgw-admin object unlink ...` 66152/head
J. Eric Ivancich [Tue, 4 Nov 2025 21:55:38 +0000 (16:55 -0500)]
rgw: fix `radosgw-admin object unlink ...`

The unlink subcommand did not handle unsharded bucket indices
appropriately. These are when the number of shards listed in the
bucket instance object is 0. In that case there will actually be 1
shard.

When number of shards as 0 is passed into the function that maps
object names to shards, it returns -1. And that was not handled
properly. That is now fixed.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 9eeb71e28526df8ce2b920d4f50763a734264416)

7 weeks agosquid: rgw-testing: fix unexpected keyword argument 'expected_sizes' for kafka test 66033/head
Hoai-Thu Vuong [Thu, 23 Oct 2025 03:47:50 +0000 (10:47 +0700)]
squid: rgw-testing: fix unexpected keyword argument 'expected_sizes' for kafka test

Signed-off-by: Hoai-Thu Vuong <thuvh87@gmail.com>
7 weeks agoMerge pull request #66242 from kshtsk/wip-73816-squid
J. Eric Ivancich [Tue, 18 Nov 2025 16:46:38 +0000 (11:46 -0500)]
Merge pull request #66242 from kshtsk/wip-73816-squid

squid: rgw: update keystone repo stable branch to 2024.2

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
7 weeks agoMerge pull request #66251 from kshtsk/wip-73582-squid
kyr [Tue, 18 Nov 2025 16:22:18 +0000 (17:22 +0100)]
Merge pull request #66251 from kshtsk/wip-73582-squid

squid: qa/tasks/workunit: fix no module named 'pipes'

7 weeks agoMerge pull request #65922 from guits/wip-73514-squid
Guillaume Abrioux [Tue, 18 Nov 2025 12:45:22 +0000 (13:45 +0100)]
Merge pull request #65922 from guits/wip-73514-squid

squid: ceph-volume: use udev data instead of LVM subprocess in get_devices()

7 weeks agodoc/radosgw: Fix frontends.rst typo 66287/head 66289/head
Anthony D'Atri [Mon, 3 Nov 2025 15:43:25 +0000 (10:43 -0500)]
doc/radosgw: Fix frontends.rst typo

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 075f5afd4a7fafc333d0a70b977fbac446f51e44)

7 weeks agorgw/frontend: fix typo in function name
Yuval Lifshitz [Mon, 3 Nov 2025 08:42:48 +0000 (08:42 +0000)]
rgw/frontend: fix typo in function name

regression from: d8a3f3e2c5ae4d586fffdb12426c836b659c99cd

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
(cherry picked from commit 20743ee6896d7ca5b7186dfe1a29ee2da800963c)

7 weeks agorgw: asio/beast add ssl hot-reload
Henry Richter [Wed, 8 Oct 2025 23:00:34 +0000 (01:00 +0200)]
rgw: asio/beast add ssl hot-reload

Adds the `ssl_reload` config option to the beast frontend.
This sets an interval in seconds to periodically reload the ssl context to pick up changes without restarting. It can be disabled (default) be setting it to `0`.

Fixes: 65470
Signed-off-by: Henry Richter <henry.richter@cloudandheat.com>
(cherry picked from commit d8a3f3e2c5ae4d586fffdb12426c836b659c99cd)

Conflicts:
      src/rgw/rgw_asio_frontend.cc
- squid doesn't support graceful stop

7 weeks agoMerge pull request #64509 from NitzanMordhai/wip-72122-squidReviewed-by: Aishwarya...
Yuri Weinstein [Fri, 14 Nov 2025 16:26:44 +0000 (08:26 -0800)]
Merge pull request #64509 from NitzanMordhai/wip-72122-squidReviewed-by: Aishwarya Mathuria <amathuri@redhat.com>

squid: mon/OSDMonitor: call no_reply() on ignored osd alive

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
7 weeks agoqa/tasks/workunit: fix no module named 'pipes' 66251/head
Kyr Shatskyy [Fri, 10 Oct 2025 19:37:21 +0000 (21:37 +0200)]
qa/tasks/workunit: fix no module named 'pipes'

Python 3.13 finally dropped the 'pipes' module,
replacing it with shlex.

Fixes: https://tracker.ceph.com/issues/73498
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
(cherry picked from commit da40484b9577aba21833e6b09c6129fe2d3c596c)

7 weeks agorgw: update keystone repo stable branch to 2024.2 66242/head
Kyr Shatskyy [Tue, 11 Nov 2025 12:55:39 +0000 (13:55 +0100)]
rgw: update keystone repo stable branch to 2024.2

The stable/2024.1 is gone from the github repo:

  https://github.com/openstack/keystone.git

Fixes: https://tracker.ceph.com/issues/73800
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
(cherry picked from commit 998e4299af417221ac8102fe46c46967e88f0da4)

7 weeks agoMerge pull request #65584 from rzarzynski/wip-bug-72412-squid
Yuri Weinstein [Thu, 13 Nov 2025 18:14:01 +0000 (10:14 -0800)]
Merge pull request #65584 from rzarzynski/wip-bug-72412-squid

squid: osd: stop scrub_purged_snaps() from ignoring osd_beacon_report_interval

Reviewed-by: Prashant D <pdhange@redhat.com>