]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 weeks agorgw/dbstore: free objectmap in DB::Destroy() 63599/head
Kefu Chai [Thu, 29 May 2025 15:26:06 +0000 (23:26 +0800)]
rgw/dbstore: free objectmap in DB::Destroy()

Memory leak was detected by AddressSanitizer in dbstore tests. Objects
inserted into a static objectmap were not being properly freed when
tests completed without explicitly deleting buckets.

The leak occurred because:

- Objects were preserved in a static map after insertion
- Objects were only freed by DB::objectmapDelete() when deleting the
  corresponding bucket
- In tests, buckets weren't always deleted after insertion, leaving
  objects allocated

ASan rightly pointed this out:

```
Direct leak of 200 byte(s) in 1 object(s) allocated from:
    #0 0x55c420f5274d in operator new(unsigned long) (/home/jenkins-build/build/workspace/ceph-pull-requests/build/bin/unittest_dbstore_tests+0x4df74d) (BuildId: c19ed2d2b1ead306fdc59fc311f546a287300010)
    #1 0x55c42143cfaf in SQLGetBucket::Execute(DoutPrefixProvider const*, rgw::store::DBOpParams*) /home/jenkins-build/build/workspace/ceph-pull-requests/src/rgw/driver/dbstore/sqlite/sqliteDB.cc:1689:11
    #2 0x55c42102751c in rgw::store::DB::ProcessOp(DoutPrefixProvider const*, std::basic_string_view<char, std::char_traits<char>>, rgw::store::DBOpParams*) /home/jenkins-build/build/workspace/ceph-pull-requests/src/rgw/driver/dbstore/common/dbstore.cc:251:16
    #3 0x55c4210328c9 in rgw::store::DB::get_bucket_info(DoutPrefixProvider const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, RGWBucketInfo&, std::map<std::__cxx11
::basic_string<char, std::char_traits<char>, std::allocator<char>>, ceph::buffer::v15_2_0::list, std::less<std::__cxx11::basic_string<char, std::c
har_traits<char>, std::allocator<char>>>, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const, ceph::buffer::v15_2_0::list>>>*, std::chrono::time_point<ceph::real_clock, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l>>>*, obj_version*) /home/jenkins-build/build/workspace/ceph-pull-requests/src/rgw/driver/dbstore/common/dbstore.cc:450:9
    #4 0x55c421034357 in rgw::store::DB::create_bucket(DoutPrefixProvider const*, std::variant<rgw_user, rgw_account_id> const&, rgw_bucket const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, rgw_placement_rule const&, std::map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>, ceph::buffer::v15_2_0::list, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>>, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const, ceph::buffer::v15_2_0::list>>> const&, std::optional<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>> const&, std::optional<RGWQuotaInfo> const&, std::optional<std::chrono::time_point<ceph::real_clock, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l>>>>, obj_version*, RGWBucketInfo&, optional_yield) /home/jenkins-build/build/workspace/ceph-pull-requests/src/rgw/driver/dbstore/common/dbstore.cc:504:9
    #5 0x55c420f6c3ed in DBStoreTest_CreateBucket_Test::TestBody() /home/jenkins-build/build/workspace/ceph-pull-requests/src/rgw/driver/dbstore/tests/dbstore_tests.cc:495:13
    #6 0x55c42174fa0d in void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /home/jenkins-build/build/workspace/ceph-pull-requests/src/googletest/googletest/src/gtest.cc:2653:10
    #7 0x55c421717f25 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /home/jenkins-build/build/workspace/ceph-pull-requests/src/googletest/googletest/src/gtest.cc:2689:14
    #8 0x55c4216d4bbd in testing::Test::Run() /home/jenkins-build/build/workspace/ceph-pull-requests/src/googletest/googletest/src/gtest.cc:2728:5
```

In this change, we:

- Free objectmap entries in DB::Destroy() to ensure cleanup on shutdown
- Call DB::Destroy() in DBStoreTest::TearDown() to guarantee cleanup after each test

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
7 weeks agoMerge pull request #63435 from phlogistonjohn/jjm-fix-dash-fix
Dan Mick [Thu, 29 May 2025 22:10:15 +0000 (15:10 -0700)]
Merge pull request #63435 from phlogistonjohn/jjm-fix-dash-fix

dashboard: fix the workaround for unpacking node sources

7 weeks agoMerge pull request #63410 from Hezko/nvmeof-cli-align-part-3
Hezko [Thu, 29 May 2025 17:46:05 +0000 (20:46 +0300)]
Merge pull request #63410 from Hezko/nvmeof-cli-align-part-3

mgr/dashboard: align response of subsystem add and ns add with old cli

7 weeks agoMerge pull request #63412 from awojno-bloomberg/cephadm-optional-build
Alex [Thu, 29 May 2025 17:04:07 +0000 (13:04 -0400)]
Merge pull request #63412 from awojno-bloomberg/cephadm-optional-build

cephadm: add optional build flag

7 weeks agoMerge pull request #60428 from amathuria/wip-amat-add-pg-splitting-crimson
Matan Breizman [Thu, 29 May 2025 15:35:13 +0000 (18:35 +0300)]
Merge pull request #60428 from amathuria/wip-amat-add-pg-splitting-crimson

Crimson PG Splitting

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
7 weeks agoMerge pull request #63381 from mkogan1/wip-d3n-test-stripe_size
Mark Kogan [Thu, 29 May 2025 14:08:28 +0000 (17:08 +0300)]
Merge pull request #63381 from mkogan1/wip-d3n-test-stripe_size

rgw/d3n: fix teuthology run-datacache.sh FAIL when stripe_size!=4MiB

7 weeks agoMerge pull request #63471 from zdover23/wip-doc-2025-05-26-mgr-prometheus-62782-followup
Zac Dover [Thu, 29 May 2025 12:56:12 +0000 (22:56 +1000)]
Merge pull request #63471 from zdover23/wip-doc-2025-05-26-mgr-prometheus-62782-followup

doc/mgr: edit prometheus.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63470 from zdover23/wip-doc-2025-05-26-mgr-progress-62782-followup
Zac Dover [Thu, 29 May 2025 12:54:42 +0000 (22:54 +1000)]
Merge pull request #63470 from zdover23/wip-doc-2025-05-26-mgr-progress-62782-followup

doc/mgr: edit progress.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63565 from cbodley/wip-backport-redmine-key
Casey Bodley [Thu, 29 May 2025 12:41:52 +0000 (08:41 -0400)]
Merge pull request #63565 from cbodley/wip-backport-redmine-key

script: ceph-backport.sh adds redmine key to api requests

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Adam Kraitman <akraitma@redhat.com>
7 weeks agoMerge pull request #63452 from zdover23/wip-doc-2025-05-23-mgr-nfs-62782-followup
Zac Dover [Thu, 29 May 2025 12:38:35 +0000 (22:38 +1000)]
Merge pull request #63452 from zdover23/wip-doc-2025-05-23-mgr-nfs-62782-followup

doc/mgr: edit nfs.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63451 from zdover23/wip-doc-2025-05-23-mgr-modules-62782-followup
Zac Dover [Thu, 29 May 2025 12:33:57 +0000 (22:33 +1000)]
Merge pull request #63451 from zdover23/wip-doc-2025-05-23-mgr-modules-62782-followup

doc/mgr: edit modules.rst.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63240 from yuvalif/wip-yuval-71255
Yuval Lifshitz [Thu, 29 May 2025 08:24:22 +0000 (11:24 +0300)]
Merge pull request #63240 from yuvalif/wip-yuval-71255

rgw/logging: support object metadata changes in journal mode

7 weeks agoMerge pull request #63525 from ronen-fr/wip-rf-checkrepair
Ronen Friedman [Thu, 29 May 2025 05:50:19 +0000 (08:50 +0300)]
Merge pull request #63525 from ronen-fr/wip-rf-checkrepair

osd/scrub: no auto-repair in 'after_repair' type of scrubs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
7 weeks agoMerge PR #61547 into main
Venky Shankar [Thu, 29 May 2025 04:21:16 +0000 (09:51 +0530)]
Merge PR #61547 into main

* refs/pull/61547/head:
qa: enable libcephfs debug logs for fio workload with nfs

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
7 weeks agoMerge PR #62549 into main
Venky Shankar [Thu, 29 May 2025 04:20:00 +0000 (09:50 +0530)]
Merge PR #62549 into main

* refs/pull/62549/head:
test/libcephfs: Add a new test with ceph_ll_get() API
libcephfs: Implement ceph_ll_get() API

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
7 weeks agoMerge pull request #63131 from joscollin/wip-B71186-test_cephfs_mirror_stats-failure
Venky Shankar [Thu, 29 May 2025 04:19:00 +0000 (09:49 +0530)]
Merge pull request #63131 from joscollin/wip-B71186-test_cephfs_mirror_stats-failure

qa: fix test_cephfs_mirror_stats failure

Reviewed-by: Venky Shankar <vshankar@redhat.com>
7 weeks agoMerge PR #63178 into main
Venky Shankar [Thu, 29 May 2025 04:17:39 +0000 (09:47 +0530)]
Merge PR #63178 into main

* refs/pull/63178/head:
cephfs, tools/cephfs_mirror: migrate from boost::variant to std::variant

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
7 weeks agoMerge pull request #63220 from trociny/wip-71270
Venky Shankar [Thu, 29 May 2025 04:16:18 +0000 (09:46 +0530)]
Merge pull request #63220 from trociny/wip-71270

mds: log meaningful error message when entering damaged state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
7 weeks agoscript: ceph-backport.sh adds redmine key to api requests 63565/head
Casey Bodley [Wed, 28 May 2025 20:33:44 +0000 (16:33 -0400)]
script: ceph-backport.sh adds redmine key to api requests

the ceph-backport.sh script recently started failing with:

> ceph-backport.sh: DEBUG: Considering Redmine issue: https://tracker.ceph.com/issues/70374 - is it in the Backport tracker?
> ceph-backport.sh: DEBUG:
> ceph-backport.sh: ERROR: Issue https://tracker.ceph.com/issues/70374 is not a Backport

because the command `curl --silent https://tracker.ceph.com/issues/70374.json`
now fails with `HTTP/2 401` (Unauthorized) and returns an empty string

the command succeeds after adding my redmine key as a query param like
some of the other redmine requests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 weeks agoMerge pull request #63092 from bill-scales/issue71027
Yuri Weinstein [Wed, 28 May 2025 19:15:15 +0000 (12:15 -0700)]
Merge pull request #63092 from bill-scales/issue71027

crushtool: init with CINIT_FLAG_NO_DAEMON_ACTIONS

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 weeks agomgr/dashboard: align response of subsystem add and ns add with old cli 63410/head
Tomer Haskalovitch [Tue, 20 May 2025 20:27:43 +0000 (23:27 +0300)]
mgr/dashboard: align response of subsystem add and ns add with old cli

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>
7 weeks agoMerge pull request #63481 from bluikko/doc-minor-fixes-rgw-mgr
Anthony D'Atri [Wed, 28 May 2025 15:39:17 +0000 (11:39 -0400)]
Merge pull request #63481 from bluikko/doc-minor-fixes-rgw-mgr

doc/mgr: Small improvements in rgw.rst

7 weeks agoMerge pull request #62164 from piyushagarwal1411/cephfsdashboard
Aashish Sharma [Wed, 28 May 2025 14:01:44 +0000 (19:31 +0530)]
Merge pull request #62164 from piyushagarwal1411/cephfsdashboard

mgr/dashboard: Creating CephFS dashboard for Grafana

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
7 weeks agoMerge pull request #63450 from bluikko/doc-capitalize-nfs-ct-radosgw
Anthony D'Atri [Wed, 28 May 2025 13:04:48 +0000 (09:04 -0400)]
Merge pull request #63450 from bluikko/doc-capitalize-nfs-ct-radosgw

doc/radosgw: Fix capitalization, tab use, punctuation in two files

7 weeks agoMerge pull request #62823 from NitzanMordhai/wip-nitzan-suites-verify-validater-valgr...
SrinivasaBharathKanta [Wed, 28 May 2025 12:58:12 +0000 (18:28 +0530)]
Merge pull request #62823 from NitzanMordhai/wip-nitzan-suites-verify-validater-valgrind-doesnt-wait-enough

qa/suites: wait longer before stopping OSDs with valgrind

7 weeks agoMerge PR #63528 into main
Patrick Donnelly [Wed, 28 May 2025 12:27:44 +0000 (08:27 -0400)]
Merge PR #63528 into main

* refs/pull/63528/head:
qa/crontab: update priority for tentacle upgrade command

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
7 weeks agoMerge pull request #59903 from connorfawcett/wip-connorfa-ec-consistency-2024-09...
Connor Fawcett [Wed, 28 May 2025 09:01:23 +0000 (10:01 +0100)]
Merge pull request #59903 from connorfawcett/wip-connorfa-ec-consistency-2024-09-18-1703

qa/tasks: Add a task which performs an offline check of the consistency of parity shards

7 weeks agomgr/dashboard: Creating CephFS dashboard for Grafana 62164/head
Piyush Agarwal [Sun, 13 Apr 2025 14:26:31 +0000 (19:56 +0530)]
mgr/dashboard: Creating CephFS dashboard for Grafana

Fixes: https://tracker.ceph.com/issues/70901
Signed-off-by: Piyush Agarwal <piyushagarwal14.pa@gmail.com>
7 weeks agodoc/mgr: Small improvements in rgw.rst 63481/head
Ville Ojamo [Mon, 26 May 2025 10:41:24 +0000 (17:41 +0700)]
doc/mgr: Small improvements in rgw.rst

Use double backticks consistently for module name, CLI commands and
parameters etc.

Use title case in section titles and underline them only until end of
title text.

Use "command line" instead of "cmd line" in text.

Capitalize RGW consistently.

Delete one paragraph that included a strange out of place text fragment.

Call it "Manager" consistently instead of "MGR" in text one time.

Improve language in CA cert upgrade.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
7 weeks agoMerge pull request #62496 from aainscow/interval_set_reenable_assert
Adam Kupczyk [Wed, 28 May 2025 06:07:11 +0000 (08:07 +0200)]
Merge pull request #62496 from aainscow/interval_set_reenable_assert

test/osd: Adapt strategy for testing asserts in interval_sets

7 weeks agoMerge pull request #63419 from zdover23/wip-doc-2025-05-22-mgr-localpool-62782-followup
Zac Dover [Wed, 28 May 2025 05:24:32 +0000 (15:24 +1000)]
Merge pull request #63419 from zdover23/wip-doc-2025-05-22-mgr-localpool-62782-followup

doc/mgr: edit localpool.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63275 from zdover23/wip-doc-2025-05-14-dev-cephfs-mirroring-63237...
Zac Dover [Wed, 28 May 2025 05:18:53 +0000 (15:18 +1000)]
Merge pull request #63275 from zdover23/wip-doc-2025-05-14-dev-cephfs-mirroring-63237-followup-3-of-x

doc/dev/cephfs-mirroring: edit file 3 of x

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63530 from anthonyeleven/balancer-advice
Zac Dover [Wed, 28 May 2025 04:45:20 +0000 (14:45 +1000)]
Merge pull request #63530 from anthonyeleven/balancer-advice

doc/rados/operations: Add settings advice to balancer.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
7 weeks agoMerge pull request #62973 from connorfawcett/exerciser-fixes-2404
Connor Fawcett [Tue, 27 May 2025 22:55:15 +0000 (23:55 +0100)]
Merge pull request #62973 from connorfawcett/exerciser-fixes-2404

common/io_exerciser: Fixes for sequencing options

7 weeks agoMerge pull request #63327 from Hezko/nvmeof-cli-text-format
Hezko [Tue, 27 May 2025 19:23:14 +0000 (22:23 +0300)]
Merge pull request #63327 from Hezko/nvmeof-cli-text-format

mgr/dashboard: Nvmeof CLI plain format support

7 weeks agodoc/rados/operations: Add settings advice to balancer.rst 63530/head
Anthony D'Atri [Tue, 27 May 2025 19:00:59 +0000 (15:00 -0400)]
doc/rados/operations: Add settings advice to balancer.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
7 weeks agoqa/crontab: update priority for tentacle upgrade command 63528/head
Laura Flores [Tue, 27 May 2025 17:09:04 +0000 (12:09 -0500)]
qa/crontab: update priority for tentacle upgrade command

The current prio (100) results in this error:
```
teuthology.exceptions.ScheduleFailError: Scheduling failed: Unable to schedule 244 jobs with priority 100.
```

I tested the prio on 150 on my teuthology setup, and this passes with the amount of jobs.

Signed-off-by: Laura Flores <lflores@ibm.com>
7 weeks agoqa/tasks: Add a task which performs an offline check of the consistency of parity... 59903/head
Connor Fawcett [Mon, 9 Dec 2024 17:02:11 +0000 (17:02 +0000)]
qa/tasks: Add a task which performs an offline check of the consistency of parity shards

Add a Python script which can be used to scan a Ceph cluster, find any erasure coded data objects and
check them for consistency. This is achieved by reading the data shards for a given object, running the data shards
through the existing EC tool and verifying the output matches the parity shards stored on the OSDs.

This commit adds a new teuthology task but does not add it to any YAMLs currently, this work will be
expanded on in future commits.

Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/71412
7 weeks agoMerge pull request #60833 from connorfawcett/wip-vstart-runner-fns2
Kamoltat (Junior) Sirivadhna [Tue, 27 May 2025 15:41:44 +0000 (11:41 -0400)]
Merge pull request #60833 from connorfawcett/wip-vstart-runner-fns2

qa/vstart_runner: Add get_file and write_file equivalents to the LocalRemoteProcess class

Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
7 weeks agoosd/scrub: no auto-repair in 'after_repair' type of scrubs 63525/head
Ronen Friedman [Tue, 27 May 2025 15:13:09 +0000 (10:13 -0500)]
osd/scrub: no auto-repair in 'after_repair' type of scrubs

The deep scrubs that are initiated after a full "peering" repair, are
not supposed to auto-repair any errors - just report them.

This behavior detail was inadvertently changed recently, and is fixed
here.

Fixes: https://tracker.ceph.com/issues/71463
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
7 weeks agoMerge pull request #63267 from ceph/wip-yuriw-17.2.9-release.notes-main
Yuri Weinstein [Tue, 27 May 2025 14:52:55 +0000 (07:52 -0700)]
Merge pull request #63267 from ceph/wip-yuriw-17.2.9-release.notes-main

doc: quincy 17.2.9 release notes

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
7 weeks agoMerge pull request #63433 from stackhpc/cephadm-upgrade-order
Anthony D'Atri [Tue, 27 May 2025 13:48:38 +0000 (09:48 -0400)]
Merge pull request #63433 from stackhpc/cephadm-upgrade-order

doc/cephadm: fix upgrade ordering

7 weeks agocommon/io_exerciser: Fix the --sequence and --listsequence options for 62973/head
Connor Fawcett [Fri, 25 Apr 2025 10:30:58 +0000 (11:30 +0100)]
common/io_exerciser: Fix the --sequence and --listsequence options for
the IO exerciser. Also fix an incorrect read operation in SEQ7.

Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/71074
7 weeks agomgr/dashboard: add plain output type support to nvme cli 63327/head
Tomer Haskalovitch [Thu, 8 May 2025 08:54:39 +0000 (11:54 +0300)]
mgr/dashboard: add plain output type support to nvme cli

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>
fixon

7 weeks agoMerge pull request #62955 from yuvalif/wip-yuval-fix-admin-flush
Yuval Lifshitz [Tue, 27 May 2025 08:08:19 +0000 (11:08 +0300)]
Merge pull request #62955 from yuvalif/wip-yuval-fix-admin-flush

rgw/logging: extract tenant from bucket name on admin flush

7 weeks agoMerge pull request #63377 from yuvalif/wip-yuval-71385
Yuval Lifshitz [Tue, 27 May 2025 08:07:50 +0000 (11:07 +0300)]
Merge pull request #63377 from yuvalif/wip-yuval-71385

rgw/logging: add mtime to get-bucket-logging response

7 weeks agoMerge pull request #63268 from yuvalif/wip-yuval-71312
Yuval Lifshitz [Tue, 27 May 2025 08:07:16 +0000 (11:07 +0300)]
Merge pull request #63268 from yuvalif/wip-yuval-71312

rgw/logging: part upload operation name should be REST.PUT.PART

7 weeks agoqa/suites/crimson: Add a test for PG Splitting in the crimson suite 60428/head
Aishwarya Mathuria [Tue, 11 Feb 2025 09:38:22 +0000 (09:38 +0000)]
qa/suites/crimson: Add a test for PG Splitting in the crimson suite

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
7 weeks agocrimson/osd/osd_operations/pg_advance_map: Use new macro for logging
Aishwarya Mathuria [Fri, 16 May 2025 11:16:18 +0000 (11:16 +0000)]
crimson/osd/osd_operations/pg_advance_map: Use new macro for logging

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
7 weeks agocrimson/osd/osd_operations/pg_advance_map: Add splitting as a function
Aishwarya Mathuria [Wed, 23 Apr 2025 13:21:23 +0000 (13:21 +0000)]
crimson/osd/osd_operations/pg_advance_map: Add splitting as a function

As we initiate pg splitting as part of the PGAdvanceMap workflow, it is not required
to maintain it as a separate osd_operation.
A new function in PGAdvanceMap - split_pg(), will now take care of the splitting workflow
if we detect split children in an OSD map.

Since we do not follow the same queuing system as classical OSD in crimson, we will not
need to maintain pg_num_history. This makes the splitting check simpler.
With most of the splitting code being part of PGAdvanceMap, it makes sense to have the
splitting check there as well and leave broadcast_map_to_pgs untouched.

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
7 weeks agoMerge pull request #63347 from cloudbehl/application-pool-panel-fix
Aashish Sharma [Tue, 27 May 2025 06:06:49 +0000 (11:36 +0530)]
Merge pull request #63347 from cloudbehl/application-pool-panel-fix

mgr/dashboard: Fix application pool table for filtered pools
Fixes: fixes: https://tracker.ceph.com/issues/71361
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
7 weeks agoMerge pull request #63459 from myoungwon/wip-fix-oi-max-length
Yingxin Cheng [Tue, 27 May 2025 05:58:09 +0000 (13:58 +0800)]
Merge pull request #63459 from myoungwon/wip-fix-oi-max-length

crimson/os/seastore: increase OI_MAX_LENGTH to avoid storing OI data in the omap tree

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
7 weeks agoMerge pull request #63418 from zdover23/wip-doc-2025-05-22-mgr-iostat-62782-followup
Zac Dover [Tue, 27 May 2025 03:57:14 +0000 (13:57 +1000)]
Merge pull request #63418 from zdover23/wip-doc-2025-05-22-mgr-iostat-62782-followup

doc/mgr: edit iostat.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63417 from zdover23/wip-doc-2025-05-22-mgr-insights-62782-followup
Zac Dover [Tue, 27 May 2025 03:53:12 +0000 (13:53 +1000)]
Merge pull request #63417 from zdover23/wip-doc-2025-05-22-mgr-insights-62782-followup

doc/mgr: edit insights.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63465 from zdover23/wip-doc-2025-05-26-rados-operations-cache...
Zac Dover [Tue, 27 May 2025 03:40:17 +0000 (13:40 +1000)]
Merge pull request #63465 from zdover23/wip-doc-2025-05-26-rados-operations-cache-tiering

doc/rados: improve markup in cache-tiering.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63463 from zdover23/wip-doc-2025-05-26-rados-operations-pgcalc
Zac Dover [Tue, 27 May 2025 03:32:33 +0000 (13:32 +1000)]
Merge pull request #63463 from zdover23/wip-doc-2025-05-26-rados-operations-pgcalc

doc/rados: s/enpty/empty/ in pgcalc doc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #62600 from zdover23/wip-doc-2025-04-01-cephadm-host-management
Zac Dover [Tue, 27 May 2025 03:26:30 +0000 (13:26 +1000)]
Merge pull request #62600 from zdover23/wip-doc-2025-04-01-cephadm-host-management

doc/cephadm: improve "Maintenance Mode"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 weeks agoMerge pull request #63428 from myoungwon/wip-fix-incorrect-space-calculation
Yingxin Cheng [Tue, 27 May 2025 03:21:21 +0000 (11:21 +0800)]
Merge pull request #63428 from myoungwon/wip-fix-incorrect-space-calculation

crimson/os/seastore/rbm: prevent incorrect space calculation at maximum capacity

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
7 weeks agoMerge pull request #63487 from anthonyeleven/scrubscope
Zac Dover [Tue, 27 May 2025 03:04:48 +0000 (13:04 +1000)]
Merge pull request #63487 from anthonyeleven/scrubscope

src/common/options: Clarify scope of scrub intervals in osd.yaml.in

Reviewed-by: Zac Dover <zac.dover@proton.me>
7 weeks agoMerge pull request #63376 from xxhdx1985126/wip-seastore-omap-root-fix
Yingxin Cheng [Tue, 27 May 2025 01:49:28 +0000 (09:49 +0800)]
Merge pull request #63376 from xxhdx1985126/wip-seastore-omap-root-fix

crimson/os/seastore/omap_manager: handle the cases in which omap nodes are rewritten before seen by users

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
7 weeks agosrc/common/options: Clarify scope of scrub intervals in osd.yaml.in 63487/head
Anthony D'Atri [Tue, 27 May 2025 00:06:18 +0000 (20:06 -0400)]
src/common/options: Clarify scope of scrub intervals in osd.yaml.in

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
7 weeks agoqa/vstart_runner: Add get_file and write_file equivalents to the LocalRemoteProcess... 60833/head
Connor Fawcett [Tue, 26 Nov 2024 04:01:05 +0000 (04:01 +0000)]
qa/vstart_runner: Add get_file and write_file equivalents to the LocalRemoteProcess class

Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
7 weeks agoMerge pull request #63480 from bluikko/doc-minor-fixes-cloud-restore-radosgw
Anthony D'Atri [Mon, 26 May 2025 22:58:05 +0000 (18:58 -0400)]
Merge pull request #63480 from bluikko/doc-minor-fixes-cloud-restore-radosgw

doc/radosgw: Small improvements in cloud-restore.rst

7 weeks agoMerge pull request #63366 from Hezko/nvmeof-cli-align-part-2
Hezko [Mon, 26 May 2025 19:27:57 +0000 (22:27 +0300)]
Merge pull request #63366 from Hezko/nvmeof-cli-align-part-2

mgr/dashboard: align cli commands listener list, ns list, host list

7 weeks agodoc/radosgw: Small improvements in cloud-restore.rst 63480/head
Ville Ojamo [Mon, 26 May 2025 09:54:41 +0000 (16:54 +0700)]
doc/radosgw: Small improvements in cloud-restore.rst

Add a label in file cloud-transition.rst for linking to it.
Change a link using full URL of Ceph docs to use :ref: and said label.

Indent text in unordered lists so that they are rendered as list items.

Use consistently double backticks for references to configuration
values.

Change one external link pointing to old v1 of AWS CLI to the
recommended v2 docs.

Change another external link pointing to old v1 of AWS CLI to the
current AWS API doc instead and add link text instead of rendering the
whole URL.
However, both the old and the new text (which are the same) do not
currently seem to explicitly confirm the claim "storage class of
restored objects should remain unchanged".

Change one CLI command prompt to privileged prompt because it uses
radosgw-admin.

Use "lifecycle" consistently instead of "Life Cycle" in one place and
put the acronym "LC" inside parenthesis instead of the full spelling.

Fix typo "Th" into "The".

Use admonitions instead of spelling out "Note: [...]".

Small improvement to language in one admonition.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
7 weeks agoMerge pull request #63434 from cbodley/wip-70673-debug
Yuval Lifshitz [Mon, 26 May 2025 14:15:14 +0000 (17:15 +0300)]
Merge pull request #63434 from cbodley/wip-70673-debug

test/rgw: link lua test against unit-main for g_ceph_context

7 weeks agoMerge pull request #62179 from benhanokh/s3_full_object_dedup
Yuval Lifshitz [Mon, 26 May 2025 14:10:34 +0000 (17:10 +0300)]
Merge pull request #62179 from benhanokh/s3_full_object_dedup

rgw/dedup: full object dedup

7 weeks agoMerge pull request #63335 from Hezko/nvmeof-align-gw-info
Hezko [Mon, 26 May 2025 13:44:23 +0000 (16:44 +0300)]
Merge pull request #63335 from Hezko/nvmeof-align-gw-info

mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli

7 weeks agoMerge pull request #63334 from Hezko/nvmeof-cli-fix-spdk-set-lvl
Hezko [Mon, 26 May 2025 13:44:12 +0000 (16:44 +0300)]
Merge pull request #63334 from Hezko/nvmeof-cli-fix-spdk-set-lvl

mgr/dashboard: fix set spdk log level cli command

7 weeks agoMerge PR #59161 into main
Venky Shankar [Mon, 26 May 2025 09:22:23 +0000 (14:52 +0530)]
Merge PR #59161 into main

* refs/pull/59161/head:
qa: test failure for duplicate retention spec
mgr/snap_schedule: fix message format error

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
7 weeks agomgr/dashboard: align cli commands listener list, ns list, host list 63366/head
Tomer Haskalovitch [Mon, 19 May 2025 08:29:22 +0000 (11:29 +0300)]
mgr/dashboard: align cli commands listener list, ns list, host list

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>
7 weeks agomgr/dashboard: align gw info, gw version, spdk_log_level get with old cli 63335/head
Tomer Haskalovitch [Sun, 18 May 2025 18:58:37 +0000 (21:58 +0300)]
mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>
7 weeks agomgr/dashboard: fix set spdk log level cli command 63334/head
Tomer Haskalovitch [Sun, 18 May 2025 17:21:04 +0000 (20:21 +0300)]
mgr/dashboard: fix set spdk log level cli command

Signed-off-by: Tomer Haskalovitch <il033030@Tomers-MBP.lan>
7 weeks agoMerge pull request #63475 from zdover23/wip-doc-2025-05-26-mgr-telegraf-62782-followup
Anthony D'Atri [Mon, 26 May 2025 04:56:34 +0000 (00:56 -0400)]
Merge pull request #63475 from zdover23/wip-doc-2025-05-26-mgr-telegraf-62782-followup

doc/mgr: edit telegraf.rst

7 weeks agoMerge pull request #63474 from zdover23/wip-doc-2025-05-26-mgr-smb-62782-followup
Anthony D'Atri [Mon, 26 May 2025 04:55:49 +0000 (00:55 -0400)]
Merge pull request #63474 from zdover23/wip-doc-2025-05-26-mgr-smb-62782-followup

doc/mgr: edit smb.rst

7 weeks agodoc/mgr: edit telegraf.rst 63475/head
Zac Dover [Mon, 26 May 2025 04:42:59 +0000 (14:42 +1000)]
doc/mgr: edit telegraf.rst

Edit doc/mgr/telegraf.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/mgr: edit smb.rst 63474/head
Zac Dover [Mon, 26 May 2025 04:33:55 +0000 (14:33 +1000)]
doc/mgr: edit smb.rst

Edit doc/mgr/smb.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agoMerge pull request #63464 from zdover23/wip-doc-2025-05-26-cephfs-mount-using-kernel...
Anthony D'Atri [Mon, 26 May 2025 00:47:13 +0000 (20:47 -0400)]
Merge pull request #63464 from zdover23/wip-doc-2025-05-26-cephfs-mount-using-kernel-driver

doc/cephfs: correct ill-formatted command

7 weeks agoMerge pull request #63469 from zdover23/wip-doc-2025-05-26-mgr-orchestrator-62782...
Anthony D'Atri [Mon, 26 May 2025 00:19:59 +0000 (20:19 -0400)]
Merge pull request #63469 from zdover23/wip-doc-2025-05-26-mgr-orchestrator-62782-followup

doc/mgr: edit orchestrator.rst

7 weeks agoMerge pull request #63472 from zdover23/wip-doc-2025-05-26-mgr-rgw-62782-followup
Anthony D'Atri [Mon, 26 May 2025 00:08:37 +0000 (20:08 -0400)]
Merge pull request #63472 from zdover23/wip-doc-2025-05-26-mgr-rgw-62782-followup

doc/mgr: edit rgw.rst

7 weeks agodoc/mgr: edit rgw.rst 63472/head
Zac Dover [Sun, 25 May 2025 23:57:40 +0000 (09:57 +1000)]
doc/mgr: edit rgw.rst

Edit doc/mgr/rgw.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/mgr: edit prometheus.rst 63471/head
Zac Dover [Sun, 25 May 2025 23:52:17 +0000 (09:52 +1000)]
doc/mgr: edit prometheus.rst

Edit doc/mgr/prometheus.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/mgr: edit progress.rst 63470/head
Zac Dover [Sun, 25 May 2025 23:45:58 +0000 (09:45 +1000)]
doc/mgr: edit progress.rst

Edit doc/mgr/progress.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/mgr: edit orchestrator.rst 63469/head
Zac Dover [Sun, 25 May 2025 23:40:31 +0000 (09:40 +1000)]
doc/mgr: edit orchestrator.rst

Edit doc/mgr/orchestrator.rst.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/rados: improve markup in cache-tiering.rst 63465/head
Zac Dover [Sun, 25 May 2025 23:19:38 +0000 (09:19 +1000)]
doc/rados: improve markup in cache-tiering.rst

Correct ill-formatted markup in cache-tiering.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/cephfs: correct ill-formatted command 63464/head
Zac Dover [Sun, 25 May 2025 23:09:38 +0000 (09:09 +1000)]
doc/cephfs: correct ill-formatted command

Correct a command that was broken across two lines, causing the argument
of an option to appear as though it was a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agodoc/rados: s/enpty/empty/ in pgcalc doc 63463/head
Zac Dover [Sun, 25 May 2025 23:05:20 +0000 (09:05 +1000)]
doc/rados: s/enpty/empty/ in pgcalc doc

s/enpty/empty/ in doc/rados/operations/pgcalc/index.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
7 weeks agorgw/d3n: fix teuthology run-datacache.sh FAIL when stripe_size!=4MiB 63381/head
Mark Kogan [Tue, 20 May 2025 11:49:19 +0000 (11:49 +0000)]
rgw/d3n: fix teuthology run-datacache.sh FAIL when stripe_size!=4MiB

Fixes: https://tracker.ceph.com/issues/71387
Signed-off-by: Mark Kogan <mkogan@redhat.com>
8 weeks agoMerge pull request #63027 from tchaikov/any-alignas
Kefu Chai [Sat, 24 May 2025 15:48:50 +0000 (23:48 +0800)]
Merge pull request #63027 from tchaikov/any-alignas

include/any.h: avoid using std::aligned_storage_t

Reviewed-by: Adam Emerson <aemerson@redhat.com>
8 weeks agoMerge PR #63420 into main
Patrick Donnelly [Fri, 23 May 2025 23:06:23 +0000 (19:06 -0400)]
Merge PR #63420 into main

* refs/pull/63420/head:
doc/mgr: edit mds_autoscaler.rst

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
8 weeks agocrimson/os/seastore: increase OI_MAX_LENGTH to avoid storing OI data in the omap... 63459/head
myoungwon oh [Fri, 23 May 2025 13:52:14 +0000 (13:52 +0000)]
crimson/os/seastore: increase OI_MAX_LENGTH to avoid storing OI data in the omap tree

Due to a recent change (adding shard_versions in object_info_t),
the size of OI has increased to 236. This causes to store OI data to the omap tree
because the size is over than OI_MAX_LENGTH. As a result, this results in
performance drop in small random write.

Signed-off-by: Myoungwon Oh <ohmyoungwon@gmail.com>
8 weeks agotest/rgw/dedup: add dedup test suite to teuthology 62179/head
Yuval Lifshitz [Wed, 23 Apr 2025 09:00:45 +0000 (09:00 +0000)]
test/rgw/dedup: add dedup test suite to teuthology

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
8 weeks agoMerge pull request #63426 from bluikko/doc-account-formatting-radosgw
Anthony D'Atri [Fri, 23 May 2025 13:09:08 +0000 (09:09 -0400)]
Merge pull request #63426 from bluikko/doc-account-formatting-radosgw

doc/radosgw: Cosmetic improvements and ref links in account.rst

8 weeks agoMerge pull request #63415 from zdover23/wip-doc-2025-05-22-mgr-influx-62782-followup
Zac Dover [Fri, 23 May 2025 11:02:59 +0000 (21:02 +1000)]
Merge pull request #63415 from zdover23/wip-doc-2025-05-22-mgr-influx-62782-followup

doc/mgr: edit influx.rst.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
8 weeks agodoc/mgr: edit nfs.rst 63452/head
Zac Dover [Fri, 23 May 2025 10:54:58 +0000 (20:54 +1000)]
doc/mgr: edit nfs.rst

Edit doc/mgr/nfs.rst. Improve some of the English.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

This commit and the PR of which it is a part includes the changes made
in https://github.com/ceph/ceph/pull/62782 and some corrections to
glaring grammatical errors. However, this file could use a careful
grammar pass.

Signed-off-by: Zac Dover <zac.dover@proton.me>
8 weeks agodoc/mgr: edit modules.rst. 63451/head
Zac Dover [Fri, 23 May 2025 10:24:01 +0000 (20:24 +1000)]
doc/mgr: edit modules.rst.

Edit doc/mgr/modules.rst. Improve some of the English.

This is part of a project to separate out the twenty-five files that
were committed to https://github.com/ceph/ceph/pull/62782.

This commit and the PR of which it is a part includes the changes made
in https://github.com/ceph/ceph/pull/62782 and some corrections to
glaring grammatical errors. However, this file could use a careful
grammar pass. As it currently stands, it contains run-on sentences and
English that is acceptable in conversation but not acceptable in written
communication.

Signed-off-by: Zac Dover <zac.dover@proton.me>
8 weeks agocrimson/os/seastore/omap_manager: handle the cases in which omap nodes 63376/head
Xuehan Xu [Wed, 21 May 2025 03:50:23 +0000 (11:50 +0800)]
crimson/os/seastore/omap_manager: handle the cases in which omap nodes
are rewritten before seen by users

Fixes: https://tracker.ceph.com/issues/71383
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
8 weeks agodoc/radosgw: Fix capitalization, tab use, punctuation in two files 63450/head
Ville Ojamo [Fri, 23 May 2025 09:48:07 +0000 (16:48 +0700)]
doc/radosgw: Fix capitalization, tab use, punctuation in two files

Use title case consistently in section titles.

Capitalize first letter for Ceph, Unix, Luminous.

Capitalize RGW and NFS-Ganesha consistently.

Remove a colon from end of a section title in nfs.rst.

Add full stops at end of two sentences in sync-modules.rst.

Change tabs into four spaces in nfs.rst.
Also use comments more sensibly in logging example in nfs.rst:
- Indent the comments consistently, fixing a leading space in the
  beginning of the rendered preformatted block.
- Also comment out the closing brace.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
8 weeks agoMerge pull request #62683 from alexjr2001/issue-66309-scroll-up-navigation
afreen23 [Fri, 23 May 2025 09:41:10 +0000 (15:11 +0530)]
Merge pull request #62683 from alexjr2001/issue-66309-scroll-up-navigation

scroll up by default when clicking on side navigation

Reviewed-by: Afreen Misbah <afreen@ibm.com>
8 weeks agoMerge pull request #63446 from bluikko/doc-cloud-transition-formatting-radosgw
Zac Dover [Fri, 23 May 2025 09:07:40 +0000 (19:07 +1000)]
Merge pull request #63446 from bluikko/doc-cloud-transition-formatting-radosgw

doc/radosgw: Cosmetic improvements in cloud-transition.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>