]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
9 months agoMerge pull request #59532 from ifed01/wip-ifed-fix-spillover-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:40:17 +0000 (16:40 -0700)]
Merge pull request #59532 from ifed01/wip-ifed-fix-spillover-qui

quincy: test/store_test: enforce sync compactions for spillover tests

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
9 months agoMerge pull request #59468 from sajibreadd/wip-67039-quincy
Yuri Weinstein [Mon, 7 Oct 2024 23:39:00 +0000 (16:39 -0700)]
Merge pull request #59468 from sajibreadd/wip-67039-quincy

quincy: os/bluestore: Warning added for slow operations and stalled read

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
9 months agoMerge pull request #58674 from ifed01/wip-ifed-many-many-extents-read-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:38:00 +0000 (16:38 -0700)]
Merge pull request #58674 from ifed01/wip-ifed-many-many-extents-read-qui

quincy: blk/aio: fix long batch (64+K entries) submission

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
9 months agoMerge pull request #56138 from ifed01/wip-ifed-fix-global-repair-stats-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:36:41 +0000 (16:36 -0700)]
Merge pull request #56138 from ifed01/wip-ifed-fix-global-repair-stats-qui

quincy: os/store_test: Retune tests to current code

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
9 months agoMerge pull request #55133 from ifed01/wip-ifed-refresh-perf-counters-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:35:39 +0000 (16:35 -0700)]
Merge pull request #55133 from ifed01/wip-ifed-refresh-perf-counters-qui

quincy: os: introduce ObjectStore::refresh_perf_counters() method

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
9 months agoMerge pull request #59236 from NitzanMordhai/wip-67571-quincy
Radoslaw Zarzynski [Mon, 7 Oct 2024 19:58:33 +0000 (21:58 +0200)]
Merge pull request #59236 from NitzanMordhai/wip-67571-quincy

quincy: cls/cas/cls_cas_internal: Initialize 'hash' value before decoding

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agoMerge pull request #60136 from zdover23/wip-doc-2024-10-05-backport-60116-to-quincy
Anthony D'Atri [Sat, 5 Oct 2024 15:42:35 +0000 (11:42 -0400)]
Merge pull request #60136 from zdover23/wip-doc-2024-10-05-backport-60116-to-quincy

quincy: doc/governance: add Zac Dover's updated email

9 months agodoc/governance: add Zac Dover's updated email 60136/head
Zac Dover [Fri, 4 Oct 2024 13:25:30 +0000 (23:25 +1000)]
doc/governance: add Zac Dover's updated email

Update Zac Dover's email address.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 322c1a792062a72e958a9cfbd6a24a3e7333908d)

9 months agoMerge pull request #60087 from idryomov/wip-68213-quincy
Ilya Dryomov [Thu, 3 Oct 2024 14:07:15 +0000 (16:07 +0200)]
Merge pull request #60087 from idryomov/wip-68213-quincy

quincy: qa/suites/rbd/iscsi: enable all supported container hosts

Reviewed-by: N Balachandran <nibalach@redhat.com>
9 months agoqa/suites/rbd/iscsi: enable all supported container hosts 60087/head
Ilya Dryomov [Tue, 24 Sep 2024 12:06:42 +0000 (14:06 +0200)]
qa/suites/rbd/iscsi: enable all supported container hosts

On Ubuntu open-iscsi and multipath-tools need to be installed instead
of iscsi-initiator-utils and device-mapper-multipath.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 29e122f8754aa56a2b1cdc56ac4f0591828e5269)

Conflicts:
- .qa/distros/supported-container-hosts doesn't exist in quincy,
  replaced with .qa/distros/container-hosts to fix the symlink

9 months agoqa: avoid a non-standard shell construct in rbd/iscsi_client.t
Ilya Dryomov [Thu, 26 Sep 2024 15:36:37 +0000 (17:36 +0200)]
qa: avoid a non-standard shell construct in rbd/iscsi_client.t

dash which is used as /bin/sh on Ubuntu interprets "2&> /dev/null" as
an instruction to launch iscsiadm in the background.  While that is
mostly compensated by the following sleep, stderr isn't redirected to
/dev/null either -- the output gets polluted and the test fails.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d3f385aaed0b7631f6d69bf1ed88f9570b1d8f50)

9 months agoqa: don't hardcode podman in rbd/gwcli_{create,delete}.t
Ilya Dryomov [Wed, 25 Sep 2024 09:34:34 +0000 (11:34 +0200)]
qa: don't hardcode podman in rbd/gwcli_{create,delete}.t

If podman isn't available (e.g. on Ubuntu), cephadm falls back to
docker.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit b66b98e76d424b2881084d97d5da0e3c9ce062be)

9 months agoqa/tasks/ceph_iscsi_client: don't use mpathconf
Ilya Dryomov [Wed, 25 Sep 2024 07:53:35 +0000 (09:53 +0200)]
qa/tasks/ceph_iscsi_client: don't use mpathconf

... since it's not available on Ubuntu.  In this case mpathconf just
sets a couple of default values and defines an empty blacklist section,
so it's easy enough to replicate.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9022ef19a58155620b3626080ea58b3c60b6fa36)

9 months agoMerge pull request #60086 from zdover23/wip-doc-2024-10-02-backport-59164-to-quincy
Anthony D'Atri [Tue, 1 Oct 2024 21:33:30 +0000 (17:33 -0400)]
Merge pull request #60086 from zdover23/wip-doc-2024-10-02-backport-59164-to-quincy

quincy: doc:update e-mail addresses governance

9 months agodoc:update e-mail addresses governance 60086/head
Tobias Fischer [Mon, 12 Aug 2024 09:30:48 +0000 (11:30 +0200)]
doc:update e-mail addresses governance

with the consent of my colleagues
- Dan van der Ster
- João Eduardo Luis
- Mark Nelson

changed their e-mail addresses to the current one

Signed-off-by: Tobias Fischer <tobias.fischer@clyso.com>
Signed-off-by: Tobias Fischer <138117964+toficly@users.noreply.github.com>
(cherry picked from commit 180378b5adee303fe57ecd4951b0f0ff46afa5e1)

9 months agoMerge pull request #58512 from k0ste/wip-66889-quincy
Yuri Weinstein [Tue, 1 Oct 2024 21:02:02 +0000 (14:02 -0700)]
Merge pull request #58512 from k0ste/wip-66889-quincy

quincy: mgr/Mgr.cc: clear daemon health metrics instead of removing down/out osd from daemon state

Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #58845 from idryomov/wip-58120-quincy
Yuri Weinstein [Tue, 1 Oct 2024 19:56:54 +0000 (12:56 -0700)]
Merge pull request #58845 from idryomov/wip-58120-quincy

quincy: osd: avoid watcher remains after "rados watch" is interrupted

Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #60074 from kshtsk/wip-68349-quincy
kyr [Tue, 1 Oct 2024 15:53:01 +0000 (17:53 +0200)]
Merge pull request #60074 from kshtsk/wip-68349-quincy

quincy: ceph.spec.in: we need jsonnet for all distroes for make check

9 months agoMerge pull request #58921 from mohit84/wip-67236-quincy
Yuri Weinstein [Tue, 1 Oct 2024 15:14:57 +0000 (08:14 -0700)]
Merge pull request #58921 from mohit84/wip-67236-quincy

quincy: test: Create ParallelPGMapper object before start threadpool

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
9 months agoMerge pull request #59370 from NitzanMordhai/wip-67643-quincy
Yuri Weinstein [Tue, 1 Oct 2024 15:05:34 +0000 (08:05 -0700)]
Merge pull request #59370 from NitzanMordhai/wip-67643-quincy

quincy: mgr/rest: Trim  requests array and limit size

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
9 months agoceph.spec.in: we need jsonnet for all distroes for make check 60074/head
Kyr Shatskyy [Thu, 18 Jul 2024 00:45:26 +0000 (02:45 +0200)]
ceph.spec.in: we need jsonnet for all distroes for make check

Fixes: https://tracker.ceph.com/issues/67938
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
(cherry picked from commit e7139a8f438c2a019de4c1fc8a81d735ca27e35a)

9 months agoMerge pull request #59109 from YiteGu/wip-61396-quincy
SrinivasaBharathKanta [Mon, 30 Sep 2024 23:55:00 +0000 (05:25 +0530)]
Merge pull request #59109 from YiteGu/wip-61396-quincy

quincy: osd/TrackedOp: Fix TrackedOp event order

9 months agoMerge pull request #60048 from zdover23/wip-doc-2024-09-30-backport-60039-to-quincy
Anthony D'Atri [Mon, 30 Sep 2024 04:37:21 +0000 (00:37 -0400)]
Merge pull request #60048 from zdover23/wip-doc-2024-09-30-backport-60039-to-quincy

quincy: doc/rados: edit "Placement Groups Never Get Clean"

9 months agodoc/rados: edit "Placement Groups Never Get Clean" 60048/head
Zac Dover [Sun, 29 Sep 2024 06:10:29 +0000 (16:10 +1000)]
doc/rados: edit "Placement Groups Never Get Clean"

Make grammar improvements (and correct a verb disagreement) in the
section "Placement Groups Never Get Clean" in
doc/rados/troubleshooting/troubleshooting-pg.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2baa027b13c0b4ac8b9fb864858a42e010ca8948)

9 months agoMerge pull request #58871 from kshtsk/wip-quincy-containerized-make-check
kyr [Sun, 29 Sep 2024 15:13:38 +0000 (17:13 +0200)]
Merge pull request #58871 from kshtsk/wip-quincy-containerized-make-check

quincy: run-make-check: use get_processors in run-make-check script

9 months agoMerge pull request #60035 from zdover23/wip-doc-2024-09-28-backport-60030-to-quincy
Anthony D'Atri [Sat, 28 Sep 2024 03:18:55 +0000 (23:18 -0400)]
Merge pull request #60035 from zdover23/wip-doc-2024-09-28-backport-60030-to-quincy

quincy: doc: Document the Windows CI job

9 months agodoc: Document the Windows CI job 60035/head
Lucian Petrut [Fri, 27 Sep 2024 14:09:34 +0000 (14:09 +0000)]
doc: Document the Windows CI job

We're adding a document that describes:

* the steps performed by the Windows CI job
* artifact structure
* frequently asked questions

The document is meant to assist the Ceph developers in investigating
CI failures. This is especially important as the Windows CI job runs
integration tests that would otherwise only be executed by
Teuthology, thus helping catch potential regressions quickly.

Note that the identified regressions are not necessarily Windows
specific, usually affecting Linux builds as well.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit bb7d5b62d9db13ca8c0268d00b8e353443285957)

9 months agoMerge pull request #59317 from k0ste/wip-57417-quincy
Shilpa Jagannath [Thu, 26 Sep 2024 17:33:37 +0000 (10:33 -0700)]
Merge pull request #59317 from k0ste/wip-57417-quincy

quincy: rgw: Get canonical storage class when storage class is empty in

9 months agoMerge pull request #59312 from k0ste/wip-54151-quincy
Shilpa Jagannath [Thu, 26 Sep 2024 17:33:23 +0000 (10:33 -0700)]
Merge pull request #59312 from k0ste/wip-54151-quincy

quincy: rgwlc: fix compat-decoding of cls_rgw_lc_get_entry_ret

9 months agoMerge pull request #59993 from zdover23/wip-doc-2024-09-26-backport-59986-to-quincy
Anthony D'Atri [Thu, 26 Sep 2024 11:35:52 +0000 (07:35 -0400)]
Merge pull request #59993 from zdover23/wip-doc-2024-09-26-backport-59986-to-quincy

quincy: doc: fix typo

9 months agodoc: fix typo 59993/head
N Balachandran [Thu, 26 Sep 2024 04:16:56 +0000 (09:46 +0530)]
doc: fix typo

Fixed a typo in the jaeger traces documentation.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5a11bc00e6c068c965bb7d961feeb47353cc893c)

9 months agoMerge pull request #59909 from zdover23/wip-doc-2024-09-21-backport-59904-to-quincy
Anthony D'Atri [Fri, 20 Sep 2024 17:06:13 +0000 (13:06 -0400)]
Merge pull request #59909 from zdover23/wip-doc-2024-09-21-backport-59904-to-quincy

quincy: doc: Update "Getting Started" to link to start not install

9 months agodoc: Update "Getting Started" to link to start not install 59909/head
Matthew Vernon [Fri, 20 Sep 2024 14:07:37 +0000 (15:07 +0100)]
doc: Update "Getting Started" to link to start not install

Currently the "Getting Started" link points at the install page, not the "Intro to Ceph" section, which seems more appropriate.

If you're happy with this, can it get backported to the still-supported releases, please?

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit d257eacb05a463c93872ae8aa8210806affda4ec)

9 months agoMerge pull request #59873 from zdover23/wip-doc-2024-09-19-backport-59856-to-quincy
Anthony D'Atri [Thu, 19 Sep 2024 11:40:52 +0000 (07:40 -0400)]
Merge pull request #59873 from zdover23/wip-doc-2024-09-19-backport-59856-to-quincy

quincy: doc/rados: add confval directives to health-checks

9 months agoWarning added for slow operations and stalled read in BlueStore. User can control... 59468/head
sajibreadd [Mon, 27 May 2024 07:30:06 +0000 (13:30 +0600)]
Warning added for slow operations and stalled read in BlueStore. User can control how much time the warning should persist after last occurence and maximum number of operations as a threshold will be considered for the warning.

Fixes: https://tracker.ceph.com/issues/62500
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
(cherry picked from commit 73b80a9a2c38259346fb646f85fa2ba4dcbb1329)

Conflicts:
src/blk/BlockDevice.h
src/common/options/global.yaml.in
src/os/bluestore/BlueStore.cc
src/os/bluestore/BlueStore.h
        doc/rados/operations/health-checks.rst

9 months agoMerge pull request #59500 from idryomov/wip-67698-quincy
Ilya Dryomov [Thu, 19 Sep 2024 07:21:01 +0000 (09:21 +0200)]
Merge pull request #59500 from idryomov/wip-67698-quincy

quincy: rbd: "rbd bench" always writes the same byte

Reviewed-by: Mykola Golub <mgolub@suse.com>
9 months agoMerge pull request #59659 from idryomov/wip-67845-quincy
Ilya Dryomov [Thu, 19 Sep 2024 07:19:40 +0000 (09:19 +0200)]
Merge pull request #59659 from idryomov/wip-67845-quincy

quincy: librbd/migration: prune snapshot extents in RawFormat::list_snaps()

Reviewed-by: Ramana Raja <rraja@redhat.com>
9 months agoMerge pull request #59774 from nbalacha/wip-67762-quincy
Ilya Dryomov [Thu, 19 Sep 2024 07:18:28 +0000 (09:18 +0200)]
Merge pull request #59774 from nbalacha/wip-67762-quincy

quincy: rbd-mirror: use correct ioctx for namespace

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
9 months agodoc/rados: add confval directives to health-checks 59873/head
Zac Dover [Wed, 18 Sep 2024 11:36:24 +0000 (21:36 +1000)]
doc/rados: add confval directives to health-checks

Add confval directives to doc/rados/operations/health-checks.rst, as
requested by Anthony D'Atri here: https://github.com/ceph/ceph/pull/59635#pullrequestreview-2286205705

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a159821ddfcecaa75f5a92af7e22ea198d82a8db)

10 months agoMerge pull request #59836 from zdover23/wip-doc-2024-09-17-backport-59788-to-quincy
Zac Dover [Wed, 18 Sep 2024 11:18:22 +0000 (21:18 +1000)]
Merge pull request #59836 from zdover23/wip-doc-2024-09-17-backport-59788-to-quincy

quincy: doc/README.md: create selectable commands

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
10 months agodoc/README.md: create selectable commands 59836/head
Zac Dover [Sat, 14 Sep 2024 08:46:56 +0000 (18:46 +1000)]
doc/README.md: create selectable commands

An indentation of five spaces relative to the previous line creates a
command that is copyable with a single mouse click. This commit adds
those copyabale commands to the procedure in the section "Building
Ceph".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 36c620b04f3a88562d75955b46cc1864de60ce70)

10 months agoMerge pull request #59804 from zdover23/wip-doc-2024-09-16-backport-59801-to-quincy
Anthony D'Atri [Mon, 16 Sep 2024 03:11:08 +0000 (23:11 -0400)]
Merge pull request #59804 from zdover23/wip-doc-2024-09-16-backport-59801-to-quincy

quincy: doc/rados: add osd_deep_scrub_interval setting operation

10 months agodoc/rados: add osd_deep_scrub_interval setting operation 59804/head
Zac Dover [Sun, 15 Sep 2024 11:33:55 +0000 (21:33 +1000)]
doc/rados: add osd_deep_scrub_interval setting operation

Add a second method of changing the value of osd_deep_scrub_interval to
remedy the condition indicated by the "PGs not deep-scrubbed in time"
warning.

This procedure was developed by Eugen Block, and is at the time of this
commit available on his blog at
https://heiterbiswolkig.blogs.nde.ag/2024/09/06/pgs-not-deep-scrubbed-in-time/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f57e99e1731af3affee1c299bb9a79852e31f5ea)

10 months agoMerge pull request #59796 from zdover23/wip-doc-2024-09-15-backport-59613-to-quincy
Anthony D'Atri [Sun, 15 Sep 2024 19:13:25 +0000 (15:13 -0400)]
Merge pull request #59796 from zdover23/wip-doc-2024-09-15-backport-59613-to-quincy

quincy: doc/rados: add link to messenger v2 info in mon-lookup-dns.rst

10 months agoMerge pull request #59800 from zdover23/wip-doc-2024-09-15-backport-59024-to-quincy
Anthony D'Atri [Sun, 15 Sep 2024 19:10:06 +0000 (15:10 -0400)]
Merge pull request #59800 from zdover23/wip-doc-2024-09-15-backport-59024-to-quincy

quincy: doc/README.md - add ordered list

10 months agodoc/README.md - add ordered list 59800/head
Zac Dover [Mon, 5 Aug 2024 13:02:49 +0000 (23:02 +1000)]
doc/README.md - add ordered list

Add ordered-list formatting to the "Building Ceph" section of README.md.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1f21057e4166f2ea9f51ee037eb8e234c1390cfb)

10 months agodoc/rados: add link to messenger v2 info in mon-lookup-dns.rst 59796/head
Zac Dover [Thu, 5 Sep 2024 07:59:15 +0000 (17:59 +1000)]
doc/rados: add link to messenger v2 info in mon-lookup-dns.rst

Add a link to the page about Messenger v2 to the end of
doc/rados/configuration/mon-lookup-dns.rst.

Fixes: https://tracker.ceph.com/issues/58752
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 81f9d064f714f42ff27bf620df526f87b393402b)

10 months agorbd-mirror: use correct ioctx for namespace 59774/head
N Balachandran [Thu, 22 Aug 2024 08:15:36 +0000 (13:45 +0530)]
rbd-mirror: use correct ioctx for namespace

The PoolReplayer uses the ioctx for the default namespace
to check if other namespaces are enabled for mirroring, causing
it to incorrectly conclude that they are all enabled.

Fixes: https://tracker.ceph.com/issues/67676
Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 2346cd912ee2c5aefe5b203cc872e0528fc96a49)

10 months agoMerge pull request #59769 from zdover23/wip-doc-2024-09-13-backport-59438-to-quincy
Anthony D'Atri [Thu, 12 Sep 2024 23:49:08 +0000 (19:49 -0400)]
Merge pull request #59769 from zdover23/wip-doc-2024-09-13-backport-59438-to-quincy

quincy: doc/rgw/d3n: pass cache dir volume to extra_container_args

10 months agoMerge pull request #59651 from guits/wip-63919-quincy
Guillaume Abrioux [Thu, 12 Sep 2024 16:20:14 +0000 (18:20 +0200)]
Merge pull request #59651 from guits/wip-63919-quincy

quincy: ceph-volume: Fix unbound var in disk.get_devices()

10 months agoMerge pull request #59355 from k0ste/wip-64276-quincy
Laura Flores [Thu, 12 Sep 2024 15:19:43 +0000 (10:19 -0500)]
Merge pull request #59355 from k0ste/wip-64276-quincy

quincy: rgw: swift: tempurl fixes for ceph

10 months agoMerge pull request #59338 from k0ste/wip-61633-quincy
Laura Flores [Thu, 12 Sep 2024 15:18:36 +0000 (10:18 -0500)]
Merge pull request #59338 from k0ste/wip-61633-quincy

quincy: rgw : fix add initialization for RGWGC::process()

10 months agodoc/rgw/d3n: pass cache dir volume to extra_container_args 59769/head
Mark Kogan [Mon, 26 Aug 2024 12:44:08 +0000 (15:44 +0300)]
doc/rgw/d3n: pass cache dir volume to extra_container_args

Fixes: https://tracker.ceph.com/issues/66492
Signed-off-by: Mark Kogan <mkogan@ibm.com>
(cherry picked from commit 4594e38bf19a8f73191904f5f373a3707cddd2f3)

10 months agoMerge pull request #59758 from zdover23/wip-doc-2024-09-12-backport-59753-to-quincy
Anthony D'Atri [Thu, 12 Sep 2024 14:00:35 +0000 (10:00 -0400)]
Merge pull request #59758 from zdover23/wip-doc-2024-09-12-backport-59753-to-quincy

quincy: doc/install: Keep the name field of the created user consistent with …

10 months agodoc/install: Keep the name field of the created user consistent with the node name... 59758/head
hejindong [Thu, 12 Sep 2024 07:14:21 +0000 (15:14 +0800)]
doc/install: Keep the name field of the created user consistent with the node name in the Start RADOSGW service command

If the user name does not match the name of the node that started the RADOSGW service, this will cause confusion for those who are new to ceph. Because they can't start the radosgw service normally as shown in the tutorial.

Signed-off-by: hejindong <wodeshijie3394@126.com>
(cherry picked from commit 128e6451d8c4764025d4a2565f15ec175c857bb2)

10 months agoMerge pull request #55336 from guits/wip-64196-quincy
Guillaume Abrioux [Thu, 12 Sep 2024 07:03:49 +0000 (09:03 +0200)]
Merge pull request #55336 from guits/wip-64196-quincy

quincy: ceph-volume: use 'no workqueue' options with dmcrypt

10 months agoMerge pull request #59656 from zdover23/wip-doc-2024-09-08-backport-59628-to-quincy
Anthony D'Atri [Thu, 12 Sep 2024 00:01:18 +0000 (20:01 -0400)]
Merge pull request #59656 from zdover23/wip-doc-2024-09-08-backport-59628-to-quincy

quincy: doc/dev: add "activate latest release" RTD step

10 months agoMerge pull request #59735 from zdover23/wip-doc-2024-09-11-backport-59635-to-quincy
Anthony D'Atri [Wed, 11 Sep 2024 18:30:04 +0000 (14:30 -0400)]
Merge pull request #59735 from zdover23/wip-doc-2024-09-11-backport-59635-to-quincy

quincy: doc/rados: add "pgs not deep scrubbed in time" info

10 months agodoc/rados: add "pgs not deep scrubbed in time" info 59735/head
Zac Dover [Fri, 6 Sep 2024 12:43:59 +0000 (22:43 +1000)]
doc/rados: add "pgs not deep scrubbed in time" info

Add a procedure to doc/rados/operations/health-warnings.rst that
explains how to remedy the "X PGs not deep-scrubbed in time" health
warning.

This procedure was developed by Eugen Block, and is at the time of this
commit available on his blog at
https://heiterbiswolkig.blogs.nde.ag/2024/09/06/pgs-not-deep-scrubbed-in-time/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d620a51c306d1ebcdfc974dc0b85dc46cfde8d40)

10 months agoMerge pull request #58221 from guits/wip-66025-quincy
Guillaume Abrioux [Wed, 11 Sep 2024 11:03:22 +0000 (13:03 +0200)]
Merge pull request #58221 from guits/wip-66025-quincy

quincy: ceph-volume: create LVs when using partitions

10 months agoMerge pull request #58999 from guits/wip-64643-quincy
Guillaume Abrioux [Wed, 11 Sep 2024 11:02:17 +0000 (13:02 +0200)]
Merge pull request #58999 from guits/wip-64643-quincy

quincy: src/ceph-volume/ceph_volume/devices/lvm/listing.py : lvm list filters with vg name

10 months agoceph-volume: fix regex usage in `set_dmcrypt_no_workqueue` 55336/head
Guillaume Abrioux [Wed, 19 Jun 2024 13:06:52 +0000 (15:06 +0200)]
ceph-volume: fix regex usage in `set_dmcrypt_no_workqueue`

- Updated the regex pattern to `r'(\d+\.?)+'` to more accurately
  capture version numbers.

- Replaced `re.match` with `re.search` to properly match the cryptsetup
  version in the output.

- `re.match` only checks for a match at the beginning of the string,
   while `re.search` looks for a match anywhere in the string.

This fix ensures that the function correctly retrieves the
cryptsetup version from the output.

Fixes: https://tracker.ceph.com/issues/66393
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 607eb34b2c278566c386efcbf3018629cf08ccfd)

10 months agoceph-volume: fix set_dmcrypt_no_workqueue()
Guillaume Abrioux [Fri, 7 Jun 2024 08:46:16 +0000 (10:46 +0200)]
ceph-volume: fix set_dmcrypt_no_workqueue()

`set_dmcrypt_no_workqueue()` from `ceph_volume.util.encryption`

The function `set_dmcrypt_no_workqueue` in `encryption.py` now
dynamically retrieves the installed cryptsetup version using `cryptsetup
--version` command. It then parses the version string using a regular
expression to accommodate varying digit counts. If the retrieved version
is greater than or equal to the specified target version,
`conf.dmcrypt_no_workqueue` is set to True, allowing for flexible version
handling.

Fixes: https://tracker.ceph.com/issues/66393
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit dc28b77a6ea50b3390663ac02eeb80367650b7ed)

10 months agoceph-volume: fix partitions support in disk.get_devices()
Guillaume Abrioux [Fri, 26 Jan 2024 20:35:18 +0000 (21:35 +0100)]
ceph-volume: fix partitions support in disk.get_devices()

The following:
```
is_part = get_file_contents(os.path.join(_sys_dev_block_path, item, 'partition')) == "1"
```
assumes any `/sys/dev/block/x:y/partition` contains '1' which is wrong.
This file actually contains the corresponding partition number.

Fixes: https://tracker.ceph.com/issues/64195
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d5d2d1456542829495d3ebbbad6ca2febd7c344d)

10 months agoceph-volume: use 'no workqueue' options with dmcrypt
Guillaume Abrioux [Wed, 8 Nov 2023 16:43:46 +0000 (16:43 +0000)]
ceph-volume: use 'no workqueue' options with dmcrypt

CloudFlare engineers made some testing and realized that using
workqueues with encryption on flash devices has a bad effect.

See [1] for details.

With this patch it will make ceph-volume call crypsetup with
`--perf-no_read_workqueue` and `--perf-no_write_workqueue` options
when the device is not a rotational.

[1] https://blog.cloudflare.com/speeding-up-linux-disk-encryption/

Fixes: https://tracker.ceph.com/issues/64195
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
Co-Authored-by: Stefan Kooman <stefan@kooman.org>
(cherry picked from commit 0985e201342fa53c014a811156aed661b4b8f994)
(cherry picked from commit 956305eb5caf323cfadb772a9a1f910a90aa7740)

10 months agoMerge pull request #59702 from zdover23/wip-doc-2024-09-10-backport-59675-to-quincy
Anthony D'Atri [Tue, 10 Sep 2024 14:31:16 +0000 (10:31 -0400)]
Merge pull request #59702 from zdover23/wip-doc-2024-09-10-backport-59675-to-quincy

quincy: doc/README.md: improve formatting

10 months agoMerge pull request #59684 from zdover23/wip-doc-2024-09-10-backport-59677-to-quincy
Anthony D'Atri [Tue, 10 Sep 2024 14:20:40 +0000 (10:20 -0400)]
Merge pull request #59684 from zdover23/wip-doc-2024-09-10-backport-59677-to-quincy

quincy: doc/man: edit ceph-bluestore-tool.rst

10 months agodoc/README.md: improve formatting 59702/head
Zac Dover [Mon, 9 Sep 2024 15:21:18 +0000 (01:21 +1000)]
doc/README.md: improve formatting

Improve the formatting of the section "Building Ceph" in the file
README.md.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7171f73c81d603f8ff62198fc1e5f50c20a0aa05)

10 months agodoc/man: edit ceph-bluestore-tool.rst 59684/head
Zac Dover [Mon, 9 Sep 2024 19:39:34 +0000 (05:39 +1000)]
doc/man: edit ceph-bluestore-tool.rst

Edit the section "bluefs-bdev-migrate" in
doc/man/8/ceph-bluestore-tool.rst to add the information that this
operation expands the target storage by updating its size label, making
"bluefs-bdev-expand" unnecessary.

Improve the subject-verb agreement in this section, and supply some
absent definite articles.

Co-authored-by: Peter Gervai <grin@drop.grin.hu>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6b34707f827b2b197f53fe2e430d173b30b81401)

10 months agoMerge pull request #59665 from zdover23/wip-doc-2024-09-09-backport-59642-to-quincy
Anthony D'Atri [Mon, 9 Sep 2024 19:41:29 +0000 (15:41 -0400)]
Merge pull request #59665 from zdover23/wip-doc-2024-09-09-backport-59642-to-quincy

quincy: doc/cephadm: add malformed-JSON removal instructions

10 months agoMerge pull request #59639 from zdover23/wip-doc-2024-09-06-backport-59630-to-quincy
Anthony D'Atri [Mon, 9 Sep 2024 13:46:33 +0000 (09:46 -0400)]
Merge pull request #59639 from zdover23/wip-doc-2024-09-06-backport-59630-to-quincy

quincy: doc/README.md: edit "Build Prerequisites"

10 months agodoc/cephadm: add malformed-JSON removal instructions 59665/head
Zac Dover [Fri, 6 Sep 2024 13:31:21 +0000 (23:31 +1000)]
doc/cephadm: add malformed-JSON removal instructions

Add instructions for removing malformed JSON that causes the cephadm
module to fail to start, which in turn makes the orchestrator fail to
start.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 93d90ea358cf17b08e502caf8529061a10008fad)

10 months agolibrbd/migration: don't include ImageState.h in formats 59659/head
Ilya Dryomov [Sun, 1 Sep 2024 13:50:37 +0000 (15:50 +0200)]
librbd/migration: don't include ImageState.h in formats

src_image_ctx, whether dummy for RawFormat and QCOWFormat or real for
NativeFormat, is managed by OpenSourceImageRequest.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8e58a52a408b703b79342670acbeb6c7303ddde7)

Conflicts:
src/librbd/migration/NativeFormat.cc [ commit 293d523ea69a
  ("librbd/migration: add external clusters support") not in
  quincy ]

10 months agolibrbd/migration: prune snapshot extents in RawFormat::list_snaps()
Ilya Dryomov [Sat, 31 Aug 2024 10:33:55 +0000 (12:33 +0200)]
librbd/migration: prune snapshot extents in RawFormat::list_snaps()

list-snaps is exempt from clipping in ImageDispatcher::PreprocessVisitor
because it's considered to be an internal API.  Further, reads issued
by ObjectCopyRequest based on list-snaps results may also be exempt
because of READ_FLAG_DISABLE_CLIPPING.

Since RawFormat allows specifying a set of snapshots (possibly of
varying size!) to be imported, it needs to compensate for that in its
list-snaps implementation.  Otherwise, an out-of-bounds read will
eventually be submitted to the stream.

Fixes: https://tracker.ceph.com/issues/67845
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d9192b5aca156b706f14bd858df6fb3e45050079)

10 months agolibrbd: factor out prune_extents() from prune_parent_extents()
Ilya Dryomov [Sat, 31 Aug 2024 10:00:48 +0000 (12:00 +0200)]
librbd: factor out prune_extents() from prune_parent_extents()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5d64c9c5cda5c1ca44c349cfb9e4f1e9eac21bd5)

Conflicts:
src/librbd/ImageCtx.cc [ ImageArea support not in quincy ]

10 months agodoc/dev: add "activate latest release" RTD step 59656/head
Zac Dover [Thu, 5 Sep 2024 23:31:47 +0000 (09:31 +1000)]
doc/dev: add "activate latest release" RTD step

Add a step to the section called "First Stable Release" that explains
how to activate the latest release in Read the Docs.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e7bd4bcdd074a3defae5866a6c035559bf210271)

10 months agoceph-volume: Fix unbound var in disk.get_devices() 59651/head
Zack Cerza [Thu, 7 Sep 2023 18:58:22 +0000 (11:58 -0700)]
ceph-volume: Fix unbound var in disk.get_devices()

00ba00fdfab8 looks to have regressed.

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 0e95b27402e46c34586f460d2140af48d03fa305)

10 months agodoc/README.md: edit "Build Prerequisites" 59639/head
Zac Dover [Fri, 6 Sep 2024 07:56:27 +0000 (17:56 +1000)]
doc/README.md: edit "Build Prerequisites"

Make the sentences in the "Build Prerequisites" section of README.md
more direct.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0b277fe3809c2eae7bfced002ac85f7e1629fa30)

10 months agoMerge pull request #59600 from idryomov/wip-67752-quincy
Ilya Dryomov [Thu, 5 Sep 2024 16:38:59 +0000 (18:38 +0200)]
Merge pull request #59600 from idryomov/wip-67752-quincy

quincy: rbd: amend "rbd {group,} rename" and "rbd mirror pool" command descriptions

Reviewed-by: Ramana Raja <rraja@redhat.com>
10 months agoMerge pull request #56616 from prazumovsky/wip-63620
Shilpa Jagannath [Wed, 4 Sep 2024 17:48:30 +0000 (10:48 -0700)]
Merge pull request #56616 from prazumovsky/wip-63620

quincy: rgw/swift: preserve dashes/underscores in swift user metadata names

10 months agoMerge pull request #56145 from yuvalif/wip-64793-quincy
Shilpa Jagannath [Wed, 4 Sep 2024 17:47:47 +0000 (10:47 -0700)]
Merge pull request #56145 from yuvalif/wip-64793-quincy

quincy: rgw/notification: Kafka persistent notifications not retried and removed even when the broker is down

10 months agoMerge pull request #56447 from pr0ton11/wip-65005
Casey Bodley [Wed, 4 Sep 2024 12:26:25 +0000 (08:26 -0400)]
Merge pull request #56447 from pr0ton11/wip-65005

quincy: RGW: allow user disabling presigned urls in rgw configuration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
10 months agorbd: mention namespace in "rbd mirror pool" command descriptions 59600/head
Ilya Dryomov [Fri, 30 Aug 2024 12:00:44 +0000 (14:00 +0200)]
rbd: mention namespace in "rbd mirror pool" command descriptions

Commit 5e64748927d0 ("doc/rbd: add namespace information for mirror
commands") did this for the man page, update the built-in help as well.

The "by default" bit in the description of "rbd mirror pool enable" and
"rbd mirror pool disable" commands is specific to pool mode which is in
turn specific to journal-based mirroring, so it's removed.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 7e02946a3f60da0dcc99e0b4a4b6b3d359db1c15)

10 months agorbd: clarify "rbd {group,} rename" command description
Ilya Dryomov [Tue, 27 Aug 2024 18:34:31 +0000 (20:34 +0200)]
rbd: clarify "rbd {group,} rename" command description

Make it clearer that, despite a full image or group spec being taken
for source and destination, an image or a group can be renamed only
within its pool or namespace.

Rename across pools or namespaces within the same pool is unsupported.

Fixes: https://tracker.ceph.com/issues/67752
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5f064a52707af58fd6007734a768899aeb5a32fc)

10 months agoMerge pull request #59584 from zdover23/wip-doc-2024-09-04-backport-59546-to-quincy
Anthony D'Atri [Wed, 4 Sep 2024 11:42:52 +0000 (07:42 -0400)]
Merge pull request #59584 from zdover23/wip-doc-2024-09-04-backport-59546-to-quincy

quincy: doc/rados/operations: Improve health-checks.rst

10 months agoMerge pull request #59587 from zdover23/wip-doc-2024-09-04-backport-59577-to-quincy
Anthony D'Atri [Wed, 4 Sep 2024 11:41:19 +0000 (07:41 -0400)]
Merge pull request #59587 from zdover23/wip-doc-2024-09-04-backport-59577-to-quincy

quincy: doc/mds: improve wording

10 months agoMerge pull request #59561 from zdover23/wip-doc-2024-09-02-backport-59556-to-quincy
Zac Dover [Wed, 4 Sep 2024 01:37:26 +0000 (11:37 +1000)]
Merge pull request #59561 from zdover23/wip-doc-2024-09-02-backport-59556-to-quincy

quincy: doc: Correct link to Prometheus docs

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
10 months agodoc/mds: improve wording 59587/head
Piotr Parczewski [Tue, 3 Sep 2024 11:25:26 +0000 (13:25 +0200)]
doc/mds: improve wording

Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>
(cherry picked from commit 332804bad58c892d01d2d2da557e42104365ef8a)

10 months agodoc/rados/operations: Improve health-checks.rst 59584/head
Anthony D'Atri [Sun, 1 Sep 2024 00:32:17 +0000 (20:32 -0400)]
doc/rados/operations: Improve health-checks.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 2aa82539ede8ade095ad0b22e973eac538354711)

10 months agorgw/notification: Fix Kafka persistent notification breakage that are not retried. 56145/head
kchheda3 [Thu, 26 Oct 2023 19:57:54 +0000 (15:57 -0400)]
rgw/notification: Fix Kafka persistent notification  breakage that are not retried.

Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
(cherry picked from commit b2fadb65ae6a9eb3eaade56e04b08f2b694b220c)

10 months agodoc: Correct link to Prometheus docs 59561/head
Matthew Vernon [Mon, 2 Sep 2024 09:16:36 +0000 (10:16 +0100)]
doc: Correct link to Prometheus docs

The link is to the `#http_sd_config` anchor in the prometheus config docs; that link only works without the trailing `/`.

This correction would ideally get backported to at least reef & squid.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit 84a30ba6b94b34806faac8217ccaa299c9ee68d6)

10 months agoMerge pull request #59550 from zdover23/wip-doc-2024-09-01-backport-59544-to-quincy
Anthony D'Atri [Sun, 1 Sep 2024 15:15:58 +0000 (11:15 -0400)]
Merge pull request #59550 from zdover23/wip-doc-2024-09-01-backport-59544-to-quincy

quincy: doc: update tests-integration-testing-teuthology-workflow.rst

10 months agodoc: update tests-integration-testing-teuthology-workflow.rst 59550/head
Vallari Agrawal [Sat, 31 Aug 2024 14:27:25 +0000 (19:57 +0530)]
doc: update tests-integration-testing-teuthology-workflow.rst

* add "Infrastructure" section.

* move "Naming the ceph-ci branch" section under
   "Getting binaries - Build Ceph". Also mention
   about centos9-only trick.

* in "Teuthology Archives", mention about developer
   playground machines and ceph log files.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
(cherry picked from commit 9bfcb8e17db8c61e523e10856d12b237433d831a)

10 months agoMerge pull request #59542 from zdover23/wip-doc-2024-08-31-backport-59528-to-quincy
Anthony D'Atri [Sat, 31 Aug 2024 14:29:34 +0000 (10:29 -0400)]
Merge pull request #59542 from zdover23/wip-doc-2024-08-31-backport-59528-to-quincy

quincy: doc/ceph-volume: add spillover fix procedure

10 months agodoc/ceph-volume: add spillover fix procedure 59542/head
Zac Dover [Fri, 30 Aug 2024 11:16:57 +0000 (21:16 +1000)]
doc/ceph-volume: add spillover fix procedure

Add a procedure that explains how, after an upgrade, to move bytes that
have spilled over to a relatively slow device back to the faster device.

This procedure was developed by Chris Dunlop on the [ceph-users] mailing
list, here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/POPUFSZGXR3P2RPYPJ4WJ4HGHZ3QESF6/

Eugen Block requested the addition of this procedure to the
documentation on 30 Aug 2024.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 98618aaa1c8b786c7d240a210b62cc737fdb048d)

10 months agoMerge pull request #59359 from k0ste/wip-64380-quincy
Yuri Weinstein [Fri, 30 Aug 2024 19:04:40 +0000 (12:04 -0700)]
Merge pull request #59359 from k0ste/wip-64380-quincy

quincy: rgw/auth/s3: validate x-amz-content-sha256 for empty payloads

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
10 months agoMerge pull request #59132 from k0ste/wip-67133-quincy
Yuri Weinstein [Fri, 30 Aug 2024 19:03:24 +0000 (12:03 -0700)]
Merge pull request #59132 from k0ste/wip-67133-quincy

quincy: osd/ECTransaction: Remove incorrect asserts in generate_transactions

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
10 months agoMerge pull request #59283 from k0ste/wip-65041-quincy
Yuri Weinstein [Fri, 30 Aug 2024 17:53:12 +0000 (10:53 -0700)]
Merge pull request #59283 from k0ste/wip-65041-quincy

quincy: librados: use CEPH_OSD_FLAG_FULL_FORCE for IoCtxImpl::remove

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
10 months agoMerge pull request #59272 from k0ste/wip-63064-quincy
Yuri Weinstein [Fri, 30 Aug 2024 17:52:40 +0000 (10:52 -0700)]
Merge pull request #59272 from k0ste/wip-63064-quincy

quincy: test/cls_lock: expired lock before unlock and start check

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Sunil Angadi <Sunil.Angadi@ibm.com>
10 months agoMerge pull request #59320 from k0ste/wip-58592-quincy
Yuri Weinstein [Fri, 30 Aug 2024 15:06:14 +0000 (08:06 -0700)]
Merge pull request #59320 from k0ste/wip-58592-quincy

quincy: rgw/rgw-gap-list: refactoring and adding more error checking

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>