]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
11 months agodoc/dev/peering: Change acting set num 59064/head
qn2060 [Tue, 6 Aug 2024 16:40:42 +0000 (00:40 +0800)]
doc/dev/peering: Change acting set num

This commit updates the peering doc page with the changed [2,1,2] to [3,1,2]

Signed-off-by: qn2060 <qn2060@users.noreply.github.com>
(cherry picked from commit 103d65ea6787ab16d1824f71578264e0abb9820c)

11 months agoMerge pull request #50538 from k0ste/wip-55502-quincy
Shilpa Jagannath [Tue, 6 Aug 2024 20:24:14 +0000 (13:24 -0700)]
Merge pull request #50538 from k0ste/wip-55502-quincy

quincy: rgw: address crash and race in RGWIndexCompletionManager

11 months agoMerge pull request #55357 from cbodley/wip-64227-quincy
Shilpa Jagannath [Tue, 6 Aug 2024 20:23:51 +0000 (13:23 -0700)]
Merge pull request #55357 from cbodley/wip-64227-quincy

quincy: rgw/rest: fix url decode of post params for iam/sts/sns

11 months agoMerge pull request #58313 from cbodley/wip-66711-quincy
Shilpa Jagannath [Tue, 6 Aug 2024 20:23:00 +0000 (13:23 -0700)]
Merge pull request #58313 from cbodley/wip-66711-quincy

quincy: rgw/notifications/test: fix rabbitmq and kafka issues in centos9

11 months agoMerge pull request #57907 from adamemerson/wip-62292-quincy
Yuri Weinstein [Tue, 6 Aug 2024 15:21:52 +0000 (08:21 -0700)]
Merge pull request #57907 from adamemerson/wip-62292-quincy

quincy: rgw: modify string match_wildcards with fnmatch

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
11 months agoMerge pull request #57405 from ivancich/wip-65891-quincy
Yuri Weinstein [Tue, 6 Aug 2024 15:21:14 +0000 (08:21 -0700)]
Merge pull request #57405 from ivancich/wip-65891-quincy

quincy: rgw: make incomplete multipart upload part of bucket check efficient

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
11 months agoMerge pull request #56119 from mkogan1/wip-64767-quincy
Yuri Weinstein [Tue, 6 Aug 2024 15:20:22 +0000 (08:20 -0700)]
Merge pull request #56119 from mkogan1/wip-64767-quincy

quincy: rgw/beast: Enable SSL session-id reuse speedup mechanism

Reviewed-by: Casey Bodley <cbodley@redhat.com>
11 months agoMerge pull request #51806 from soumyakoduri/wip-skoduri-quincy
Yuri Weinstein [Tue, 6 Aug 2024 15:03:21 +0000 (08:03 -0700)]
Merge pull request #51806 from soumyakoduri/wip-skoduri-quincy

[quincy] RGW backports

Reviewed-by: Mark Kogan <mkogan@redhat.com>
11 months agoMerge pull request #51797 from yuvalif/wip-61478-quincy
Yuri Weinstein [Tue, 6 Aug 2024 15:01:24 +0000 (08:01 -0700)]
Merge pull request #51797 from yuvalif/wip-61478-quincy

quincy: rgw/kafka: remove potential race condition between creation and deletion of endpoint

Reviewed-by: Adam Emerson <aemerson@redhat.com>
11 months agoMerge pull request #59033 from zdover23/wip-doc-2024-08-05-backport-57905-to-quincy
Anthony D'Atri [Tue, 6 Aug 2024 03:19:26 +0000 (23:19 -0400)]
Merge pull request #59033 from zdover23/wip-doc-2024-08-05-backport-57905-to-quincy

quincy: doc/mgr/dashboard: fix TLS typo

11 months agodoc/mgr/dashboard: fix TLS typo 59033/head
Mindy Preston [Wed, 5 Jun 2024 16:58:35 +0000 (11:58 -0500)]
doc/mgr/dashboard: fix TLS typo

Change "SSL/TSL" to "SSL/TLS"

Signed-off-by: Mindy Preston <mcpreston@icecube.wisc.edu>
(cherry picked from commit e63b967aeb00a667ab5c91b9b526c7a19a9539ec)

11 months agoMerge pull request #59009 from zdover23/wip-doc-2024-08-04-backport-59006-to-quincy
Anthony D'Atri [Sun, 4 Aug 2024 13:33:50 +0000 (09:33 -0400)]
Merge pull request #59009 from zdover23/wip-doc-2024-08-04-backport-59006-to-quincy

quincy: doc/glossary: add "ceph-ansible"

11 months agodoc/glossary: add "ceph-ansible" 59009/head
Zac Dover [Fri, 2 Aug 2024 20:51:32 +0000 (06:51 +1000)]
doc/glossary: add "ceph-ansible"

Add a "ceph-ansible" entry to the glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 484e9d2b9d81b6de498ac08125c9a458730dd444)

11 months agoMerge pull request #58852 from idryomov/wip-67051-quincy
Ilya Dryomov [Thu, 1 Aug 2024 17:56:39 +0000 (19:56 +0200)]
Merge pull request #58852 from idryomov/wip-67051-quincy

quincy: qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
11 months agoMerge pull request #58565 from idryomov/wip-rbd-c9-on-quincy
Yuri Weinstein [Thu, 1 Aug 2024 12:50:17 +0000 (05:50 -0700)]
Merge pull request #58565 from idryomov/wip-rbd-c9-on-quincy

quincy: centos 9 related backports for RBD

Reviewed-by: Ramana Raja <rraja@redhat.com>
11 months agoMerge pull request #58208 from idryomov/wip-66300-quincy
Yuri Weinstein [Thu, 1 Aug 2024 12:49:31 +0000 (05:49 -0700)]
Merge pull request #58208 from idryomov/wip-66300-quincy

quincy: librbd: disallow group snap rollback if memberships don't match

Reviewed-by: Ramana Raja <rraja@redhat.com>
11 months agoMerge pull request #58979 from zdover23/wip-doc-2024-08-01-backport-58899-to-quincy
Anthony D'Atri [Thu, 1 Aug 2024 12:17:33 +0000 (08:17 -0400)]
Merge pull request #58979 from zdover23/wip-doc-2024-08-01-backport-58899-to-quincy

quincy: doc/glossary: add "Prometheus"

11 months agoMerge pull request #58975 from zdover23/wip-doc-2024-08-01-backport-58972-to-quincy
Anthony D'Atri [Thu, 1 Aug 2024 12:04:17 +0000 (08:04 -0400)]
Merge pull request #58975 from zdover23/wip-doc-2024-08-01-backport-58972-to-quincy

quincy: doc: Improve doc/radosgw/placement.rst

11 months agodoc/glossary: add "Prometheus" 58979/head
Zac Dover [Mon, 29 Jul 2024 10:19:02 +0000 (20:19 +1000)]
doc/glossary: add "Prometheus"

Add a glossary entry for "Prometheus".

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1a76464999cb2d2cc748d69e1bb0567544a0bb8b)

11 months agodoc: Improve doc/radosgw/placement.rst 58975/head
Anthony D'Atri [Wed, 31 Jul 2024 22:41:53 +0000 (18:41 -0400)]
doc: Improve doc/radosgw/placement.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 5890a156524b8d1fe3a51ea1c76d800e5903a01c)

11 months agoMerge pull request #58949 from zdover23/wip-doc-2024-07-31-backport-58946-to-quincy
Anthony D'Atri [Wed, 31 Jul 2024 01:49:12 +0000 (21:49 -0400)]
Merge pull request #58949 from zdover23/wip-doc-2024-07-31-backport-58946-to-quincy

quincy: doc/rados/operations: remove vanity cluster name reference from crush…

11 months agodoc/rados/operations: remove vanity cluster name reference from crush-map.rst 58949/head
Anthony D'Atri [Wed, 31 Jul 2024 00:45:11 +0000 (20:45 -0400)]
doc/rados/operations: remove vanity cluster name reference from crush-map.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 62562ec65e3c1cc040a57ab77fc219e0aad25651)

11 months agoMerge pull request #58942 from zdover23/wip-doc-2024-07-31-backport-58922-to-quincy
Anthony D'Atri [Wed, 31 Jul 2024 00:50:35 +0000 (20:50 -0400)]
Merge pull request #58942 from zdover23/wip-doc-2024-07-31-backport-58922-to-quincy

quincy: doc/cephadm: edit "Using Custom Images"

11 months agoMerge pull request #58945 from zdover23/wip-doc-2024-07-31-backport-58908-to-quincy
Anthony D'Atri [Wed, 31 Jul 2024 00:48:42 +0000 (20:48 -0400)]
Merge pull request #58945 from zdover23/wip-doc-2024-07-31-backport-58908-to-quincy

quincy: doc/glossary: add "ceph-fuse" entry

11 months agoMerge pull request #58939 from zdover23/wip-doc-2024-07-31-backport-58918-to-quincy
Anthony D'Atri [Wed, 31 Jul 2024 00:39:02 +0000 (20:39 -0400)]
Merge pull request #58939 from zdover23/wip-doc-2024-07-31-backport-58918-to-quincy

quincy: doc/dev: improve basic-workflow.rst

11 months agodoc/glossary: add "ceph-fuse" entry 58945/head
Zac Dover [Mon, 29 Jul 2024 15:50:13 +0000 (01:50 +1000)]
doc/glossary: add "ceph-fuse" entry

Add a "ceph-fuse" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d1c049d24befedc396221dafcc66db8c40acf5ab)

11 months agodoc/cephadm: edit "Using Custom Images" 58942/head
Zac Dover [Tue, 30 Jul 2024 07:33:55 +0000 (17:33 +1000)]
doc/cephadm: edit "Using Custom Images"

Edit the section "Using Custom Images" in
doc/cephadm/services/monitoring.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e99fc5c82fd698c222a489a1ebc26c8fcbca321d)

11 months agodoc/dev: improve basic-workflow.rst 58939/head
Zac Dover [Tue, 30 Jul 2024 06:07:04 +0000 (16:07 +1000)]
doc/dev: improve basic-workflow.rst

Make various improvements to doc/dev/developer_guide/basic-workflow.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b81d6af1b488cdb87143e13da519d70c3a090679)

11 months agoMerge pull request #58601 from cbodley/wip-qa-rgw-quincy-centos9
Casey Bodley [Tue, 30 Jul 2024 20:30:42 +0000 (21:30 +0100)]
Merge pull request #58601 from cbodley/wip-qa-rgw-quincy-centos9

quincy: qa/rgw: adapt tests to centos 9

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>
11 months agoMerge pull request #58758 from adk3798/wip-65957-quincy
Adam King [Mon, 29 Jul 2024 17:21:25 +0000 (13:21 -0400)]
Merge pull request #58758 from adk3798/wip-65957-quincy

quincy: mgr/cephadm: Fix unfound progress events

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #56492 from adk3798/wip-64992-quincy
Adam King [Mon, 29 Jul 2024 17:09:35 +0000 (13:09 -0400)]
Merge pull request #56492 from adk3798/wip-64992-quincy

quincy: mgr/cephadm: refresh public_network for config checks before checking

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #56322 from adk3798/wip-64843-quincy
Adam King [Mon, 29 Jul 2024 17:06:38 +0000 (13:06 -0400)]
Merge pull request #56322 from adk3798/wip-64843-quincy

quincy: ceph-volume: Use safe accessor to get TYPE info

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #56222 from adk3798/quincy-regex-host-pattern
Adam King [Mon, 29 Jul 2024 17:05:15 +0000 (13:05 -0400)]
Merge pull request #56222 from adk3798/quincy-regex-host-pattern

quincy: mgr/cephadm: support for regex based host patterns

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #58903 from zdover23/wip-doc-2024-07-29-backport-58554-to-quincy
Anthony D'Atri [Mon, 29 Jul 2024 14:25:46 +0000 (10:25 -0400)]
Merge pull request #58903 from zdover23/wip-doc-2024-07-29-backport-58554-to-quincy

quincy: docs: removed centos 8 and added squid to the build matrix

11 months agovalgrind: UninitCondition under __run_exit_handlers suppression 58601/head
Mark Kogan [Mon, 21 Aug 2023 17:49:28 +0000 (17:49 +0000)]
valgrind: UninitCondition under __run_exit_handlers suppression

reqiered in CentOS / RHEL 9 & Ubuntu 22.04.1 LTS

Fixes: https://tracker.ceph.com/issues/62141
Signed-off-by: Mark Kogan <mkogan@redhat.com>
(cherry picked from commit 03616b4330080cadf20be440d92e33ca90de254a)

11 months agodocs: removed centos 8 and added squid to the build matrix 58903/head
Yuri Weinstein [Fri, 12 Jul 2024 13:42:02 +0000 (06:42 -0700)]
docs: removed centos 8 and added squid to the build matrix

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 8761bbe16c2a6d19e136254c26d1d67ebe839e3b)

11 months agoMerge pull request #58894 from zdover23/wip-doc-2024-07-28-backport-58884-to-quincy
Anthony D'Atri [Sun, 28 Jul 2024 14:13:05 +0000 (10:13 -0400)]
Merge pull request #58894 from zdover23/wip-doc-2024-07-28-backport-58884-to-quincy

doc/cephfs: fix "OSD capabilities" link

11 months agodoc/cephfs: fix "OSD capabilities" link 58894/head
Zac Dover [Sun, 28 Jul 2024 07:27:53 +0000 (17:27 +1000)]
doc/cephfs: fix "OSD capabilities" link

Fix a broken link from the "OSD capabilites" reference on
doc/cephfs/client-auth.rst.

Fixes: https://tracker.ceph.com/issues/67218
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 74b03a8cb2f196171b10d8cbde27324240649e70)

11 months agoMerge pull request #58855 from idryomov/wip-67097-quincy
Ilya Dryomov [Sat, 27 Jul 2024 15:29:02 +0000 (17:29 +0200)]
Merge pull request #58855 from idryomov/wip-67097-quincy

quincy: qa/suites/krbd: stress test for recovering from watch errors for -o exclusive

Reviewed-by: Ramana Raja <rraja@redhat.com>
11 months agoMerge pull request #58877 from zdover23/wip-doc-2024-07-27-backport-58867-to-quincy
Anthony D'Atri [Sat, 27 Jul 2024 01:11:40 +0000 (21:11 -0400)]
Merge pull request #58877 from zdover23/wip-doc-2024-07-27-backport-58867-to-quincy

quincy: doc/cephfs: fix "file layouts" link

11 months agoMerge pull request #58627 from adk3798/wip-66412-quincy
Adam King [Fri, 26 Jul 2024 17:55:52 +0000 (13:55 -0400)]
Merge pull request #58627 from adk3798/wip-66412-quincy

quincy: mgr/prometheus: s/pkg_resources.packaging/packaging/

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoqa/rgw: remove ragweed from all suites
Casey Bodley [Fri, 26 Jul 2024 15:57:49 +0000 (11:57 -0400)]
qa/rgw: remove ragweed from all suites

Signed-off-by: Casey Bodley <cbodley@redhat.com>
11 months agoqa: pin rgw/crypt suite temporarily to ubuntu_latest
Ali Maredia [Thu, 3 Aug 2023 16:45:01 +0000 (12:45 -0400)]
qa: pin rgw/crypt suite temporarily to ubuntu_latest

barbican tests are only passing on ubunutu latest,
this commit allows us to have a green crypt suite.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit 863f8d789dbb02d70cbdf78790c63802cdd0f24d)

Conflicts:
ubuntu_latest.yaml: no qa/distros/all/ubuntu_latest.yaml, used
ubuntu_20.04.yaml

11 months agoqa: change admin_host to admin_url in barbican.py
Ali Maredia [Thu, 3 Aug 2023 16:39:12 +0000 (12:39 -0400)]
qa: change admin_host to admin_url in barbican.py

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit 43069394c542f252e66453497cca8f195336d3f4)

11 months agoqa: bump keystone version in barbican.yaml
Ali Maredia [Mon, 17 Jul 2023 20:34:14 +0000 (16:34 -0400)]
qa: bump keystone version in barbican.yaml

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit fc12be0fcfabf3ae0040532ad06d91fcb7a94d55)

11 months agoqa: rgw/tempest suite only runs on ubuntu latest
Ali Maredia [Tue, 13 Jun 2023 17:21:14 +0000 (13:21 -0400)]
qa: rgw/tempest suite only runs on ubuntu latest

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit 703effd45bf2c5d7cf8982e07e954a5f2cbb1902)

11 months agoqa: update rgw openstack versions
Tobias Urdin [Fri, 31 Mar 2023 07:10:20 +0000 (07:10 +0000)]
qa: update rgw openstack versions

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit fffa119424bad6e5c6b5ed436978d4319dd54a6b)

11 months agoqa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist
Casey Bodley [Mon, 21 Aug 2023 19:43:04 +0000 (15:43 -0400)]
qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Fixes: https://tracker.ceph.com/issues/62504
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4293d9bf117592a743ec70098cfb2bc1a9d38967)

Conflicts: git got confused about these; unchanged in original commit
qa/suites/rbd/device/ignore-pg-availability.yaml
qa/suites/upgrade/octopus-x/ignore-pg-availability.yaml

qa/suites/rgw/dbstore/ignore-pg-availability.yaml depended on
missing .qa symlink

11 months agorgw/notifications/test: install java for kafka build
Yuval Lifshitz [Sun, 15 Oct 2023 15:54:07 +0000 (15:54 +0000)]
rgw/notifications/test: install java for kafka build

also use kafka binaries insted of building from source

Fixes: https://tracker.ceph.com/issues/63205
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit 2ab7c16737dbf97402907db74d7432a056f2fa97)

11 months agorgw/notifications/test: use dnf and systemctl to setup rabbitmq
Yuval Lifshitz [Sun, 15 Oct 2023 11:31:54 +0000 (11:31 +0000)]
rgw/notifications/test: use dnf and systemctl to setup rabbitmq

Fixes: https://tracker.ceph.com/issues/63205
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit 1ffe4aca2a870600d2946e9432740848600a8ac4)

11 months agoqa/rgw/sts: keycloak task installs java manually
Casey Bodley [Fri, 22 Sep 2023 21:37:33 +0000 (17:37 -0400)]
qa/rgw/sts: keycloak task installs java manually

java had already been installed automatically before centos 9. add an
override to install the jdk-17 packages manually

Fixes: https://tracker.ceph.com/issues/62536
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 06f6a3e6e8ad65e75d640a128338ffa9dc246f4a)

Conflicts:
qa/suites/rgw/sts/tasks/1-keycloak.yaml moved from first.yaml

11 months agoqa/rgw/notifications: pin to centos_latest
Casey Bodley [Wed, 20 Sep 2023 15:11:37 +0000 (11:11 -0400)]
qa/rgw/notifications: pin to centos_latest

the subsuite had a supported-all-distro$/ subdirectory, but that only
contained centos_8.yaml. qa/tasks/rabbitmq.py is hardcoded to use 'yum'
and rpm packages, so replace supported-all-distro$ with a link to
centos_latest.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 2d9348ad564f9199ae58062c1d12b7020cba0790)

11 months agodoc/cephfs: fix "file layouts" link 58877/head
Zac Dover [Fri, 26 Jul 2024 07:15:12 +0000 (17:15 +1000)]
doc/cephfs: fix "file layouts" link

Fix a broken link to the "File Layouts" page on
doc/cephfs/client-auth.rst.

Fixes: https://tracker.ceph.com/issues/67190
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6bb5ce94c6a2cbfdf978a66d00f428ad4cd4c312)

11 months agoMerge pull request #58865 from zdover23/wip-doc-2024-07-26-backport-58838-to-quincy
Anthony D'Atri [Fri, 26 Jul 2024 00:36:36 +0000 (20:36 -0400)]
Merge pull request #58865 from zdover23/wip-doc-2024-07-26-backport-58838-to-quincy

quincy: doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks

11 months agodoc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks 58865/head
Ilya Dryomov [Thu, 25 Jul 2024 07:48:10 +0000 (09:48 +0200)]
doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks

This is due to both using the same name for the lock at the RADOS level
("rbd_lock").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2e83b77c9f610f42765266ff4d4d7bc2a635eac8)

11 months agoqa/suites/krbd: override extra_system_packages directly on install task 58855/head
Ilya Dryomov [Wed, 24 Jul 2024 06:47:51 +0000 (08:47 +0200)]
qa/suites/krbd: override extra_system_packages directly on install task

Follow commit c61cb16223fa ("qa/suites/rbd: override
extra_system_packages directly on install task").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2a9f92f23472dfcb1cb0fabc8572a28e6e5dd91a)

11 months agoqa/suites/krbd: stress test for recovering from watch errors for -o exclusive
Ilya Dryomov [Wed, 24 Jul 2024 06:44:46 +0000 (08:44 +0200)]
qa/suites/krbd: stress test for recovering from watch errors for -o exclusive

This is based on a test added in commit 237aa221ebad ("qa/suites/krbd:
stress test for recovering from watch errors") for regular mappings.

Fixes: https://tracker.ceph.com/issues/67097
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8fee41da8b8cd250bbbd8490604193c0864c1295)

11 months agoqa/workunits/rbd: avoid caching effects in luks-encryption.sh 58852/head
Ilya Dryomov [Fri, 19 Jul 2024 17:35:28 +0000 (19:35 +0200)]
qa/workunits/rbd: avoid caching effects in luks-encryption.sh

Commit 40f6f5224bce ("qa/workunits/rbd: fix issues in
luks-encryption.sh") did the right thing for reads, which solved
most of the issue.  However, it actually made a step in the opposite
direction for writes -- depending on the RBD cache settings, rbd-nbd
virtual devices can behave as physical devices with a volatile write
cache, so fsync is required.

While at it, involving O_DIRECT for reads isn't needed outside of
test_encryption_format().

Fixes: https://tracker.ceph.com/issues/67051
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9e1c0342e9931e898d795d47f923edd3b4324f4a)

Conflicts:
qa/workunits/rbd/luks-encryption.sh [ commit 1d3de19c4005
  ("tools/rbd: add encryption format support for cloned image")
  not in quincy ]

11 months agoqa/workunits/rbd: fix issues in luks-encryption.sh
Or Ozeri [Tue, 7 Jun 2022 07:44:21 +0000 (10:44 +0300)]
qa/workunits/rbd: fix issues in luks-encryption.sh

This commit fixes 2 issues in luks-encryption.sh:
1. Fix sporadic comparison failures due to stale data read from kernel buffer cache.
2. Fix test skipping condition (when journaling is enabled)

Additionally, sudo is removed from most commands.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
(cherry picked from commit 40f6f5224bce0df7b1cf987a06a164340477c3d2)

11 months agoMerge pull request #56231 from adk3798/quincy-docs-typo-replace-osd
Adam King [Thu, 25 Jul 2024 12:24:29 +0000 (08:24 -0400)]
Merge pull request #56231 from adk3798/quincy-docs-typo-replace-osd

quincy: doc: cephadm/services/osd: fix typo

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Zac Dover <zac.dover@proton.me>
11 months agoMerge pull request #58776 from zdover23/wip-doc-2024-07-24-backport-58524-to-quincy
Anthony D'Atri [Wed, 24 Jul 2024 22:28:58 +0000 (18:28 -0400)]
Merge pull request #58776 from zdover23/wip-doc-2024-07-24-backport-58524-to-quincy

quincy: doc/cephfs: streamline a paragraph

11 months agorgw: address crash and race in RGWIndexCompletionManager 50538/head
J. Eric Ivancich [Tue, 12 Apr 2022 18:47:45 +0000 (14:47 -0400)]
rgw: address crash and race in RGWIndexCompletionManager

An atomic int was used in a modulo operator to distribute contention
among a set of locks and to track completions. Because it was an int,
enough increments would cause it to go negative (due to
twos-complement encoding and overflow) thereby causing a
crash. Additionally, even though it was atomic, the read and increment
were separate operations, leading to a race.

This commit addresses both of these issues.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 41f4e83cf5c1c89cd2aa22658716239c4197db0e)

11 months agodoc/cephfs: streamline a paragraph 58776/head
Zac Dover [Wed, 10 Jul 2024 23:15:38 +0000 (09:15 +1000)]
doc/cephfs: streamline a paragraph

Streamline a paragraph in doc/cephfs/index.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 820f8ead8919483df37c751400bd6842d4c1bd92)

11 months agomgr/cephadm: Fix unfound progress events 58758/head
Prashant D [Fri, 3 May 2024 23:32:32 +0000 (19:32 -0400)]
mgr/cephadm: Fix unfound progress events

While applying service specs, cephadm creates a progress event for
the daemons to be added or deleted from the hosts. The progress
event is initialized if progress_total is greater than 0
but at the end cephadm tries to mark the progress event as
complete/fail even though progress event has not been initialized.

Mark progress events as complete/fail only if they are initialized.

Fixes: https://tracker.ceph.com/issues/65799
Signed-off-by: Prashant D <pdhange@redhat.com>
(cherry picked from commit cfcdfd6ae2e0580450cc857123ca35e0d4d2ebea)

11 months agoMerge pull request #58731 from zdover23/wip-doc-2024-07-23-backport-58725-to-quincy
Anthony D'Atri [Mon, 22 Jul 2024 20:15:36 +0000 (16:15 -0400)]
Merge pull request #58731 from zdover23/wip-doc-2024-07-23-backport-58725-to-quincy

quincy: doc/dev_guide: add needs-upgrade-testing label info

11 months agoMerge pull request #58739 from zdover23/wip-doc-2024-07-23-backport-58600-to-quincy
Anthony D'Atri [Mon, 22 Jul 2024 20:12:17 +0000 (16:12 -0400)]
Merge pull request #58739 from zdover23/wip-doc-2024-07-23-backport-58600-to-quincy

quincy: doc/dev: add formatting to basic workflow

11 months agodoc/dev: add formatting to basic workflow 58739/head
Zac Dover [Mon, 15 Jul 2024 16:03:37 +0000 (02:03 +1000)]
doc/dev: add formatting to basic workflow

Add some formatting to a few sections near the end of
doc/dev/developer_guide_basic-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4c4063a09759dc3412d89ecafb9ac55a55e6bc01)

11 months agodoc/dev_guide: add needs-upgrade-testing label info 58731/head
Zac Dover [Mon, 22 Jul 2024 15:36:53 +0000 (01:36 +1000)]
doc/dev_guide: add needs-upgrade-testing label info

Add an explanation of the "needs-upgrade-testing" label and explain when
to use it.

Laura is the true author of this text.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 02d5a6a3371c9fa52a32124cf07da16b89a11e27)

11 months agoMerge pull request #58637 from zdover23/wip-doc-2024-07-16-backport-57685-to-quincy
Zac Dover [Mon, 22 Jul 2024 15:45:53 +0000 (01:45 +1000)]
Merge pull request #58637 from zdover23/wip-doc-2024-07-16-backport-57685-to-quincy

quincy: cephadm: use importlib.metadata for querying ceph_iscsi's version

Reviewed-by: Adam King <adking@redhat.com>
11 months agopybind/mgr/mgr_util: convert certs to bytes before loading them 58627/head
Adam King [Mon, 22 Jul 2024 15:27:26 +0000 (11:27 -0400)]
pybind/mgr/mgr_util: convert certs to bytes before loading them

This function expects to be passed bytes rather than a string.
Mypy complains about failing to do this conversion

mgr_util.py: note: In function "verify_cacrt_content":
mgr_util.py:547: error: Argument 2 to "load_certificate" has incompatible type "str"; expected "bytes"
mgr_util.py: note: In function "verify_tls":
mgr_util.py:584: error: Argument 2 to "load_certificate" has incompatible type "str"; expected "bytes"

Signed-off-by: Adam King <adking@redhat.com>
12 months agoMerge pull request #58698 from zdover23/wip-doc-2024-07-21-backport-58695-to-quincy
Anthony D'Atri [Sat, 20 Jul 2024 19:13:21 +0000 (15:13 -0400)]
Merge pull request #58698 from zdover23/wip-doc-2024-07-21-backport-58695-to-quincy

quincy: doc: Amend dev mailing list subscribe instructions.

12 months agodoc: Amend dev mailing list subscribe instructions. 58698/head
Paulo E. Castro [Sat, 20 Jul 2024 16:32:17 +0000 (17:32 +0100)]
doc: Amend dev mailing list subscribe instructions.

Signed-off-by: Paulo E. Castro <pecastro@wormholenet.com>
(cherry picked from commit 3b0360bc2ea1e0b5f7a7c6b04ade483f77e4b5c6)

12 months agoMerge pull request #58682 from zdover23/wip-doc-2024-07-20-backport-58678-to-quincy
Anthony D'Atri [Fri, 19 Jul 2024 17:50:19 +0000 (13:50 -0400)]
Merge pull request #58682 from zdover23/wip-doc-2024-07-20-backport-58678-to-quincy

quincy: doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

12 months agoMerge pull request #58685 from zdover23/wip-doc-2024-07-20-backport-58671-to-quincy
Anthony D'Atri [Fri, 19 Jul 2024 17:44:31 +0000 (13:44 -0400)]
Merge pull request #58685 from zdover23/wip-doc-2024-07-20-backport-58671-to-quincy

quincy: doc/start: update mailing list links

12 months agodoc/start: update mailing list links 58685/head
Zac Dover [Fri, 19 Jul 2024 06:44:44 +0000 (16:44 +1000)]
doc/start: update mailing list links

Update the User and Dev mailing list subscription links. This commit is
made in response to a request from Dan van der Ster.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a242fe3d940d5764cd766dba8e42449501986765)

12 months agodoc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io 58682/head
Casey Bodley [Fri, 19 Jul 2024 14:10:38 +0000 (10:10 -0400)]
doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9c77963300fee804f249d512c980cdeac06f14f7)

12 months agoMerge pull request #58520 from ljflores/wip-add-c9-rados-quincy
Laura Flores [Thu, 18 Jul 2024 18:20:37 +0000 (13:20 -0500)]
Merge pull request #58520 from ljflores/wip-add-c9-rados-quincy

quincy: qa/distros: replace centos 8 references with centos 9 in the rados suite

12 months agoMerge pull request #58616 from zdover23/wip-doc-2024-07-16-backport-58596-to-quincy
Zac Dover [Thu, 18 Jul 2024 00:39:50 +0000 (10:39 +1000)]
Merge pull request #58616 from zdover23/wip-doc-2024-07-16-backport-58596-to-quincy

quincy: doc: clarify superuser note for ceph-fuse

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
12 months agoMerge pull request #57622 from sajibreadd/wip-65936-quincy
Yuri Weinstein [Wed, 17 Jul 2024 23:10:34 +0000 (16:10 -0700)]
Merge pull request #57622 from sajibreadd/wip-65936-quincy

quincy: os/bluestore: set rocksdb iterator bounds for Bluestore::_collection_list()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #57568 from amathuria/wip-66000-quincy
Yuri Weinstein [Wed, 17 Jul 2024 23:09:57 +0000 (16:09 -0700)]
Merge pull request #57568 from amathuria/wip-66000-quincy

quincy: mgr/pg_autoscaler: add check for norecover flag

Reviewed-by: Laura Flores <lflores@redhat.com>
12 months agoMerge pull request #57620 from sajibreadd/wip-66144-quincy
Yuri Weinstein [Wed, 17 Jul 2024 23:09:09 +0000 (16:09 -0700)]
Merge pull request #57620 from sajibreadd/wip-66144-quincy

quincy: osd: CEPH_OSD_OP_FLAG_BYPASS_CLEAN_CACHE flag is passed from ECBackend

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agoMerge pull request #57521 from pdvian/wip-65942-quincy
Yuri Weinstein [Wed, 17 Jul 2024 23:07:52 +0000 (16:07 -0700)]
Merge pull request #57521 from pdvian/wip-65942-quincy

quincy: mon/LogMonitor: Use generic cluster log level config

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
12 months agoMerge pull request #57243 from sajibreadd/wip-65358-quincy
Yuri Weinstein [Wed, 17 Jul 2024 23:06:57 +0000 (16:06 -0700)]
Merge pull request #57243 from sajibreadd/wip-65358-quincy

quincy: os/bluestore: expand BlueFS log if available space is insufficient

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #57198 from k0ste/wip-63316-quincy
Yuri Weinstein [Wed, 17 Jul 2024 23:05:59 +0000 (16:05 -0700)]
Merge pull request #57198 from k0ste/wip-63316-quincy

quincy: os/bluestore: fix crash caused by dividing by 0

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agocephadm: use importlib.metadata for querying ceph_iscsi's version 58637/head
Kefu Chai [Thu, 23 May 2024 23:21:51 +0000 (07:21 +0800)]
cephadm: use importlib.metadata for querying ceph_iscsi's version

use importlib.metadata for querying ceph_iscsi's version and fallback to
pkg_resources. as the former is only available in Python 3.8, while
the latter is deprecated.

Refs https://tracker.ceph.com/issues/66201
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit cbd4bede7f258823462f27cb15d86e13eb52c359)

Conflicts:
src/cephadm/cephadmlib/daemons/iscsi.py [ this file doesn't
  exist in quincy, get_version() lives in src/cephadm/cephadm ]

12 months agocephadm: extract python() helper to execute python statement
Kefu Chai [Thu, 23 May 2024 23:16:14 +0000 (07:16 +0800)]
cephadm: extract python() helper to execute python statement

to prepare for a change to use importlib, then fallback to
pkg_resources. as the former is only available in Python 3.8, while
the latter is deprecated.

Refs https://tracker.ceph.com/issues/66201
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit be1a8c2c43e97f91bd26554ba9dadc71c499865d)

Conflicts:
src/cephadm/cephadmlib/daemons/iscsi.py [ this file doesn't
  exist in quincy, get_version() lives in src/cephadm/cephadm ]

12 months agoqa/distros/podman: add centos 9 distro to podman 58520/head
Laura Flores [Tue, 16 Jul 2024 17:04:09 +0000 (12:04 -0500)]
qa/distros/podman: add centos 9 distro to podman

This commit, although a direct merge to quincy, is based
on c8873c6591d368e12907669c274fd3d6391e3f68.

The motivation is that centos 8 went end of life, so now
we need to use centos 9.

Signed-off-by: Laura Flores <lflores@ibm.com>
12 months agoqa/suites/rados/thrash-old-clients/0-distros$: test on ubuntu_20.04 and drop nautilus
Laura Flores [Tue, 16 Jul 2024 16:47:35 +0000 (11:47 -0500)]
qa/suites/rados/thrash-old-clients/0-distros$: test on ubuntu_20.04 and drop nautilus

Centos 8 has gone end of life, so we need to choose a different distro on which
to test thrash-old-clients.

thrash-old-clients tests should only support N-3 releases. Nautilus fits with
this, but unfortunately there is no overlapping distro between nautilus, pacific,
octopus, AND quincy (bionic was dropped from quincy, and nautilus does not build
focal). As such, we are only able to test N-2.

Proof that focal is not available for octopus (this is where the test would search for packages):
https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nautilus

Signed-off-by: Laura Flores <lflores@ibm.com>
12 months agoqa/suites/orch/cephadm/workunits/task/test_iscsi_container: switch to centos 9
Laura Flores [Wed, 10 Jul 2024 20:32:53 +0000 (15:32 -0500)]
qa/suites/orch/cephadm/workunits/task/test_iscsi_container: switch to centos 9

Centos 8 went end of life (see https://docs.ceph.com/en/latest/start/os-recommendations/#platforms),
so we will now test on centos 9 for quincy.

Signed-off-by: Laura Flores <lflores@ibm.com>
12 months agomgr/prometheus: s/pkg_resources.packaging/packaging/
Kefu Chai [Sat, 25 May 2024 05:50:43 +0000 (13:50 +0800)]
mgr/prometheus: s/pkg_resources.packaging/packaging/

instead of relying on the internal implementation of pkg_resources,
let's import packaging directly.

in this change, we also add the dependency to the packaging module
in the packaging recipes.

See also https://github.com/pypa/setuptools/issues/4385

Fixes https://tracker.ceph.com/issues/66201
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 844b66de419d7bf5f622980b0de3c69b5ad8bc9c)

Conflicts:
debian/ceph-mgr-modules-core.requires
src/pybind/mgr/prometheus/module.py

12 months agodoc: elide superuser discussion from mount prereq 58616/head
Patrick Donnelly [Mon, 15 Jul 2024 14:18:15 +0000 (10:18 -0400)]
doc: elide superuser discussion from mount prereq

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 7290bdce6f4dd93be88be6ad54030fa90a8c1ec0)

12 months agodoc: clarify superuser note for ceph-fuse
Patrick Donnelly [Mon, 15 Jul 2024 14:12:24 +0000 (10:12 -0400)]
doc: clarify superuser note for ceph-fuse

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit d100de9c9ce884beee6e9551b2b221c686b775b5)

12 months agoMerge pull request #58577 from zdover23/wip-doc-2024-07-14-backport-58451-to-quincy
Zac Dover [Mon, 15 Jul 2024 13:21:20 +0000 (23:21 +1000)]
Merge pull request #58577 from zdover23/wip-doc-2024-07-14-backport-58451-to-quincy

quincy: doc/dev: edit "Principles for format change"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58580 from zdover23/wip-doc-2024-07-15-backport-58574-to-quincy
Anthony D'Atri [Sun, 14 Jul 2024 17:23:08 +0000 (13:23 -0400)]
Merge pull request #58580 from zdover23/wip-doc-2024-07-15-backport-58574-to-quincy

quincy: doc/cephfs: edit "is mount helper present"

12 months agodoc/cephfs: edit "is mount helper present" 58580/head
Zac Dover [Sun, 14 Jul 2024 06:40:14 +0000 (16:40 +1000)]
doc/cephfs: edit "is mount helper present"

Edit the section called "Is mount helper present?", the title of which
prior to this commit was "Is mount helper is present?". Other small
disambiguating improvements have been made to the text in the section.
An unselectable prompt has been added before a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0ebfb3eda8e2fc88662530bbddc84f2efcc4e13c)

12 months agodoc/dev: edit "Principles for format change" 58577/head
Zac Dover [Sun, 7 Jul 2024 03:59:15 +0000 (13:59 +1000)]
doc/dev: edit "Principles for format change"

Improve "Principles for format change" in doc/dev/encoding.rst. This
commit started as a response to Anthony D'Atri's suggestion here: https://github.com/ceph/ceph/pull/58299/files#r1656985564

Review of this section suggested to me that certain minor English usage
improvements would be of benefit. The numbered lists in this section
could still be made a bit clearer.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 570797e5588b67b8c72e5297b61f84d9aa48dc45)

12 months agoMerge pull request #58342 from idryomov/wip-66570-quincy
Ilya Dryomov [Sat, 13 Jul 2024 09:21:45 +0000 (11:21 +0200)]
Merge pull request #58342 from idryomov/wip-66570-quincy

quincy: librbd: make diff-iterate in fast-diff mode aware of encryption

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58539 from idryomov/wip-66886-quincy
Ilya Dryomov [Sat, 13 Jul 2024 08:40:24 +0000 (10:40 +0200)]
Merge pull request #58539 from idryomov/wip-66886-quincy

quincy: qa: account for rbd_trash object in krbd_data_pool.sh + related ceph{,adm} task fixes

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #56414 from zdover23/wip-doc-2024-03-23-backport-56379-to-quincy
Ilya Dryomov [Sat, 13 Jul 2024 07:20:31 +0000 (09:20 +0200)]
Merge pull request #56414 from zdover23/wip-doc-2024-03-23-backport-56379-to-quincy

quincy: doc/install: fix typos in openEuler-installation doc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Rongqi Sun <sunrongqi@huawei.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
12 months agodoc/install: fix typos in openEuler-installation doc 56414/head
Rongqi Sun [Fri, 22 Mar 2024 03:12:09 +0000 (03:12 +0000)]
doc/install: fix typos in openEuler-installation doc

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
(cherry picked from commit 593ab1ad41467898c57c44baeb947bd238cba645)