]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
19 months agomgr/dashboard: disable dashboard v3 in quincy 54250/head
Nizamudeen A [Mon, 30 Oct 2023 15:24:50 +0000 (20:54 +0530)]
mgr/dashboard: disable dashboard v3 in quincy

Fixes: https://tracker.ceph.com/issues/63357
Signed-off-by: Nizamudeen A <nia@redhat.com>
20 months agoMerge pull request #54236 from zdover23/wip-doc-2023-10-30-backport-54232-to-quincy
Anthony D'Atri [Mon, 30 Oct 2023 01:17:39 +0000 (21:17 -0400)]
Merge pull request #54236 from zdover23/wip-doc-2023-10-30-backport-54232-to-quincy

quincy: doc/ceph-volume: improve front matter

20 months agodoc/ceph-volume: improve front matter 54236/head
Zac Dover [Sun, 29 Oct 2023 12:15:13 +0000 (22:15 +1000)]
doc/ceph-volume: improve front matter

Simplify and improve the readability of the front matter of
doc/ceph-volume/lvm/activate.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 23190dd91861d1dcb8d03b78fb378e042394dfad)

20 months agoMerge pull request #54234 from zdover23/wip-doc-2023-10-30-backport-54231-to-quincy
Anthony D'Atri [Mon, 30 Oct 2023 00:29:40 +0000 (20:29 -0400)]
Merge pull request #54234 from zdover23/wip-doc-2023-10-30-backport-54231-to-quincy

quincy: doc/ceph-volume: explain idempotence

20 months agodoc/ceph-volume: explain idempotence 54234/head
Zac Dover [Sun, 29 Oct 2023 12:01:11 +0000 (22:01 +1000)]
doc/ceph-volume: explain idempotence

Improve the grammar of a note explaining that the execution of the call
that activates ceph-volume is idempotent.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e58bc3e4df97d950d96d006b6336e10dbe9327a2)

20 months agoMerge pull request #54229 from zdover23/wip-doc-2023-10-28-backport-54218-to-quincy
Anthony D'Atri [Sat, 28 Oct 2023 14:45:07 +0000 (10:45 -0400)]
Merge pull request #54229 from zdover23/wip-doc-2023-10-28-backport-54218-to-quincy

quincy: doc/rados: edit troubleshooting-pg.rst

20 months agodoc/rados: edit troubleshooting-pg.rst 54229/head
Zac Dover [Fri, 27 Oct 2023 05:22:34 +0000 (15:22 +1000)]
doc/rados: edit troubleshooting-pg.rst

s/placement group/pool/ in a sentence that, prior to this change, was
confusing. Suitable for backports prior to Reef.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 97512a3e3c28d9aae7e61c30bbe66987298960a9)

20 months agoMerge pull request #54221 from zdover23/wip-doc-2023-10-27-backport-53976-to-quincy
zdover23 [Fri, 27 Oct 2023 10:23:38 +0000 (20:23 +1000)]
Merge pull request #54221 from zdover23/wip-doc-2023-10-27-backport-53976-to-quincy

quincy: cephadm: add a --dry-run option to cephadm shell

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
20 months agocephadm: add a --dry-run option to cephadm shell 54221/head
John Mulligan [Wed, 11 Oct 2023 18:05:17 +0000 (14:05 -0400)]
cephadm: add a --dry-run option to cephadm shell

Instead of creating the shell, the --dry-run option prints the container
command that would be used. This can be used as a starting point for
creating custom container commands similar to what cephadm shell would
generate but with tweaks.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit db1e785b2c1a55f4d232b1642573e5672a136190)

doc/cephadm: clean up debugging section

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 4a033788f87859be4da706e38621009474ed3b82)

doc/cephadm: extend container debugging to cover live processes

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit b4e2b3991774fc15f677752a344181920fc1216c)

20 months agoMerge pull request #54175 from rzarzynski/wip-bug-63305
Yuri Weinstein [Wed, 25 Oct 2023 17:07:57 +0000 (10:07 -0700)]
Merge pull request #54175 from rzarzynski/wip-bug-63305

quincy: osd: bring the missed fmt::formatter for snapid_t to address FTBFS

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
20 months agoMerge pull request #54169 from cbodley/wip-quincy-revert-50749
Ilya Dryomov [Wed, 25 Oct 2023 14:34:35 +0000 (16:34 +0200)]
Merge pull request #54169 from cbodley/wip-quincy-revert-50749

quincy: Revert "exporter: user only counter dump/schema commands for extacting counters"

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
20 months agoosd: bring the missed fmt::formatter for snapid_t to address FTBFS 54175/head
Radosław Zarzyński [Tue, 24 Oct 2023 21:50:25 +0000 (23:50 +0200)]
osd: bring the missed fmt::formatter for snapid_t to address FTBFS

This commit is specific to quincy.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
20 months agoRevert "exporter: user only counter dump/schema commands for extacting counters" 54169/head
Casey Bodley [Tue, 24 Oct 2023 15:09:19 +0000 (11:09 -0400)]
Revert "exporter: user only counter dump/schema commands for extacting counters"

This reverts commit 6cc7c069ee1a9fd54def4eb79da16ddf7751add8.

the 'counter' commands are not present on quincy

Signed-off-by: Casey Bodley <cbodley@redhat.com>
20 months agoMerge pull request #54132 from ivancich/wip-quincy-build-wo-mgr
J. Eric Ivancich [Mon, 23 Oct 2023 18:29:14 +0000 (14:29 -0400)]
Merge pull request #54132 from ivancich/wip-quincy-build-wo-mgr

quincy: build: make it possible to build w/o ceph-mgr

Reviewed-by: Casey Bodley <cbodley@redhat.com>
20 months agoMerge pull request #54108 from ceph/revert-53139-wip-62571-quincy
Yuri Weinstein [Mon, 23 Oct 2023 14:42:42 +0000 (07:42 -0700)]
Merge pull request #54108 from ceph/revert-53139-wip-62571-quincy

Revert "quincy: ceph_fs.h: add separate owner_{u,g}id fields"

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #54131 from zdover23/wip-doc-2023-10-21-backport-54107-to-quincy
Anthony D'Atri [Sat, 21 Oct 2023 16:01:43 +0000 (12:01 -0400)]
Merge pull request #54131 from zdover23/wip-doc-2023-10-21-backport-54107-to-quincy

quincy: .github: Clarify checklist details

21 months agoquincy: build: make it possible to build w/o ceph-mgr 54132/head
J. Eric Ivancich [Sat, 21 Oct 2023 01:43:41 +0000 (21:43 -0400)]
quincy: build: make it possible to build w/o ceph-mgr

Fix problematic dependencies w/ ceph-exporter and ceph-mgr.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
21 months ago.github: Clarify checklist details 54131/head
Anthony D'Atri [Thu, 19 Oct 2023 15:28:07 +0000 (11:28 -0400)]
.github: Clarify checklist details

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 1ca356a916910a4016d5d3460d68ea3732f3bad9)

21 months agoMerge pull request #54115 from zdover23/wip-doc-2023-10-20-backport-54084-to-quincy
Anthony D'Atri [Fri, 20 Oct 2023 19:26:30 +0000 (15:26 -0400)]
Merge pull request #54115 from zdover23/wip-doc-2023-10-20-backport-54084-to-quincy

quincy: doc/rados: edit troubleshooting-pg (2 of x)

21 months agodoc/rados: edit troubleshooting-pg (2 of x) 54115/head
Zac Dover [Wed, 18 Oct 2023 22:25:38 +0000 (08:25 +1000)]
doc/rados: edit troubleshooting-pg (2 of x)

Edit doc/rados/troubleshooting/troubleshooting-pg.rst (1 of x).

Follows https://github.com/ceph/ceph/pull/54052.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d0cdfc1d72c4edefb060f8ba9ab130189617cab1)

21 months agoMerge pull request #54112 from zdover23/wip-doc-2023-10-20-backport-54099-to-quincy
Anthony D'Atri [Thu, 19 Oct 2023 22:09:39 +0000 (18:09 -0400)]
Merge pull request #54112 from zdover23/wip-doc-2023-10-20-backport-54099-to-quincy

quincy: doc: Documentation about main Ceph metrics

21 months agodoc: Documentation about main Ceph metrics 54112/head
Juan Miguel Olmo Martínez [Wed, 11 Oct 2023 16:00:15 +0000 (18:00 +0200)]
doc: Documentation about main Ceph metrics

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@ibm.com>
(cherry picked from commit 9bb63bdc8969f2ecdfeedfc8396890ad59f0d796)

21 months agoRevert "quincy: ceph_fs.h: add separate owner_{u,g}id fields" 54108/head
Venky Shankar [Thu, 19 Oct 2023 17:08:42 +0000 (22:38 +0530)]
Revert "quincy: ceph_fs.h: add separate owner_{u,g}id fields"

This seems to be causing test failures:

        https://pulpito.ceph.com/yuriw-2023-10-19_16:09:31-smoke-quincy-release-distro-default-smithi/7432399

Where the MDS crashes with

In function 'CInode* Server::prepare_new_inode(MDRequestRef&, CDir*, inodeno_t, unsigned int, const file_layout_t*)'
3449: FAILED ceph_assert(_inode->gid != (unsigned)-1)

1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14f) [0x7f991631c89e]
2: /usr/lib/ceph/libceph-common.so.2(+0x27eab0) [0x7f991631cab0]
3: (Server::prepare_new_inode(boost::intrusive_ptr<MDRequestImpl>&, CDir*, inodeno_t, unsigned int, file_layout_t const*)+0x2791) [0x55563bec4831]
4: (Server::handle_client_mkdir(boost::intrusive_ptr<MDRequestImpl>&)+0x1ec) [0x55563bede88c]

Revert this change till the failure is fixed.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #54085 from ceph/revert-53647-wip-62289-quincy
Yuri Weinstein [Thu, 19 Oct 2023 16:27:41 +0000 (09:27 -0700)]
Merge pull request #54085 from ceph/revert-53647-wip-62289-quincy

Revert "[DNM] quincy: test: explicitly link to ceph-common for some libcephfs tests"

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
21 months agoRevert "[DNM] quincy: test: explicitly link to ceph-common for some libcephfs tests" 54085/head
Venky Shankar [Thu, 19 Oct 2023 03:52:30 +0000 (09:22 +0530)]
Revert "[DNM] quincy: test: explicitly link to ceph-common for some libcephfs tests"

This got merged inspite of being marked as DNM. @yuriw plans for another round
of quincy build, so if possible let's inculde this in the branch.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #54078 from cbodley/wip-qa-quincy-p2p-upgrade-s3tests
Yuri Weinstein [Wed, 18 Oct 2023 20:26:08 +0000 (13:26 -0700)]
Merge pull request #54078 from cbodley/wip-qa-quincy-p2p-upgrade-s3tests

qa/upgrade/quincy-p2p: remove s3tests

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
21 months agoMerge pull request #54080 from zdover23/wip-doc-2023-10-19-backport-54051-to-quincy
Anthony D'Atri [Wed, 18 Oct 2023 20:04:48 +0000 (16:04 -0400)]
Merge pull request #54080 from zdover23/wip-doc-2023-10-19-backport-54051-to-quincy

quincy: doc: Update mClock QOS documentation to discard osd_mclock_cost_per_*

21 months agodoc: Update mClock QOS documentation to discard osd_mclock_cost_per_* 54080/head
tanchangzhi [Tue, 17 Oct 2023 08:48:51 +0000 (16:48 +0800)]
doc: Update mClock QOS documentation to discard osd_mclock_cost_per_*

The cost parameters (osd_mclock_cost_per_*) have been removed.
The cost of an operation is now determined using the random IOPS
and maximum sequential bandwidth capability of the OSD's underlying device.

Fixes: https://tracker.ceph.com/issues/58529
Signed-off-by: tanchangzhi <544463199@qq.com>
(cherry picked from commit a7502cb5125dda8d052dc3991ed5d7013606aca2)

21 months agoqa/upgrade/quincy-p2p: remove s3tests 54078/head
Casey Bodley [Wed, 18 Oct 2023 18:38:50 +0000 (14:38 -0400)]
qa/upgrade/quincy-p2p: remove s3tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #54065 from pdvian/wip-quincy-test-fixes
Laura Flores [Wed, 18 Oct 2023 17:01:17 +0000 (13:01 -0400)]
Merge pull request #54065 from pdvian/wip-quincy-test-fixes

qa/smoke,rados,perf-basic: add POOL_APP_NOT_ENABLED to ignorelist

21 months agoMerge pull request #54072 from zdover23/wip-doc-2023-10-18-backport-54028-to-quincy
Anthony D'Atri [Wed, 18 Oct 2023 16:50:12 +0000 (12:50 -0400)]
Merge pull request #54072 from zdover23/wip-doc-2023-10-18-backport-54028-to-quincy

quincy: doc/start: Modernize and clarify hardware-recommendations.rst

21 months agoMerge pull request #54074 from zdover23/wip-doc-2023-10-18-backport-54052-to-quincy
Anthony D'Atri [Wed, 18 Oct 2023 16:48:39 +0000 (12:48 -0400)]
Merge pull request #54074 from zdover23/wip-doc-2023-10-18-backport-54052-to-quincy

quincy: doc/rados: edit troubleshooting-pg.rst (1 of x)

21 months agodoc/rados: edit troubleshooting-pg.rst (1 of x) 54074/head
Zac Dover [Tue, 17 Oct 2023 09:13:01 +0000 (19:13 +1000)]
doc/rados: edit troubleshooting-pg.rst (1 of x)

Edit doc/rados/troubleshooting/troubleshooting-pg.rst (1 of x).

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fbde0a441ee753c06afe3723584d6c9686ceef21)

21 months agodoc/start: Modernize and clarify hardware-recommendations.rst 54072/head
Anthony D'Atri [Mon, 16 Oct 2023 01:27:44 +0000 (21:27 -0400)]
doc/start: Modernize and clarify hardware-recommendations.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 83bd3a8dfb83c46a2ba84d9f309a6dbe72c64ea9)

21 months agoqa/smoke,rados,perf-basic: add POOL_APP_NOT_ENABLED to ignorelist 54065/head
Prashant D [Tue, 17 Oct 2023 19:58:34 +0000 (15:58 -0400)]
qa/smoke,rados,perf-basic: add POOL_APP_NOT_ENABLED to ignorelist

Some of the smoke, rados, perf-basic and upgrade-clients tests were
failing due to POOL_APP_NOT_ENABLED health check failure. Add
POOL_APP_NOT_ENABLED to ignorelist for these tests.

Signed-off-by: Prashant D <pdhange@redhat.com>
21 months agoMerge pull request #54064 from zdover23/wip-doc-2023-10-18-backport-52319-to-quincy
zdover23 [Tue, 17 Oct 2023 19:38:54 +0000 (05:38 +1000)]
Merge pull request #54064 from zdover23/wip-doc-2023-10-18-backport-52319-to-quincy

quincy: doc/foundation: Updating foundation members for July 2023

Reviewed-by: Mark Nelson <mark.nelson@clyso.com>
21 months agodoc/foundation: Updating foundation members for July 2023 54064/head
Mike Perez [Wed, 5 Jul 2023 15:31:04 +0000 (08:31 -0700)]
doc/foundation: Updating foundation members for July 2023

Backport to Quincy requested by Mark Nelson, because a Google
search was returning the Quincy page, which as of 2023 is outdated.

Signed-off-by: Mike Perez <thingee@gmail.com>
(cherry picked from commit 640390906f76da4bfd66bcd8006e964d6e73c98e)

21 months agoMerge pull request #54027 from zdover23/wip-doc-2023-10-16-backport-54022-to-quincy
Anthony D'Atri [Sun, 15 Oct 2023 23:54:30 +0000 (19:54 -0400)]
Merge pull request #54027 from zdover23/wip-doc-2023-10-16-backport-54022-to-quincy

quincy: doc/rados: Edit troubleshooting-osd (3 of x)

21 months agodoc/rados: Edit troubleshooting-osd (3 of x) 54027/head
Zac Dover [Sun, 15 Oct 2023 12:43:39 +0000 (22:43 +1000)]
doc/rados: Edit troubleshooting-osd (3 of x)

Edit doc/rados/troubleshooting/troubleshooting-osd.rst (3 of x).

Follows https://github.com/ceph/ceph/pull/53986.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 01b5aa5d27a97a02cef03b9eb0ee9dbcd55684f1)

21 months agoMerge pull request #54001 from zdover23/wip-doc-2023-10-13-backport-53986-to-quincy
zdover23 [Fri, 13 Oct 2023 14:01:17 +0000 (00:01 +1000)]
Merge pull request #54001 from zdover23/wip-doc-2023-10-13-backport-53986-to-quincy

quincy: doc/rados: Edit troubleshooting-osd (2 of x)

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
21 months agodoc/rados: Edit troubleshooting-osd (2 of x) 54001/head
Zac Dover [Thu, 12 Oct 2023 08:33:58 +0000 (18:33 +1000)]
doc/rados: Edit troubleshooting-osd (2 of x)

Edit doc/rados/troubleshooting/troubleshooting.rst (2 of x).

Follows https://github.com/ceph/ceph/pull/53936.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 37e7099267996a3075b4902a10a19d94fc738c08)

21 months agoMerge pull request #53920 from ajarr/wip-63155-quincy
Yuri Weinstein [Thu, 12 Oct 2023 22:27:40 +0000 (15:27 -0700)]
Merge pull request #53920 from ajarr/wip-63155-quincy

quincy: librbd: kick ExclusiveLock state machine stalled waiting for lock from reacquire_lock()

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
21 months agoMerge pull request #52553 from k0ste/wip-62092-quincy
Laura Flores [Thu, 12 Oct 2023 20:33:53 +0000 (16:33 -0400)]
Merge pull request #52553 from k0ste/wip-62092-quincy

quincy:  mon: fix iterator mishandling in PGMap::apply_incremental

21 months agoMerge pull request #53983 from zdover23/wip-doc-2023-10-12-backport-53936-to-quincy
Anthony D'Atri [Thu, 12 Oct 2023 09:03:05 +0000 (05:03 -0400)]
Merge pull request #53983 from zdover23/wip-doc-2023-10-12-backport-53936-to-quincy

quincy: doc/rados: edit troubleshooting-osd (1 of x)

21 months agodoc/rados: edit troubleshooting-osd (1 of x) 53983/head
Zac Dover [Wed, 11 Oct 2023 10:38:55 +0000 (20:38 +1000)]
doc/rados: edit troubleshooting-osd (1 of x)

Edit doc/rados/troubleshooting/troubleshooting-osd.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0fc663d793fe34e42e19b251fcc79b5af52581c6)

21 months agoMerge pull request #53725 from kamoltat/wip-ksirivad-quincy-backport-51921
Laura Flores [Wed, 11 Oct 2023 18:42:13 +0000 (14:42 -0400)]
Merge pull request #53725 from kamoltat/wip-ksirivad-quincy-backport-51921

quincy: pybind/mgr/pg_autoscaler: Use bytes_used for actual_raw_used

21 months agoMerge pull request #53852 from batrick/wip-63081-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:41:08 +0000 (08:41 -0700)]
Merge pull request #53852 from batrick/wip-63081-quincy

quincy: mds/FSMap: allow upgrades if no up mds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53557 from batrick/wip-62732-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:40:35 +0000 (08:40 -0700)]
Merge pull request #53557 from batrick/wip-62732-quincy

quincy: mds: add event for batching getattr/lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53485 from batrick/wip-62853-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:40:07 +0000 (08:40 -0700)]
Merge pull request #53485 from batrick/wip-62853-quincy

quincy: qa: ignore expected cluster warning from damage tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #52653 from joscollin/wip-62176-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:39:37 +0000 (08:39 -0700)]
Merge pull request #52653 from joscollin/wip-62176-quincy

quincy: qa: fix cephfs-mirror unwinding and 'fs volume create/rm' order

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53785 from idryomov/wip-63010-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:24:35 +0000 (08:24 -0700)]
Merge pull request #53785 from idryomov/wip-63010-quincy

quincy: qa/suites/krbd: stress test for recovering from watch errors

Reviewed-by: Mykola Golub <mgolub@suse.com>
21 months agoMerge pull request #53933 from zdover23/wip-doc-2023-10-11-backport-53908-to-quincy
zdover23 [Wed, 11 Oct 2023 04:10:42 +0000 (14:10 +1000)]
Merge pull request #53933 from zdover23/wip-doc-2023-10-11-backport-53908-to-quincy

quincy: doc/rados: edit memory-profiling.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
21 months agodoc/rados: edit memory-profiling.rst 53933/head
Zac Dover [Tue, 10 Oct 2023 08:26:53 +0000 (18:26 +1000)]
doc/rados: edit memory-profiling.rst

Edit doc/rados/troubleshooting/memory-profiling.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3be932425e3020085db5abff6f914938015d8590)

21 months agoMerge pull request #53675 from kamoltat/wip-ksirivad-quincy-backport-51923
Yuri Weinstein [Tue, 10 Oct 2023 15:27:06 +0000 (08:27 -0700)]
Merge pull request #53675 from kamoltat/wip-ksirivad-quincy-backport-51923

quincy: pybind/mgr/pg_autoscaler: fix warn when not too few pgs

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #53895 from cbodley/wip-62743-quincy
Yuri Weinstein [Tue, 10 Oct 2023 15:02:55 +0000 (08:02 -0700)]
Merge pull request #53895 from cbodley/wip-62743-quincy

quincy: qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53821 from cfsnyder/wip-62943-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:32:16 +0000 (07:32 -0700)]
Merge pull request #53821 from cfsnyder/wip-62943-quincy

quincy: rgw: add radosgw-admin bucket check olh/unlinked commands

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53774 from cbodley/wip-63056-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:31:38 +0000 (07:31 -0700)]
Merge pull request #53774 from cbodley/wip-63056-quincy

quincy: rgw: improve buffer list utilization in the chunkupload scenario

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53771 from cbodley/wip-63053-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:30:54 +0000 (07:30 -0700)]
Merge pull request #53771 from cbodley/wip-63053-quincy

quincy: rgw: fix SignatureDoesNotMatch when extra headers start with 'x-amz'

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53768 from cbodley/wip-63050-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:30:09 +0000 (07:30 -0700)]
Merge pull request #53768 from cbodley/wip-63050-quincy

quincy: rgw: s3website doesn't prefetch for web_dir() check

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53766 from cbodley/wip-63047-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:29:19 +0000 (07:29 -0700)]
Merge pull request #53766 from cbodley/wip-63047-quincy

quincy: rgw: fix rgw rate limiting RGWRateLimitInfo class decode_json max_rea…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53761 from cbodley/wip-63059-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:28:19 +0000 (07:28 -0700)]
Merge pull request #53761 from cbodley/wip-63059-quincy

quincy: rgw: fix unwatch crash at radosgw startup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53757 from cbodley/wip-63041-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:27:18 +0000 (07:27 -0700)]
Merge pull request #53757 from cbodley/wip-63041-quincy

quincy: [CVE-2023-43040] rgw: Fix bucket validation against POST policies

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agolibrbd/ManagedLock: kickstart ExclusiveLock state machine 53920/head
Ramana Raja [Mon, 2 Oct 2023 16:39:26 +0000 (12:39 -0400)]
librbd/ManagedLock: kickstart ExclusiveLock state machine

... that is stalled waiting for lock. Do this when trying to reacquire
lock in the ImageWatcher's rewatch mechanism. This would enable the
ExclusiveLock state machine to propagate the blocklist error to the
caller trying to perform an image operation requiring an exclusive
lock.

Previous attempt, e66db763, to fix the hang due to exclusive lock
acquisiton (stuck waiting for lock) racing with client blocklisting
did not always work. e66db763 kickstarted the ExclusiveLock state
machine when the ImageWatcher tried to schedule a exclusive lock
request and the blocklisting was detected. However, there is a short
window between a watch getting deregistered and client blocklisting
getting detected as part of rewatching. If hit when trying to schedule
a lock request, the ExclusiveLock state machine wasn't kickstarted,
blocklist error wasn't propagated, and the hang resurfaced.

A more robust approach is taken to resume the ExclusiveLock state
machine stuck waiting for lock during client blocklisting. Whenever
a client's ImageWatcher loses connection to the cluster, as it happens
during blocklising, the ImageWatcher initiates a mechanism to rewatch
the image and tries to reacquire the lock. Piggyback on this rewatch
mechanism that gets triggered during client blocklisting. And when
trying to reacquire the lock, kickstart the ExclusiveLock state
machine stalled waiting for lock (STATE_WAITING_FOR_LOCK).

Fixes: https://tracker.ceph.com/issues/63009
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 18b018578cf8ac51a7e7a7d25f62d7bde345461a)

21 months agoMerge pull request #53573 from kotreshhr/wip-62404-quincy
Venky Shankar [Tue, 10 Oct 2023 10:17:20 +0000 (15:47 +0530)]
Merge pull request #53573 from kotreshhr/wip-62404-quincy

quincy:    mgr/volumes: Fix pending_subvolume_deletions in volume info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53860 from ljflores/wip-63126-quincy
Yuri Weinstein [Mon, 9 Oct 2023 23:23:06 +0000 (16:23 -0700)]
Merge pull request #53860 from ljflores/wip-63126-quincy

quincy: osd: fix: slow scheduling when item_cost is large

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
21 months agoMerge pull request #51412 from ifed01/wip-ifed-fix-fit-to-fast-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:10:47 +0000 (15:10 -0700)]
Merge pull request #51412 from ifed01/wip-ifed-fix-fit-to-fast-qui

quincy: os/bluestore: allow 'fit_to_fast' selector for single-volume osd

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #50636 from ifed01/wip-ifed-bound-rm-range-keys-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:09:55 +0000 (15:09 -0700)]
Merge pull request #50636 from ifed01/wip-ifed-bound-rm-range-keys-qui

quincy: kv/RocksDBStore: cumulative backport for rm_range_keys and around

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #50495 from ifed01/wip-ifed-fix-prefixed-kv-iterator-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:09:05 +0000 (15:09 -0700)]
Merge pull request #50495 from ifed01/wip-ifed-fix-prefixed-kv-iterator-qui

quincy: kv/RocksDBStore: don't use real wholespace iterator for prefixed access

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #50323 from ifed01/wip-ifed-57271-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:08:24 +0000 (15:08 -0700)]
Merge pull request #50323 from ifed01/wip-ifed-57271-qui

quincy: blk/KernelDevice: Modify the rotational and discard check log message

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #49984 from ifed01/wip-ifed-fix-read-error-code-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:07:26 +0000 (15:07 -0700)]
Merge pull request #49984 from ifed01/wip-ifed-fix-read-error-code-qui

quincy: blk/kernel: Fix error code mapping in KernelDevice::read.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #48170 from ifed01/wip-ifed-fix-alloc-dump-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:06:15 +0000 (15:06 -0700)]
Merge pull request #48170 from ifed01/wip-ifed-fix-alloc-dump-qui

quincy: os/bluestore: proper locking for Allocators' dump methods

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #48169 from ifed01/wip-ifed-fix-bluefs-truncate-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:04:39 +0000 (15:04 -0700)]
Merge pull request #48169 from ifed01/wip-ifed-fix-bluefs-truncate-qui

quincy: os/bluestore: fix no metadata update on truncate+fsync

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #53898 from zdover23/wip-doc-2023-10-10-backport-53890-to-quincy
Anthony D'Atri [Mon, 9 Oct 2023 20:47:52 +0000 (16:47 -0400)]
Merge pull request #53898 from zdover23/wip-doc-2023-10-10-backport-53890-to-quincy

quincy: doc/rados: edit troubleshooting-mon.rst (4 of x)

21 months agoqa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist 53895/head
Casey Bodley [Mon, 21 Aug 2023 19:43:04 +0000 (15:43 -0400)]
qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Fixes: https://tracker.ceph.com/issues/62504
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4293d9bf117592a743ec70098cfb2bc1a9d38967)

21 months agodoc/rados: edit troubleshooting-mon.rst (4 of x) 53898/head
Zac Dover [Mon, 9 Oct 2023 08:55:07 +0000 (18:55 +1000)]
doc/rados: edit troubleshooting-mon.rst (4 of x)

Edit doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/53875

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 99e92fb94b2c29e565e3f4e04658e103a09ef125)

21 months agoMerge pull request #53863 from vshankar/tr-62538
Yuri Weinstein [Mon, 9 Oct 2023 18:37:03 +0000 (11:37 -0700)]
Merge pull request #53863 from vshankar/tr-62538

quincy: qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53647 from vshankar/wip-62289-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:36:24 +0000 (11:36 -0700)]
Merge pull request #53647 from vshankar/wip-62289-quincy

[DNM] quincy: test: explicitly link to ceph-common for some libcephfs tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53639 from vshankar/wip-62948-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:35:38 +0000 (11:35 -0700)]
Merge pull request #53639 from vshankar/wip-62948-quincy

quincy: cephfs-mirror: do not run concurrent C_RestartMirroring context

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53454 from joscollin/wip-62835-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:33:38 +0000 (11:33 -0700)]
Merge pull request #53454 from joscollin/wip-62835-quincy

quincy: cephfs-top: include the missing fields in --dump output

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53330 from vshankar/tr-62585
Yuri Weinstein [Mon, 9 Oct 2023 18:32:34 +0000 (11:32 -0700)]
Merge pull request #53330 from vshankar/tr-62585

quincy: mds: blocklist clients with "bloated" session metadata

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53285 from vshankar/tr-61804
Yuri Weinstein [Mon, 9 Oct 2023 18:31:07 +0000 (11:31 -0700)]
Merge pull request #53285 from vshankar/tr-61804

quincy: cephfs-journal-tool: disambiguate usage of all keyword (in tool help).

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53242 from batrick/wip-62660-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:30:12 +0000 (11:30 -0700)]
Merge pull request #53242 from batrick/wip-62660-quincy

quincy: mds: drop locks and retry when lock set changes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53188 from batrick/wip-62607-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:29:30 +0000 (11:29 -0700)]
Merge pull request #53188 from batrick/wip-62607-quincy

quincy: mgr: register OSDs in ms_handle_accept

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
21 months agoMerge pull request #53184 from batrick/wip-62516-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:28:50 +0000 (11:28 -0700)]
Merge pull request #53184 from batrick/wip-62516-quincy

quincy: mds: acquire inode snaplock in open

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53167 from leonid-s-usov/bp/cap-throttle-event/quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:28:01 +0000 (11:28 -0700)]
Merge pull request #53167 from leonid-s-usov/bp/cap-throttle-event/quincy

quincy: mds/Server: mark a cap acquisition throttle event in the request

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoqa/rgw: add POOL_APP_NOT_ENABLED to log-ignorelist
Casey Bodley [Mon, 15 May 2023 18:26:48 +0000 (14:26 -0400)]
qa/rgw: add POOL_APP_NOT_ENABLED to log-ignorelist

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f0d53e56f8d05090a5f429c8826ca552e0140798)

21 months agoMerge pull request #53414 from trociny/wip-62507-quincy
Yuri Weinstein [Mon, 9 Oct 2023 15:12:12 +0000 (08:12 -0700)]
Merge pull request #53414 from trociny/wip-62507-quincy

quincy: rgw: handle http options CORS with v4 auth

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoqa: typo fix when checking for perf counter - s/md_thresh_evicted/mdthresh_evicted 53330/head
Venky Shankar [Mon, 9 Oct 2023 04:29:45 +0000 (09:59 +0530)]
qa: typo fix when checking for perf counter - s/md_thresh_evicted/mdthresh_evicted

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 5856a1e6b72dc77d3b4d9109385481b924e4fe36)

21 months agoqa: lower mds_session_metadata_threshold for tests
Venky Shankar [Sat, 7 Oct 2023 15:12:29 +0000 (20:42 +0530)]
qa: lower mds_session_metadata_threshold for tests

... and increase the number of files that are created so as to
hit the threshold with a high probability.

Fixes: http://tracker.ceph.com/issues/62873
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 92200d9d10d30ed35f640fd1120be65577a3ce64)

21 months agoMerge pull request #53880 from zdover23/wip-doc-2023-10-08-backport-53875-to-quincy
Anthony D'Atri [Sun, 8 Oct 2023 12:53:22 +0000 (08:53 -0400)]
Merge pull request #53880 from zdover23/wip-doc-2023-10-08-backport-53875-to-quincy

quincy: doc/rados: edit troubleshooting-mon.rst (3 of x)

21 months agoMerge pull request #53882 from zdover23/wip-doc-2023-10-08-backport-53874-to-quincy
Anthony D'Atri [Sun, 8 Oct 2023 12:51:29 +0000 (08:51 -0400)]
Merge pull request #53882 from zdover23/wip-doc-2023-10-08-backport-53874-to-quincy

quincy: doc/rados: edit troubleshooting/community.rst

21 months agodoc/rados: edit troubleshooting/community.rst 53882/head
Zac Dover [Sat, 7 Oct 2023 20:39:23 +0000 (06:39 +1000)]
doc/rados: edit troubleshooting/community.rst

Edit doc/rados/troubleshooting/community.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fabfec273474a85cf3687ddf89183f0607c2ad71)

21 months agodoc/rados: edit troubleshooting-mon.rst (3 of x) 53880/head
Zac Dover [Sat, 7 Oct 2023 21:33:17 +0000 (07:33 +1000)]
doc/rados: edit troubleshooting-mon.rst (3 of x)

Edit doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/52827

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fc45a0c4dd0247f472a940d6c92e7acdb0cdc354)

21 months agoMerge pull request #53878 from zdover23/wip-doc-2023-10-08-backport-53876-to-quincy
Anthony D'Atri [Sun, 8 Oct 2023 01:55:00 +0000 (21:55 -0400)]
Merge pull request #53878 from zdover23/wip-doc-2023-10-08-backport-53876-to-quincy

quincy: doc/architecture: repair RBD sentence

21 months agodoc/architecture: repair RBD sentence 53878/head
Zac Dover [Sat, 7 Oct 2023 21:43:43 +0000 (07:43 +1000)]
doc/architecture: repair RBD sentence

Improve an ambiguous sentence in doc/architecture.rst.

The problem presented by the original sentence is that the phrasal verb
"to provide with" is implicated in one of its possible readings.
Interpreted in that way, the sentence seems to express the incorrect
idea that RBD furnishes block devices with snapshotting and cloning, as
though snapshotting and cloning are being delivered to the block
devices. In fact, snapshotting and cloning are just features of RBD, and
are features that are described on this page:
https://docs.ceph.com/en/quincy/rbd/rbd-snapshot/.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5abd530460e3d5a60142d9350d93544402b6dec4)

21 months agoMerge pull request #53664 from lxbsz/wip-62519
Yuri Weinstein [Sat, 7 Oct 2023 22:04:59 +0000 (15:04 -0700)]
Merge pull request #53664 from lxbsz/wip-62519

quincy: client: move the Inode to new auth mds session when changing auth cap

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53663 from lxbsz/wip-62522
Yuri Weinstein [Sat, 7 Oct 2023 22:04:10 +0000 (15:04 -0700)]
Merge pull request #53663 from lxbsz/wip-62522

quincy: ceph: allow xlock state to be LOCK_PREXLOCK when putting it

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoqa: use exisitng ignorelist override list for fs:mirror[-ha] 53863/head
Venky Shankar [Tue, 12 Sep 2023 10:21:05 +0000 (15:51 +0530)]
qa: use exisitng ignorelist override list for fs:mirror[-ha]

The custom ignorelist yaml would also require `POOL_APP_NOT_ENABLED`
to be ignored. The custom yaml is unnecessary anyway.

Fixes: http://tracker.ceph.com/issues/62482
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit a728d170cc8e610c7dbb952197303de7b083c650)

21 months agoMerge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy
zdover23 [Sat, 7 Oct 2023 05:33:26 +0000 (16:33 +1100)]
Merge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy

quincy: doc/architecture: edit "Peering and Sets"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
21 months agodoc/architecture: edit "Peering and Sets" 53872/head
Zac Dover [Tue, 3 Oct 2023 12:11:50 +0000 (22:11 +1000)]
doc/architecture: edit "Peering and Sets"

Edit the English in the section "Peering and Sets" in the file
doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c69b111966f190ac4a1ebd5244a9cf9f61970dd7)