]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
20 months agoqa/tests: removed rgw tests wip-yuriw-q-p2p-quincy 54106/head
Yuri Weinstein [Thu, 19 Oct 2023 14:40:27 +0000 (07:40 -0700)]
qa/tests: removed rgw tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
20 months agoMerge pull request #54078 from cbodley/wip-qa-quincy-p2p-upgrade-s3tests
Yuri Weinstein [Wed, 18 Oct 2023 20:26:08 +0000 (13:26 -0700)]
Merge pull request #54078 from cbodley/wip-qa-quincy-p2p-upgrade-s3tests

qa/upgrade/quincy-p2p: remove s3tests

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
20 months agoMerge pull request #54080 from zdover23/wip-doc-2023-10-19-backport-54051-to-quincy
Anthony D'Atri [Wed, 18 Oct 2023 20:04:48 +0000 (16:04 -0400)]
Merge pull request #54080 from zdover23/wip-doc-2023-10-19-backport-54051-to-quincy

quincy: doc: Update mClock QOS documentation to discard osd_mclock_cost_per_*

20 months agodoc: Update mClock QOS documentation to discard osd_mclock_cost_per_* 54080/head
tanchangzhi [Tue, 17 Oct 2023 08:48:51 +0000 (16:48 +0800)]
doc: Update mClock QOS documentation to discard osd_mclock_cost_per_*

The cost parameters (osd_mclock_cost_per_*) have been removed.
The cost of an operation is now determined using the random IOPS
and maximum sequential bandwidth capability of the OSD's underlying device.

Fixes: https://tracker.ceph.com/issues/58529
Signed-off-by: tanchangzhi <544463199@qq.com>
(cherry picked from commit a7502cb5125dda8d052dc3991ed5d7013606aca2)

20 months agoqa/upgrade/quincy-p2p: remove s3tests 54078/head
Casey Bodley [Wed, 18 Oct 2023 18:38:50 +0000 (14:38 -0400)]
qa/upgrade/quincy-p2p: remove s3tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #54065 from pdvian/wip-quincy-test-fixes
Laura Flores [Wed, 18 Oct 2023 17:01:17 +0000 (13:01 -0400)]
Merge pull request #54065 from pdvian/wip-quincy-test-fixes

qa/smoke,rados,perf-basic: add POOL_APP_NOT_ENABLED to ignorelist

21 months agoMerge pull request #54072 from zdover23/wip-doc-2023-10-18-backport-54028-to-quincy
Anthony D'Atri [Wed, 18 Oct 2023 16:50:12 +0000 (12:50 -0400)]
Merge pull request #54072 from zdover23/wip-doc-2023-10-18-backport-54028-to-quincy

quincy: doc/start: Modernize and clarify hardware-recommendations.rst

21 months agoMerge pull request #54074 from zdover23/wip-doc-2023-10-18-backport-54052-to-quincy
Anthony D'Atri [Wed, 18 Oct 2023 16:48:39 +0000 (12:48 -0400)]
Merge pull request #54074 from zdover23/wip-doc-2023-10-18-backport-54052-to-quincy

quincy: doc/rados: edit troubleshooting-pg.rst (1 of x)

21 months agodoc/rados: edit troubleshooting-pg.rst (1 of x) 54074/head
Zac Dover [Tue, 17 Oct 2023 09:13:01 +0000 (19:13 +1000)]
doc/rados: edit troubleshooting-pg.rst (1 of x)

Edit doc/rados/troubleshooting/troubleshooting-pg.rst (1 of x).

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fbde0a441ee753c06afe3723584d6c9686ceef21)

21 months agodoc/start: Modernize and clarify hardware-recommendations.rst 54072/head
Anthony D'Atri [Mon, 16 Oct 2023 01:27:44 +0000 (21:27 -0400)]
doc/start: Modernize and clarify hardware-recommendations.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 83bd3a8dfb83c46a2ba84d9f309a6dbe72c64ea9)

21 months agoqa/smoke,rados,perf-basic: add POOL_APP_NOT_ENABLED to ignorelist 54065/head
Prashant D [Tue, 17 Oct 2023 19:58:34 +0000 (15:58 -0400)]
qa/smoke,rados,perf-basic: add POOL_APP_NOT_ENABLED to ignorelist

Some of the smoke, rados, perf-basic and upgrade-clients tests were
failing due to POOL_APP_NOT_ENABLED health check failure. Add
POOL_APP_NOT_ENABLED to ignorelist for these tests.

Signed-off-by: Prashant D <pdhange@redhat.com>
21 months agoMerge pull request #54064 from zdover23/wip-doc-2023-10-18-backport-52319-to-quincy
zdover23 [Tue, 17 Oct 2023 19:38:54 +0000 (05:38 +1000)]
Merge pull request #54064 from zdover23/wip-doc-2023-10-18-backport-52319-to-quincy

quincy: doc/foundation: Updating foundation members for July 2023

Reviewed-by: Mark Nelson <mark.nelson@clyso.com>
21 months agodoc/foundation: Updating foundation members for July 2023 54064/head
Mike Perez [Wed, 5 Jul 2023 15:31:04 +0000 (08:31 -0700)]
doc/foundation: Updating foundation members for July 2023

Backport to Quincy requested by Mark Nelson, because a Google
search was returning the Quincy page, which as of 2023 is outdated.

Signed-off-by: Mike Perez <thingee@gmail.com>
(cherry picked from commit 640390906f76da4bfd66bcd8006e964d6e73c98e)

21 months agoMerge pull request #54027 from zdover23/wip-doc-2023-10-16-backport-54022-to-quincy
Anthony D'Atri [Sun, 15 Oct 2023 23:54:30 +0000 (19:54 -0400)]
Merge pull request #54027 from zdover23/wip-doc-2023-10-16-backport-54022-to-quincy

quincy: doc/rados: Edit troubleshooting-osd (3 of x)

21 months agodoc/rados: Edit troubleshooting-osd (3 of x) 54027/head
Zac Dover [Sun, 15 Oct 2023 12:43:39 +0000 (22:43 +1000)]
doc/rados: Edit troubleshooting-osd (3 of x)

Edit doc/rados/troubleshooting/troubleshooting-osd.rst (3 of x).

Follows https://github.com/ceph/ceph/pull/53986.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 01b5aa5d27a97a02cef03b9eb0ee9dbcd55684f1)

21 months agoMerge pull request #54001 from zdover23/wip-doc-2023-10-13-backport-53986-to-quincy
zdover23 [Fri, 13 Oct 2023 14:01:17 +0000 (00:01 +1000)]
Merge pull request #54001 from zdover23/wip-doc-2023-10-13-backport-53986-to-quincy

quincy: doc/rados: Edit troubleshooting-osd (2 of x)

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
21 months agodoc/rados: Edit troubleshooting-osd (2 of x) 54001/head
Zac Dover [Thu, 12 Oct 2023 08:33:58 +0000 (18:33 +1000)]
doc/rados: Edit troubleshooting-osd (2 of x)

Edit doc/rados/troubleshooting/troubleshooting.rst (2 of x).

Follows https://github.com/ceph/ceph/pull/53936.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 37e7099267996a3075b4902a10a19d94fc738c08)

21 months agoMerge pull request #53920 from ajarr/wip-63155-quincy
Yuri Weinstein [Thu, 12 Oct 2023 22:27:40 +0000 (15:27 -0700)]
Merge pull request #53920 from ajarr/wip-63155-quincy

quincy: librbd: kick ExclusiveLock state machine stalled waiting for lock from reacquire_lock()

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
21 months agoMerge pull request #52553 from k0ste/wip-62092-quincy
Laura Flores [Thu, 12 Oct 2023 20:33:53 +0000 (16:33 -0400)]
Merge pull request #52553 from k0ste/wip-62092-quincy

quincy:  mon: fix iterator mishandling in PGMap::apply_incremental

21 months agoMerge pull request #53983 from zdover23/wip-doc-2023-10-12-backport-53936-to-quincy
Anthony D'Atri [Thu, 12 Oct 2023 09:03:05 +0000 (05:03 -0400)]
Merge pull request #53983 from zdover23/wip-doc-2023-10-12-backport-53936-to-quincy

quincy: doc/rados: edit troubleshooting-osd (1 of x)

21 months agodoc/rados: edit troubleshooting-osd (1 of x) 53983/head
Zac Dover [Wed, 11 Oct 2023 10:38:55 +0000 (20:38 +1000)]
doc/rados: edit troubleshooting-osd (1 of x)

Edit doc/rados/troubleshooting/troubleshooting-osd.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0fc663d793fe34e42e19b251fcc79b5af52581c6)

21 months agoMerge pull request #53725 from kamoltat/wip-ksirivad-quincy-backport-51921
Laura Flores [Wed, 11 Oct 2023 18:42:13 +0000 (14:42 -0400)]
Merge pull request #53725 from kamoltat/wip-ksirivad-quincy-backport-51921

quincy: pybind/mgr/pg_autoscaler: Use bytes_used for actual_raw_used

21 months agoMerge pull request #53852 from batrick/wip-63081-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:41:08 +0000 (08:41 -0700)]
Merge pull request #53852 from batrick/wip-63081-quincy

quincy: mds/FSMap: allow upgrades if no up mds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53557 from batrick/wip-62732-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:40:35 +0000 (08:40 -0700)]
Merge pull request #53557 from batrick/wip-62732-quincy

quincy: mds: add event for batching getattr/lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53485 from batrick/wip-62853-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:40:07 +0000 (08:40 -0700)]
Merge pull request #53485 from batrick/wip-62853-quincy

quincy: qa: ignore expected cluster warning from damage tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #52653 from joscollin/wip-62176-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:39:37 +0000 (08:39 -0700)]
Merge pull request #52653 from joscollin/wip-62176-quincy

quincy: qa: fix cephfs-mirror unwinding and 'fs volume create/rm' order

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53785 from idryomov/wip-63010-quincy
Yuri Weinstein [Wed, 11 Oct 2023 15:24:35 +0000 (08:24 -0700)]
Merge pull request #53785 from idryomov/wip-63010-quincy

quincy: qa/suites/krbd: stress test for recovering from watch errors

Reviewed-by: Mykola Golub <mgolub@suse.com>
21 months agoMerge pull request #53933 from zdover23/wip-doc-2023-10-11-backport-53908-to-quincy
zdover23 [Wed, 11 Oct 2023 04:10:42 +0000 (14:10 +1000)]
Merge pull request #53933 from zdover23/wip-doc-2023-10-11-backport-53908-to-quincy

quincy: doc/rados: edit memory-profiling.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
21 months agodoc/rados: edit memory-profiling.rst 53933/head
Zac Dover [Tue, 10 Oct 2023 08:26:53 +0000 (18:26 +1000)]
doc/rados: edit memory-profiling.rst

Edit doc/rados/troubleshooting/memory-profiling.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3be932425e3020085db5abff6f914938015d8590)

21 months agoMerge pull request #53675 from kamoltat/wip-ksirivad-quincy-backport-51923
Yuri Weinstein [Tue, 10 Oct 2023 15:27:06 +0000 (08:27 -0700)]
Merge pull request #53675 from kamoltat/wip-ksirivad-quincy-backport-51923

quincy: pybind/mgr/pg_autoscaler: fix warn when not too few pgs

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #53895 from cbodley/wip-62743-quincy
Yuri Weinstein [Tue, 10 Oct 2023 15:02:55 +0000 (08:02 -0700)]
Merge pull request #53895 from cbodley/wip-62743-quincy

quincy: qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53821 from cfsnyder/wip-62943-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:32:16 +0000 (07:32 -0700)]
Merge pull request #53821 from cfsnyder/wip-62943-quincy

quincy: rgw: add radosgw-admin bucket check olh/unlinked commands

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53774 from cbodley/wip-63056-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:31:38 +0000 (07:31 -0700)]
Merge pull request #53774 from cbodley/wip-63056-quincy

quincy: rgw: improve buffer list utilization in the chunkupload scenario

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53771 from cbodley/wip-63053-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:30:54 +0000 (07:30 -0700)]
Merge pull request #53771 from cbodley/wip-63053-quincy

quincy: rgw: fix SignatureDoesNotMatch when extra headers start with 'x-amz'

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53768 from cbodley/wip-63050-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:30:09 +0000 (07:30 -0700)]
Merge pull request #53768 from cbodley/wip-63050-quincy

quincy: rgw: s3website doesn't prefetch for web_dir() check

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53766 from cbodley/wip-63047-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:29:19 +0000 (07:29 -0700)]
Merge pull request #53766 from cbodley/wip-63047-quincy

quincy: rgw: fix rgw rate limiting RGWRateLimitInfo class decode_json max_rea…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53761 from cbodley/wip-63059-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:28:19 +0000 (07:28 -0700)]
Merge pull request #53761 from cbodley/wip-63059-quincy

quincy: rgw: fix unwatch crash at radosgw startup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53757 from cbodley/wip-63041-quincy
Yuri Weinstein [Tue, 10 Oct 2023 14:27:18 +0000 (07:27 -0700)]
Merge pull request #53757 from cbodley/wip-63041-quincy

quincy: [CVE-2023-43040] rgw: Fix bucket validation against POST policies

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agolibrbd/ManagedLock: kickstart ExclusiveLock state machine 53920/head
Ramana Raja [Mon, 2 Oct 2023 16:39:26 +0000 (12:39 -0400)]
librbd/ManagedLock: kickstart ExclusiveLock state machine

... that is stalled waiting for lock. Do this when trying to reacquire
lock in the ImageWatcher's rewatch mechanism. This would enable the
ExclusiveLock state machine to propagate the blocklist error to the
caller trying to perform an image operation requiring an exclusive
lock.

Previous attempt, e66db763, to fix the hang due to exclusive lock
acquisiton (stuck waiting for lock) racing with client blocklisting
did not always work. e66db763 kickstarted the ExclusiveLock state
machine when the ImageWatcher tried to schedule a exclusive lock
request and the blocklisting was detected. However, there is a short
window between a watch getting deregistered and client blocklisting
getting detected as part of rewatching. If hit when trying to schedule
a lock request, the ExclusiveLock state machine wasn't kickstarted,
blocklist error wasn't propagated, and the hang resurfaced.

A more robust approach is taken to resume the ExclusiveLock state
machine stuck waiting for lock during client blocklisting. Whenever
a client's ImageWatcher loses connection to the cluster, as it happens
during blocklising, the ImageWatcher initiates a mechanism to rewatch
the image and tries to reacquire the lock. Piggyback on this rewatch
mechanism that gets triggered during client blocklisting. And when
trying to reacquire the lock, kickstart the ExclusiveLock state
machine stalled waiting for lock (STATE_WAITING_FOR_LOCK).

Fixes: https://tracker.ceph.com/issues/63009
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 18b018578cf8ac51a7e7a7d25f62d7bde345461a)

21 months agoMerge pull request #53573 from kotreshhr/wip-62404-quincy
Venky Shankar [Tue, 10 Oct 2023 10:17:20 +0000 (15:47 +0530)]
Merge pull request #53573 from kotreshhr/wip-62404-quincy

quincy:    mgr/volumes: Fix pending_subvolume_deletions in volume info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53860 from ljflores/wip-63126-quincy
Yuri Weinstein [Mon, 9 Oct 2023 23:23:06 +0000 (16:23 -0700)]
Merge pull request #53860 from ljflores/wip-63126-quincy

quincy: osd: fix: slow scheduling when item_cost is large

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
21 months agoMerge pull request #51412 from ifed01/wip-ifed-fix-fit-to-fast-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:10:47 +0000 (15:10 -0700)]
Merge pull request #51412 from ifed01/wip-ifed-fix-fit-to-fast-qui

quincy: os/bluestore: allow 'fit_to_fast' selector for single-volume osd

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #50636 from ifed01/wip-ifed-bound-rm-range-keys-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:09:55 +0000 (15:09 -0700)]
Merge pull request #50636 from ifed01/wip-ifed-bound-rm-range-keys-qui

quincy: kv/RocksDBStore: cumulative backport for rm_range_keys and around

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #50495 from ifed01/wip-ifed-fix-prefixed-kv-iterator-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:09:05 +0000 (15:09 -0700)]
Merge pull request #50495 from ifed01/wip-ifed-fix-prefixed-kv-iterator-qui

quincy: kv/RocksDBStore: don't use real wholespace iterator for prefixed access

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #50323 from ifed01/wip-ifed-57271-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:08:24 +0000 (15:08 -0700)]
Merge pull request #50323 from ifed01/wip-ifed-57271-qui

quincy: blk/KernelDevice: Modify the rotational and discard check log message

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #49984 from ifed01/wip-ifed-fix-read-error-code-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:07:26 +0000 (15:07 -0700)]
Merge pull request #49984 from ifed01/wip-ifed-fix-read-error-code-qui

quincy: blk/kernel: Fix error code mapping in KernelDevice::read.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #48170 from ifed01/wip-ifed-fix-alloc-dump-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:06:15 +0000 (15:06 -0700)]
Merge pull request #48170 from ifed01/wip-ifed-fix-alloc-dump-qui

quincy: os/bluestore: proper locking for Allocators' dump methods

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #48169 from ifed01/wip-ifed-fix-bluefs-truncate-qui
Yuri Weinstein [Mon, 9 Oct 2023 22:04:39 +0000 (15:04 -0700)]
Merge pull request #48169 from ifed01/wip-ifed-fix-bluefs-truncate-qui

quincy: os/bluestore: fix no metadata update on truncate+fsync

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
21 months agoMerge pull request #53898 from zdover23/wip-doc-2023-10-10-backport-53890-to-quincy
Anthony D'Atri [Mon, 9 Oct 2023 20:47:52 +0000 (16:47 -0400)]
Merge pull request #53898 from zdover23/wip-doc-2023-10-10-backport-53890-to-quincy

quincy: doc/rados: edit troubleshooting-mon.rst (4 of x)

21 months agoqa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist 53895/head
Casey Bodley [Mon, 21 Aug 2023 19:43:04 +0000 (15:43 -0400)]
qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Fixes: https://tracker.ceph.com/issues/62504
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4293d9bf117592a743ec70098cfb2bc1a9d38967)

21 months agodoc/rados: edit troubleshooting-mon.rst (4 of x) 53898/head
Zac Dover [Mon, 9 Oct 2023 08:55:07 +0000 (18:55 +1000)]
doc/rados: edit troubleshooting-mon.rst (4 of x)

Edit doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/53875

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 99e92fb94b2c29e565e3f4e04658e103a09ef125)

21 months agoMerge pull request #53863 from vshankar/tr-62538
Yuri Weinstein [Mon, 9 Oct 2023 18:37:03 +0000 (11:37 -0700)]
Merge pull request #53863 from vshankar/tr-62538

quincy: qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53647 from vshankar/wip-62289-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:36:24 +0000 (11:36 -0700)]
Merge pull request #53647 from vshankar/wip-62289-quincy

[DNM] quincy: test: explicitly link to ceph-common for some libcephfs tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53639 from vshankar/wip-62948-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:35:38 +0000 (11:35 -0700)]
Merge pull request #53639 from vshankar/wip-62948-quincy

quincy: cephfs-mirror: do not run concurrent C_RestartMirroring context

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53454 from joscollin/wip-62835-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:33:38 +0000 (11:33 -0700)]
Merge pull request #53454 from joscollin/wip-62835-quincy

quincy: cephfs-top: include the missing fields in --dump output

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53330 from vshankar/tr-62585
Yuri Weinstein [Mon, 9 Oct 2023 18:32:34 +0000 (11:32 -0700)]
Merge pull request #53330 from vshankar/tr-62585

quincy: mds: blocklist clients with "bloated" session metadata

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53285 from vshankar/tr-61804
Yuri Weinstein [Mon, 9 Oct 2023 18:31:07 +0000 (11:31 -0700)]
Merge pull request #53285 from vshankar/tr-61804

quincy: cephfs-journal-tool: disambiguate usage of all keyword (in tool help).

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53242 from batrick/wip-62660-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:30:12 +0000 (11:30 -0700)]
Merge pull request #53242 from batrick/wip-62660-quincy

quincy: mds: drop locks and retry when lock set changes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53188 from batrick/wip-62607-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:29:30 +0000 (11:29 -0700)]
Merge pull request #53188 from batrick/wip-62607-quincy

quincy: mgr: register OSDs in ms_handle_accept

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
21 months agoMerge pull request #53184 from batrick/wip-62516-quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:28:50 +0000 (11:28 -0700)]
Merge pull request #53184 from batrick/wip-62516-quincy

quincy: mds: acquire inode snaplock in open

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53167 from leonid-s-usov/bp/cap-throttle-event/quincy
Yuri Weinstein [Mon, 9 Oct 2023 18:28:01 +0000 (11:28 -0700)]
Merge pull request #53167 from leonid-s-usov/bp/cap-throttle-event/quincy

quincy: mds/Server: mark a cap acquisition throttle event in the request

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoqa/rgw: add POOL_APP_NOT_ENABLED to log-ignorelist
Casey Bodley [Mon, 15 May 2023 18:26:48 +0000 (14:26 -0400)]
qa/rgw: add POOL_APP_NOT_ENABLED to log-ignorelist

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f0d53e56f8d05090a5f429c8826ca552e0140798)

21 months agoMerge pull request #53414 from trociny/wip-62507-quincy
Yuri Weinstein [Mon, 9 Oct 2023 15:12:12 +0000 (08:12 -0700)]
Merge pull request #53414 from trociny/wip-62507-quincy

quincy: rgw: handle http options CORS with v4 auth

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoqa: typo fix when checking for perf counter - s/md_thresh_evicted/mdthresh_evicted 53330/head
Venky Shankar [Mon, 9 Oct 2023 04:29:45 +0000 (09:59 +0530)]
qa: typo fix when checking for perf counter - s/md_thresh_evicted/mdthresh_evicted

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 5856a1e6b72dc77d3b4d9109385481b924e4fe36)

21 months agoqa: lower mds_session_metadata_threshold for tests
Venky Shankar [Sat, 7 Oct 2023 15:12:29 +0000 (20:42 +0530)]
qa: lower mds_session_metadata_threshold for tests

... and increase the number of files that are created so as to
hit the threshold with a high probability.

Fixes: http://tracker.ceph.com/issues/62873
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 92200d9d10d30ed35f640fd1120be65577a3ce64)

21 months agoMerge pull request #53880 from zdover23/wip-doc-2023-10-08-backport-53875-to-quincy
Anthony D'Atri [Sun, 8 Oct 2023 12:53:22 +0000 (08:53 -0400)]
Merge pull request #53880 from zdover23/wip-doc-2023-10-08-backport-53875-to-quincy

quincy: doc/rados: edit troubleshooting-mon.rst (3 of x)

21 months agoMerge pull request #53882 from zdover23/wip-doc-2023-10-08-backport-53874-to-quincy
Anthony D'Atri [Sun, 8 Oct 2023 12:51:29 +0000 (08:51 -0400)]
Merge pull request #53882 from zdover23/wip-doc-2023-10-08-backport-53874-to-quincy

quincy: doc/rados: edit troubleshooting/community.rst

21 months agodoc/rados: edit troubleshooting/community.rst 53882/head
Zac Dover [Sat, 7 Oct 2023 20:39:23 +0000 (06:39 +1000)]
doc/rados: edit troubleshooting/community.rst

Edit doc/rados/troubleshooting/community.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fabfec273474a85cf3687ddf89183f0607c2ad71)

21 months agodoc/rados: edit troubleshooting-mon.rst (3 of x) 53880/head
Zac Dover [Sat, 7 Oct 2023 21:33:17 +0000 (07:33 +1000)]
doc/rados: edit troubleshooting-mon.rst (3 of x)

Edit doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/52827

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit fc45a0c4dd0247f472a940d6c92e7acdb0cdc354)

21 months agoMerge pull request #53878 from zdover23/wip-doc-2023-10-08-backport-53876-to-quincy
Anthony D'Atri [Sun, 8 Oct 2023 01:55:00 +0000 (21:55 -0400)]
Merge pull request #53878 from zdover23/wip-doc-2023-10-08-backport-53876-to-quincy

quincy: doc/architecture: repair RBD sentence

21 months agodoc/architecture: repair RBD sentence 53878/head
Zac Dover [Sat, 7 Oct 2023 21:43:43 +0000 (07:43 +1000)]
doc/architecture: repair RBD sentence

Improve an ambiguous sentence in doc/architecture.rst.

The problem presented by the original sentence is that the phrasal verb
"to provide with" is implicated in one of its possible readings.
Interpreted in that way, the sentence seems to express the incorrect
idea that RBD furnishes block devices with snapshotting and cloning, as
though snapshotting and cloning are being delivered to the block
devices. In fact, snapshotting and cloning are just features of RBD, and
are features that are described on this page:
https://docs.ceph.com/en/quincy/rbd/rbd-snapshot/.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5abd530460e3d5a60142d9350d93544402b6dec4)

21 months agoMerge pull request #53664 from lxbsz/wip-62519
Yuri Weinstein [Sat, 7 Oct 2023 22:04:59 +0000 (15:04 -0700)]
Merge pull request #53664 from lxbsz/wip-62519

quincy: client: move the Inode to new auth mds session when changing auth cap

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53663 from lxbsz/wip-62522
Yuri Weinstein [Sat, 7 Oct 2023 22:04:10 +0000 (15:04 -0700)]
Merge pull request #53663 from lxbsz/wip-62522

quincy: ceph: allow xlock state to be LOCK_PREXLOCK when putting it

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoqa: use exisitng ignorelist override list for fs:mirror[-ha] 53863/head
Venky Shankar [Tue, 12 Sep 2023 10:21:05 +0000 (15:51 +0530)]
qa: use exisitng ignorelist override list for fs:mirror[-ha]

The custom ignorelist yaml would also require `POOL_APP_NOT_ENABLED`
to be ignored. The custom yaml is unnecessary anyway.

Fixes: http://tracker.ceph.com/issues/62482
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit a728d170cc8e610c7dbb952197303de7b083c650)

21 months agoMerge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy
zdover23 [Sat, 7 Oct 2023 05:33:26 +0000 (16:33 +1100)]
Merge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy

quincy: doc/architecture: edit "Peering and Sets"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
21 months agodoc/architecture: edit "Peering and Sets" 53872/head
Zac Dover [Tue, 3 Oct 2023 12:11:50 +0000 (22:11 +1000)]
doc/architecture: edit "Peering and Sets"

Edit the English in the section "Peering and Sets" in the file
doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c69b111966f190ac4a1ebd5244a9cf9f61970dd7)

21 months agoMerge pull request #52799 from cbodley/wip-62302-quincy
Shilpa Jagannath [Fri, 6 Oct 2023 18:03:14 +0000 (14:03 -0400)]
Merge pull request #52799 from cbodley/wip-62302-quincy

quincy: rgw: retry metadata cache notifications with INVALIDATE_OBJ

21 months agoRevert "Revert "Merge PR #53077 into main""
Venky Shankar [Fri, 8 Sep 2023 08:41:13 +0000 (14:11 +0530)]
Revert "Revert "Merge PR #53077 into main""

This reverts commit af4558f0ac3b0dc23a8b3cbba63b9c8acc498ea4.

Fixes: http://tracker.ceph.com/issues/62482
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 7d5795dc37fc903121f2caa584bec55773fb61ee)

21 months agoqa: do not create rbd pool for CephFS QA
Patrick Donnelly [Thu, 17 Aug 2023 13:27:45 +0000 (09:27 -0400)]
qa: do not create rbd pool for CephFS QA

Fixes: https://tracker.ceph.com/issues/62482
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 636d2a44c7a935426788ed61e9a77432dc49ca5e)

21 months agoRevert "Merge PR #53077 into main"
Patrick Donnelly [Mon, 28 Aug 2023 13:16:10 +0000 (09:16 -0400)]
Revert "Merge PR #53077 into main"

This reverts commit b8bf0c62b96cb76ae547d5d2f13d2a68417e79e9, reversing
changes made to fe07f64396e504c373bd1b621dda0b7893753fe8.

Silencing this health warning is unnecessary if we stop creating the rbd pool
in CephFS testing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit af4558f0ac3b0dc23a8b3cbba63b9c8acc498ea4)

21 months agoqa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests
Venky Shankar [Tue, 22 Aug 2023 06:14:55 +0000 (11:44 +0530)]
qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests

Fixes: http://tracker.ceph.com/issues/62508
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 97b76a480b9708f8557222de14058f644746a4a6)

21 months agoosd: fix: slow scheduling when item_cost is large 53860/head
jrchyang [Tue, 12 Sep 2023 09:31:28 +0000 (09:31 +0000)]
osd: fix: slow scheduling when item_cost is large

We use the iops and bandwidth tested by
`ceph tell osd.0 bench 10737418240 204800 204800 100`
to verify the QoS function. iops was 400 and bandwidth was 80MiB/s.
When osd_mclock_scheduler_client_lim is set to 1,
the sequential write bandwidth is only half of the capacity.
Therefore, we believe that it should not unconditionally increase
osd_bandwidth_cost_per_io for each IO, but take the maximum of the two.

Fixes: https://tracker.ceph.com/issues/62812
co-author: yanghonggang <yanghonggang_yewu@cmss.chinamobile.com>
co-author: zhangjianwei <zhangjianwei2_yewu@cmss.chinamobile.com>
Signed-off-by: Jrchyang Yu <yuzhiqiang_yewu@cmss.chinamobile.com>
(cherry picked from commit 65ebf2d6f1b41c93ee2e170437780846d20f5480)

21 months agoMerge pull request #53854 from zdover23/wip-doc-2023-10-06-backport-53834-to-quincy
Anthony D'Atri [Fri, 6 Oct 2023 00:41:35 +0000 (20:41 -0400)]
Merge pull request #53854 from zdover23/wip-doc-2023-10-06-backport-53834-to-quincy

quincy: doc: remove egg fragment from dev/developer_guide/running-tests-locally

21 months agodoc: remove egg fragment from dev/developer_guide/running-tests-locally 53854/head
Dhairya Parmar [Thu, 5 Oct 2023 08:12:31 +0000 (13:42 +0530)]
doc: remove egg fragment from dev/developer_guide/running-tests-locally

DEPRECATION: git+https://github.com/ceph/teuthology#egg=teuthology
[test] contains an egg fragment with a non-PEP 508 name pip 25.0 will enforce
this behaviour change. A possible replacement is to use the req @ url syntax,
and remove the egg fragment. Discussion can be found at
https://github.com/pypa/pip/issues/11617

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
(cherry picked from commit 1f78a32a1822fea1a56a88215e452b730b7672c7)

21 months agomds/FSMap: allow upgrades if no up mds 53852/head
Patrick Donnelly [Fri, 22 Sep 2023 18:05:23 +0000 (14:05 -0400)]
mds/FSMap: allow upgrades if no up mds

This is to support the fail_fs scenario for cephadm where max_mds >= 1
and all MDS are down.

Fixes: https://tracker.ceph.com/issues/62682
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 7cde5724e6b47631acd037a2ebd96ea72ad07324)

21 months agoMerge pull request #53102 from batrick/wip-62554-quincy
Yuri Weinstein [Thu, 5 Oct 2023 18:01:06 +0000 (11:01 -0700)]
Merge pull request #53102 from batrick/wip-62554-quincy

quincy: libcephsqlite: fill 0s in unread portion of buffer

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #53566 from pdvian/wip-59177-quincy
Yuri Weinstein [Thu, 5 Oct 2023 18:00:05 +0000 (11:00 -0700)]
Merge pull request #53566 from pdvian/wip-59177-quincy

quincy: blk/kernel: Add O_EXCL for block devices

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #53158 from ljflores/wip-62592-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:59:24 +0000 (10:59 -0700)]
Merge pull request #53158 from ljflores/wip-62592-quincy

quincy: python-common: drive_selection: fix KeyError when osdspec_affinity is not set

Reviewed-by: Adam King adking@redhat.com
21 months agoMerge pull request #52952 from k0ste/wip-62118-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:58:22 +0000 (10:58 -0700)]
Merge pull request #52952 from k0ste/wip-62118-quincy

quincy: qa: use parallel gzip for compressing logs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
21 months agoMerge pull request #52215 from batrick/wip-61834-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:57:26 +0000 (10:57 -0700)]
Merge pull request #52215 from batrick/wip-61834-quincy

quincy: pybind/mgr/devicehealth: do not crash if db not ready

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #51811 from NitzanMordhai/wip-61487-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:56:42 +0000 (10:56 -0700)]
Merge pull request #51811 from NitzanMordhai/wip-61487-quincy

quincy: pybind/argparse: blocklist ip validation

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agoMerge pull request #53838 from zdover23/wip-doc-2023-10-05-backport-53819-to-quincy
Anthony D'Atri [Thu, 5 Oct 2023 16:52:21 +0000 (12:52 -0400)]
Merge pull request #53838 from zdover23/wip-doc-2023-10-05-backport-53819-to-quincy

quincy: doc/rados: edit troubleshooting.rst

21 months agoMerge pull request #53729 from ceph/revert-50974-wip-59201-quincy
Yuri Weinstein [Thu, 5 Oct 2023 14:27:39 +0000 (07:27 -0700)]
Merge pull request #53729 from ceph/revert-50974-wip-59201-quincy

Revert "quincy: qa: add subvolume option flavors"

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #53677 from kamoltat/wip-ksirivad-quincy-backport-52442
Yuri Weinstein [Thu, 5 Oct 2023 14:20:02 +0000 (07:20 -0700)]
Merge pull request #53677 from kamoltat/wip-ksirivad-quincy-backport-52442

quincy: pybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
21 months agoMerge pull request #53092 from sseshasa/wip-62547-quincy
Yuri Weinstein [Thu, 5 Oct 2023 14:19:02 +0000 (07:19 -0700)]
Merge pull request #53092 from sseshasa/wip-62547-quincy

quincy: osd/scheduler/mClockScheduler: Use same profile and client ids for all clients to ensure allocated QoS limit consumption.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agodoc/rados: edit troubleshooting.rst 53838/head
Zac Dover [Wed, 4 Oct 2023 11:14:13 +0000 (21:14 +1000)]
doc/rados: edit troubleshooting.rst

Edit doc/rads/troubleshooting.rst to remove some language that sounds
quite close to marketing language.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9d9d92837e44e3af233bc228850be09e8f64eb7c)

21 months agoMerge pull request #53812 from zdover23/wip-doc-2023-10-04-backport-53791-to-quincy
zdover23 [Thu, 5 Oct 2023 11:31:45 +0000 (22:31 +1100)]
Merge pull request #53812 from zdover23/wip-doc-2023-10-04-backport-53791-to-quincy

quincy: doc/rados: edit ops/control.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
21 months agoMerge pull request #48523 from k0ste/wip-57886-quincy
Avan [Thu, 5 Oct 2023 09:34:24 +0000 (15:04 +0530)]
Merge pull request #48523 from k0ste/wip-57886-quincy

quincy: mgr/prometheus: avoid duplicates and deleted entries for rbd_stats_pools

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
21 months agoMerge pull request #52739 from theanalyst/wip-58818
Yuri Weinstein [Wed, 4 Oct 2023 20:29:11 +0000 (13:29 -0700)]
Merge pull request #52739 from theanalyst/wip-58818

quincy: rgw: swift : check for valid key in POST forms

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53690 from pdvian/wip-62995-quincy
Radoslaw Zarzynski [Wed, 4 Oct 2023 19:14:50 +0000 (21:14 +0200)]
Merge pull request #53690 from pdvian/wip-62995-quincy

quincy: osd/OpRequest: Add detailed description for delayed op in osd log file

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>