]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
21 months agodoc/architecture: repair RBD sentence 53878/head
Zac Dover [Sat, 7 Oct 2023 21:43:43 +0000 (07:43 +1000)]
doc/architecture: repair RBD sentence

Improve an ambiguous sentence in doc/architecture.rst.

The problem presented by the original sentence is that the phrasal verb
"to provide with" is implicated in one of its possible readings.
Interpreted in that way, the sentence seems to express the incorrect
idea that RBD furnishes block devices with snapshotting and cloning, as
though snapshotting and cloning are being delivered to the block
devices. In fact, snapshotting and cloning are just features of RBD, and
are features that are described on this page:
https://docs.ceph.com/en/quincy/rbd/rbd-snapshot/.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5abd530460e3d5a60142d9350d93544402b6dec4)

21 months agoMerge pull request #53664 from lxbsz/wip-62519
Yuri Weinstein [Sat, 7 Oct 2023 22:04:59 +0000 (15:04 -0700)]
Merge pull request #53664 from lxbsz/wip-62519

quincy: client: move the Inode to new auth mds session when changing auth cap

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53663 from lxbsz/wip-62522
Yuri Weinstein [Sat, 7 Oct 2023 22:04:10 +0000 (15:04 -0700)]
Merge pull request #53663 from lxbsz/wip-62522

quincy: ceph: allow xlock state to be LOCK_PREXLOCK when putting it

Reviewed-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy
zdover23 [Sat, 7 Oct 2023 05:33:26 +0000 (16:33 +1100)]
Merge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy

quincy: doc/architecture: edit "Peering and Sets"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
21 months agodoc/architecture: edit "Peering and Sets" 53872/head
Zac Dover [Tue, 3 Oct 2023 12:11:50 +0000 (22:11 +1000)]
doc/architecture: edit "Peering and Sets"

Edit the English in the section "Peering and Sets" in the file
doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c69b111966f190ac4a1ebd5244a9cf9f61970dd7)

21 months agoMerge pull request #52799 from cbodley/wip-62302-quincy
Shilpa Jagannath [Fri, 6 Oct 2023 18:03:14 +0000 (14:03 -0400)]
Merge pull request #52799 from cbodley/wip-62302-quincy

quincy: rgw: retry metadata cache notifications with INVALIDATE_OBJ

21 months agoMerge pull request #53854 from zdover23/wip-doc-2023-10-06-backport-53834-to-quincy
Anthony D'Atri [Fri, 6 Oct 2023 00:41:35 +0000 (20:41 -0400)]
Merge pull request #53854 from zdover23/wip-doc-2023-10-06-backport-53834-to-quincy

quincy: doc: remove egg fragment from dev/developer_guide/running-tests-locally

21 months agodoc: remove egg fragment from dev/developer_guide/running-tests-locally 53854/head
Dhairya Parmar [Thu, 5 Oct 2023 08:12:31 +0000 (13:42 +0530)]
doc: remove egg fragment from dev/developer_guide/running-tests-locally

DEPRECATION: git+https://github.com/ceph/teuthology#egg=teuthology
[test] contains an egg fragment with a non-PEP 508 name pip 25.0 will enforce
this behaviour change. A possible replacement is to use the req @ url syntax,
and remove the egg fragment. Discussion can be found at
https://github.com/pypa/pip/issues/11617

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
(cherry picked from commit 1f78a32a1822fea1a56a88215e452b730b7672c7)

21 months agoMerge pull request #53102 from batrick/wip-62554-quincy
Yuri Weinstein [Thu, 5 Oct 2023 18:01:06 +0000 (11:01 -0700)]
Merge pull request #53102 from batrick/wip-62554-quincy

quincy: libcephsqlite: fill 0s in unread portion of buffer

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #53566 from pdvian/wip-59177-quincy
Yuri Weinstein [Thu, 5 Oct 2023 18:00:05 +0000 (11:00 -0700)]
Merge pull request #53566 from pdvian/wip-59177-quincy

quincy: blk/kernel: Add O_EXCL for block devices

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #53158 from ljflores/wip-62592-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:59:24 +0000 (10:59 -0700)]
Merge pull request #53158 from ljflores/wip-62592-quincy

quincy: python-common: drive_selection: fix KeyError when osdspec_affinity is not set

Reviewed-by: Adam King adking@redhat.com
21 months agoMerge pull request #52952 from k0ste/wip-62118-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:58:22 +0000 (10:58 -0700)]
Merge pull request #52952 from k0ste/wip-62118-quincy

quincy: qa: use parallel gzip for compressing logs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
21 months agoMerge pull request #52215 from batrick/wip-61834-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:57:26 +0000 (10:57 -0700)]
Merge pull request #52215 from batrick/wip-61834-quincy

quincy: pybind/mgr/devicehealth: do not crash if db not ready

Reviewed-by: Laura Flores <lflores@redhat.com>
21 months agoMerge pull request #51811 from NitzanMordhai/wip-61487-quincy
Yuri Weinstein [Thu, 5 Oct 2023 17:56:42 +0000 (10:56 -0700)]
Merge pull request #51811 from NitzanMordhai/wip-61487-quincy

quincy: pybind/argparse: blocklist ip validation

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agoMerge pull request #53838 from zdover23/wip-doc-2023-10-05-backport-53819-to-quincy
Anthony D'Atri [Thu, 5 Oct 2023 16:52:21 +0000 (12:52 -0400)]
Merge pull request #53838 from zdover23/wip-doc-2023-10-05-backport-53819-to-quincy

quincy: doc/rados: edit troubleshooting.rst

21 months agoMerge pull request #53729 from ceph/revert-50974-wip-59201-quincy
Yuri Weinstein [Thu, 5 Oct 2023 14:27:39 +0000 (07:27 -0700)]
Merge pull request #53729 from ceph/revert-50974-wip-59201-quincy

Revert "quincy: qa: add subvolume option flavors"

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #53677 from kamoltat/wip-ksirivad-quincy-backport-52442
Yuri Weinstein [Thu, 5 Oct 2023 14:20:02 +0000 (07:20 -0700)]
Merge pull request #53677 from kamoltat/wip-ksirivad-quincy-backport-52442

quincy: pybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
21 months agoMerge pull request #53092 from sseshasa/wip-62547-quincy
Yuri Weinstein [Thu, 5 Oct 2023 14:19:02 +0000 (07:19 -0700)]
Merge pull request #53092 from sseshasa/wip-62547-quincy

quincy: osd/scheduler/mClockScheduler: Use same profile and client ids for all clients to ensure allocated QoS limit consumption.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agodoc/rados: edit troubleshooting.rst 53838/head
Zac Dover [Wed, 4 Oct 2023 11:14:13 +0000 (21:14 +1000)]
doc/rados: edit troubleshooting.rst

Edit doc/rads/troubleshooting.rst to remove some language that sounds
quite close to marketing language.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9d9d92837e44e3af233bc228850be09e8f64eb7c)

21 months agoMerge pull request #53812 from zdover23/wip-doc-2023-10-04-backport-53791-to-quincy
zdover23 [Thu, 5 Oct 2023 11:31:45 +0000 (22:31 +1100)]
Merge pull request #53812 from zdover23/wip-doc-2023-10-04-backport-53791-to-quincy

quincy: doc/rados: edit ops/control.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
21 months agoMerge pull request #48523 from k0ste/wip-57886-quincy
Avan [Thu, 5 Oct 2023 09:34:24 +0000 (15:04 +0530)]
Merge pull request #48523 from k0ste/wip-57886-quincy

quincy: mgr/prometheus: avoid duplicates and deleted entries for rbd_stats_pools

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
21 months agoMerge pull request #52739 from theanalyst/wip-58818
Yuri Weinstein [Wed, 4 Oct 2023 20:29:11 +0000 (13:29 -0700)]
Merge pull request #52739 from theanalyst/wip-58818

quincy: rgw: swift : check for valid key in POST forms

Reviewed-by: Casey Bodley <cbodley@redhat.com>
21 months agoMerge pull request #53690 from pdvian/wip-62995-quincy
Radoslaw Zarzynski [Wed, 4 Oct 2023 19:14:50 +0000 (21:14 +0200)]
Merge pull request #53690 from pdvian/wip-62995-quincy

quincy: osd/OpRequest: Add detailed description for delayed op in osd log file

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
21 months agoMerge pull request #52585 from rishabh-d-dave/wip-58991-quincy
Yuri Weinstein [Wed, 4 Oct 2023 16:18:47 +0000 (09:18 -0700)]
Merge pull request #52585 from rishabh-d-dave/wip-58991-quincy

quincy: qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
21 months agoMerge pull request #53042 from pdvian/wip-62479-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:39:28 +0000 (08:39 -0700)]
Merge pull request #53042 from pdvian/wip-62479-quincy

quincy: mon, qa: issue pool application warning even if pool is empty

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agoMerge pull request #52752 from mchangir/wip-61795-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:38:45 +0000 (08:38 -0700)]
Merge pull request #52752 from mchangir/wip-61795-quincy

quincy: mgr/snap_schedule: catch all exceptions for cli

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
21 months agoMerge pull request #52722 from NitzanMordhai/wip-62252-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:37:36 +0000 (08:37 -0700)]
Merge pull request #52722 from NitzanMordhai/wip-62252-quincy

quincy: qa/standalone/osd/divergent-prior.sh: Divergent test 3 with pg_autoscale_mode on pick divergent osd

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
21 months agoMerge pull request #52534 from idryomov/wip-61733-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:35:49 +0000 (08:35 -0700)]
Merge pull request #52534 from idryomov/wip-61733-quincy

quincy: mon/MonClient: resurrect original client_mount_timeout handling

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
21 months agoMerge pull request #52467 from k0ste/wip-62030-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:34:26 +0000 (08:34 -0700)]
Merge pull request #52467 from k0ste/wip-62030-quincy

quincy: mon/ConfigMonitor: update crush_location from osd entity

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agoMerge pull request #47840 from NitzanMordhai/wip-57316-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:33:12 +0000 (08:33 -0700)]
Merge pull request #47840 from NitzanMordhai/wip-57316-quincy

quincy: osd, mon: add pglog dups length

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agoMerge pull request #53139 from mihalicyn/wip-62571-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:30:50 +0000 (08:30 -0700)]
Merge pull request #53139 from mihalicyn/wip-62571-quincy

quincy: ceph_fs.h: add separate owner_{u,g}id fields

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52983 from batrick/wip-61799-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:30:18 +0000 (08:30 -0700)]
Merge pull request #52983 from batrick/wip-61799-quincy

quincy: mon/MDSMonitor: plug paxos when maybe manipulating osdmap

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52902 from leonid-s-usov/backport/bulk-data-pool/quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:29:36 +0000 (08:29 -0700)]
Merge pull request #52902 from leonid-s-usov/backport/bulk-data-pool/quincy

quincy: Consider setting "bulk" autoscale pool flag when automatically creating a data pool for CephFS

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
21 months agoMerge pull request #52851 from lxbsz/wip-61167
Yuri Weinstein [Wed, 4 Oct 2023 15:28:42 +0000 (08:28 -0700)]
Merge pull request #52851 from lxbsz/wip-61167

quincy: client: issue a cap release immediately if no cap exists

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52849 from lxbsz/wip-62194
Yuri Weinstein [Wed, 4 Oct 2023 15:28:09 +0000 (08:28 -0700)]
Merge pull request #52849 from lxbsz/wip-62194

quincy: mds: do not send split_realms for CEPH_SNAP_OP_UPDATE msg

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52845 from lxbsz/wip-62200
Yuri Weinstein [Wed, 4 Oct 2023 15:27:12 +0000 (08:27 -0700)]
Merge pull request #52845 from lxbsz/wip-62200

quincy: mds: skip forwarding request if the session were removed

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52749 from mchangir/wip-61991-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:26:30 +0000 (08:26 -0700)]
Merge pull request #52749 from mchangir/wip-61991-quincy

quincy: mgr/snap_schedule: allow retention spec 'n' to be user defined

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52743 from batrick/wip-62270-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:25:30 +0000 (08:25 -0700)]
Merge pull request #52743 from batrick/wip-62270-quincy

quincy: qa: wait for file to have correct size

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52725 from kotreshhr/wip-62241-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:24:10 +0000 (08:24 -0700)]
Merge pull request #52725 from kotreshhr/wip-62241-quincy

quincy: mds: Fix the linkmerge assert check

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge pull request #52683 from batrick/wip-62191-quincy
Yuri Weinstein [Wed, 4 Oct 2023 15:15:38 +0000 (08:15 -0700)]
Merge pull request #52683 from batrick/wip-62191-quincy

quincy: mds: update mdlog perf counters during replay

Reviewed-by: Milind Changire <mchangir@redhat.com>
21 months agoMerge branch 'quincy' into wip-doc-2023-10-04-backport-53791-to-quincy 53812/head
zdover23 [Wed, 4 Oct 2023 14:37:34 +0000 (01:37 +1100)]
Merge branch 'quincy' into wip-doc-2023-10-04-backport-53791-to-quincy

Signed-off-by: zdover23 <zac.dover@proton.me>
21 months agoMerge pull request #53816 from zdover23/wip-doc-2023-10-04-backport-53792-to-quincy
Anthony D'Atri [Wed, 4 Oct 2023 13:01:41 +0000 (09:01 -0400)]
Merge pull request #53816 from zdover23/wip-doc-2023-10-04-backport-53792-to-quincy

quincy: doc/rados: edit ops/control.rst (2 of x)

21 months agoMerge pull request #48249 from ifed01/wip-ifed-fix-57121-qui
Igor Fedotov [Wed, 4 Oct 2023 11:55:53 +0000 (14:55 +0300)]
Merge pull request #48249 from ifed01/wip-ifed-fix-57121-qui

quincy: osd: set per_pool_stats true when OSD has no PG

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
21 months agodoc/rados: edit ops/control.rst (2 of x) 53816/head
Zac Dover [Tue, 3 Oct 2023 12:39:23 +0000 (22:39 +1000)]
doc/rados: edit ops/control.rst (2 of x)

Edit doc/rados/operations/control.rst (2 of x).

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 03ed13930661628c10f185af1a3949548bdc8288)

21 months agoMerge pull request #51774 from ifed01/wip-ifed-fix-bluefs-prealloc-qui
Igor Fedotov [Wed, 4 Oct 2023 10:19:42 +0000 (13:19 +0300)]
Merge pull request #51774 from ifed01/wip-ifed-fix-bluefs-prealloc-qui

quincy: os/bluestore: proper override rocksdb::WritableFile::Allocate

Reviewed-by: Adam Kupczyk <akupszyk@ibm.com>
21 months agodoc/rados: edit ops/control.rst (1 of x)
Zac Dover [Tue, 3 Oct 2023 12:22:39 +0000 (22:22 +1000)]
doc/rados: edit ops/control.rst (1 of x)

Edit doc/rados/operations/control.rst (1 of x).

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 89c9584f8a1633b5ad1936af09529657d81b7134)

21 months agoMerge pull request #53796 from rhcs-dashboard/wip-63078-quincy
Nizamudeen A [Wed, 4 Oct 2023 06:11:45 +0000 (11:41 +0530)]
Merge pull request #53796 from rhcs-dashboard/wip-63078-quincy

quincy: mgr/dashboard: enable protect option if layering enabled

Reviewed-by: Nizamudeen A <nia@redhat.com>
21 months agomgr/dashboard: enable protect option if layering enabled 53796/head
avanthakkar [Tue, 26 Sep 2023 11:04:08 +0000 (16:34 +0530)]
mgr/dashboard: enable protect option if layering enabled

Fixes: https://tracker.ceph.com/issues/63076
Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit 91be9ecdf519df18e564c79681f6275376f786e6)

21 months agoqa/workunits: modified tests for noautoscale flag change 53677/head
Kamoltat [Thu, 13 Jul 2023 19:41:29 +0000 (19:41 +0000)]
qa/workunits: modified tests for noautoscale flag change

modified:

`qa/workunits/mon/test_noautoscale_flag.sh`
`qa/workunits/cephtool/test.sh`

adding test coverage to files mentioned above

Fixes: https://tracker.ceph.com/issues/61922
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit 0972dbf225a287345387bed9e0fde0f9e8be8285)

21 months agopybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs
Kamoltat [Thu, 13 Jul 2023 18:23:13 +0000 (18:23 +0000)]
pybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs

Problem:

The pg_autoscaler `noautoscale flag` doesn't retain individual pool states of
`autoscale mode`. For example turn the flag `ON` and then `OFF` again all
the pools will have `autoscale mode on` which is inconvenience for the user
because sometimes the user just want to temporary disable the autoscaler on
all pools and will enable it back after a period of time while retaining
individual pool states of `autoscale mode`

Solution:

We store noautoscale flag in the OSDMAP such that it is
persistent. We then get rid of noautoscale MODULE OPTION
in the pg_autoscaler module since we do not need it anymore.
Everytime we set, unset or get the flag we rely on looking up
the OSDMAP, we did this because we want to avoid inconsistancy
between the `noautoscale flag`. This is because `noautoscale flag`
can easily be set by doing `ceph osd set noautoscale`.

Fixes: https://tracker.ceph.com/issues/61922
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit 0bfdf6362a6b9705212705ee96fa3d6933e51437)

Conflicts:
src/pybind/mgr/pg_autoscaler/module.py - trivial fix

21 months agoMerge pull request #53749 from zdover23/wip-doc-2023-10-02-backport-53744-to-quincy
Anthony D'Atri [Mon, 2 Oct 2023 13:39:57 +0000 (09:39 -0400)]
Merge pull request #53749 from zdover23/wip-doc-2023-10-02-backport-53744-to-quincy

quincy: doc/architecture: edit "Calculating PG IDs"

21 months agodoc/architecture: edit "Calculating PG IDs" 53749/head
Zac Dover [Sun, 1 Oct 2023 23:43:37 +0000 (09:43 +1000)]
doc/architecture: edit "Calculating PG IDs"

Edit the section "Calcluating PG IDs" in doc/architecture.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 69a585fbf4fbf50eed784a248442f622f01120c9)

21 months agoMerge pull request #53705 from adk3798/wip-61550-quincy
Adam King [Sun, 1 Oct 2023 17:04:52 +0000 (13:04 -0400)]
Merge pull request #53705 from adk3798/wip-61550-quincy

quincy: mgr/cephadm: also don't write client files/tuned profiles to maintenance hosts

Reviewed-by: John Mulligan <jmulligan@redhat.com>
21 months agoMerge pull request #53743 from zdover23/wip-doc-2023-10-01-backport-53740-to-quincy
Anthony D'Atri [Sun, 1 Oct 2023 13:04:36 +0000 (09:04 -0400)]
Merge pull request #53743 from zdover23/wip-doc-2023-10-01-backport-53740-to-quincy

quincy: doc/architecture: edit several sections

21 months agoMerge pull request #53098 from adk3798/quincy-keealive-unicast-or-interface
Yuri Weinstein [Sun, 1 Oct 2023 12:53:46 +0000 (05:53 -0700)]
Merge pull request #53098 from adk3798/quincy-keealive-unicast-or-interface

quincy: cephadm: Split multicast interface and unicast_ip in keepalived.conf

Reviewed-by: Adam King adking@redhat.com
21 months agoMerge pull request #52909 from adk3798/quincy-cephadm-fix-call
Yuri Weinstein [Sun, 1 Oct 2023 12:52:14 +0000 (05:52 -0700)]
Merge pull request #52909 from adk3798/quincy-cephadm-fix-call

quincy: cephadm: fix call timeout argument

Reviewed-by: John Mulligan <jmulligan@redhat.com>
21 months agoMerge pull request #53598 from idryomov/wip-62711-quincy
Yuri Weinstein [Sun, 1 Oct 2023 12:48:53 +0000 (05:48 -0700)]
Merge pull request #53598 from idryomov/wip-62711-quincy

quincy: qa/suites/{rbd,krbd}: disable POOL_APP_NOT_ENABLED health check

Reviewed-by: Ramana Raja <rraja@redhat.com>
21 months agoMerge pull request #53294 from ajarr/wip-62685-quincy
Yuri Weinstein [Sun, 1 Oct 2023 12:48:18 +0000 (05:48 -0700)]
Merge pull request #53294 from ajarr/wip-62685-quincy

quincy: librbd: kick ExclusiveLock state machine on client being blocklisted when waiting for lock

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
21 months agoMerge pull request #53275 from idryomov/wip-61707-quincy
Yuri Weinstein [Sun, 1 Oct 2023 12:47:26 +0000 (05:47 -0700)]
Merge pull request #53275 from idryomov/wip-61707-quincy

quincy: librbd: make CreatePrimaryRequest remove any unlinked mirror snapshots

Reviewed-by: Ramana Raja <rraja@redhat.com>
21 months agoMerge pull request #52879 from idryomov/wip-52913-quincy
Yuri Weinstein [Sun, 1 Oct 2023 12:46:32 +0000 (05:46 -0700)]
Merge pull request #52879 from idryomov/wip-52913-quincy

quincy: rbd-mirror: fix image replayer shut down description on force promote

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
21 months agodoc/architecture: edit several sections 53743/head
Zac Dover [Sat, 30 Sep 2023 04:58:41 +0000 (14:58 +1000)]
doc/architecture: edit several sections

Edit the following sections in doc/architecture.rst:

 1. Dynamic Cluster Management
 2. About Pools
 3. Mapping PGs to OSDs

The tone of "Dynamic Cluster Management" remains a bit too close to the
tone of marketing material, in my opinion, but I will return to firm it
up when I have finished a once-over of architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9657c45fc12cd8522df72c9bb8820320758305e4)

21 months agoMerge pull request #53739 from zdover23/wip-doc-2023-09-30-backport-53726-to-quincy
Anthony D'Atri [Sat, 30 Sep 2023 09:43:17 +0000 (05:43 -0400)]
Merge pull request #53739 from zdover23/wip-doc-2023-09-30-backport-53726-to-quincy

quincy: doc/architecture: edit "Replication"

21 months agodoc/architecture: edit "Replication" 53739/head
Zac Dover [Thu, 28 Sep 2023 21:37:40 +0000 (07:37 +1000)]
doc/architecture: edit "Replication"

Edit "Replication" in the "Smart Daemons Enable Hyperscale" section of
doc/architecture.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4cf22e195ab367eb65f95c2578d06919ebcd108f)

21 months agoMerge pull request #53731 from zdover23/wip-doc-2023-09-29-backport-53723-to-quincy
zdover23 [Sat, 30 Sep 2023 00:09:31 +0000 (10:09 +1000)]
Merge pull request #53731 from zdover23/wip-doc-2023-09-29-backport-53723-to-quincy

quincy: doc/architecture: edit "Data Scrubbing"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
21 months agoMerge pull request #53592 from trociny/wip-58479-quincy
Yuri Weinstein [Fri, 29 Sep 2023 16:06:01 +0000 (09:06 -0700)]
Merge pull request #53592 from trociny/wip-58479-quincy

quincy: rgw: fix FP error when calculating enteries per bi shard

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
21 months agoMerge pull request #53561 from cfsnyder/wip-58788-quincy
Yuri Weinstein [Fri, 29 Sep 2023 16:05:22 +0000 (09:05 -0700)]
Merge pull request #53561 from cfsnyder/wip-58788-quincy

quincy: rgwlc: prevent lc for one bucket from exceeding time budget

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
21 months agoMerge pull request #53441 from trociny/wip-61870-quincy
Yuri Weinstein [Fri, 29 Sep 2023 16:04:45 +0000 (09:04 -0700)]
Merge pull request #53441 from trociny/wip-61870-quincy

quincy: rgw: pick http_date in case of http_x_amz_date absence

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
21 months agoMerge pull request #53399 from trociny/wip-62753-quincy
Yuri Weinstein [Fri, 29 Sep 2023 16:04:11 +0000 (09:04 -0700)]
Merge pull request #53399 from trociny/wip-62753-quincy

quincy: rgw: fix 2 null versionID after convert_plain_entry_to_versioned

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
21 months agoMerge pull request #53396 from trociny/wip-62307-quincy
Yuri Weinstein [Fri, 29 Sep 2023 16:03:39 +0000 (09:03 -0700)]
Merge pull request #53396 from trociny/wip-62307-quincy

quincy: rgw/sync-policy: Correct "sync status" & "sync group" commands

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
21 months agoMerge pull request #52818 from cbodley/wip-62321-quincy
Yuri Weinstein [Fri, 29 Sep 2023 16:02:48 +0000 (09:02 -0700)]
Merge pull request #52818 from cbodley/wip-62321-quincy

quincy: rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
21 months agoMerge pull request #51598 from alimaredia/wip-61174-quincy
Yuri Weinstein [Fri, 29 Sep 2023 15:57:11 +0000 (08:57 -0700)]
Merge pull request #51598 from alimaredia/wip-61174-quincy

quincy: rgw/swift: check position of first slash in slo manifest files

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
21 months agoMerge pull request #52626 from nbalacha/wip-62112-quincy
Yuri Weinstein [Fri, 29 Sep 2023 15:51:03 +0000 (08:51 -0700)]
Merge pull request #52626 from nbalacha/wip-62112-quincy

quincy: rbd-mirror: fix race preventing local image deletion

Reviewed-by: Mykola Golub <mgolub@suse.com>
21 months agodoc/architecture: edit "Data Scrubbing" 53731/head
Zac Dover [Thu, 28 Sep 2023 18:40:08 +0000 (04:40 +1000)]
doc/architecture: edit "Data Scrubbing"

Edit the "Data Scrubbing" listitem in the list of benefits conferred by
the use by OSDs of the aggregate power of the cluster, in the section
"Smart Daemons Enable Hyperscale" in doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d7b991646fcd36a1df7456e8e82c9d54a01e50f9)

21 months agoRevert "quincy: qa: add subvolume option flavors" 53729/head
Venky Shankar [Fri, 29 Sep 2023 05:05:24 +0000 (10:35 +0530)]
Revert "quincy: qa: add subvolume option flavors"

Signed-off-by: Venky Shankar <vshankar@redhat.com>
21 months agoMerge pull request #53728 from zdover23/wip-doc-2023-09-29-backport-53707-to-quincy
Anthony D'Atri [Fri, 29 Sep 2023 02:53:54 +0000 (22:53 -0400)]
Merge pull request #53728 from zdover23/wip-doc-2023-09-29-backport-53707-to-quincy

quincy: doc/architecture: edit "OSD Membership and Status"

21 months agodoc/architecture: edit "OSD Membership and Status" 53728/head
Zac Dover [Thu, 28 Sep 2023 03:55:02 +0000 (13:55 +1000)]
doc/architecture: edit "OSD Membership and Status"

Edit "OSD Membership and Status" in the "Smart Daemons Enable
Hyperscale" section of doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dbd85336b1aa3ef42cfc12495b3dc5142d4b8a28)

21 months agoMerge pull request #53706 from rhcs-dashboard/quincy-legacy-resolver-fix
Ilya Dryomov [Thu, 28 Sep 2023 07:26:49 +0000 (09:26 +0200)]
Merge pull request #53706 from rhcs-dashboard/quincy-legacy-resolver-fix

quincy: install-deps: remove the legacy resolver flags

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
21 months agoinstall-deps: remove the legacy resolver flags 53706/head
Nizamudeen A [Wed, 19 Jul 2023 14:05:05 +0000 (19:35 +0530)]
install-deps: remove the legacy resolver flags

This was a workaround that was introduced long time ago. This will be
something that could be deprectaed at some point [1]. And its preventing some of the dependencies to be
downloaded or stored into the wheelhouse. Deps like jsonschema, parse,
mypy, cryptography etc.

[1] https://pip.pypa.io/en/latest/user_guide/#deprecation-timeline

Fixes: https://tracker.ceph.com/issues/62082
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit d179b95ddf57f8ca48633aed9f6229e39ad83fef)

21 months agomgr/cephadm: also don't write client files/tuned profiles to maintenance hosts 53705/head
Adam King [Thu, 4 May 2023 16:55:55 +0000 (12:55 -0400)]
mgr/cephadm: also don't write client files/tuned profiles to maintenance hosts

Since they could have been taken offline for maintenance,
they should be treated the same as offline hosts in this
case and we should avoid trying to write files to them

Fixes: https://tracker.ceph.com/issues/59650
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 4244d83f70abf4331a055dbeaa6fc2f0d7814bb6)

21 months agoMerge pull request #53687 from zdover23/wip-doc-2023-09-27-backport-53685-to-quincy
Anthony D'Atri [Wed, 27 Sep 2023 19:15:13 +0000 (15:15 -0400)]
Merge pull request #53687 from zdover23/wip-doc-2023-09-27-backport-53685-to-quincy

quincy: doc/architecture: edit "OSDs service clients directly"

21 months agoosd/OpRequest: Add detail description for delayed op in osd log file 53690/head
yite.gu [Tue, 14 Mar 2023 13:58:56 +0000 (09:58 -0400)]
osd/OpRequest: Add detail description for delayed op in osd log file

Have no description delayed reason while the op mark is delayed
in the log file. Add a detailed description while the op mark
is delayed, it helps to quickly determine the problem and leave
a trace.

Signed-off-by: Yite Gu <yitegu0@gmail.com>
(cherry picked from commit a6c0e601b13dc2209cb6d546d249988d0472e1d4)

21 months agodoc/architecture: edit "OSDs service clients directly" 53687/head
Zac Dover [Tue, 26 Sep 2023 20:00:34 +0000 (06:00 +1000)]
doc/architecture: edit "OSDs service clients directly"

Edit "OSDs service clients directly" in the list in
"Smart Daemons Enable Hyperscale" in doc/architecure.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6f9dfd75b50f7793d2ff9bc3003c35efa6d6da04)

21 months agoMerge pull request #53656 from cityofships/quincy
Anthony D'Atri [Tue, 26 Sep 2023 20:22:45 +0000 (16:22 -0400)]
Merge pull request #53656 from cityofships/quincy

quincy: doc/radosgw: fix command error blank

21 months agoMerge pull request #53660 from zdover23/wip-doc-2023-09-26-backport-53657-to-quincy
Anthony D'Atri [Tue, 26 Sep 2023 18:36:02 +0000 (14:36 -0400)]
Merge pull request #53660 from zdover23/wip-doc-2023-09-26-backport-53657-to-quincy

quincy: doc/architecture: edit "SDEH"

21 months agoclient: move the Inode to new auth mds session when changing auth cap 53664/head
Xiubo Li [Wed, 19 Jul 2023 02:22:39 +0000 (10:22 +0800)]
client: move the Inode to new auth mds session when changing auth cap

When the auth cap changes we need to move the Inode to the new session's
dirty cap list.

Fixes: https://tracker.ceph.com/issues/56698
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 8aafa4cd7b1c124f5139ca93591cff61da1d2965)

21 months agoclient: check the xlists in ~MetaSession()
Xiubo Li [Thu, 6 Jul 2023 07:38:49 +0000 (15:38 +0800)]
client: check the xlists in ~MetaSession()

This will crash the clients more gracefully instead of in ~xlist(),
and this will be easier to debug the root cause and get to know
exactly which list is not empty.

Fixes: https://tracker.ceph.com/issues/56698
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 687d4b77e5615e4a76da862c1286eb1d6bb9f559)

21 months agoceph: allow xlock state to be LOCK_SYNC when putting it 53663/head
Xiubo Li [Tue, 26 Sep 2023 04:55:41 +0000 (12:55 +0800)]
ceph: allow xlock state to be LOCK_SYNC when putting it

When the journal logs are successfully flushed the lockers' state
could be LOCK_SYNC during the xlock count is non-zero.

Fixes: https://tracker.ceph.com/issues/44565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit cf42b377c4be665765f4e2136f5ee8e73a6289e5)

21 months agoceph: allow xlock state to be LOCK_PREXLOCK when putting it
Xiubo Li [Tue, 26 Sep 2023 04:54:58 +0000 (12:54 +0800)]
ceph: allow xlock state to be LOCK_PREXLOCK when putting it

When the journal logs are successfully flushed the lockers' state
could be LOCK_PREXLOCK if the inflight OP need to gather issued
caps.

Fixes: https://tracker.ceph.com/issues/44565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 81890e8a57341b3a14db310ae1700394ecdbbad4)

21 months agodoc/architecture: edit "SDEH" 53660/head
Zac Dover [Mon, 25 Sep 2023 21:40:42 +0000 (07:40 +1000)]
doc/architecture: edit "SDEH"

Edit the front matter of the "Smart Daemons Enable Hyperscale" section
of doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5054f6c7538e1e3b0ffd3c0badf0fcd3a95c8d92)

21 months agodoc/radosgw: fix command error blank 53656/head
stevenhua [Tue, 1 Nov 2022 01:53:02 +0000 (09:53 +0800)]
doc/radosgw: fix command error blank

(cherry picked from commit 870e8e7b3fd8a438925c034dc621e4d2644d39af)

21 months agoMerge pull request #53633 from zdover23/wip-doc-2023-09-25-backport-53631-to-quincy
Anthony D'Atri [Mon, 25 Sep 2023 05:17:03 +0000 (01:17 -0400)]
Merge pull request #53633 from zdover23/wip-doc-2023-09-25-backport-53631-to-quincy

quincy: doc/architecture: edit "HA Authentication"

21 months agodoc/architecture: edit "HA Authentication" 53633/head
Zac Dover [Mon, 25 Sep 2023 04:34:06 +0000 (14:34 +1000)]
doc/architecture: edit "HA Authentication"

Edit "High Availability Authentication" in doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit cb680a7865c4766d54d535889ec1517a0e84b5b5)

21 months agoMerge pull request #53620 from zdover23/wip-doc-2023-09-24-backport-53613-to-quincy
Anthony D'Atri [Sat, 23 Sep 2023 18:02:13 +0000 (14:02 -0400)]
Merge pull request #53620 from zdover23/wip-doc-2023-09-24-backport-53613-to-quincy

quincy: doc/architecture: "Edit HA Auth"

21 months agodoc/architecture: "Edit HA Auth" 53620/head
Zac Dover [Sat, 23 Sep 2023 02:26:18 +0000 (12:26 +1000)]
doc/architecture: "Edit HA Auth"

Rewrite the explanation of how a client authenticates against a monitor.
This is a rewrite of a single paragraph, and has been set apart in its
own PR so that it can receive the maximum amount of scrutiny that the
upstream Ceph community can muster.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c71cd84ec9e579ba0913c4952570bba6082e03b5)

21 months agoqa/suites/krbd: disable POOL_APP_NOT_ENABLED health check 53598/head
Ilya Dryomov [Fri, 15 Sep 2023 13:33:27 +0000 (15:33 +0200)]
qa/suites/krbd: disable POOL_APP_NOT_ENABLED health check

... same as for rbd suite.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0b68a8b4c07d1528190c71cda566b9d1fdb32640)

21 months agoqa/suites/rbd: drop POOL_APP_NOT_ENABLED from ignorelists
Ilya Dryomov [Fri, 15 Sep 2023 13:33:27 +0000 (15:33 +0200)]
qa/suites/rbd: drop POOL_APP_NOT_ENABLED from ignorelists

With "mon warn on pool no app = false" in the config, it's obviously
redundant.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 9e884ddeecde4a3028803d207b1fab91706ebbf1)

21 months agoqa/suites/rbd: disable POOL_APP_NOT_ENABLED health check
Ilya Dryomov [Fri, 15 Sep 2023 13:33:27 +0000 (15:33 +0200)]
qa/suites/rbd: disable POOL_APP_NOT_ENABLED health check

Commit 990806e635a1 ("mon, qa: issue pool application warning even
if pool is empty") made it impossible to create a pool without raising
a (bogus) health alert.  See [1] for details.

[1] https://lists.ceph.io/hyperkitty/list/dev@ceph.io/thread/ZTDYC5HN677RR26EB4P6PORN6L2IFH4R/

Fixes: https://tracker.ceph.com/issues/62711
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit e64830eb8e94eafa42b0a5f6cacd5359db317a0b)

21 months agoMerge pull request #53544 from rhcs-dashboard/wip-62881-quincy
Nizamudeen A [Fri, 22 Sep 2023 06:52:24 +0000 (12:22 +0530)]
Merge pull request #53544 from rhcs-dashboard/wip-62881-quincy

quincy: mgr/dashboard: align charts of landing page

Reviewed-by: Nizamudeen A <nia@redhat.com>
21 months agorgw: fix FP error when calculating enteries per bi shard 53592/head
J. Eric Ivancich [Thu, 5 Jan 2023 18:57:37 +0000 (13:57 -0500)]
rgw: fix FP error when calculating enteries per bi shard

When calculating how many entries per shard to request during an
ordered bucket listing, we divide by the number of bucket index
shards. If this value is 0, then a floating point exception is
generated, crashing the RGW.

This addresses the proximate issue by detecting the situation and
returning an error rather than crashing.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit bd6ee7e78d857bff31b0bb23f0ee8d8737ffef8e)

Conflicts:
src/rgw/rgw_rados.cc (trivial: __func__ vs __PRETTY_FUNCTION__)

21 months agoMerge pull request #53586 from zdover23/wip-doc-2023-09-22-backport-53493-to-quincy
Anthony D'Atri [Thu, 21 Sep 2023 18:21:13 +0000 (14:21 -0400)]
Merge pull request #53586 from zdover23/wip-doc-2023-09-22-backport-53493-to-quincy

quincy: doc/architecture: "Edit HA Auth" (one of several)