]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Patrick Donnelly [Thu, 27 Jul 2023 00:46:55 +0000 (20:46 -0400)]
qa: add test cases for vanilla ops commands
To test they work, not that the output is useful.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
ca4d0dc42b553352d64c0eb9a8be6487b59b03fe )
Conflicts:
qa/tasks/cephfs/test_admin.py: dump_blocked_ops_count does not exist in quincy, introduced in
1ead2229aeb1f2cca0f4f4f328cb176443389760
Patrick Donnelly [Tue, 18 Jul 2023 01:22:04 +0000 (21:22 -0400)]
mds: dump locks when printing mutation ops
For debugging where an operation may be stuck.
Fixes: https://tracker.ceph.com/issues/62086
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
5c7dea32bb1ee04743f0e4341dcbe06cdb096c2d )
Conflicts:
src/mds/MDSRank.cc: header conflict
Patrick Donnelly [Wed, 26 Jul 2023 17:14:46 +0000 (13:14 -0400)]
common/TrackedOp: support overriding the _dump method
When dumping an op, it may be desirable to alter how it is dumped depending on
which locks are held. As it happens, I plan to dump extra information if the
mds_lock is held!
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
224ba5ad4cf7cce6f48d9cbe1e0157b804954c6a )
Conflicts:
src/common/TrackedOp.cc: lost option
src/common/TrackedOp.h: lost option
Patrick Donnelly [Fri, 21 Jul 2023 16:50:10 +0000 (12:50 -0400)]
mds: remove op field obsoleted by more usable "reqid"
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
051916ec697da0ab539ffb38adb4ed92d6f9f74d )
Patrick Donnelly [Thu, 20 Jul 2023 13:41:53 +0000 (09:41 -0400)]
mds: dump metareq_t instead of full op
This avoids infinite recursion when dumping locks with xlock_by
non-null.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
79c7ddce8a9c9deaf277aa27ca402aa0415420de )
Patrick Donnelly [Wed, 19 Jul 2023 15:50:24 +0000 (11:50 -0400)]
mds: add lock type to formatter dump of SimpleLock
Otherwise you can't easily know which lock it is in the corresponding
MDSCacheObject.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
c62333453ab57540d087398a1ae6e9d525db783f )
Patrick Donnelly [Wed, 19 Jul 2023 15:52:29 +0000 (11:52 -0400)]
mds: mark print methods const
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
342d1210de857dcc2460917d5710caddfc13df5d )
Patrick Donnelly [Fri, 21 Jul 2023 17:05:15 +0000 (13:05 -0400)]
mds: drop MDRequestImpl::msg_lock
TrackedOp::lock is already suitable for this purpose.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
98d50889f65bdfcce793e2d3acf3352fe8b5c90f )
Patrick Donnelly [Fri, 21 Jul 2023 16:56:27 +0000 (12:56 -0400)]
mds: lock TrackedOp when dumping
The MDS does not generally bother locking a Mutation before changing
anything so this lock provides weak protection. In any case, try to
improve on that...
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
9d75d6b0bdfe18ffb6f345bacb02dc602d014398 )
Patrick Donnelly [Thu, 27 Jul 2023 00:17:02 +0000 (20:17 -0400)]
mds: avoid recursive locks dumping state
Also: fix return to std::string. A string_view is not a thread-safe return.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
60d1bdb1f53723249746d64c660f88aa79cd5b35 )
Patrick Donnelly [Wed, 26 Jul 2023 16:55:07 +0000 (12:55 -0400)]
common/TrackedOp: fix race updating description with proper lock
It is not safe to "cache" a member which may be changed by a racing thread.
This reworks the locking so we can do a light-weight check if the description
is already generated wihtout acquiring the heavier TrackedOp::lock. If it's not
available yet or it needs regenerated, then get the proper locks to generate
it.
Fixes: e45f5c2c33508bec3b177e51fd6cc5fde1f0e674
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
36eaa495eb37485796ce57c8c4b1cca603efc193 )
Patrick Donnelly [Fri, 21 Jul 2023 17:57:33 +0000 (13:57 -0400)]
common/Formatter: add support for dumping null
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
5f57c526b22af16e8a079aacefcb26cc14202ad2 )
Patrick Donnelly [Fri, 21 Jul 2023 17:55:25 +0000 (13:55 -0400)]
common/Formatter: refactor generating xml name
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
dd7a99349f6fb571d53d412e04f6386be30eec82 )
Anthony D'Atri [Sun, 8 Oct 2023 12:53:22 +0000 (08:53 -0400)]
Merge pull request #53880 from zdover23/wip-doc-2023-10-08-backport-53875-to-quincy
quincy: doc/rados: edit troubleshooting-mon.rst (3 of x)
Anthony D'Atri [Sun, 8 Oct 2023 12:51:29 +0000 (08:51 -0400)]
Merge pull request #53882 from zdover23/wip-doc-2023-10-08-backport-53874-to-quincy
quincy: doc/rados: edit troubleshooting/community.rst
Zac Dover [Sat, 7 Oct 2023 20:39:23 +0000 (06:39 +1000)]
doc/rados: edit troubleshooting/community.rst
Edit doc/rados/troubleshooting/community.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
fabfec273474a85cf3687ddf89183f0607c2ad71 )
Zac Dover [Sat, 7 Oct 2023 21:33:17 +0000 (07:33 +1000)]
doc/rados: edit troubleshooting-mon.rst (3 of x)
Edit doc/rados/troubleshooting/troubleshooting-mon.rst.
Follows https://github.com/ceph/ceph/pull/52827
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
fc45a0c4dd0247f472a940d6c92e7acdb0cdc354 )
Anthony D'Atri [Sun, 8 Oct 2023 01:55:00 +0000 (21:55 -0400)]
Merge pull request #53878 from zdover23/wip-doc-2023-10-08-backport-53876-to-quincy
quincy: doc/architecture: repair RBD sentence
Zac Dover [Sat, 7 Oct 2023 21:43:43 +0000 (07:43 +1000)]
doc/architecture: repair RBD sentence
Improve an ambiguous sentence in doc/architecture.rst.
The problem presented by the original sentence is that the phrasal verb
"to provide with" is implicated in one of its possible readings.
Interpreted in that way, the sentence seems to express the incorrect
idea that RBD furnishes block devices with snapshotting and cloning, as
though snapshotting and cloning are being delivered to the block
devices. In fact, snapshotting and cloning are just features of RBD, and
are features that are described on this page:
https://docs.ceph.com/en/quincy/rbd/rbd-snapshot/.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
5abd530460e3d5a60142d9350d93544402b6dec4 )
Yuri Weinstein [Sat, 7 Oct 2023 22:04:59 +0000 (15:04 -0700)]
Merge pull request #53664 from lxbsz/wip-62519
quincy: client: move the Inode to new auth mds session when changing auth cap
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Yuri Weinstein [Sat, 7 Oct 2023 22:04:10 +0000 (15:04 -0700)]
Merge pull request #53663 from lxbsz/wip-62522
quincy: ceph: allow xlock state to be LOCK_PREXLOCK when putting it
Reviewed-by: Venky Shankar <vshankar@redhat.com>
zdover23 [Sat, 7 Oct 2023 05:33:26 +0000 (16:33 +1100)]
Merge pull request #53872 from zdover23/wip-doc-2023-10-07-backport-53790-to-quincy
quincy: doc/architecture: edit "Peering and Sets"
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Zac Dover [Tue, 3 Oct 2023 12:11:50 +0000 (22:11 +1000)]
doc/architecture: edit "Peering and Sets"
Edit the English in the section "Peering and Sets" in the file
doc/architecture.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
c69b111966f190ac4a1ebd5244a9cf9f61970dd7 )
Shilpa Jagannath [Fri, 6 Oct 2023 18:03:14 +0000 (14:03 -0400)]
Merge pull request #52799 from cbodley/wip-62302-quincy
quincy: rgw: retry metadata cache notifications with INVALIDATE_OBJ
Anthony D'Atri [Fri, 6 Oct 2023 00:41:35 +0000 (20:41 -0400)]
Merge pull request #53854 from zdover23/wip-doc-2023-10-06-backport-53834-to-quincy
quincy: doc: remove egg fragment from dev/developer_guide/running-tests-locally
Dhairya Parmar [Thu, 5 Oct 2023 08:12:31 +0000 (13:42 +0530)]
doc: remove egg fragment from dev/developer_guide/running-tests-locally
DEPRECATION: git+https://github.com/ceph/teuthology#egg=teuthology
[test] contains an egg fragment with a non-PEP 508 name pip 25.0 will enforce
this behaviour change. A possible replacement is to use the req @ url syntax,
and remove the egg fragment. Discussion can be found at
https://github.com/pypa/pip/issues/11617
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
(cherry picked from commit
1f78a32a1822fea1a56a88215e452b730b7672c7 )
Yuri Weinstein [Thu, 5 Oct 2023 18:01:06 +0000 (11:01 -0700)]
Merge pull request #53102 from batrick/wip-62554-quincy
quincy: libcephsqlite: fill 0s in unread portion of buffer
Reviewed-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Thu, 5 Oct 2023 18:00:05 +0000 (11:00 -0700)]
Merge pull request #53566 from pdvian/wip-59177-quincy
quincy: blk/kernel: Add O_EXCL for block devices
Reviewed-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Thu, 5 Oct 2023 17:59:24 +0000 (10:59 -0700)]
Merge pull request #53158 from ljflores/wip-62592-quincy
quincy: python-common: drive_selection: fix KeyError when osdspec_affinity is not set
Reviewed-by: Adam King adking@redhat.com
Yuri Weinstein [Thu, 5 Oct 2023 17:58:22 +0000 (10:58 -0700)]
Merge pull request #52952 from k0ste/wip-62118-quincy
quincy: qa: use parallel gzip for compressing logs
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Thu, 5 Oct 2023 17:57:26 +0000 (10:57 -0700)]
Merge pull request #52215 from batrick/wip-61834-quincy
quincy: pybind/mgr/devicehealth: do not crash if db not ready
Reviewed-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Thu, 5 Oct 2023 17:56:42 +0000 (10:56 -0700)]
Merge pull request #51811 from NitzanMordhai/wip-61487-quincy
quincy: pybind/argparse: blocklist ip validation
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Anthony D'Atri [Thu, 5 Oct 2023 16:52:21 +0000 (12:52 -0400)]
Merge pull request #53838 from zdover23/wip-doc-2023-10-05-backport-53819-to-quincy
quincy: doc/rados: edit troubleshooting.rst
Yuri Weinstein [Thu, 5 Oct 2023 14:27:39 +0000 (07:27 -0700)]
Merge pull request #53729 from ceph/revert-50974-wip-59201-quincy
Revert "quincy: qa: add subvolume option flavors"
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Thu, 5 Oct 2023 14:20:02 +0000 (07:20 -0700)]
Merge pull request #53677 from kamoltat/wip-ksirivad-quincy-backport-52442
quincy: pybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs
Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Yuri Weinstein [Thu, 5 Oct 2023 14:19:02 +0000 (07:19 -0700)]
Merge pull request #53092 from sseshasa/wip-62547-quincy
quincy: osd/scheduler/mClockScheduler: Use same profile and client ids for all clients to ensure allocated QoS limit consumption.
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Zac Dover [Wed, 4 Oct 2023 11:14:13 +0000 (21:14 +1000)]
doc/rados: edit troubleshooting.rst
Edit doc/rads/troubleshooting.rst to remove some language that sounds
quite close to marketing language.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
9d9d92837e44e3af233bc228850be09e8f64eb7c )
zdover23 [Thu, 5 Oct 2023 11:31:45 +0000 (22:31 +1100)]
Merge pull request #53812 from zdover23/wip-doc-2023-10-04-backport-53791-to-quincy
quincy: doc/rados: edit ops/control.rst (1 of x)
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Avan [Thu, 5 Oct 2023 09:34:24 +0000 (15:04 +0530)]
Merge pull request #48523 from k0ste/wip-57886-quincy
quincy: mgr/prometheus: avoid duplicates and deleted entries for rbd_stats_pools
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 20:29:11 +0000 (13:29 -0700)]
Merge pull request #52739 from theanalyst/wip-58818
quincy: rgw: swift : check for valid key in POST forms
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Radoslaw Zarzynski [Wed, 4 Oct 2023 19:14:50 +0000 (21:14 +0200)]
Merge pull request #53690 from pdvian/wip-62995-quincy
quincy: osd/OpRequest: Add detailed description for delayed op in osd log file
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 16:18:47 +0000 (09:18 -0700)]
Merge pull request #52585 from rishabh-d-dave/wip-58991-quincy
quincy: qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:39:28 +0000 (08:39 -0700)]
Merge pull request #53042 from pdvian/wip-62479-quincy
quincy: mon, qa: issue pool application warning even if pool is empty
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:38:45 +0000 (08:38 -0700)]
Merge pull request #52752 from mchangir/wip-61795-quincy
quincy: mgr/snap_schedule: catch all exceptions for cli
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:37:36 +0000 (08:37 -0700)]
Merge pull request #52722 from NitzanMordhai/wip-62252-quincy
quincy: qa/standalone/osd/divergent-prior.sh: Divergent test 3 with pg_autoscale_mode on pick divergent osd
Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:35:49 +0000 (08:35 -0700)]
Merge pull request #52534 from idryomov/wip-61733-quincy
quincy: mon/MonClient: resurrect original client_mount_timeout handling
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:34:26 +0000 (08:34 -0700)]
Merge pull request #52467 from k0ste/wip-62030-quincy
quincy: mon/ConfigMonitor: update crush_location from osd entity
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:33:12 +0000 (08:33 -0700)]
Merge pull request #47840 from NitzanMordhai/wip-57316-quincy
quincy: osd, mon: add pglog dups length
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:30:50 +0000 (08:30 -0700)]
Merge pull request #53139 from mihalicyn/wip-62571-quincy
quincy: ceph_fs.h: add separate owner_{u,g}id fields
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:30:18 +0000 (08:30 -0700)]
Merge pull request #52983 from batrick/wip-61799-quincy
quincy: mon/MDSMonitor: plug paxos when maybe manipulating osdmap
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:29:36 +0000 (08:29 -0700)]
Merge pull request #52902 from leonid-s-usov/backport/bulk-data-pool/quincy
quincy: Consider setting "bulk" autoscale pool flag when automatically creating a data pool for CephFS
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:28:42 +0000 (08:28 -0700)]
Merge pull request #52851 from lxbsz/wip-61167
quincy: client: issue a cap release immediately if no cap exists
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:28:09 +0000 (08:28 -0700)]
Merge pull request #52849 from lxbsz/wip-62194
quincy: mds: do not send split_realms for CEPH_SNAP_OP_UPDATE msg
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:27:12 +0000 (08:27 -0700)]
Merge pull request #52845 from lxbsz/wip-62200
quincy: mds: skip forwarding request if the session were removed
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:26:30 +0000 (08:26 -0700)]
Merge pull request #52749 from mchangir/wip-61991-quincy
quincy: mgr/snap_schedule: allow retention spec 'n' to be user defined
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:25:30 +0000 (08:25 -0700)]
Merge pull request #52743 from batrick/wip-62270-quincy
quincy: qa: wait for file to have correct size
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:24:10 +0000 (08:24 -0700)]
Merge pull request #52725 from kotreshhr/wip-62241-quincy
quincy: mds: Fix the linkmerge assert check
Reviewed-by: Milind Changire <mchangir@redhat.com>
Yuri Weinstein [Wed, 4 Oct 2023 15:15:38 +0000 (08:15 -0700)]
Merge pull request #52683 from batrick/wip-62191-quincy
quincy: mds: update mdlog perf counters during replay
Reviewed-by: Milind Changire <mchangir@redhat.com>
zdover23 [Wed, 4 Oct 2023 14:37:34 +0000 (01:37 +1100)]
Merge branch 'quincy' into wip-doc-2023-10-04-backport-53791-to-quincy
Signed-off-by: zdover23 <zac.dover@proton.me>
Anthony D'Atri [Wed, 4 Oct 2023 13:01:41 +0000 (09:01 -0400)]
Merge pull request #53816 from zdover23/wip-doc-2023-10-04-backport-53792-to-quincy
quincy: doc/rados: edit ops/control.rst (2 of x)
Igor Fedotov [Wed, 4 Oct 2023 11:55:53 +0000 (14:55 +0300)]
Merge pull request #48249 from ifed01/wip-ifed-fix-57121-qui
quincy: osd: set per_pool_stats true when OSD has no PG
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Zac Dover [Tue, 3 Oct 2023 12:39:23 +0000 (22:39 +1000)]
doc/rados: edit ops/control.rst (2 of x)
Edit doc/rados/operations/control.rst (2 of x).
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
03ed13930661628c10f185af1a3949548bdc8288 )
Igor Fedotov [Wed, 4 Oct 2023 10:19:42 +0000 (13:19 +0300)]
Merge pull request #51774 from ifed01/wip-ifed-fix-bluefs-prealloc-qui
quincy: os/bluestore: proper override rocksdb::WritableFile::Allocate
Reviewed-by: Adam Kupczyk <akupszyk@ibm.com>
Zac Dover [Tue, 3 Oct 2023 12:22:39 +0000 (22:22 +1000)]
doc/rados: edit ops/control.rst (1 of x)
Edit doc/rados/operations/control.rst (1 of x).
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
89c9584f8a1633b5ad1936af09529657d81b7134 )
Nizamudeen A [Wed, 4 Oct 2023 06:11:45 +0000 (11:41 +0530)]
Merge pull request #53796 from rhcs-dashboard/wip-63078-quincy
quincy: mgr/dashboard: enable protect option if layering enabled
Reviewed-by: Nizamudeen A <nia@redhat.com>
avanthakkar [Tue, 26 Sep 2023 11:04:08 +0000 (16:34 +0530)]
mgr/dashboard: enable protect option if layering enabled
Fixes: https://tracker.ceph.com/issues/63076
Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit
91be9ecdf519df18e564c79681f6275376f786e6 )
Kamoltat [Thu, 13 Jul 2023 19:41:29 +0000 (19:41 +0000)]
qa/workunits: modified tests for noautoscale flag change
modified:
`qa/workunits/mon/test_noautoscale_flag.sh`
`qa/workunits/cephtool/test.sh`
adding test coverage to files mentioned above
Fixes: https://tracker.ceph.com/issues/61922
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit
0972dbf225a287345387bed9e0fde0f9e8be8285 )
Kamoltat [Thu, 13 Jul 2023 18:23:13 +0000 (18:23 +0000)]
pybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs
Problem:
The pg_autoscaler `noautoscale flag` doesn't retain individual pool states of
`autoscale mode`. For example turn the flag `ON` and then `OFF` again all
the pools will have `autoscale mode on` which is inconvenience for the user
because sometimes the user just want to temporary disable the autoscaler on
all pools and will enable it back after a period of time while retaining
individual pool states of `autoscale mode`
Solution:
We store noautoscale flag in the OSDMAP such that it is
persistent. We then get rid of noautoscale MODULE OPTION
in the pg_autoscaler module since we do not need it anymore.
Everytime we set, unset or get the flag we rely on looking up
the OSDMAP, we did this because we want to avoid inconsistancy
between the `noautoscale flag`. This is because `noautoscale flag`
can easily be set by doing `ceph osd set noautoscale`.
Fixes: https://tracker.ceph.com/issues/61922
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit
0bfdf6362a6b9705212705ee96fa3d6933e51437 )
Conflicts:
src/pybind/mgr/pg_autoscaler/module.py - trivial fix
Anthony D'Atri [Mon, 2 Oct 2023 13:39:57 +0000 (09:39 -0400)]
Merge pull request #53749 from zdover23/wip-doc-2023-10-02-backport-53744-to-quincy
quincy: doc/architecture: edit "Calculating PG IDs"
Zac Dover [Sun, 1 Oct 2023 23:43:37 +0000 (09:43 +1000)]
doc/architecture: edit "Calculating PG IDs"
Edit the section "Calcluating PG IDs" in doc/architecture.rst.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
69a585fbf4fbf50eed784a248442f622f01120c9 )
Adam King [Sun, 1 Oct 2023 17:04:52 +0000 (13:04 -0400)]
Merge pull request #53705 from adk3798/wip-61550-quincy
quincy: mgr/cephadm: also don't write client files/tuned profiles to maintenance hosts
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Anthony D'Atri [Sun, 1 Oct 2023 13:04:36 +0000 (09:04 -0400)]
Merge pull request #53743 from zdover23/wip-doc-2023-10-01-backport-53740-to-quincy
quincy: doc/architecture: edit several sections
Yuri Weinstein [Sun, 1 Oct 2023 12:53:46 +0000 (05:53 -0700)]
Merge pull request #53098 from adk3798/quincy-keealive-unicast-or-interface
quincy: cephadm: Split multicast interface and unicast_ip in keepalived.conf
Reviewed-by: Adam King adking@redhat.com
Yuri Weinstein [Sun, 1 Oct 2023 12:52:14 +0000 (05:52 -0700)]
Merge pull request #52909 from adk3798/quincy-cephadm-fix-call
quincy: cephadm: fix call timeout argument
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Yuri Weinstein [Sun, 1 Oct 2023 12:48:53 +0000 (05:48 -0700)]
Merge pull request #53598 from idryomov/wip-62711-quincy
quincy: qa/suites/{rbd,krbd}: disable POOL_APP_NOT_ENABLED health check
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Sun, 1 Oct 2023 12:48:18 +0000 (05:48 -0700)]
Merge pull request #53294 from ajarr/wip-62685-quincy
quincy: librbd: kick ExclusiveLock state machine on client being blocklisted when waiting for lock
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Yuri Weinstein [Sun, 1 Oct 2023 12:47:26 +0000 (05:47 -0700)]
Merge pull request #53275 from idryomov/wip-61707-quincy
quincy: librbd: make CreatePrimaryRequest remove any unlinked mirror snapshots
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Sun, 1 Oct 2023 12:46:32 +0000 (05:46 -0700)]
Merge pull request #52879 from idryomov/wip-52913-quincy
quincy: rbd-mirror: fix image replayer shut down description on force promote
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
Zac Dover [Sat, 30 Sep 2023 04:58:41 +0000 (14:58 +1000)]
doc/architecture: edit several sections
Edit the following sections in doc/architecture.rst:
1. Dynamic Cluster Management
2. About Pools
3. Mapping PGs to OSDs
The tone of "Dynamic Cluster Management" remains a bit too close to the
tone of marketing material, in my opinion, but I will return to firm it
up when I have finished a once-over of architecture.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
9657c45fc12cd8522df72c9bb8820320758305e4 )
Anthony D'Atri [Sat, 30 Sep 2023 09:43:17 +0000 (05:43 -0400)]
Merge pull request #53739 from zdover23/wip-doc-2023-09-30-backport-53726-to-quincy
quincy: doc/architecture: edit "Replication"
Zac Dover [Thu, 28 Sep 2023 21:37:40 +0000 (07:37 +1000)]
doc/architecture: edit "Replication"
Edit "Replication" in the "Smart Daemons Enable Hyperscale" section of
doc/architecture.rst.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
4cf22e195ab367eb65f95c2578d06919ebcd108f )
zdover23 [Sat, 30 Sep 2023 00:09:31 +0000 (10:09 +1000)]
Merge pull request #53731 from zdover23/wip-doc-2023-09-29-backport-53723-to-quincy
quincy: doc/architecture: edit "Data Scrubbing"
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Yuri Weinstein [Fri, 29 Sep 2023 16:06:01 +0000 (09:06 -0700)]
Merge pull request #53592 from trociny/wip-58479-quincy
quincy: rgw: fix FP error when calculating enteries per bi shard
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 16:05:22 +0000 (09:05 -0700)]
Merge pull request #53561 from cfsnyder/wip-58788-quincy
quincy: rgwlc: prevent lc for one bucket from exceeding time budget
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 16:04:45 +0000 (09:04 -0700)]
Merge pull request #53441 from trociny/wip-61870-quincy
quincy: rgw: pick http_date in case of http_x_amz_date absence
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 16:04:11 +0000 (09:04 -0700)]
Merge pull request #53399 from trociny/wip-62753-quincy
quincy: rgw: fix 2 null versionID after convert_plain_entry_to_versioned
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 16:03:39 +0000 (09:03 -0700)]
Merge pull request #53396 from trociny/wip-62307-quincy
quincy: rgw/sync-policy: Correct "sync status" & "sync group" commands
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 16:02:48 +0000 (09:02 -0700)]
Merge pull request #52818 from cbodley/wip-62321-quincy
quincy: rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 15:57:11 +0000 (08:57 -0700)]
Merge pull request #51598 from alimaredia/wip-61174-quincy
quincy: rgw/swift: check position of first slash in slo manifest files
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Yuri Weinstein [Fri, 29 Sep 2023 15:51:03 +0000 (08:51 -0700)]
Merge pull request #52626 from nbalacha/wip-62112-quincy
quincy: rbd-mirror: fix race preventing local image deletion
Reviewed-by: Mykola Golub <mgolub@suse.com>
Zac Dover [Thu, 28 Sep 2023 18:40:08 +0000 (04:40 +1000)]
doc/architecture: edit "Data Scrubbing"
Edit the "Data Scrubbing" listitem in the list of benefits conferred by
the use by OSDs of the aggregate power of the cluster, in the section
"Smart Daemons Enable Hyperscale" in doc/architecture.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
d7b991646fcd36a1df7456e8e82c9d54a01e50f9 )
Venky Shankar [Fri, 29 Sep 2023 05:05:24 +0000 (10:35 +0530)]
Revert "quincy: qa: add subvolume option flavors"
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Anthony D'Atri [Fri, 29 Sep 2023 02:53:54 +0000 (22:53 -0400)]
Merge pull request #53728 from zdover23/wip-doc-2023-09-29-backport-53707-to-quincy
quincy: doc/architecture: edit "OSD Membership and Status"
Zac Dover [Thu, 28 Sep 2023 03:55:02 +0000 (13:55 +1000)]
doc/architecture: edit "OSD Membership and Status"
Edit "OSD Membership and Status" in the "Smart Daemons Enable
Hyperscale" section of doc/architecture.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
dbd85336b1aa3ef42cfc12495b3dc5142d4b8a28 )
Ilya Dryomov [Thu, 28 Sep 2023 07:26:49 +0000 (09:26 +0200)]
Merge pull request #53706 from rhcs-dashboard/quincy-legacy-resolver-fix
quincy: install-deps: remove the legacy resolver flags
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Nizamudeen A [Wed, 19 Jul 2023 14:05:05 +0000 (19:35 +0530)]
install-deps: remove the legacy resolver flags
This was a workaround that was introduced long time ago. This will be
something that could be deprectaed at some point [1]. And its preventing some of the dependencies to be
downloaded or stored into the wheelhouse. Deps like jsonschema, parse,
mypy, cryptography etc.
[1] https://pip.pypa.io/en/latest/user_guide/#deprecation-timeline
Fixes: https://tracker.ceph.com/issues/62082
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
d179b95ddf57f8ca48633aed9f6229e39ad83fef )
Adam King [Thu, 4 May 2023 16:55:55 +0000 (12:55 -0400)]
mgr/cephadm: also don't write client files/tuned profiles to maintenance hosts
Since they could have been taken offline for maintenance,
they should be treated the same as offline hosts in this
case and we should avoid trying to write files to them
Fixes: https://tracker.ceph.com/issues/59650
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit
4244d83f70abf4331a055dbeaa6fc2f0d7814bb6 )
Anthony D'Atri [Wed, 27 Sep 2023 19:15:13 +0000 (15:15 -0400)]
Merge pull request #53687 from zdover23/wip-doc-2023-09-27-backport-53685-to-quincy
quincy: doc/architecture: edit "OSDs service clients directly"
yite.gu [Tue, 14 Mar 2023 13:58:56 +0000 (09:58 -0400)]
osd/OpRequest: Add detail description for delayed op in osd log file
Have no description delayed reason while the op mark is delayed
in the log file. Add a detailed description while the op mark
is delayed, it helps to quickly determine the problem and leave
a trace.
Signed-off-by: Yite Gu <yitegu0@gmail.com>
(cherry picked from commit
a6c0e601b13dc2209cb6d546d249988d0472e1d4 )
Zac Dover [Tue, 26 Sep 2023 20:00:34 +0000 (06:00 +1000)]
doc/architecture: edit "OSDs service clients directly"
Edit "OSDs service clients directly" in the list in
"Smart Daemons Enable Hyperscale" in doc/architecure.rst.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
6f9dfd75b50f7793d2ff9bc3003c35efa6d6da04 )