]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Zac Dover [Thu, 16 Jun 2022 05:57:16 +0000 (15:57 +1000)]
doc/dev: s/master/main/ in title
This changes "master" to "main" in a title. If we lived in an
ideal world, this would have been a part of PR#46678.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
f5fd158bea2a54b83c7f75cd806885de44045ad6 )
Yuri Weinstein [Thu, 16 Jun 2022 21:22:18 +0000 (14:22 -0700)]
Merge pull request #45928 from kotreshhr/wip-55349-pacific
pacific: mgr/volumes: Show clone failure reason in clone status command
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Venky Shankar vshankar@redhat.com
Venky Shankar [Thu, 16 Jun 2022 11:19:42 +0000 (16:49 +0530)]
Merge pull request #45961 from vshankar/tr-55375
pacific: mgr/volumes: set, get, list and remove metadata of subvolume
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
zdover23 [Thu, 16 Jun 2022 06:03:08 +0000 (16:03 +1000)]
Merge pull request #46710 from zdover23/wip-doc-2022-06-15-backport-pacific-46705-master-to-main-dev-guide-merging
pacific: doc/dev_guide: s/master/main in merging.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Wed, 15 Jun 2022 21:54:31 +0000 (07:54 +1000)]
doc/dev_guide: s/master/main in merging.rst
This changes the branch name "master" to the branch name
"main" in merging.rst.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
52da71f0ab0a4606a73be749b3d983969bd34972 )
zdover23 [Thu, 16 Jun 2022 01:13:43 +0000 (11:13 +1000)]
Merge pull request #46704 from zdover23/wip-doc-2022-06-15-backport-pacific-46678-master-to-main-dev-guide-basic-workflow
pacific: doc/dev: s/master/main/ in basic workflow
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
zdover23 [Wed, 15 Jun 2022 21:48:27 +0000 (07:48 +1000)]
Merge pull request #46662 from zdover23/wip-doc-2022-06-13-backport-pacific-46651-master-to-main
pacific: doc/dev: s/master/main/ essentials.rst dev guide
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
zdover23 [Wed, 15 Jun 2022 21:44:39 +0000 (07:44 +1000)]
Merge pull request #46663 from zdover23/wip-doc-2022-06-13-backport-pacific-46659-hardware-recs-polish
pacific: doc/start: Polish network section of hardware-recommendations.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Tue, 14 Jun 2022 22:15:33 +0000 (08:15 +1000)]
doc/dev: s/master/main/ in basic workflow
This PR changes "master" to "main" in the
basic_workflow.rst file. I have even changed
"master" to "main" in some terminal output from
several years ago. This isn't historically ac-
curate, of course, but my hope is that this change
will prevent someone in the future from being con-
fused about why an antiquated branch name is ref-
erred to.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
f5cfc22445a3e454e572873cdcfbc1852a38aa17 )
Yuri Weinstein [Wed, 15 Jun 2022 18:25:38 +0000 (11:25 -0700)]
Merge pull request #46039 from cbodley/wip-55456
pacific: rgw: OpsLogFile::stop() signals under mutex
Reviewed-by: Cory Snyder <csnyder@iland.com>
Yuri Weinstein [Wed, 15 Jun 2022 18:21:54 +0000 (11:21 -0700)]
Merge pull request #45410 from cfsnyder/wip-54537-pacific
pacific: rgw: fix segfault in OpsLogRados::log when realm is reloaded
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 17:06:25 +0000 (10:06 -0700)]
Merge pull request #46112 from Matan-B/wip-55514-pacific
pacific: mount/conf: Fix IPv6 parsing
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 17:03:04 +0000 (10:03 -0700)]
Merge pull request #45893 from nkshirsagar/wip-55296-pacific
pacific: Catch exception if thrown by __generate_command_map()
Reviewed-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 17:02:28 +0000 (10:02 -0700)]
Merge pull request #45847 from dvanders/wip-55250-pacific
pacific: rgw_reshard: drop olh entries with empty name
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 17:01:45 +0000 (10:01 -0700)]
Merge pull request #45486 from cfsnyder/wip-53868-pacific
pacific: rgw: return OK on consecutive complete-multipart reqs
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 14:28:50 +0000 (07:28 -0700)]
Merge pull request #46139 from kotreshhr/wip-55335-pacific
pacific: mgr/volumes: Fix idempotent subvolume rm
Reviewed-by: Venky Shankar vshankar@redhat.com
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 14:28:00 +0000 (07:28 -0700)]
Merge pull request #46138 from nmshelke/wip-55412-pacific
pacific: mds: add a perf counter to record slow replies
Reviewed-by: Venky Shankar vshankar@redhat.com
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Yuri Weinstein [Wed, 15 Jun 2022 14:27:06 +0000 (07:27 -0700)]
Merge pull request #45968 from vshankar/tr-55384
pacific: mgr/snap_schedule: add time zone suffix to snapshot dir name
Reviewed-by: Venky Shankar vshankar@redhat.com
Yuri Weinstein [Wed, 15 Jun 2022 14:25:00 +0000 (07:25 -0700)]
Merge pull request #45792 from lxbsz/wip-55192
pacific: client: buffer the truncate if we have the Fx caps
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
J. Eric Ivancich [Wed, 15 Jun 2022 12:56:24 +0000 (08:56 -0400)]
Merge pull request #45900 from ivancich/wip-55044-pacific
pacific: cls/rgw: rgw_dir_suggest_changes detects race with completion
Reviewed-by: casey Bodley <cbodley@redhat.com>
Ernesto Puerta [Tue, 14 Jun 2022 16:36:39 +0000 (18:36 +0200)]
Merge pull request #46456 from rhcs-dashboard/wip-55590-pacific
pacific: mgr/dashboard: WDC multipath bug fixes
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: nSedrickm <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Cory Snyder [Thu, 3 Feb 2022 19:48:05 +0000 (14:48 -0500)]
rgw: fix segfault in OpsLogRados::log when realm is reloaded
We weren't previously handling the deallocation of the store when
a realm was reloaded. Now passing a const reference to the pointer.
Fixes: https://tracker.ceph.com/issues/54130
Signed-off-by: Cory Snyder <csnyder@iland.com>
(cherry picked from commit
0713f65355586b2f6ceeb6bbce8763158847e5ed )
Conflicts:
src/rgw/rgw_log.cc
src/rgw/rgw_log.h
Cherry-pick notes:
- conflicts due to rename of RGWRados to rgw::sal::Store after Pacific
(cherry picked from commit
44a37dc0023a69da33620dc7b6e112221f7a6a0b )
Anthony D'Atri [Mon, 13 Jun 2022 23:06:12 +0000 (16:06 -0700)]
doc/start: Polish network section of hardware-recommendations.rst
Harmonize network throughput notation, minor tweaks to wording.
Followup to #46637
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
2eb173fef9dc9ff34078b0ae13e9fcc398cdbaa3 )
Zac Dover [Mon, 13 Jun 2022 21:48:46 +0000 (07:48 +1000)]
doc/dev: s/master/main/ essentials.rst dev guide
This PR changes all reference to the "master" branch
to references to the "main" branch (because we renamed
"master" to main", and the docs now need to reflect that).
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
728b8f26746c733988302d52cce4c46ebc607f63 )
zdover23 [Tue, 14 Jun 2022 06:23:44 +0000 (16:23 +1000)]
Merge pull request #46653 from zdover23/wip-doc-2022-06-13-backport-46637-pacific-hardware-recs-network
pacific: doc/start: rewrite hardware-recs networks section
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
zdover23 [Tue, 14 Jun 2022 06:17:58 +0000 (16:17 +1000)]
Merge pull request #46656 from zdover23/wip-doc-2022-06-13-backport-46583-pacific-hardware-recs-osd-and-mds-acros
pacific: doc/start: make OSD and MDS structures parallel
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
zdover23 [Tue, 14 Jun 2022 06:15:12 +0000 (16:15 +1000)]
Merge pull request #46657 from zdover23/wip-doc-2022-06-13-backport-46633-pacific-start-intro-crush-para-rewrite
pacific: doc/start: rewrite CRUSH para
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Yuri Weinstein [Mon, 13 Jun 2022 23:43:27 +0000 (16:43 -0700)]
Merge pull request #46368 from tchaikov/pacific-pr-46355
pacific: ceph.spec.in: disable annobin plugin if compile with gcc-toolset
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: David Galloway <dgallowa@redhat.com>
Yuri Weinstein [Mon, 13 Jun 2022 23:42:02 +0000 (16:42 -0700)]
Merge pull request #46365 from tchaikov/pacific-pr-44007
pacific: cmake: check for python(\d)\.(\d+) when building boost
Reviewed-by: Dirk Mueller <dmueller@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
Yuri Weinstein [Mon, 13 Jun 2022 23:39:22 +0000 (16:39 -0700)]
Merge pull request #46312 from b-ranto/wip-alerts-pacific
[pacific] mgr/alerts: Add Message-Id and Date header to sent emails
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Yuri Weinstein [Mon, 13 Jun 2022 23:38:16 +0000 (16:38 -0700)]
Merge pull request #46255 from tserong/wip-55616-pacific
pacific: test: No direct use of nose
Reviewed-by: Kefu Chai <kchai@redhat.com>
Zac Dover [Sun, 12 Jun 2022 23:41:28 +0000 (09:41 +1000)]
doc/start: rewrite CRUSH para
This PR supersedes https://github.com/ceph/ceph/pull/46584
and makes changes suggested by Anthony D'Atri that improve
the coherence and consistency of the paragraph that explains
the basics of the CRUSH algorithm.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
ba1a85b292fcd30020897a486cb452381c998690 )
Zac Dover [Wed, 8 Jun 2022 19:19:16 +0000 (05:19 +1000)]
doc/start: make OSD and MDS structures parallel
This PR makes the "Ceph OSDs" and "MDSs" bullet points
parallel by naming "object storage daemon" before referring
to the (admittedly more common and colloquial, but surely
unknown to people who genuinely require a document called
'Intro') acronym "OSD".
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
4f6edb92b9c4b7c47354d8ad66fdee6c06389541 )
Zac Dover [Mon, 13 Jun 2022 04:34:36 +0000 (14:34 +1000)]
doc/start: rewrite hardware-recs networks section
This rewrites the first two-thirds of the "Networks"
section of the Hardware Recommendations page in the
Intro to Ceph document. I have tried to divide the
techincal content in this section into subsections
that foreground the various subjects covered.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
778d3c0b59148e2a3b6bb662437778692b1988e3 )
Yuri Weinstein [Fri, 10 Jun 2022 20:47:03 +0000 (13:47 -0700)]
Merge pull request #46211 from idryomov/wip-use-system-libpmem-on-c9s-pacific
pacific: rpm: use system libpmem on Centos 9 Stream
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Fri, 10 Jun 2022 20:46:09 +0000 (13:46 -0700)]
Merge pull request #45991 from idryomov/wip-make-check-enable-rbd-caches-pacific
pacific: run-make-check.sh: enable RBD persistent caches
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Ilya Dryomov [Thu, 9 Jun 2022 11:42:01 +0000 (13:42 +0200)]
cmake: pass -Wno-error when building PMDK
It's hitting pacific with a nuisance -Werror=array-parameter= const
char * vs const char[37] mismatch. Follow commit
91a616b26e83 ("cmake:
pass RTE_DEVEL_BUILD=n when building dpdk") and just disable -Werror.
Fixes: https://tracker.ceph.com/issues/55977
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
03d27945a646124e8d8a915771ac94ed7b684366 )
Yuri Weinstein [Fri, 10 Jun 2022 14:19:17 +0000 (07:19 -0700)]
Merge pull request #46297 from dparmar18/pacific_put_get_backport
pacific: cephfs-shell: fix put and get cmd
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Yuri Weinstein [Fri, 10 Jun 2022 14:18:39 +0000 (07:18 -0700)]
Merge pull request #46183 from vshankar/tr-55427
pacific: mds: include encoded stray inode when sending dentry unlink message to replicas
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Yuri Weinstein [Fri, 10 Jun 2022 14:18:00 +0000 (07:18 -0700)]
Merge pull request #46180 from lxbsz/wip-55343
Pacific: mds: reset heartbeat when fetching or committing entries
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Yuri Weinstein [Fri, 10 Jun 2022 14:17:12 +0000 (07:17 -0700)]
Merge pull request #46179 from lxbsz/wip-55346
Pacific: client: stop forwarding the request when exceeding 256 times
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Yuri Weinstein [Fri, 10 Jun 2022 14:15:38 +0000 (07:15 -0700)]
Merge pull request #46146 from neesingh-rh/wip-55539-pacific
pacific: cephfs-top: Multiple filesystem support
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Yuri Weinstein [Thu, 9 Jun 2022 13:28:40 +0000 (06:28 -0700)]
Merge pull request #46470 from gregsfortytwo/wip-55747-pacific
pacific: Implement CIDR blocklisting
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Ilya Dryomov [Tue, 19 Apr 2022 09:21:06 +0000 (11:21 +0200)]
run-make-check.sh: enable RBD persistent caches
This was attempted in commit
69a7ed4eab36 ("run-make-check: enable
WITH_RBD_RWL when WITH_PMEM is true") but never completed. We soon
bumped the requirement on libpmem, so WITH_SYSTEM_PMDK=ON wouldn't
have worked anyway.
Enable the RWL mode conditionally based on WITH_RBD_RWL variable.
Enable the SSD mode unconditionally as it has no special dependencies
and can be built on any architecture.
Fixes: https://tracker.ceph.com/issues/55285
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
0f1634a21f5da2250915d8ac05a6f179d4e76d03 )
Conflicts:
run-make-check.sh [ commit
69a7ed4eab36 ("run-make-check:
enable WITH_RBD_RWL when WITH_PMEM is true") not in pacific ]
Ilya Dryomov [Tue, 19 Apr 2022 09:21:06 +0000 (11:21 +0200)]
test/encoding/check-generated.sh: show diff if binary reencode check fails
Take
bf0b161115aa ("test/encoding/check-generated.sh: show diff if cmp
fails") a bit further. Suggesting "cmp $tmp1 $tmp2" isn't very helpful
since cmp would report just the mismatch offset.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
59d928a06c028bf381307001d2b68fa8545d8fc4 )
Ilya Dryomov [Tue, 19 Apr 2022 09:21:05 +0000 (11:21 +0200)]
librbd/cache/pwl: WriteLogCacheEntry constructor must initialize flags
Initializing the individual bit field members leaves the remaining two
bits uninitialized and that garbage state gets persisted.
In general, using bit fields in a structure where the layout actually
matters is not desirable. Even with a few single bits, such as here,
their order, strictly speaking, is not guaranteed:
An implementation may allocate any addressable storage unit large
enough to hold a bit-field. If enough space remains, a bit-field
that immediately follows another bit-field in a structure shall be
packed into adjacent bits of the same unit. If insufficient space
remains, whether a bit-field that does not fit is put into the next
unit or overlaps adjacent units is implementation-defined. The
order of allocation of bit-fields within a unit (high-order to
low-order or low-order to high-order) is implementation-defined.
The alignment of the addressable storage unit is unspecified.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
91d270b210a908ea2f3578dd7db3263383da95a8 )
Ilya Dryomov [Tue, 19 Apr 2022 09:21:05 +0000 (11:21 +0200)]
librbd/cache/pwl: initialize generate_test_instances() objects
... to prevent check-generated.sh failures such as:
**** librbd::cache::pwl::WriteLogPoolRoot test 1 dump_json check failed ****
ceph-dencoder type librbd::cache::pwl::WriteLogPoolRoot select_test 1 dump_json > /tmp/typ-cAoWrqlHC
ceph-dencoder type librbd::cache::pwl::WriteLogPoolRoot select_test 1 encode decode dump_json > /tmp/typ-ES5yHpfGL
5c5
< "flushed_sync_gen": 0,
---
> "flushed_sync_gen": 255,
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
2c131f57d63454de39210375ce75a282df6fe365 )
Conflicts:
src/librbd/cache/pwl/Types.cc [ commit
6eb14774fec0 ("librbd:
build without "using namespace std"") not in pacific ]
src/librbd/cache/pwl/ssd/Types.h [ ditto ]
Ilya Dryomov [Tue, 19 Apr 2022 09:21:05 +0000 (11:21 +0200)]
librbd/cache/pwl: fix -Wunused-lambda-capture warnings
Reported by clang on "make check" and "make check arm64" builds.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
753aa038fdbc26a2ee0978f54d3f7dcfa052e833 )
Adam King [Wed, 8 Jun 2022 23:57:44 +0000 (19:57 -0400)]
Merge pull request #46556 from adk3798/pacific-fqdn-autotune
pacific: mgr/cephadm: use host shortname for osd memory autotuning
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
Adam King [Wed, 8 Jun 2022 21:15:26 +0000 (17:15 -0400)]
Merge pull request #45698 from tserong/wip-55097-pacific
pacific: ceph.spec.in: remove build directory at end of %install
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Adam King [Wed, 8 Jun 2022 21:13:54 +0000 (17:13 -0400)]
Merge pull request #46545 from adk3798/pacific-raw-osd-fixup
pacific: mgr/cephadm: don't redeploy osds seen in raw list if cephadm knows them
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Adam King [Wed, 8 Jun 2022 21:13:03 +0000 (17:13 -0400)]
Merge pull request #46552 from guits/bkp-pacific-46481
pacific: backport of cephadm: fix osd adoption with custom cluster name
Reviewed-by: Adam King <adking@redhat.com>
Adam King [Wed, 8 Jun 2022 21:11:59 +0000 (17:11 -0400)]
Merge pull request #46555 from adk3798/pacific-allow-crush-class
pacific: python-common: allow crush device class to be set from osd service spec
Reviewed-by: Cory Snyder <csnyder@iland.com>
Casey Bodley [Mon, 25 Apr 2022 20:32:33 +0000 (16:32 -0400)]
rgw: OpsLogFile drops lock before flush()
flush() acquires the same lock, so lockdep complains about recursive
locking here
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
5473ae75276b3f552ec70ae308a6fe0db1fe22a5 )
Casey Bodley [Mon, 25 Apr 2022 17:40:19 +0000 (13:40 -0400)]
rgw: remove unnecessary OpsLogFile::flush_mutex
this mutex was only held by one function, OpsLogFile::flush(). this
private member function is only ever called from the background thread,
so doesn't need to be protected by a mutex
as a further cleanup, i renamed 'cond' and 'mutex' now that we don't
need to differentiate between different locks
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
279d664f8b25d2eeafac0b5d60e532dbcf56218f )
Casey Bodley [Mon, 25 Apr 2022 17:28:02 +0000 (13:28 -0400)]
rgw: OpsLogFile::stop() signals under mutex
this shuts up ceph::debug_condition_variable's assertion that the
associated mutex is held during notify_one(). this is not strictly
required for correct use, but is a common source of bugs
Fixes: https://tracker.ceph.com/issues/55432
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
cf6f99e67a6dbbc4e39d9e1fda32356c18051f5a )
Yuri Weinstein [Wed, 8 Jun 2022 15:25:51 +0000 (08:25 -0700)]
Merge pull request #46429 from pdvian/wip-55309-pacific
pacific: mgr, mgr/prometheus: Fix regression with prometheus metrics
Reviewed-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Wed, 8 Jun 2022 15:25:14 +0000 (08:25 -0700)]
Merge pull request #46427 from pdvian/wip-55308-pacific
pacific: mgr, mon: Keep upto date metadata with mgr for MONs
Reviewed-by: Laura Flores <lflores@redhat.com>
Adam King [Fri, 3 Jun 2022 01:32:53 +0000 (21:32 -0400)]
mgr/cephadm: use hostname from crush map for osd memory autotuning
Fixes: https://tracker.ceph.com/issues/55841
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit
50f28aa56edd348c3816335bef3bbfaf5133ae54 )
Xiubo Li [Mon, 20 Dec 2021 02:21:50 +0000 (10:21 +0800)]
client: force a request to update the perms
If the caller perms is different with the current dirtier's, we
can still cache the attributes locally if possible, but will
mark the ctime needs to be updated forcely and the request will
implicitly flush the dirty caps for us.
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit
569770afe52726e1df970c2219b8aa2c080e8a31 )
Xiubo Li [Mon, 11 Oct 2021 08:45:16 +0000 (16:45 +0800)]
client: improve the code of setattr for atime/mtime
When the Fw caps is issued and increasing the atime/mtime, we can
buffer the atime/mtime. And when the Fs caps is issued and they
are not changing we can just ignore them.
In case when recovering the atime/mtime maybe decreased, no matter
the Fsw caps are issued, always send the request immediatelly.
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit
d3d1be4c62a8358569f0fea3a9ac17475c1e173b )
Xiubo Li [Mon, 11 Oct 2021 08:32:51 +0000 (16:32 +0800)]
client: try to buffer the truncate if we have the Fx caps
If the Fx caps is issued and new size is larger we can try to
buffer the truncate, and just ignore in case the new size equals
to current size.
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit
b557d642aeb21acf8b456a4addf6da63b17e1f68 )
Xiubo Li [Mon, 11 Oct 2021 01:55:58 +0000 (09:55 +0800)]
client: try to skip changing the gid/uid/mode/btime if As is issued
If the As caps is issued and the gid/uid/mode/btime don't change,
then it's safe to skip sending out a setattr request to MDS.
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit
ec32f0915b637b4bc6bbc6c9b2f675d058a5c02b )
Cory Snyder [Wed, 1 Jun 2022 09:39:11 +0000 (05:39 -0400)]
python-common: allow crush device class to be set from osd service spec
Adds crush_device_class parameter to DriveGroupSpec so that device class
can be set via service specs with cephadm.
Fixes: https://tracker.ceph.com/issues/55813
Signed-off-by: Cory Snyder <csnyder@iland.com>
(cherry picked from commit
c2f314ab8c187b54f12c04ec26034d451bd82273 )
Conflicts:
src/python-common/ceph/deployment/drive_group.py
Yuri Weinstein [Tue, 7 Jun 2022 16:04:18 +0000 (09:04 -0700)]
Merge pull request #46215 from rzarzynski/wip-tests-bl-fix-rebuild-pacific
pacific: test/bufferlist: ensure rebuild_aligned_size_and_memory() always rebuilds.
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Yuri Weinstein [Tue, 7 Jun 2022 16:03:21 +0000 (09:03 -0700)]
Merge pull request #46120 from myoungwon/backport-50806
pacific: osd: fix wrong input when calling recover_object()
Reviewed-by: Neha Ojha <nojha@redhat.com>
Yuri Weinstein [Tue, 7 Jun 2022 16:02:41 +0000 (09:02 -0700)]
Merge pull request #45870 from idryomov/wip-stretch-last-force-resend-pacific
pacific: mon/OSDMonitor: properly set last_force_op_resend in stretch mode
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Yuri Weinstein [Tue, 7 Jun 2022 16:01:33 +0000 (09:01 -0700)]
Merge pull request #45171 from pponnuvel/wip-53391-pacific
pacific: Fix data corruption in bluefs truncate()
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Neha Ojha [Tue, 7 Jun 2022 15:33:26 +0000 (08:33 -0700)]
Merge pull request #46252 from rzarzynski/wip-45529-pacific
pacific: osd/PGLog.cc: Trim duplicates by number of entries
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
Ernesto Puerta [Tue, 7 Jun 2022 15:03:19 +0000 (17:03 +0200)]
Merge pull request #46549 from MrFreezeex/wip-55652-pacific
pacific: ceph-mixin: backport of recent cleanups
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Guillaume Abrioux [Wed, 1 Jun 2022 11:24:50 +0000 (13:24 +0200)]
cephadm: fix osd adoption with custom cluster name
When adopting Ceph OSD containers from a Ceph cluster with a custom name, it fails
because the name isn't propagated in unit.run.
The idea here is to change the lvm metadata and enforce 'ceph.cluster_name=ceph'
given that cephadm doesn't support custom names anyway.
Fixes: https://tracker.ceph.com/issues/55654
Signed-off-by: Adam King <adking@redhat.com>
Co-authored-by: Guillaume Abrioux <gabrioux@redhat.com>
(cherry picked from commit
e720a658d6a1582c0497bdf709ef4bd26bb5bb73 )
Ilya Dryomov [Tue, 7 Jun 2022 08:21:37 +0000 (10:21 +0200)]
Merge pull request #46541 from idryomov/wip-rbd-codeowners-pacific
pacific: CODEOWNERS: add RBD team
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Arthur Outhenin-Chalandre [Wed, 18 May 2022 08:12:25 +0000 (10:12 +0200)]
ceph-mixin: remove timepicker override in every dashboards
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
37add644d1e65b4d6375a63dcbef742420a5a4c3 )
Arthur Outhenin-Chalandre [Wed, 18 May 2022 10:16:13 +0000 (12:16 +0200)]
ceph-mixin: rationalize local helper functions to utils
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
5db37300fde5c6cc2ec9f3ead34ea1b93126f5bf )
Arthur Outhenin-Chalandre [Wed, 18 May 2022 08:02:54 +0000 (10:02 +0200)]
ceph-mixin: fix typos
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
0b7cc6bc998fec47a29abfa94224cacee2dd598d )
Arthur Outhenin-Chalandre [Tue, 17 May 2022 07:42:29 +0000 (09:42 +0200)]
ceph-mixin: fix test with rate and label changes
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
c8f086c182b87f1a813cb37fd58ad1e753a6b0bf )
Arthur Outhenin-Chalandre [Tue, 17 May 2022 07:41:21 +0000 (09:41 +0200)]
ceph-mixin: don't add cluster matcher if showcluster is disabled
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
3b6356c8724ee2b299743d20ff5df0401181228b )
Arthur Outhenin-Chalandre [Mon, 16 May 2022 11:46:20 +0000 (13:46 +0200)]
ceph-mixin: refactor the structure of _config and utils
Before this refactor we couln't override the config externally. Now the
_config is correctly propagated and not only taken from the
config.libsonnet file.
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
fd4f484d220d98ba684878c87488cd74c502b4ff )
Arthur Outhenin-Chalandre [Thu, 12 May 2022 15:23:56 +0000 (17:23 +0200)]
ceph-mixin: fix makefile dashboards dependency
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
4595e9af23205e82a5232ecc3da408054b30d520 )
Arthur Outhenin-Chalandre [Thu, 12 May 2022 15:24:35 +0000 (17:24 +0200)]
ceph-mixin: fix linting issue and add cluster template support
Fix most of the issues reported by dashboards-linter:
- Add matcher/template for job (and also cluster)
- use $__rate_interval everywhere
Also this change all the irate functions to rate as most of irate where
not actually used correctly. While using irate on graph for instance you
can easily miss some of the metrics values as irate only take the two
last values and the query steps can be quite large if you want a graph
for a few hours/a day or more.
Fixes: https://tracker.ceph.com/issues/55003
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
ceph-mixin: add config with matchers and tags
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
faeea8d165342245929ea26441ee0cbb8957e3a7 )
Arthur Outhenin-Chalandre [Wed, 23 Mar 2022 11:50:20 +0000 (12:50 +0100)]
ceph-mixin: rewrite promql queries to multiline
Fixes: https://tracker.ceph.com/issues/55005
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
(cherry picked from commit
1452311a9bb01baa85786345e119d719b5838307 )
Adam King [Mon, 6 Jun 2022 21:39:31 +0000 (17:39 -0400)]
mgr/cephadm: don't redeploy osds seen in raw list if cephadm knows them
As is already done when checking the lvm list
results and should also be done for checking raw
list but is missing do ot a backporting mistake
Tachnically a partial backport of #44228 that
was not included in #44627 because raw osd support
was not in pacific then
Signed-off-by: Adam King <adking@redhat.com>
Ilya Dryomov [Wed, 1 Jun 2022 07:22:15 +0000 (09:22 +0200)]
CODEOWNERS: add RBD team
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit
00a44f1c6b3c5270f1c9d75cf6dcac3f0d470fa9 )
Neha Ojha [Mon, 6 Jun 2022 16:39:14 +0000 (09:39 -0700)]
Merge pull request #46520 from neha-ojha/wip-46415-pacific
pacific: .github/CODEOWNERS: tag core devs on core PRs
Reviewed-by: Laura Flores lflores@redhat.com
zdover23 [Fri, 3 Jun 2022 21:17:58 +0000 (07:17 +1000)]
Merge pull request #46484 from zdover23/wip-doc-2022-06-02-backport-46430-pacific-2nd-attempt
Neha Ojha [Fri, 27 May 2022 19:34:57 +0000 (19:34 +0000)]
.github/CODEOWNERS: tag core devs on core PRs
Start with everything that is present under core in .github/labeler.yml.
Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit
8303c6b911154ee936adb46e7c3491b174d22df8 )
Zac Dover [Fri, 3 Jun 2022 20:00:44 +0000 (06:00 +1000)]
doc: (squash) adding :orphan: to security/index
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Zac Dover [Fri, 3 Jun 2022 19:39:21 +0000 (05:39 +1000)]
doc: (squash) fix s3-select-feature-table link
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Zac Dover [Fri, 3 Jun 2022 19:28:32 +0000 (05:28 +1000)]
doc: (squash) removing extraneous toc entry
Signed-off-by: Zac Dover <zac.dover@gmail.com>
zdover23 [Fri, 3 Jun 2022 19:18:08 +0000 (05:18 +1000)]
Merge branch 'pacific' into wip-doc-2022-06-02-backport-46430-pacific-2nd-attempt
Zac Dover [Wed, 1 Jun 2022 14:44:02 +0000 (00:44 +1000)]
doc: (squash) adding pacific.rst to toctree
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc/start: update "memory" in hardware-recs.rst
This PR corrects some usage errors in the "Memory" section
of the hardware-recommendations.rst file. It also closes
some opened but never closed parentheses.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit
429bbdea65188df6708832efee188e0a40e1cde2 )
(cherry picked from commit
e63b048a98a33e82e35d76c2d67ed8de184fed57 )
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) adding security/ dir
This adds the security/ directory from the main branch.
This is done so that all references in the pacific.rst
file find destinations. This means that Sphinx will re-
cognize the document as coherent and that Sphinx will
permit it to build.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) add security/index.rst to toctree
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: remove :confvals: from bluestore-config-ref
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) linking to s3-feature-table
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) repair refs to cephfs-top
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) fix link to snap-schedule
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) fix link to ceph-dokan
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: (squash) fixing active-releases link
Signed-off-by: Zac Dover <zac.dover@gmail.com>
doc: testing security/index toctree link
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Guillaume Abrioux [Fri, 3 Jun 2022 12:14:00 +0000 (14:14 +0200)]
Merge pull request #46511 from adk3798/pacific-fix-activate
pacific: ceph-volume: fix activate
zdover23 [Thu, 2 Jun 2022 23:02:54 +0000 (09:02 +1000)]
Merge pull request #46485 from zdover23/wip-doc-2022-06-02-backport-rocksdb-sharding-to-pacific
doc/rados: update bluestore-config-ref.rst
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Guillaume Abrioux [Tue, 1 Mar 2022 23:38:17 +0000 (00:38 +0100)]
ceph-volume: fix generic activate
afd8be7eac5e996c3bd07656601a4534053e2516 broke it.
It has dropped`block_wal` and `block_db` from
`ceph_volume.devices.raw.activate.activate_bluestore` but
`activate.main.Activate.main` still passes those arguments when
calling `RAWActivate([]).activate()`
Fixes: https://tracker.ceph.com/issues/54441
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
(cherry picked from commit
3337b62e859673cba908bf8e12c7f3f23fddf2c2 )
Sage Weil [Wed, 24 Nov 2021 14:17:03 +0000 (09:17 -0500)]
mgr/cephadm: add some debug output for serve loop
Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit
f10f94478f58db96653ffa4f74e99b40b529c663 )
Conflicts:
src/pybind/mgr/cephadm/serve.py
Sage Weil [Sat, 20 Nov 2021 15:19:36 +0000 (10:19 -0500)]
ceph-volume: adjust arguments for 'ceph-volume raw activate'
Take a list of devices, so that we can selectively activate a raw osd
with db/wal.
Remove the argument type kludge introduced in
2c228a9a409176c0f1679f176443fd3ead219c7a
since it is no longer needed.
Note that we're making this change because (1) it allows db/wal and (2)
because there are no known users of 'raw activate'. The only known user
is via 'ceph-volume activate' and we've fixed that caller in this commit.
Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit
afd8be7eac5e996c3bd07656601a4534053e2516 )
Conflicts:
src/ceph-volume/ceph_volume/devices/raw/list.py
Sage Weil [Fri, 19 Nov 2021 20:15:18 +0000 (15:15 -0500)]
ceph-volume: add raw support for db/wal for list and activate
Currently 'prepare' doesn't support db/wal, but we want it in list and
activate because 'ceph-volume activate ...' tries raw before lvm.
Note that I'm not sure we really want to accept --block.db and --block.wal
here at all.
Fixes: 3d7ceec684b0ac5b83fae4c397b134236fac485e
Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit
f0a0c70d5c8c150abd0590ea23be83c7e53f9a10 )
Ernesto Puerta [Thu, 2 Jun 2022 16:56:45 +0000 (18:56 +0200)]
Merge pull request #46504 from rhcs-dashboard/wip-55832-pacific
pacific: qa: fix teuthology master branch ref
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Ernesto Puerta [Thu, 2 Jun 2022 10:27:02 +0000 (12:27 +0200)]
qa: fix teuthology master branch ref
Fixes: https://tracker.ceph.com/issues/55826
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
(cherry picked from commit
e91773df68c286266a2855e69bf542b4c73379d9 )
Conflicts:
qa/tox.ini
- accept only master-main rename
David Galloway [Wed, 1 Jun 2022 20:19:33 +0000 (16:19 -0400)]
Merge pull request #46490 from ceph/pacific-nobranch
pacific: qa: remove .teuthology_branch file