]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agodoc: update docs for centralized logging 46087/head
Aashish Sharma [Fri, 29 Apr 2022 05:13:45 +0000 (10:43 +0530)]
doc: update docs for centralized logging

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agoMerge pull request #46044 from zdover23/wip-doc-2022-04-27-reef-PendingReleaseNotes...
zdover23 [Thu, 28 Apr 2022 21:39:43 +0000 (07:39 +1000)]
Merge pull request #46044 from zdover23/wip-doc-2022-04-27-reef-PendingReleaseNotes-cleanup

doc: clean up PendingReleaseNotes for reef

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #43371 from liavt/master
Yuval Lifshitz [Thu, 28 Apr 2022 16:12:55 +0000 (19:12 +0300)]
Merge pull request #43371 from liavt/master

rgw: notifications on object replication

3 years agoMerge pull request #46023 from linuxbox2/wip-dbstore-shutdown
Matt Benjamin [Thu, 28 Apr 2022 14:14:35 +0000 (10:14 -0400)]
Merge pull request #46023 from linuxbox2/wip-dbstore-shutdown

rgw: dbstore: add mechanism to signal gc_worker to exit

3 years agoMerge pull request #46053 from guits/cv-quick-change-log-level
Guillaume Abrioux [Thu, 28 Apr 2022 08:13:14 +0000 (10:13 +0200)]
Merge pull request #46053 from guits/cv-quick-change-log-level

ceph-volume: only warn when config file isn't found

3 years agoMerge pull request #46009 from ljflores/wip-link-submitting-backports
Laura Flores [Wed, 27 Apr 2022 23:01:30 +0000 (18:01 -0500)]
Merge pull request #46009 from ljflores/wip-link-submitting-backports

3 years agoMerge pull request #46025 from CongMinYin/fix-endianness-issue-encoding
Ilya Dryomov [Wed, 27 Apr 2022 16:22:43 +0000 (18:22 +0200)]
Merge pull request #46025 from CongMinYin/fix-endianness-issue-encoding

librbd/cache/pwl: fix bit field endianness issue

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agorgw: dbstore: add mechanism to signal gc_worker to exit 46023/head
Matt Benjamin [Mon, 25 Apr 2022 15:22:32 +0000 (11:22 -0400)]
rgw: dbstore: add mechanism to signal gc_worker to exit

This addresses a trivial hang on shutdown.

Fixes: https://tracker.ceph.com/issues/55431
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
3 years agoMerge pull request #46022 from linuxbox2/wip-dbstore-nfs
Matt Benjamin [Wed, 27 Apr 2022 13:43:36 +0000 (09:43 -0400)]
Merge pull request #46022 from linuxbox2/wip-dbstore-nfs

librgw: teach librgw about rgw_backend_store

3 years agoMerge pull request #45954 from Matan-B/wip-matanb-c-cyanlog
Radoslaw Zarzynski [Wed, 27 Apr 2022 13:13:15 +0000 (15:13 +0200)]
Merge pull request #45954 from Matan-B/wip-matanb-c-cyanlog

crimson/os: CyanStore debug subsystem

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoceph-volume: only warn when config file isn't found 46053/head
Guillaume Abrioux [Wed, 27 Apr 2022 12:12:23 +0000 (14:12 +0200)]
ceph-volume: only warn when config file isn't found

According to [1], this should only be a warning.

[1] https://github.com/ceph/ceph/commit/0487a9ac60c5ba289b7dd7c730b014a298c5998f

Fixes: https://tracker.ceph.com/issues/47633
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #45811 from rhcs-dashboard/grafana-e2e
Ernesto Puerta [Wed, 27 Apr 2022 12:09:29 +0000 (14:09 +0200)]
Merge pull request #45811 from rhcs-dashboard/grafana-e2e

mgr/dashboard: introduce grafana frontend e2e testing

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
3 years agomgr/dashboard: prometheus rules internal server error 45811/head
Nizamudeen A [Tue, 26 Apr 2022 10:19:09 +0000 (15:49 +0530)]
mgr/dashboard: prometheus rules internal server error

After we increase/decrease the count of the node-exporter, we get a 500
- Internal server error from api/prometheus/rules endpoint. On further
  debugging its caused by the jsonDecodder, because I guess the expected
input for the json.loads() is not a json formatted input. So to fix
that issue I can either do an error handling on the json.loads() or I
can move the json.loads() on the already existing try block. I went for
the second approach here.

Fixes: https://tracker.ceph.com/issues/54356
Signed-off-by: Nizamudeen A <nia@redhat.com>
3 years agoMerge pull request #46012 from liu-chunmei/crimson-osd_op.rval
Samuel Just [Tue, 26 Apr 2022 23:22:38 +0000 (16:22 -0700)]
Merge pull request #46012 from liu-chunmei/crimson-osd_op.rval

crimson/osd: still need set error code value in osd_op.rval

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #45598 from rkachach/fix_issue_55008
Adam King [Tue, 26 Apr 2022 19:48:03 +0000 (15:48 -0400)]
Merge pull request #45598 from rkachach/fix_issue_55008

mgr/cephadm: Adding image tag and date to cephadm startup messages

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
3 years agoMerge pull request #45855 from rkachach/fix_issue_55265
Adam King [Tue, 26 Apr 2022 19:11:34 +0000 (15:11 -0400)]
Merge pull request #45855 from rkachach/fix_issue_55265

mgr/cephadm: fixing call method timeout handling

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #45877 from rkachach/fix_issue_55185
Adam King [Tue, 26 Apr 2022 19:10:26 +0000 (15:10 -0400)]
Merge pull request #45877 from rkachach/fix_issue_55185

mgr/cephadm: Adding support to store ceph conf per cluster fsid

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #45899 from rkachach/fix_issue_53527
Adam King [Tue, 26 Apr 2022 19:09:37 +0000 (15:09 -0400)]
Merge pull request #45899 from rkachach/fix_issue_53527

mgr/cephadm: fixing upgrade candidate versions listing

Reviewed-by: Adam King <adking@redhat.com>
3 years agorgw: notifications on object replication 43371/head
Liav Turkia [Sun, 27 Feb 2022 16:24:09 +0000 (18:24 +0200)]
rgw: notifications on object replication

Signed-off-by: liavt <liav.turkia@gmail.com>
3 years ago.github: remove "Submitting Patches to Ceph" comment 46009/head
Laura Flores [Tue, 26 Apr 2022 18:17:06 +0000 (13:17 -0500)]
.github: remove "Submitting Patches to Ceph" comment

Ideally, this should not be in comment form so users
can click on the link.

Signed-off-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #45623 from dang/wip-dang-zipper-objctx
Daniel Gryniewicz [Tue, 26 Apr 2022 18:03:11 +0000 (14:03 -0400)]
Merge pull request #45623 from dang/wip-dang-zipper-objctx

RGW: Zipper - zonegroup, placement tier

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #46010 from gregsfortytwo/wip-55419-blocklist-test
Neha Ojha [Tue, 26 Apr 2022 17:59:07 +0000 (10:59 -0700)]
Merge pull request #46010 from gregsfortytwo/wip-55419-blocklist-test

test: Fix a blocklist API test

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agomgr/dashboard: introduce grafana frontend e2e testing
Nizamudeen A [Thu, 7 Apr 2022 13:31:39 +0000 (19:01 +0530)]
mgr/dashboard: introduce grafana frontend e2e testing

Used the https://www.npmjs.com/package/@grafana/e2e npm packages and
followed
https://github.com/grafana/grafana/blob/main/contribute/style-guides/e2e.md
to understand the style of the grafana e2e testing.

In this PR I introduces the tests for the Hosts Overall
Performance and also RGW per Daemon and Overall Performance

Fixes: https://tracker.ceph.com/issues/54356
Signed-off-by: Nizamudeen A <nia@redhat.com>
3 years agodoc: clean up PendingReleaseNotes for reef 46044/head
Zac Dover [Tue, 26 Apr 2022 17:15:27 +0000 (03:15 +1000)]
doc: clean up PendingReleaseNotes for reef

This PR removes all of the release notes up to
version 17 (Quincy) inclusive.

As far as I know, for as long as I have worked
on the Ceph project, we have never cleaned up
the release notes from release to release.

Until now.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #44958 from rishabh-d-dave/qa-cephfs-timeout
Venky Shankar [Tue, 26 Apr 2022 17:00:43 +0000 (22:30 +0530)]
Merge pull request #44958 from rishabh-d-dave/qa-cephfs-timeout

qa/cephfs: change default timeout from 900 secs to 300

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45737 from cbodley/wip-rgw-ops-log-defaults
Casey Bodley [Tue, 26 Apr 2022 16:43:44 +0000 (12:43 -0400)]
Merge pull request #45737 from cbodley/wip-rgw-ops-log-defaults

rgw: change default ops log backend from rados to file

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
3 years agoMerge pull request #46007 from cbodley/wip-49302
Casey Bodley [Tue, 26 Apr 2022 16:25:36 +0000 (12:25 -0400)]
Merge pull request #46007 from cbodley/wip-49302

rgw: RGWCoroutine::set_sleeping() checks for null stack

Reviewed-by: Or Friedmann <ofriedma@redhat.com>
3 years agoMerge pull request #46027 from cbodley/wip-55432
Casey Bodley [Tue, 26 Apr 2022 16:24:35 +0000 (12:24 -0400)]
Merge pull request #46027 from cbodley/wip-55432

rgw: OpsLogFile::stop() signals under mutex

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
3 years agoMerge pull request #45784 from cbodley/wip-rgw-multisite-configurables
Casey Bodley [Tue, 26 Apr 2022 16:22:43 +0000 (12:22 -0400)]
Merge pull request #45784 from cbodley/wip-rgw-multisite-configurables

rgw multisite: configurable polling intervals and concurrency windows

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
3 years agoqa/cephfs: change default timeout from 900 secs to 300 44958/head
Rishabh Dave [Wed, 9 Feb 2022 18:16:27 +0000 (23:46 +0530)]
qa/cephfs: change default timeout from 900 secs to 300

15 minutes is unnecessarily large as a default value for timeout for a
command. Not having to wait unnecessarily on a crash of a command will
reduce teuthology's testing queue and will save individual developer's
time while running tests locally.

Whatever lines are modified for this purpose are also modified to follow
the stlye guideline, specfically wrapping at 80 characters.

Fixes: https://tracker.ceph.com/issues/54236
Signed-off-by: Rishabh Dave <ridave@redhat.com>
3 years agoMerge pull request #45830 from rhcs-dashboard/cephadm-logs-save
Ernesto Puerta [Tue, 26 Apr 2022 10:50:43 +0000 (12:50 +0200)]
Merge pull request #45830 from rhcs-dashboard/cephadm-logs-save

mgr/dashboard: save mgr logs inside a folder

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agolibrbd/cache/pwl: fix endianness issue 46025/head
Yin Congmin [Mon, 25 Apr 2022 17:10:18 +0000 (01:10 +0800)]
librbd/cache/pwl: fix endianness issue

fix endianness issue with WriteLogCacheEntry encoding. abandon the
use of bits in the union. make '&' operation with the whole union
filed(flags) to get the bit information.

Fixes: https://tracker.ceph.com/issues/55389
Signed-off-by: Yin Congmin <congmin.yin@intel.com>
3 years agoMerge pull request #45370 from lxbsz/wip-54411
Venky Shankar [Tue, 26 Apr 2022 04:25:04 +0000 (09:55 +0530)]
Merge pull request #45370 from lxbsz/wip-54411

client: add option to disable collecting and sending metrics

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agocrimson/osd: still need set error code value in osd_op.rval 46012/head
chunmei-liu [Sat, 23 Apr 2022 08:59:31 +0000 (01:59 -0700)]
crimson/osd: still need set error code value in osd_op.rval

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agoMerge pull request #45904 from cfsnyder/fix_rocksdb_iter_perf
Yuri Weinstein [Mon, 25 Apr 2022 22:58:45 +0000 (15:58 -0700)]
Merge pull request #45904 from cfsnyder/fix_rocksdb_iter_perf

os/bluestore: set upper and lower bounds on rocksdb omap iterators

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
3 years agoMerge pull request #46028 from ceph/revert-43413-bluestore-bufferbloat-mitigation
Neha Ojha [Mon, 25 Apr 2022 22:07:38 +0000 (15:07 -0700)]
Merge pull request #46028 from ceph/revert-43413-bluestore-bufferbloat-mitigation

Revert "os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation"

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agorgw: OpsLogFile drops lock before flush() 46027/head
Casey Bodley [Mon, 25 Apr 2022 20:32:33 +0000 (16:32 -0400)]
rgw: OpsLogFile drops lock before flush()

flush() acquires the same lock, so lockdep complains about recursive
locking here

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: RGWCoroutine::set_sleeping() checks for null stack 46007/head
Or Friedmann [Tue, 19 Apr 2022 12:00:28 +0000 (12:00 +0000)]
rgw: RGWCoroutine::set_sleeping() checks for null stack

users of the RGWOmapAppend coroutine don't manage the lifetime of its
underlying coroutine stack, so end up making calls on RGWOmapAppend
after its stack goes away. this null check is a band-aid, and there are
still several other calls in RGWCoroutine that don't check for null
stack

Fixes: https://tracker.ceph.com/issues/49302
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agobluestore: Revert "os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation" 46028/head
Samuel Just [Mon, 25 Apr 2022 19:29:49 +0000 (12:29 -0700)]
bluestore: Revert "os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation"

Merge caused: https://tracker.ceph.com/issues/55433

Signed-off-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #44989 from Ejdesgaard/patch-1
Casey Bodley [Mon, 25 Apr 2022 18:26:08 +0000 (14:26 -0400)]
Merge pull request #44989 from Ejdesgaard/patch-1

radosgw-admin zone deletion uses zone delete

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: remove unnecessary OpsLogFile::flush_mutex
Casey Bodley [Mon, 25 Apr 2022 17:40:19 +0000 (13:40 -0400)]
rgw: remove unnecessary OpsLogFile::flush_mutex

this mutex was only held by one function, OpsLogFile::flush(). this
private member function is only ever called from the background thread,
so doesn't need to be protected by a mutex

as a further cleanup, i renamed 'cond' and 'mutex' now that we don't
need to differentiate between different locks

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: OpsLogFile::stop() signals under mutex
Casey Bodley [Mon, 25 Apr 2022 17:28:02 +0000 (13:28 -0400)]
rgw: OpsLogFile::stop() signals under mutex

this shuts up ceph::debug_condition_variable's assertion that the
associated mutex is held during notify_one(). this is not strictly
required for correct use, but is a common source of bugs

Fixes: https://tracker.ceph.com/issues/55432
Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agolibrgw: teach librgw about rgw_backend_store 46022/head
Matt Benjamin [Thu, 21 Apr 2022 23:26:55 +0000 (19:26 -0400)]
librgw: teach librgw about rgw_backend_store

With this change, basic i/o against dbstore works in the primary
librgw_file tests.

Fixes: https://tracker.ceph.com/issues/55430
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
3 years agoMerge pull request #45407 from vshankar/wip-54046
Venky Shankar [Mon, 25 Apr 2022 14:18:57 +0000 (19:48 +0530)]
Merge pull request #45407 from vshankar/wip-54046

mds: include encoded stray inode when sending dentry unlink message to replicas

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45243 from lxbsz/mdslog_bz
Venky Shankar [Mon, 25 Apr 2022 12:26:27 +0000 (17:56 +0530)]
Merge pull request #45243 from lxbsz/mdslog_bz

mds: flush mdlog if locked and still has wanted caps not satisfied

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45307 from lxbsz/wip54461
Venky Shankar [Mon, 25 Apr 2022 12:24:06 +0000 (17:54 +0530)]
Merge pull request #45307 from lxbsz/wip54461

mds: notify clients if the session has already opened

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45887 from bluikko/patch-3
Ilya Dryomov [Sat, 23 Apr 2022 08:53:31 +0000 (10:53 +0200)]
Merge pull request #45887 from bluikko/patch-3

doc: replace spaces with underscores in config option names

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agodoc: remove spaces at line ends and doubles, fix wrapping 45887/head
Ville Ojamo [Fri, 22 Apr 2022 13:36:44 +0000 (20:36 +0700)]
doc: remove spaces at line ends and doubles, fix wrapping

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
3 years agodoc: replace spaces with underscores in config option names
Ville Ojamo [Wed, 13 Apr 2022 03:33:36 +0000 (10:33 +0700)]
doc: replace spaces with underscores in config option names

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
3 years agoMerge pull request #45948 from cyx1231st/wip-seastore-cleaner-work
Yingxin [Sat, 23 Apr 2022 04:07:09 +0000 (12:07 +0800)]
Merge pull request #45948 from cyx1231st/wip-seastore-cleaner-work

crimson/os/seastore/segment_cleaner: cleanup segment_info_set_t

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agotest: use the same address input format as output will generate 46010/head
Greg Farnum [Sat, 23 Apr 2022 00:00:59 +0000 (00:00 +0000)]
test: use the same address input format as output will generate

Otherwise, our grep fails!

Fixes: https://tracker.ceph.com/issues/55419
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years ago.github: add a "Contribution Guidelines" to the pull request template
Laura Flores [Fri, 22 Apr 2022 23:06:09 +0000 (23:06 +0000)]
.github: add a "Contribution Guidelines" to the pull request template

These guidelines refer contributors to the "Submitting Patches to Ceph" doc
and the "Submitting Patches to Ceph - Backports" doc. Even though there are
already tips for titling/signing commits in the PR template, these tips
are commented out and easy to gloss over once the contributor creates the
PR. These existing tips do not include any pointers about staging backports.

Fixes: https://tracker.ceph.com/issues/55418
Signed-off-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #43413 from esmaeil-mirvakili/bluestore-bufferbloat-mitigation
Samuel Just [Fri, 22 Apr 2022 21:37:04 +0000 (14:37 -0700)]
Merge pull request #43413 from esmaeil-mirvakili/bluestore-bufferbloat-mitigation

os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
3 years agomgr/cephadm: fixing call method timeout handling 45855/head
Redouane Kachach [Mon, 11 Apr 2022 14:13:05 +0000 (16:13 +0200)]
mgr/cephadm: fixing call method timeout handling
Fixes: https://tracker.ceph.com/issues/55265
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agomgr/cephadm: Adding support to store ceph conf per cluster fsid 45877/head
Redouane Kachach [Tue, 12 Apr 2022 12:27:02 +0000 (14:27 +0200)]
mgr/cephadm: Adding support to store ceph conf per cluster fsid
Fixes: https://tracker.ceph.com/issues/55185
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agomgr/cephadm: fixing upgrade candidate verions listing 45899/head
Redouane Kachach [Wed, 13 Apr 2022 14:22:53 +0000 (16:22 +0200)]
mgr/cephadm: fixing upgrade candidate verions listing
Fixes: https://tracker.ceph.com/issues/53527
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agomgr/cephadm: Using '.ID' instead of '.Id' which is only supported by podman 45598/head
Redouane Kachach [Fri, 22 Apr 2022 13:53:34 +0000 (15:53 +0200)]
mgr/cephadm: Using '.ID' instead of '.Id' which is only supported by podman

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agoMerge pull request #45920 from adk3798/stop-mgr-nfs-upgrade-fail
Adam King [Fri, 22 Apr 2022 13:28:35 +0000 (09:28 -0400)]
Merge pull request #45920 from adk3798/stop-mgr-nfs-upgrade-fail

qa/suites/orch/cephadm: stop upgrade tests if failures are seen

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
3 years agoMerge pull request #45931 from rkachach/fix_issue_51671
Adam King [Fri, 22 Apr 2022 13:27:47 +0000 (09:27 -0400)]
Merge pull request #45931 from rkachach/fix_issue_51671

mgr/cephadm: fixing logging output for rm-cluster operation

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #45982 from rkachach/fix_issue_52727
Adam King [Fri, 22 Apr 2022 13:23:31 +0000 (09:23 -0400)]
Merge pull request #45982 from rkachach/fix_issue_52727

mgr/cephadm: do not add _admin label when no-minimize-config is provided

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #45934 from ceph/fix-github_triage-master
Ernesto Puerta [Fri, 22 Apr 2022 12:02:24 +0000 (14:02 +0200)]
Merge pull request #45934 from ceph/fix-github_triage-master

.github/pr-triage: reorder milestone step

Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoMerge pull request #45631 from Rethan/feat-mds-slow-ops
Venky Shankar [Fri, 22 Apr 2022 11:56:52 +0000 (17:26 +0530)]
Merge pull request #45631 from Rethan/feat-mds-slow-ops

mds: add a perf counter to record slow replies

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45978 from tchaikov/wip-cmake-python3-exact
Kefu Chai [Thu, 21 Apr 2022 23:10:02 +0000 (07:10 +0800)]
Merge pull request #45978 from tchaikov/wip-cmake-python3-exact

cmake/modules: use exact version of python3 when finding cython

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agokv/RocksDBStore: simplify RocksDBStore::get_cf_handle(string, IteratorBounds) 45904/head
Cory Snyder [Thu, 21 Apr 2022 19:56:06 +0000 (15:56 -0400)]
kv/RocksDBStore: simplify RocksDBStore::get_cf_handle(string, IteratorBounds)

Adds a precondition to RocksDBStore::get_cf_handle(string, IteratorBounds)
to avoid duplicating logic of the only caller (RocksDBStore::get_iterator).
Assertions will fail if preconditions are not met.

Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agobluestore: add config option to allow rocksdb iterator bounds to be disabled
Cory Snyder [Thu, 21 Apr 2022 17:13:22 +0000 (13:13 -0400)]
bluestore: add config option to allow rocksdb iterator bounds to be disabled

Add osd_rocksdb_iterator_bounds_enabled config option to allow rocksdb iterator bounds to be disabled.
Also includes minor refactoring to shorten code associated with IteratorBounds initialization in bluestore.

Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agoMerge pull request #44151 from gregsfortytwo/wip-cidr-blocklist
Gregory Farnum [Thu, 21 Apr 2022 15:31:16 +0000 (08:31 -0700)]
Merge pull request #44151 from gregsfortytwo/wip-cidr-blocklist

Implement CIDR blocklisting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #45971 from rishabh-d-dave/cephfs-shell-exclam-marks
Venky Shankar [Thu, 21 Apr 2022 13:22:20 +0000 (18:52 +0530)]
Merge pull request #45971 from rishabh-d-dave/cephfs-shell-exclam-marks

qa/cephfs: bug fix and some cleanup for test_cephfs_shell.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45977 from tchaikov/wip-cmake-dml-cleanup
Kefu Chai [Thu, 21 Apr 2022 11:31:20 +0000 (19:31 +0800)]
Merge pull request #45977 from tchaikov/wip-cmake-dml-cleanup

cmake: try to find dml only if PMEM is enabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoqa/cephfs: cleanup some code in test_cephfs_shell.py 45971/head
Rishabh Dave [Wed, 20 Apr 2022 12:43:05 +0000 (18:13 +0530)]
qa/cephfs: cleanup some code in test_cephfs_shell.py

Also delete a comment since it's incorrect.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
3 years agoqa/cephfs: don't use exclam mark in tests in test_cephfs_shell.py
Rishabh Dave [Wed, 20 Apr 2022 11:07:16 +0000 (16:37 +0530)]
qa/cephfs: don't use exclam mark in tests in test_cephfs_shell.py

Exclamation mark is a special character for bash as well as
cephfs-shell. For bash, it substitutes current command with matching
command from command history and for cephfs-shell it runs the command
as OS-level command and not inside the cephfs-shell.

And evey command executed in tests (say "ls") is run by passing it as a
parameter to cephfs-shell command (that is "cephfs-shell -c <conf> --
ls"). So, exclamation mark, when used in tests, is consumed by bash
instead of cephfs-shell.

To avoid these complications it's best (and even simpler!) to issue the
command meant for bash on bash without going through cephfs-shell.

Fixes: https://tracker.ceph.com/issues/55394
Signed-off-by: Rishabh Dave <ridave@redhat.com>
3 years agomgr/cephadm: do not add _admin label when no-minimize-config is provided 45982/head
Redouane Kachach [Thu, 21 Apr 2022 10:01:44 +0000 (12:01 +0200)]
mgr/cephadm: do not add _admin label when no-minimize-config is provided
Fixes: https://tracker.ceph.com/issues/52727
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agoMerge pull request #45979 from lxbsz/doc_noatime
Anthony D'Atri [Thu, 21 Apr 2022 08:03:10 +0000 (01:03 -0700)]
Merge pull request #45979 from lxbsz/doc_noatime

doc: cephfs: update with atime not supporting explaination

3 years agomgr/cephadm: Adding image tag and date to cephadm startup messages
Redouane Kachach [Wed, 23 Mar 2022 17:24:01 +0000 (18:24 +0100)]
mgr/cephadm: Adding image tag and date to cephadm startup messages
Fixes: https://tracker.ceph.com/issues/55008
Fixes: https://tracker.ceph.com/issues/54373
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agodoc: cephfs: update with atime not supporting explaination 45979/head
Xiubo Li [Thu, 21 Apr 2022 01:35:58 +0000 (09:35 +0800)]
doc: cephfs: update with atime not supporting explaination

Signed-off-by: Xiubo Li <xiubli@redhat.com>
3 years agotest: osd: add a /0 cidr test for 32-bit... 44151/head
Greg Farnum [Thu, 21 Apr 2022 00:16:22 +0000 (00:16 +0000)]
test: osd: add a /0 cidr test for 32-bit...

...and make the OSDMap handle it.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years agotest: add a /0 cidr test that blocklists EVERYTHING
Greg Farnum [Wed, 20 Apr 2022 15:59:01 +0000 (15:59 +0000)]
test: add a /0 cidr test that blocklists EVERYTHING

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years agotest: add a 128-bit range blocklist test
Greg Farnum [Wed, 20 Apr 2022 15:06:33 +0000 (15:06 +0000)]
test: add a 128-bit range blocklist test

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years agoMerge pull request #45975 from adamemerson/wip-mrun-bashism
Kefu Chai [Thu, 21 Apr 2022 00:11:43 +0000 (08:11 +0800)]
Merge pull request #45975 from adamemerson/wip-mrun-bashism

mrun: Change mrun to use bash

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agocmake/modules: use exact version of python3 when finding cython 45978/head
Kefu Chai [Wed, 20 Apr 2022 22:31:21 +0000 (06:31 +0800)]
cmake/modules: use exact version of python3 when finding cython

* CMakeLists.txt:
    always pass "EXACT" to find_package(Python3).
    because per cmake document, "EXACT" only takes effect when
    <Package>_FIND_VERSION_COUNT is greater than 1, where <Package>
    is "Python3". see also cmake/modules/FindPython/Support.cmake
* cmake/modules/AddCephTest.cmake:
    drop redundant find_package(Python3) calls. since Python3 is
    a mandatory requirement for building Ceph, we only need a
    single call of find_package(Python3..) in the top of the source
    tree. the only possible case to repeat it is to ensure that we
    have the correct version of Python3 used in following CMake
    script. but there is no need to repeat it if we just want to
    ensure that we have a python3 interpretor in place.
* cmake/modules/Distutils.cmake:
    always pass "EXACT" to find_package(Python3).
    we should always pass EXACT to find_package() when finding python3,
    this is a follow-up of e2babdfae8c99f39f99a7c8a8f966299b2e62b19

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocmake: try to find dml only if PMEM is enabled 45977/head
Kefu Chai [Wed, 20 Apr 2022 22:27:25 +0000 (06:27 +0800)]
cmake: try to find dml only if PMEM is enabled

as the feature dependent on DML library requires PMEM backend.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agotooling: Change mrun to use bash 45975/head
Adam C. Emerson [Wed, 20 Apr 2022 20:19:36 +0000 (16:19 -0400)]
tooling: Change mrun to use bash

Since mrun contains some bashisms, have it use bash explicitly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
3 years agoMerge pull request #45973 from ionutbalutoiu/add-windows-tests 46002/head
David Galloway [Wed, 20 Apr 2022 20:08:21 +0000 (16:08 -0400)]
Merge pull request #45973 from ionutbalutoiu/add-windows-tests

qa/crontab/teuthology-cronjobs: add windows suite

3 years agoqa/crontab/teuthology-cronjobs: add windows suite 45973/head
Ionut Balutoiu [Wed, 20 Apr 2022 16:56:23 +0000 (19:56 +0300)]
qa/crontab/teuthology-cronjobs: add windows suite

Signed-off-by: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
3 years agoRGW: Zipper - zonegroup, placement tier 45623/head
Daniel Gryniewicz [Tue, 22 Mar 2022 17:22:15 +0000 (13:22 -0400)]
RGW: Zipper - zonegroup, placement tier

Add ZoneGroup and PlacementTier to the Zipper API.  This cleaned up a
lot of issues in the Module branch.

In addition, add cloud transition.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
3 years agotest: add 32-bit ipv4 and 64-bit ipv6 blocklist testing
Greg Farnum [Wed, 20 Apr 2022 14:51:09 +0000 (14:51 +0000)]
test: add 32-bit ipv4 and 64-bit ipv6 blocklist testing

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years agotest: add a 30-bit range mask to ipv6 blocklisting tests
Greg Farnum [Wed, 20 Apr 2022 01:50:46 +0000 (01:50 +0000)]
test: add a 30-bit range mask to ipv6 blocklisting tests

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years agotest: split up ip- and range-based blocklisting tests
Greg Farnum [Wed, 20 Apr 2022 00:38:21 +0000 (00:38 +0000)]
test: split up ip- and range-based blocklisting tests

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
3 years agoMerge pull request #44230 from optimistyzy/122_add_dml
Kefu Chai [Wed, 20 Apr 2022 10:47:00 +0000 (18:47 +0800)]
Merge pull request #44230 from optimistyzy/122_add_dml

blk/pmem: use DML library to offload read/write operations in pmem

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #45872 from idryomov/wip-make-check-enable-rbd-caches
Ilya Dryomov [Wed, 20 Apr 2022 09:08:41 +0000 (11:08 +0200)]
Merge pull request #45872 from idryomov/wip-make-check-enable-rbd-caches

run-make-check.sh: enable RBD persistent caches

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agocrimson/os/seastore/segment_cleaner: cleanup SegmentProvider interfaces 45948/head
Yingxin Cheng [Tue, 19 Apr 2022 07:40:41 +0000 (15:40 +0800)]
crimson/os/seastore/segment_cleaner: cleanup SegmentProvider interfaces

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore/segment_cleaner: cleanup segment_info_set_t
Yingxin Cheng [Tue, 19 Apr 2022 07:38:41 +0000 (15:38 +0800)]
crimson/os/seastore/segment_cleaner: cleanup segment_info_set_t

* better encapsulated interfaces to SegmentCleaner;
* drop unused device related implementations;
* improve related metrics and logs;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoMerge pull request #45609 from optimistyzy/wip_pmem_devdax
Kefu Chai [Wed, 20 Apr 2022 01:54:00 +0000 (09:54 +0800)]
Merge pull request #45609 from optimistyzy/wip_pmem_devdax

blk/pmem: Add the devdax support.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #45048 from ceph/1710
David Galloway [Wed, 20 Apr 2022 01:37:33 +0000 (21:37 -0400)]
Merge pull request #45048 from ceph/1710

doc: Add Quincy 17.2.0 release notes

3 years agodoc/releases/quincy.rst: mention log_to_journald 45048/head
Neha Ojha [Wed, 20 Apr 2022 00:45:49 +0000 (00:45 +0000)]
doc/releases/quincy.rst: mention log_to_journald

Details about https://tracker.ceph.com/issues/55383

Signed-off-by: Neha Ojha <nojha@redhat.com>
3 years agodoc: Typo and indentation fix
David Galloway [Wed, 20 Apr 2022 00:20:44 +0000 (20:20 -0400)]
doc: Typo and indentation fix

Signed-off-by: David Galloway <dgallowa@redhat.com>
3 years agoMerge pull request #45933 from ionutbalutoiu/qa-add-rbd-wnbd-tests
David Galloway [Tue, 19 Apr 2022 20:50:24 +0000 (16:50 -0400)]
Merge pull request #45933 from ionutbalutoiu/qa-add-rbd-wnbd-tests

qa: add basic Ceph on Windows integration test

3 years agodoc: No changelog for first release
David Galloway [Tue, 19 Apr 2022 18:32:39 +0000 (14:32 -0400)]
doc: No changelog for first release

The diff between origin/pacific..origin/quincy is definitely not what we want listed.  There is no Changelog for the first major release.

Signed-off-by: David Galloway <dgallowa@redhat.com>
3 years agodoc/releases: additional clarification, release date
Neha Ojha [Tue, 19 Apr 2022 16:59:06 +0000 (16:59 +0000)]
doc/releases: additional clarification, release date

- address review comments
- emphasize LevelDB removal
- update release date

Signed-off-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #45945 from vshankar/wip-54374
Venky Shankar [Tue, 19 Apr 2022 17:27:07 +0000 (22:57 +0530)]
Merge pull request #45945 from vshankar/wip-54374

mgr/snap_schedule: add time zone suffix to snapshot dir name

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45916 from tchaikov/wip-python3
David Galloway [Tue, 19 Apr 2022 15:55:35 +0000 (11:55 -0400)]
Merge pull request #45916 from tchaikov/wip-python3

cmake/modules: always use the python3 specified in command line