]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agocrimson/os: capture labels using a new variable 39359/head
Kefu Chai [Mon, 8 Feb 2021 14:04:32 +0000 (22:04 +0800)]
crimson/os: capture labels using a new variable

structured-binding does not define variables, so we cannot use "[=]" to
implicitly capture them. define variables in the capture list instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/os: mark unused variable [[maybe_unused]]
Kefu Chai [Mon, 8 Feb 2021 13:54:46 +0000 (21:54 +0800)]
crimson/os: mark unused variable [[maybe_unused]]

to silence warning like

key_layout.h:516:10: warning: unused variable 'nspace_masked'
[-Wunused-variable]
    auto nspace_masked = string_view_masked_t::decode(nspace, delta);
         ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/os: do not define assignment operator for Value
Kefu Chai [Mon, 8 Feb 2021 13:52:07 +0000 (21:52 +0800)]
crimson/os: do not define assignment operator for Value

we cannot assign a reference.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/os: do not capture unused variable
Kefu Chai [Mon, 8 Feb 2021 13:45:02 +0000 (21:45 +0800)]
crimson/os: do not capture unused variable

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/common: mark ExitBarrier final
Kefu Chai [Mon, 8 Feb 2021 13:43:09 +0000 (21:43 +0800)]
crimson/common: mark ExitBarrier final

to silence warnings like:

crimson/common/operation.h:394:20: warning: class with destructor marked
'final' cannot be inherited from [-Wfinal-dtor-non-final-class]
    ~ExitBarrier() final {
                   ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #39347 from xxhdx1985126/wip-crimson-pg-bug-fix
Kefu Chai [Mon, 8 Feb 2021 10:08:57 +0000 (18:08 +0800)]
Merge pull request #39347 from xxhdx1985126/wip-crimson-pg-bug-fix

crimson/osd: make sure ox be removed after all continuations are finished in PG::do_osd_ops

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 years agocrimson/osd: make sure ox be removed after all continuations are finished in PG:... 39347/head
Xuehan Xu [Mon, 8 Feb 2021 06:59:48 +0000 (14:59 +0800)]
crimson/osd: make sure ox be removed after all continuations are finished in PG::do_osd_ops

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
4 years agoMerge pull request #39193 from tchaikov/wip-cephadm-py3
Kefu Chai [Mon, 8 Feb 2021 04:20:03 +0000 (12:20 +0800)]
Merge pull request #39193 from tchaikov/wip-cephadm-py3

cephadm: drop support to python<3.3

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38897 from Daniel-Pivonka/mgroktostop
Kefu Chai [Mon, 8 Feb 2021 03:57:21 +0000 (11:57 +0800)]
Merge pull request #38897 from Daniel-Pivonka/mgroktostop

mgr/cephadm: ok-to-stop for mgr

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #39082 from ifed01/wip-ifed-meta-in-objectstore-tool
Kefu Chai [Mon, 8 Feb 2021 03:55:17 +0000 (11:55 +0800)]
Merge pull request #39082 from ifed01/wip-ifed-meta-in-objectstore-tool

tools/ceph-objectstore-tool: allow object operations on meta pgid

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #39273 from tchaikov/wip-timer-mono
Kefu Chai [Mon, 8 Feb 2021 03:54:03 +0000 (11:54 +0800)]
Merge pull request #39273 from tchaikov/wip-timer-mono

common/Timer: use mono_clock for clock_t

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39295 from tchaikov/wip-mgr-balancer-ann
Kefu Chai [Mon, 8 Feb 2021 03:52:21 +0000 (11:52 +0800)]
Merge pull request #39295 from tchaikov/wip-mgr-balancer-ann

pybind/mgr/balancer: add type annotations

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
4 years agoMerge pull request #39164 from tchaikov/wip-crimson-push-mov
Kefu Chai [Mon, 8 Feb 2021 01:39:35 +0000 (09:39 +0800)]
Merge pull request #39164 from tchaikov/wip-crimson-push-mov

crimson/osd: consume the push payload

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
4 years agoMerge pull request #39204 from TRYTOBE8TME/wip-rgw-create-bucket-dpp
Ali Maredia [Sun, 7 Feb 2021 17:07:14 +0000 (12:07 -0500)]
Merge pull request #39204 from TRYTOBE8TME/wip-rgw-create-bucket-dpp

src/rgw: Dpp addition to create bucket log

4 years agorgw: Dpp addition to create bucket log 39204/head
root [Wed, 13 Jan 2021 07:19:08 +0000 (12:49 +0530)]
rgw: Dpp addition to create bucket log

This commit adds dpp to the create bucket log.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
4 years agopybind/mgr/balancer: flake8 cleanups 39295/head
Kefu Chai [Thu, 4 Feb 2021 13:31:24 +0000 (21:31 +0800)]
pybind/mgr/balancer: flake8 cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/balancer: define Plan.{dump,show}()
Kefu Chai [Thu, 4 Feb 2021 13:15:27 +0000 (21:15 +0800)]
pybind/mgr/balancer: define Plan.{dump,show}()

as they are called by the commands

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/alerts: flake8 cleanups
Kefu Chai [Thu, 4 Feb 2021 05:00:57 +0000 (13:00 +0800)]
pybind/mgr/alerts: flake8 cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/balancer: define options using Option
Kefu Chai [Thu, 4 Feb 2021 07:32:35 +0000 (15:32 +0800)]
pybind/mgr/balancer: define options using Option

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/balancer: add type annotations
Kefu Chai [Thu, 4 Feb 2021 07:22:47 +0000 (15:22 +0800)]
pybind/mgr/balancer: add type annotations

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/balancer: define commands using CLICommand
Kefu Chai [Wed, 3 Feb 2021 05:44:10 +0000 (13:44 +0800)]
pybind/mgr/balancer: define commands using CLICommand

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #39336 from AlexWangD/patch-4
Kefu Chai [Sun, 7 Feb 2021 12:07:01 +0000 (20:07 +0800)]
Merge pull request #39336 from AlexWangD/patch-4

doc: fix the spelling mistake of “Topicd”

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agodoc: fix the spelling mistake of “Topicd” 39336/head
Alex Wang [Sun, 7 Feb 2021 07:26:04 +0000 (15:26 +0800)]
doc: fix the spelling mistake of “Topicd”

“Topicd” is a spelling mistake of "Topics".

4 years agoMerge pull request #37566 from AmnonHanuhov/wip-ObjectStore_EIO_Handling
Kefu Chai [Sun, 7 Feb 2021 04:18:01 +0000 (12:18 +0800)]
Merge pull request #37566 from AmnonHanuhov/wip-ObjectStore_EIO_Handling

crimson/osd: Recover missing object on read error

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #39303 from dillaman/wip-49173
Mykola Golub [Sat, 6 Feb 2021 09:23:45 +0000 (11:23 +0200)]
Merge pull request #39303 from dillaman/wip-49173

librbd/io: conditionally disable move optimization

Reviewed-by: Mykola Golub <mgolub@suse.com>
4 years agoMerge pull request #39312 from ivancich/wip-orphan-list-binary-data
J. Eric Ivancich [Fri, 5 Feb 2021 19:46:56 +0000 (14:46 -0500)]
Merge pull request #39312 from ivancich/wip-orphan-list-binary-data

rgw: allow rgw-orphan-list to handle intermediate files w/ binary data

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
4 years agoMerge pull request #39261 from adk3798/applytest
Sebastian Wagner [Fri, 5 Feb 2021 11:17:11 +0000 (12:17 +0100)]
Merge pull request #39261 from adk3798/applytest

mgr/orchestrator: useful message when no service type in "ceph orch apply"

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
4 years agoMerge pull request #39238 from liewegas/cephadm-conditional-osd-apply
Sebastian Wagner [Fri, 5 Feb 2021 10:47:58 +0000 (11:47 +0100)]
Merge pull request #39238 from liewegas/cephadm-conditional-osd-apply

mgr/cephadm: only apply osd specs if the devices have changed

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #39259 from sebastian-philipp/cephadm-execnet-chmod-600
Sebastian Wagner [Fri, 5 Feb 2021 10:46:43 +0000 (11:46 +0100)]
Merge pull request #39259 from sebastian-philipp/cephadm-execnet-chmod-600

mgr/cephadm: on ssh connection error, advice chmod 0600

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
4 years agoMerge pull request #39318 from AlexWangD/patch-3
Kefu Chai [Fri, 5 Feb 2021 10:10:06 +0000 (18:10 +0800)]
Merge pull request #39318 from AlexWangD/patch-3

doc: fix the spelling mistake of “Rersult”

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agodoc: fix the spelling mistake of “Rersult” 39318/head
Alex Wang [Fri, 5 Feb 2021 08:03:47 +0000 (16:03 +0800)]
doc: fix the spelling mistake of “Rersult”

“Rersult” is a spelling mistake of "Result".

Signed-off-by: Alex Wang wangdashuai@inspur.com
4 years agoMerge pull request #39258 from Rethan/doc-remove-ms-options
Kefu Chai [Fri, 5 Feb 2021 05:48:10 +0000 (13:48 +0800)]
Merge pull request #39258 from Rethan/doc-remove-ms-options

doc/rados: remove some invalid ms option

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agorgw: allow rgw-orphan-list to handle intermediate files w/ binary data 39312/head
J. Eric Ivancich [Thu, 4 Feb 2021 21:19:17 +0000 (16:19 -0500)]
rgw: allow rgw-orphan-list to handle intermediate files w/ binary data

Updates the grep commands with the --text command-line option since
there are cases where rados object names contain NUL characters.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
4 years agoMerge pull request #38538 from chenerqi/qos-skip-discard
Jason Dillaman [Thu, 4 Feb 2021 23:22:23 +0000 (18:22 -0500)]
Merge pull request #38538 from chenerqi/qos-skip-discard

librbd: optionally exclude ops from qos

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #39176 from ivancich/wip-rgw-gap-list
J. Eric Ivancich [Thu, 4 Feb 2021 20:16:48 +0000 (15:16 -0500)]
Merge pull request #39176 from ivancich/wip-rgw-gap-list

rgw: tooling to locate rgw objects with missing rados components

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
4 years agoMerge PR #39213 into master
Sage Weil [Thu, 4 Feb 2021 19:20:13 +0000 (14:20 -0500)]
Merge PR #39213 into master

* refs/pull/39213/head:
qa/suites/upgrade/octopus-x/parallel: include cephfs in upgrade cluster

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39135 from orozery/librbd-crypto-performance
Jason Dillaman [Thu, 4 Feb 2021 19:17:40 +0000 (14:17 -0500)]
Merge pull request #39135 from orozery/librbd-crypto-performance

librbd: crypto performance optimization

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #39298 from dillaman/wip-rbd-suite-readahead
Jason Dillaman [Thu, 4 Feb 2021 19:17:07 +0000 (14:17 -0500)]
Merge pull request #39298 from dillaman/wip-rbd-suite-readahead

qa/suites/rbd: drop require-osd-release command

Reviewed-by: Mykola Golub <mgolub@suse.com>
4 years agoMerge PR #39147 into master
Sage Weil [Thu, 4 Feb 2021 17:19:25 +0000 (12:19 -0500)]
Merge PR #39147 into master

* refs/pull/39147/head:
qa/tasks/ceph_fuse: do not createfs
qa/tasks/cephfs/fuse_mount: pass admin_socket path
qa/suites/fs/cephadm/multivolume: add basic multivolume test
mgr/mds_autoscaler: some fixes and cleanup
mgr/volumes: deploy MDSs when creating fs

Reviewed-by: Milind Changire <mchangir@redhat.com>
4 years agoMerge pull request #39262 from zdover23/wip-doc-removing-workbench-from-docs-2021...
zdover23 [Thu, 4 Feb 2021 17:05:07 +0000 (03:05 +1000)]
Merge pull request #39262 from zdover23/wip-doc-removing-workbench-from-docs-2021-Feb-first

doc/dev: Remove workbench mentions

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoqa/suites/rbd: drop require-osd-release command 39298/head
Jason Dillaman [Thu, 4 Feb 2021 14:00:23 +0000 (09:00 -0500)]
qa/suites/rbd: drop require-osd-release command

Teuthology already defaults to quincy now and results in a failure
when trying to set to pacific. Additionally, drop the LUKS readbalance
test since it's unnecessary to duplicate that test.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38715 from lxbsz/rest_api
Jason Dillaman [Thu, 4 Feb 2021 16:38:16 +0000 (11:38 -0500)]
Merge pull request #38715 from lxbsz/rest_api

qa: add REST API method support for ceph-iscsi

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #39265 from zdover23/wip-doc-rados-realy-typo-2020-feb
zdover23 [Thu, 4 Feb 2021 16:29:06 +0000 (02:29 +1000)]
Merge pull request #39265 from zdover23/wip-doc-rados-realy-typo-2020-feb

doc/rados: s/realy/really/

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39263 from cbodley/wip-48963
Casey Bodley [Thu, 4 Feb 2021 16:26:25 +0000 (11:26 -0500)]
Merge pull request #39263 from cbodley/wip-48963

cmake: partial revert of BOOST_USE_VALGRIND when ALLOCATOR=libc

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
4 years agolibrbd/io: conditionally disable move optimization 39303/head
Jason Dillaman [Thu, 4 Feb 2021 16:17:48 +0000 (11:17 -0500)]
librbd/io: conditionally disable move optimization

If the requested write length does not match the provided bufferlist
length, disable the move optimization and instead fallback to creating
a new sub-bufferlist for the object request.

Fixes: https://tracker.ceph.com/issues/49173
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #39182 from cbodley/wip-49065
Casey Bodley [Thu, 4 Feb 2021 16:04:03 +0000 (11:04 -0500)]
Merge pull request #39182 from cbodley/wip-49065

rgw multisite: fix RGWCoroutine error handling

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
4 years agoMerge pull request #39241 from dillaman/wip-49117
Mykola Golub [Thu, 4 Feb 2021 15:43:49 +0000 (17:43 +0200)]
Merge pull request #39241 from dillaman/wip-49117

test/rbd-mirror: fix broken ceph_test_rbd_mirror_random_write

Reviewed-by: Mykola Golub <mgolub@suse.com>
4 years agoqa/suites/upgrade/octopus-x/parallel: include cephfs in upgrade cluster 39213/head
Sage Weil [Mon, 1 Feb 2021 22:48:47 +0000 (16:48 -0600)]
qa/suites/upgrade/octopus-x/parallel: include cephfs in upgrade cluster

Signed-off-by: Sage Weil <sage@newdream.net>
4 years agoMerge PR #39210 into master
Sage Weil [Thu, 4 Feb 2021 14:30:55 +0000 (09:30 -0500)]
Merge PR #39210 into master

* refs/pull/39210/head:
qa/suites/rados: move thrash-old-clients out of cephadm

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39229 from rhcs-dashboard/label-badge
Ernesto Puerta [Thu, 4 Feb 2021 12:43:16 +0000 (13:43 +0100)]
Merge pull request #39229 from rhcs-dashboard/label-badge

mgr/dashboard: Add badge to the Label column in Host List

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
4 years agomgr/MgrClient: use mono_clock for clock_t used by Timer 39273/head
Kefu Chai [Thu, 4 Feb 2021 05:05:44 +0000 (13:05 +0800)]
mgr/MgrClient: use mono_clock for clock_t used by Timer

so we don't suffer from "missing event" when adjust time the system
clock

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/Timer: use mono_clock for clock_t
Kefu Chai [Wed, 3 Feb 2021 17:34:44 +0000 (01:34 +0800)]
common/Timer: use mono_clock for clock_t

there is chance that the system clock is adjust by chrony or ntpd, so that
a timer scheduled at epoch time 12:34 would never get scheduled if
the system clock is changed to 12:35 when the system clock is still
12:33.

if we have event which schedules itself when it is fired, there is
chance that this event could be put in a black hole if the system clock
is adjusted in the way explained above. this could be a serious issue
if we rely on the timer to do critical things.

but we *might* suffer from this issue even if we use mono_clock for
clock_t in Timer, because in older libstdc++ and libc++,
condition_variable::wait_until() and condition_variable::wait_for() were
still using pthread_cond_timedwait(). this is fixed after glibc
introduced pthread_cond_clockwait() in v2.3.0. for more details, see
https://reviews.llvm.org/D65339 and
https://gcc.gnu.org/legacy-ml/gcc-patches/2019-09/msg00190.html

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/Timer: add SafeTimer::add_event_at(real_clock::time_point)
Kefu Chai [Thu, 4 Feb 2021 07:05:05 +0000 (15:05 +0800)]
common/Timer: add SafeTimer::add_event_at(real_clock::time_point)

so we can schedule an event with real_clock::time_point. timer should
wait using a mono_time, but user might want to pass a
real_clock::time_point to it when, for instance, scheduling a task which
should be performed in future at a specified time. in this case, we need
to convert the real_clock::time_point to a "known" time_point.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/condition_variable_debug: support mono_clock
Kefu Chai [Wed, 3 Feb 2021 16:33:36 +0000 (00:33 +0800)]
common/condition_variable_debug: support mono_clock

it's allowed by the C++ standard library, there is not reason that it's
forbidden by us.

and it's important to use mono_clock along with condition_variable to
address the issue when system lock is modified when we are waiting for
an event using condition_variable::wait_until() or
condition_variable::wait_for()

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #39269 from tchaikov/wip-crimson-seastore-cleanup
Kefu Chai [Thu, 4 Feb 2021 11:22:57 +0000 (19:22 +0800)]
Merge pull request #39269 from tchaikov/wip-crimson-seastore-cleanup

crimson/os/seastore: do not capture unused variables

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
4 years agoMerge pull request #39162 from sebastian-philipp/cephadm-find-orch-ls-assert
Sebastian Wagner [Thu, 4 Feb 2021 10:57:19 +0000 (11:57 +0100)]
Merge pull request #39162 from sebastian-philipp/cephadm-find-orch-ls-assert

mgr/cephadm: Add strings to assert statements

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
4 years agoMerge pull request #38927 from sebastian-philipp/cephadm-upgrade-retry-ceph-volume
Sebastian Wagner [Thu, 4 Feb 2021 10:56:52 +0000 (11:56 +0100)]
Merge pull request #38927 from sebastian-philipp/cephadm-upgrade-retry-ceph-volume

mgr/cephadm: try again calling ceph-volume without --filter-for-batch

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
4 years agoMerge pull request #39242 from vshankar/wip-cephfs-mirroring-doc-cleanup
Venky Shankar [Thu, 4 Feb 2021 04:44:24 +0000 (10:14 +0530)]
Merge pull request #39242 from vshankar/wip-cephfs-mirroring-doc-cleanup

doc: cleanup cephfs-mirroring document

4 years agoMerge pull request #39208 from sebastian-philipp/pyhton-common-more-typing
Kefu Chai [Thu, 4 Feb 2021 04:20:18 +0000 (12:20 +0800)]
Merge pull request #39208 from sebastian-philipp/pyhton-common-more-typing

python-common: Add more type annotations

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38685 from tchaikov/wip-gil
Kefu Chai [Thu, 4 Feb 2021 04:18:23 +0000 (12:18 +0800)]
Merge pull request #38685 from tchaikov/wip-gil

mgr/ActivePyModules.cc: always acquire locks without holding GIL

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #39217 from myoungwon/wip-fix-seg-fault-manifest-ops
Kefu Chai [Thu, 4 Feb 2021 04:17:02 +0000 (12:17 +0800)]
Merge pull request #39217 from myoungwon/wip-fix-seg-fault-manifest-ops

osd: fix to call nullptr when cancel_manifest_ops

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39224 from petrutlucian94/rbd_fixes
Jason Dillaman [Thu, 4 Feb 2021 04:10:29 +0000 (23:10 -0500)]
Merge pull request #39224 from petrutlucian94/rbd_fixes

Windows RBD fixes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #39145 from ronen-fr/wip-ronenf-scrub-48793
Neha Ojha [Wed, 3 Feb 2021 23:49:24 +0000 (15:49 -0800)]
Merge pull request #39145 from ronen-fr/wip-ronenf-scrub-48793

osd: fix the scrubber behavior on multiple preemption attempts

Reviewed-by: Samuel Just <sjust@redhat.com>
4 years agoMerge pull request #39279 from cbodley/wip-cmake-spawn-options
Casey Bodley [Wed, 3 Feb 2021 22:14:36 +0000 (17:14 -0500)]
Merge pull request #39279 from cbodley/wip-cmake-spawn-options

cmake/rgw: forward spawn's compile options to rgw_common object library

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
4 years agorgw: add rgw-gap-list-comparator tool 39176/head
J. Eric Ivancich [Fri, 29 Jan 2021 17:03:50 +0000 (12:03 -0500)]
rgw: add rgw-gap-list-comparator tool

The rgw-gap-list tool can produce a number of false positives when the
cluster is being used during its run. One technique to minimize the
number of false positives is to run the tool twice and look for the
objects that appear in both lists. The rgw-gap-list-comparator tool is
designed to do this comparison.

Signed-off-by: Michael Kidd <linuxkidd@gmail.com>
4 years agorgw: add rgw-gap-list tool
J. Eric Ivancich [Thu, 17 Dec 2020 23:21:36 +0000 (18:21 -0500)]
rgw: add rgw-gap-list tool

Due to a prior bug (pr: 38228) tail rados objects of some RGW objects
could have been incorrectly deleted. This tool is designed to look for
such cases. It essentially does the opposite of rgw-orphan-list,
looking for rados objects that RGW expects to be there, but which are
not to be found.

IMPORTANT: This is very experimental at this point in time, and any
"results" produced should be verified by other means.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
Signed-off-by: Michael Kidd <linuxkidd@gmail.com>
4 years agomgr/cephadm: ok-to-stop for mgr 38897/head
Daniel-Pivonka [Wed, 13 Jan 2021 21:40:52 +0000 (16:40 -0500)]
mgr/cephadm: ok-to-stop for mgr

depends on #38854

Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
4 years agoMerge pull request #39275 from neha-ojha/wip-49139
Neha Ojha [Wed, 3 Feb 2021 21:00:16 +0000 (13:00 -0800)]
Merge pull request #39275 from neha-ojha/wip-49139

qa/suites/rados/perf: pin to 18.04

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agocmake/rgw: forward spawn's compile options to rgw_common object library 39279/head
Casey Bodley [Wed, 3 Feb 2021 20:17:19 +0000 (15:17 -0500)]
cmake/rgw: forward spawn's compile options to rgw_common object library

since rgw_common is an OBJECT library, we can't use
target_link_libraries() for its dependency on spawn. we add its
include directories manually already with
$<TARGET_PROPERTY:spawn,INTERFACE_INCLUDE_DIRECTORIES>, but this didn't
pull in the compile definitions. this ultimately prevented the
WITH_BOOST_VALGRIND option from passing the BOOST_USE_VALGRIND
definition attached to boost::context

Signed-off-by: Casey Bodley <cbodley@redhat.com>
4 years agocmake: remove unnecessary target_include_directories() for spawn
Casey Bodley [Wed, 3 Feb 2021 20:17:47 +0000 (15:17 -0500)]
cmake: remove unnecessary target_include_directories() for spawn

targets that depend on spawn via target_link_libraries() automatically
pull in their compile options and include directories

Signed-off-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #39274 from yuriw/wip-yuriw-crontab-master
Yuri Weinstein [Wed, 3 Feb 2021 20:07:21 +0000 (12:07 -0800)]
Merge pull request #39274 from yuriw/wip-yuriw-crontab-master

qa/tests: removed ceph-ansible (master and pacific)

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
4 years agoqa/suites/perf-basic: pin to 18.04 39275/head
Neha Ojha [Wed, 3 Feb 2021 18:57:50 +0000 (18:57 +0000)]
qa/suites/perf-basic: pin to 18.04

This will have same problems as https://tracker.ceph.com/issues/49139

Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agomgr/cephadm: 'drive group' -> 'service' 39238/head
Sage Weil [Wed, 3 Feb 2021 18:22:39 +0000 (12:22 -0600)]
mgr/cephadm: 'drive group' -> 'service'

...and add 'osd.' prefix

Signed-off-by: Sage Weil <sage@newdream.net>
4 years agoqa/tests: removed ceph-ansible (master and pacific) 39274/head
Yuri Weinstein [Wed, 3 Feb 2021 18:04:27 +0000 (10:04 -0800)]
qa/tests: removed ceph-ansible (master and pacific)

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
4 years agoqa/suites/rados/perf: pin to 18.04
Neha Ojha [Wed, 3 Feb 2021 17:29:59 +0000 (17:29 +0000)]
qa/suites/rados/perf: pin to 18.04

Caused by a07ca4c5c0f04c43c71231a898c2a89e99a80606

Fixes: https://tracker.ceph.com/issues/49139
Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge PR #38687 into master
Jan Fajerski [Wed, 3 Feb 2021 17:29:59 +0000 (18:29 +0100)]
Merge PR #38687 into master

* refs/pull/38687/head:
ceph-volume: mock VGs with string properties in tests
ceph-volume: add some flexibility to bytes_to_extents

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
4 years agoMerge pull request #39186 from tchaikov/wip-mgr-telemetry-ann
Kefu Chai [Wed, 3 Feb 2021 16:40:07 +0000 (00:40 +0800)]
Merge pull request #39186 from tchaikov/wip-mgr-telemetry-ann

pybind/mgr: add typing annotation

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
4 years agocrimson/os/seastore: do not capture unused variables 39269/head
Kefu Chai [Wed, 3 Feb 2021 15:37:45 +0000 (23:37 +0800)]
crimson/os/seastore: do not capture unused variables

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #39260 from idryomov/wip-expand-randomized-suite-doc
Ilya Dryomov [Wed, 3 Feb 2021 16:14:34 +0000 (17:14 +0100)]
Merge pull request #39260 from idryomov/wip-expand-randomized-suite-doc

qa: expand the documentation on the '$' suite feature

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agomgr/orchestrator: useful message when no service type in "ceph orch apply" 39261/head
Adam King [Wed, 3 Feb 2021 13:14:07 +0000 (08:14 -0500)]
mgr/orchestrator: useful message when no service type in "ceph orch apply"

Right now it just gives a traceback. A message telling users they have
not provided a proper service type would be more useful

Signed-off-by: Adam King <adking@redhat.com>
4 years agoMerge pull request #37954 from joscollin/wip-F46226-log-dq-throttle-limit-new
fullerdj [Wed, 3 Feb 2021 15:42:40 +0000 (10:42 -0500)]
Merge pull request #37954 from joscollin/wip-F46226-log-dq-throttle-limit-new

msg,mon,common: log when DispatchQueue throttle limit is reached

4 years agoMerge PR #39069 into master
Sage Weil [Wed, 3 Feb 2021 15:38:49 +0000 (10:38 -0500)]
Merge PR #39069 into master

* refs/pull/39069/head:
mgr/cephadm/upgrade: tolerate pre-pacific upgrade state
mgr/cephadm/upgrade: scale down MDS cluster(s) for major version upgrades
mgr/cephadm: fix capitalization, level; drop elipses of log msgs
mgr/cephadm/upgrade: match against any repo_digest, not image_id
cephadm: return repo_digests (plural) in pull/inspect output
mgr/cephadm: include container_image_digests in inventory
cephadm: include image_digests list in 'ls' output
vstart.sh: only extract first container digest
mgr/cephadm: move release -> major translation to helper
mgr/cephadm/upgrade: tolerate old upgrade_state.target_versoin
mgr/cephadm/upgrade: set require-osd-release when done with OSDs
mgr: add lookup_release_name(int) to mgr interface
mgr/cephadm: verify container image version after we pull it
mgr/cephadm: only save version portion of version string
cephadm: fix 'inspect' and 'pull'
mgr/cephadm/upgrade: implement N-2 version checks on upgrade start

Reviewed-by: Sebastian Wagner <swagner@suse.com>
4 years agodoc/rados: s/realy/really/ 39265/head
Zac Dover [Wed, 3 Feb 2021 15:04:24 +0000 (01:04 +1000)]
doc/rados: s/realy/really/

This corrects the spelling of "realy" to "really".
Hat-tip to IcePic, who noticed this on 03 Feb 2021.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
4 years agoMerge pull request #39234 from neha-ojha/wip-49064
Neha Ojha [Wed, 3 Feb 2021 14:56:02 +0000 (06:56 -0800)]
Merge pull request #39234 from neha-ojha/wip-49064

qa/*/test_envlibrados_for_rocksdb: use osd_client_message_cap to prevent slow requests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agocmake: partial revert of BOOST_USE_VALGRIND when ALLOCATOR=libc 39263/head
Casey Bodley [Wed, 3 Feb 2021 14:46:33 +0000 (09:46 -0500)]
cmake: partial revert of BOOST_USE_VALGRIND when ALLOCATOR=libc

the WITH_SYSTEM_BOOST binaries are not built with BOOST_USE_VALGRIND, so
it probably isn't safe to define for the headers only

this flag is needed for teuthology testing, and the shaman builds use
WITH_SYSTEM_BOOST=OFF. so the better fix is to enable WITH_BOOST_VALGRIND
so BuildBoost.cmake will build the libraries with valgrind support and add
-DBOOST_USE_VALGRIND to the necessary targets

this change was merged in https://github.com/ceph/ceph-build/pull/1736

Fixes: https://tracker.ceph.com/issues/48963
Signed-off-by: Casey Bodley <cbodley@redhat.com>
4 years agoqa: expand the documentation on the '$' suite feature 39260/head
Ilya Dryomov [Thu, 21 Jan 2021 11:15:34 +0000 (12:15 +0100)]
qa: expand the documentation on the '$' suite feature

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
4 years agodoc/dev: Remove workbench mentions 39262/head
Zac Dover [Wed, 3 Feb 2021 14:06:13 +0000 (00:06 +1000)]
doc/dev: Remove workbench mentions

This PR removes the "running-tests-in-cloud.rst"
file, which explains how to use ceph-workbench.
ceph-workbench is now deprecated, and the new
Teuthology documentation supplants the information
in the ceph-workbench-related documentation.

This PR also alters the "index.rst" file to remove
a link to "running-tests-in-cloud.rst".

Fixes: https://tracker.ceph.com/issues/49109 (partially)
Signed-off-by: Zac Dover <zac.dover@gmail.com>
4 years agodoc: cleanup cephfs-mirroring document 39242/head
Venky Shankar [Wed, 3 Feb 2021 05:11:59 +0000 (00:11 -0500)]
doc: cleanup cephfs-mirroring document

Remove references to in-progress feature, remove internal interfaces
section and minor cleanups.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agomgr/cephadm: on ssh connection error, advice chmod 0600 39259/head
Sebastian Wagner [Wed, 3 Feb 2021 12:56:09 +0000 (13:56 +0100)]
mgr/cephadm: on ssh connection error, advice chmod 0600

Fixes: https://tracker.ceph.com/issues/46551
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agodoc/rados: remove some invalid ms option 39258/head
haoyixing [Wed, 3 Feb 2021 12:49:37 +0000 (20:49 +0800)]
doc/rados: remove some invalid ms option

Remove some outdated ms options.

Signed-off-by: haoyixing <haoyixing@kuaishou.com>
4 years agopybind/mgr/hello: use f-string when appropriate 39186/head
Kefu Chai [Mon, 1 Feb 2021 10:53:18 +0000 (18:53 +0800)]
pybind/mgr/hello: use f-string when appropriate

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/crash: flake8 cleanups
Kefu Chai [Mon, 1 Feb 2021 06:06:39 +0000 (14:06 +0800)]
pybind/mgr/crash: flake8 cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/crash: add type annotations
Kefu Chai [Sun, 31 Jan 2021 10:44:15 +0000 (18:44 +0800)]
pybind/mgr/crash: add type annotations

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/crash: define options using Option
Kefu Chai [Sun, 31 Jan 2021 10:33:43 +0000 (18:33 +0800)]
pybind/mgr/crash: define options using Option

more type safe this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/crash: define commands using CLICommand
Kefu Chai [Sun, 31 Jan 2021 10:31:45 +0000 (18:31 +0800)]
pybind/mgr/crash: define commands using CLICommand

more type safe this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38955 from varshar16/wip-doc-update-nfs-ganesha-dynamic
Jeff Layton [Wed, 3 Feb 2021 12:45:38 +0000 (07:45 -0500)]
Merge pull request #38955 from varshar16/wip-doc-update-nfs-ganesha-dynamic

doc/cephfs/nfs: Add rook pod restart note, export and log block example

4 years agowin32*.sh: move debug symbols to separate files 39224/head
Lucian Petrut [Wed, 3 Feb 2021 08:59:24 +0000 (08:59 +0000)]
win32*.sh: move debug symbols to separate files

This patch simplifies releasing Windows binaries along with debug
symbols.

By default, we're going to provide minimum debug information (-g1).
The symbols are extracted from the binaries and placed in separate
files in the ".debug" folder, which is used by gdb implicitly.

This is more convenient than having separate versions of the binaries,
with or without debug symbols.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
4 years agopybind/mgr/alerts: define options using Option
Kefu Chai [Sun, 31 Jan 2021 10:00:50 +0000 (18:00 +0800)]
pybind/mgr/alerts: define options using Option

more type safe this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/cephadm: PEP8 cleanups
Kefu Chai [Sun, 31 Jan 2021 09:50:08 +0000 (17:50 +0800)]
pybind/mgr/cephadm: PEP8 cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr/alerts: use CLIReadCommand to define commands
Kefu Chai [Sun, 31 Jan 2021 09:48:31 +0000 (17:48 +0800)]
pybind/mgr/alerts: use CLIReadCommand to define commands

Signed-off-by: Kefu Chai <kchai@redhat.com>