]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agomgr: handle race with finisher after shutdown 31620/head
Patrick Donnelly [Wed, 13 Nov 2019 19:00:44 +0000 (11:00 -0800)]
mgr: handle race with finisher after shutdown

The module is deleted when modules is cleared. The notify method is
called on a destructed class.

Fixes: https://tracker.ceph.com/issues/42744
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31601 from tchaikov/wip/install-newer-binutils-on-xenial
Kefu Chai [Wed, 13 Nov 2019 17:03:47 +0000 (01:03 +0800)]
Merge pull request #31601 from tchaikov/wip/install-newer-binutils-on-xenial

install-deps.sh: install binutils 2.28 for xenial

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
5 years agoMerge PR #31602 into master
Sage Weil [Wed, 13 Nov 2019 16:18:58 +0000 (10:18 -0600)]
Merge PR #31602 into master

* refs/pull/31602/head:
mgr/ssh: annotate object representation

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoinstall-deps.sh: remove the cleanup for kitware repo 31601/head
Kefu Chai [Wed, 13 Nov 2019 12:41:05 +0000 (20:41 +0800)]
install-deps.sh: remove the cleanup for kitware repo

it was used for removing the kitware repo, and in
7265b55d094a639be50a567d3be92fba94c04786, we switched to a rebuilt
version hosted in chacra, and it was more than two months ago,
presumably, none builder has kitware repo anymore. so, let's remove
the cleanup code.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoinstall-deps.sh: install binutils 2.28 for xenial
Kefu Chai [Wed, 13 Nov 2019 12:11:53 +0000 (20:11 +0800)]
install-deps.sh: install binutils 2.28 for xenial

ld 2.26 segment faults when linking librados.so in
https://github.com/ceph/ceph/pull/16715 .

while ld 2.28 always survives.
binutils 2.28 is rebuilt and uploaded to chacra
binutils/master/7fa393306ed8b93019d225548474c0540b8928f7/ubuntu/xenial,

so let's use it instead.

the source deb package comes from
http://ppa.launchpad.net/jonathonf/binutils/ubuntu

i tried to use the binutils 2.30 source package from bionic,
but it has build dependency of dpkg-dev (>= 1.19.0.5) which cannot be
fulfilled on xenial. so without more changes, we cannot get
binutils 2.30 built on xenial using this source package.

Fixes: https://tracker.ceph.com/issues/42596
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31592 from jan--f/c-v-fix-mimic-functional-tests
Alfredo Deza [Wed, 13 Nov 2019 16:10:58 +0000 (11:10 -0500)]
Merge pull request #31592 from jan--f/c-v-fix-mimic-functional-tests

ceph-volume: assume msgrV1 for all branches containing mimic

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge PR #31603 into master
Sage Weil [Wed, 13 Nov 2019 16:10:20 +0000 (10:10 -0600)]
Merge PR #31603 into master

* refs/pull/31603/head:
ceph-daemon: fix prompt

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
5 years agomgr/dashboard: Add E2E tests for tasks and notifications sideb… (#31128)
Lenz Grimmer [Wed, 13 Nov 2019 14:26:19 +0000 (14:26 +0000)]
mgr/dashboard: Add E2E tests for tasks and notifications sideb… (#31128)

mgr/dashboard: Add E2E tests for tasks and notifications sidebar

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoceph-daemon: fix prompt 31603/head
Sage Weil [Wed, 13 Nov 2019 13:18:11 +0000 (07:18 -0600)]
ceph-daemon: fix prompt

[ceph: root@gnit /]#
not
[ceph: root@gnit /]$

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: annotate object representation 31602/head
Joshua Schmid [Wed, 13 Nov 2019 13:07:24 +0000 (14:07 +0100)]
mgr/ssh: annotate object representation

* InventoryNode
* ServiceDescription

Signed-off-by: Joshua Schmid <jschmid@suse.de>
5 years agoMerge PR #31583 into master
Sage Weil [Wed, 13 Nov 2019 13:04:04 +0000 (07:04 -0600)]
Merge PR #31583 into master

* refs/pull/31583/head:
ceph-daemon: -v|--verbose, not -d|--debug

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #31585 into master
Sage Weil [Wed, 13 Nov 2019 13:03:46 +0000 (07:03 -0600)]
Merge PR #31585 into master

* refs/pull/31585/head:
ceph-daemon: add `--legacy-dir` arg to `ls` command

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31533 from tspmelo/wip-bc-redmine-key
Nathan Cutler [Wed, 13 Nov 2019 12:27:26 +0000 (13:27 +0100)]
Merge pull request #31533 from tspmelo/wip-bc-redmine-key

backport-create-issue: read redmine key from file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #31544 from ifed01/wip-ifed-gettid2
Kefu Chai [Wed, 13 Nov 2019 10:58:36 +0000 (18:58 +0800)]
Merge pull request #31544 from ifed01/wip-ifed-gettid2

test/fio: bump to fio-3.15

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoceph-volume: assume msgrV1 for all branches containing mimic 31592/head
Jan Fajerski [Wed, 13 Nov 2019 09:13:01 +0000 (10:13 +0100)]
ceph-volume: assume msgrV1 for all branches containing mimic

With nautilus and newer OSDs listen on v1 ports and v2 ports. Assume
that if mimic (or luminous) occur in the branch name, the OSDs are
running msgrv1 only.

Fixes: https://tracker.ceph.com/issues/42791
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
5 years agoMerge pull request #31426 from cyx1231st/rfc-seastar-fix-build-dpdk
Kefu Chai [Wed, 13 Nov 2019 09:05:04 +0000 (17:05 +0800)]
Merge pull request #31426 from cyx1231st/rfc-seastar-fix-build-dpdk

crimson: fix build seastar with dpdk

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30662 from sebastian-philipp/orchestrator-c-v-inventory
Sebastian Wagner [Wed, 13 Nov 2019 09:03:57 +0000 (10:03 +0100)]
Merge pull request #30662 from sebastian-philipp/orchestrator-c-v-inventory

python-common, mgr/orchestrator, mgr/dashboard: Use common "Devices"

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
5 years agocrimson: build seastar dpdk from src/seastar/dpdk 31426/head
Yingxin Cheng [Wed, 6 Nov 2019 09:34:32 +0000 (17:34 +0800)]
crimson: build seastar dpdk from src/seastar/dpdk

src/spdk/dpdk and src/seastar/dpdk are both at their private branches
with project-specific modifications, so select proper dpdk source
directory according to flags WITH_SPDK and Seastar_DPDK.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
5 years agocrimson: link required dpdk components for seastar
Yingxin Cheng [Wed, 6 Nov 2019 09:27:39 +0000 (17:27 +0800)]
crimson: link required dpdk components for seastar

see https://github.com/scylladb/seastar/blob/
809b3ef875e7edb7c56643812dc8347ff9a82cee/cmake/Finddpdk.cmake#L60-L85

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
5 years agoMerge pull request #31571 from rhcs-dashboard/42775-fix-typo
Kefu Chai [Wed, 13 Nov 2019 03:49:05 +0000 (11:49 +0800)]
Merge pull request #31571 from rhcs-dashboard/42775-fix-typo

common: fix typo in rgw_user_max_buckets option long description.

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31510 from yuvalif/wip-yuval-remove-flaky-amqp-test
Kefu Chai [Wed, 13 Nov 2019 03:44:21 +0000 (11:44 +0800)]
Merge pull request #31510 from yuvalif/wip-yuval-remove-flaky-amqp-test

rgw/amqp: remove flaky amqp test

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoceph-daemon: add `--legacy-dir` arg to `ls` command 31585/head
Michael Fritch [Tue, 12 Nov 2019 23:46:09 +0000 (16:46 -0700)]
ceph-daemon: add `--legacy-dir` arg to `ls` command

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoceph-daemon: -v|--verbose, not -d|--debug 31583/head
Sage Weil [Tue, 12 Nov 2019 23:20:06 +0000 (17:20 -0600)]
ceph-daemon: -v|--verbose, not -d|--debug

-v is more natural IMO

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31575 into master
Sage Weil [Tue, 12 Nov 2019 23:16:22 +0000 (17:16 -0600)]
Merge PR #31575 into master

* refs/pull/31575/head:
ceph-daemon: 'logs' command

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoceph-daemon: 'logs' command 31575/head
Sage Weil [Tue, 12 Nov 2019 16:42:00 +0000 (10:42 -0600)]
ceph-daemon: 'logs' command

This just invokes podman logs with the appropriate argument(s).

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31577 into master
Sage Weil [Tue, 12 Nov 2019 20:16:06 +0000 (14:16 -0600)]
Merge PR #31577 into master

* refs/pull/31577/head:
pybind/mgr/CMakeLists: exclude tox.ini, requirements.txt from install

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #31542 from neha-ojha/wip-42756
Neha Ojha [Tue, 12 Nov 2019 18:24:29 +0000 (10:24 -0800)]
Merge pull request #31542 from neha-ojha/wip-42756

osd/OSDMap.cc: don't output over/underfull messages to lderr

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
5 years agopybind/mgr/CMakeLists: exclude tox.ini, requirements.txt from install 31577/head
Sage Weil [Tue, 12 Nov 2019 18:06:04 +0000 (12:06 -0600)]
pybind/mgr/CMakeLists: exclude tox.ini, requirements.txt from install

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agobackport-create-issue: read redmine key from file 31533/head
Tiago Melo [Mon, 11 Nov 2019 14:34:44 +0000 (13:34 -0100)]
backport-create-issue: read redmine key from file

Now you don't need to provide redmine key or user/password as a flag, as the
script will read it from "~/.redmine_key".

This makes it more consistent with other scripts.

Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge PR #31157 into master
Patrick Donnelly [Tue, 12 Nov 2019 17:25:26 +0000 (09:25 -0800)]
Merge PR #31157 into master

* refs/pull/31157/head:
doc: update inf/infinite option for subvolume resize
qa/tasks: fs subvolume resize inf command
mgr/volumes: fs subvolume resize inf/infinite command

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31503 into master
Sage Weil [Tue, 12 Nov 2019 16:56:08 +0000 (10:56 -0600)]
Merge PR #31503 into master

* refs/pull/31503/head:
Revert "os/bluestore: add kv_drain_preceding_waiters indicate drain_preceding."

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31537 into master
Sage Weil [Tue, 12 Nov 2019 16:23:06 +0000 (10:23 -0600)]
Merge PR #31537 into master

* refs/pull/31537/head:
mgr/orchestrator: move split_host into shared helpers
mgr/ssh: allow names to be specified for stateless services
mgr/ssh: optionally specify names for mon daemons
mgr/ssh: optionally specify names for mgr daemons

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge pull request #31280 from zy751713126/snap_get_name_and_id
Jason Dillaman [Tue, 12 Nov 2019 15:57:20 +0000 (10:57 -0500)]
Merge pull request #31280 from zy751713126/snap_get_name_and_id

librbd: add snap_get_name and snap_get_id method API

5 years agoMerge pull request #31491 from zy751713126/rbd_bench
Jason Dillaman [Tue, 12 Nov 2019 15:54:44 +0000 (10:54 -0500)]
Merge pull request #31491 from zy751713126/rbd_bench

rbd/bench: outputs bytes/s format dynamically

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #31497 from trociny/wip-mock-warnings
Jason Dillaman [Tue, 12 Nov 2019 15:54:07 +0000 (10:54 -0500)]
Merge pull request #31497 from trociny/wip-mock-warnings

test/librbd: fix mock warnings in TestMockIoImageRequest

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge PR #31487 into master
Sage Weil [Tue, 12 Nov 2019 15:42:03 +0000 (09:42 -0600)]
Merge PR #31487 into master

* refs/pull/31487/head:
ceph-daemon: add `--base-dir` arg to `adopt` command

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agocommon: fix typo in rgw_user_max_buckets option long description. 31571/head
Alfonso Martínez [Tue, 12 Nov 2019 15:33:50 +0000 (16:33 +0100)]
common: fix typo in rgw_user_max_buckets option long description.

https://tracker.ceph.com/issues/42775
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
5 years agomgr/orchestrator: move split_host into shared helpers 31537/head
Sage Weil [Tue, 12 Nov 2019 14:24:31 +0000 (08:24 -0600)]
mgr/orchestrator: move split_host into shared helpers

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: allow names to be specified for stateless services
Sage Weil [Mon, 11 Nov 2019 23:27:57 +0000 (17:27 -0600)]
mgr/ssh: allow names to be specified for stateless services

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: optionally specify names for mon daemons
Sage Weil [Mon, 11 Nov 2019 16:52:34 +0000 (10:52 -0600)]
mgr/ssh: optionally specify names for mon daemons

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: optionally specify names for mgr daemons
Sage Weil [Mon, 11 Nov 2019 16:26:13 +0000 (10:26 -0600)]
mgr/ssh: optionally specify names for mgr daemons

Use '=' as a separator.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/dashboard: Manage PG autoscaling (#31417)
Lenz Grimmer [Tue, 12 Nov 2019 13:16:52 +0000 (13:16 +0000)]
mgr/dashboard: Manage PG autoscaling (#31417)

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge PR #31559 into master
Sage Weil [Tue, 12 Nov 2019 13:11:48 +0000 (07:11 -0600)]
Merge PR #31559 into master

* refs/pull/31559/head:
mgr: Python cleanup and type check

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31539 into master
Sage Weil [Tue, 12 Nov 2019 13:09:50 +0000 (07:09 -0600)]
Merge PR #31539 into master

* refs/pull/31539/head:
mgr/orchestrator_cli: sort by service name
mgr/orchestrator_cli: collapse TYPE and ID columns

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #31394 into master
Sage Weil [Tue, 12 Nov 2019 13:08:57 +0000 (07:08 -0600)]
Merge PR #31394 into master

* refs/pull/31394/head:
mgr/crash: Calculate and add stack_sig to metadata

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomgr: Python cleanup and type check 31559/head
Volker Theile [Tue, 12 Nov 2019 10:28:25 +0000 (11:28 +0100)]
mgr: Python cleanup and type check

- Add/remove missing/obsolete empty lines
- Add type check doc
- Rename inner function args to make pylint happy

Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Support RBD namespaces (#30935)
Lenz Grimmer [Tue, 12 Nov 2019 09:50:50 +0000 (09:50 +0000)]
mgr/dashboard: Support RBD namespaces (#30935)

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #31357 from votdev/improve_timediff_unittest
Lenz Grimmer [Tue, 12 Nov 2019 09:49:23 +0000 (09:49 +0000)]
Merge pull request #31357 from votdev/improve_timediff_unittest

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agocmake: detect gettid() presense 31544/head
Igor Fedotov [Mon, 11 Nov 2019 22:20:12 +0000 (01:20 +0300)]
cmake: detect gettid() presense

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #30534 from jiahuizeng/osd_dev_node
Jan Fajerski [Tue, 12 Nov 2019 09:23:07 +0000 (10:23 +0100)]
Merge pull request #30534 from jiahuizeng/osd_dev_node

mgr/prometheus: assign a value to osd_dev_node when obj_store is not filestore or bluestore

5 years agoFix backend testing error due to attribute rename 30662/head
Kiefer Chang [Tue, 12 Nov 2019 04:47:04 +0000 (12:47 +0800)]
Fix backend testing error due to attribute rename

`id` in Device is renamed to `path`.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
5 years agoMerge pull request #31431 from jschmid1/fix_cherrypy_imports
Kefu Chai [Tue, 12 Nov 2019 08:55:47 +0000 (16:55 +0800)]
Merge pull request #31431 from jschmid1/fix_cherrypy_imports

mgr/dashboard: cheroot moved into a separate project

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr: Run python unit tests with tox in the mgr (#30364)
Lenz Grimmer [Tue, 12 Nov 2019 08:34:02 +0000 (08:34 +0000)]
mgr: Run python unit tests with tox in the mgr (#30364)

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agomgr/dashboard: Remove compression mode unset in pool from (#31376)
Lenz Grimmer [Tue, 12 Nov 2019 08:29:26 +0000 (08:29 +0000)]
mgr/dashboard: Remove compression mode unset in pool from (#31376)

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #29944 from xxhdx1985126/wip-fix-blustore-fadvice_flags-leak
Kefu Chai [Tue, 12 Nov 2019 08:17:15 +0000 (16:17 +0800)]
Merge pull request #29944 from xxhdx1985126/wip-fix-blustore-fadvice_flags-leak

osd: copy ObjectOperation::BufferUpdate::Write::fadvise_flag to ceph::os::Transaction

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31333 from adamemerson/wip-who-warns-the-warnings
Kefu Chai [Tue, 12 Nov 2019 08:14:43 +0000 (16:14 +0800)]
Merge pull request #31333 from adamemerson/wip-who-warns-the-warnings

src: use un-deprecated version of aio_create_completion

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #31416 from sseshasa/wip-41666-replicaSizeWarn
Sridhar Seshasayee [Tue, 12 Nov 2019 06:36:46 +0000 (12:06 +0530)]
Merge pull request #31416 from sseshasa/wip-41666-replicaSizeWarn

osd/OSDMap: Show health warning if a pool is configured with size 1

Reviewed-by: Sage Weil <sweil@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31475 from zdover23/wip-doc-community-calendar
Brad Hubbard [Tue, 12 Nov 2019 04:46:15 +0000 (14:46 +1000)]
Merge pull request #31475 from zdover23/wip-doc-community-calendar

doc: Added a link to Ceph Community Calendar.

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agodoc: Added a link to Ceph Community Calendar. 31475/head
Zac Dover [Thu, 7 Nov 2019 22:40:35 +0000 (08:40 +1000)]
doc: Added a link to Ceph Community Calendar.

Co-Authored by: Neha Ojha <nojha@redhat.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge PR #31501 into master
Sage Weil [Tue, 12 Nov 2019 00:09:29 +0000 (18:09 -0600)]
Merge PR #31501 into master

* refs/pull/31501/head:
ceph-mon: bind to public_addrv if set (before public_addr or public_network)
common/options: add public_addrv
common/options: fix ADDRVEC parsing
ceph-daemon: support --mon-addrv for deploy subcommand

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agomgr/crash: Calculate and add stack_sig to metadata 31394/head
Dan Mick [Tue, 5 Nov 2019 03:33:02 +0000 (19:33 -0800)]
mgr/crash: Calculate and add stack_sig to metadata

Signed-off-by: Dan Mick <dan.mick@redhat.com>
5 years agotest/fio: bump to fio 3.15
Igor Fedotov [Mon, 11 Nov 2019 22:19:29 +0000 (01:19 +0300)]
test/fio: bump to fio 3.15

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge PR #30914 into master
Patrick Donnelly [Mon, 11 Nov 2019 23:21:30 +0000 (15:21 -0800)]
Merge PR #30914 into master

* refs/pull/30914/head:
ceph: Add doc for deploying cephfs-nfs cluster using rook

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #31540 into master
Sage Weil [Mon, 11 Nov 2019 21:50:55 +0000 (15:50 -0600)]
Merge PR #31540 into master

* refs/pull/31540/head:
ceph-daemon: make ps1 a raw string

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoosd/OSDMap.cc: don't output over/underfull messages to lderr 31542/head
Neha Ojha [Mon, 11 Nov 2019 21:32:15 +0000 (13:32 -0800)]
osd/OSDMap.cc: don't output over/underfull messages to lderr

There can be cases where overfull and underfull(see example in
https://tracker.ceph.com/issues/42756) will be empty, which is not
necessarily an error. These error messages can end up spamming
the ceph-mgr log.

Fixes: https://tracker.ceph.com/issues/42756
Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agoceph-daemon: make ps1 a raw string 31540/head
Michael Fritch [Mon, 11 Nov 2019 21:07:49 +0000 (14:07 -0700)]
ceph-daemon: make ps1 a raw string

python3 interprets '\u' as a unicode escape

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #31024 into master
Patrick Donnelly [Mon, 11 Nov 2019 20:21:34 +0000 (12:21 -0800)]
Merge PR #31024 into master

* refs/pull/31024/head:
doc: improve in mount.ceph man page
doc: describe mds_namespace option in mount.ceph man page

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30911 into master
Patrick Donnelly [Mon, 11 Nov 2019 20:03:21 +0000 (12:03 -0800)]
Merge PR #30911 into master

* refs/pull/30911/head:
doc/ceph-fuse: describe -n option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Douglas Fuller <dfuller@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #30657 into master
Patrick Donnelly [Mon, 11 Nov 2019 18:45:10 +0000 (10:45 -0800)]
Merge PR #30657 into master

* refs/pull/30657/head:
test_cephfs_shell: pass arg to "help" in test_help
cephfs-shell: set exit_code when an error occurs
cephfs-shell: print traceback only when debug switch is on
cephfs-shell: catch libcephfs.Error only in onecmd()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31452 into master
Patrick Donnelly [Mon, 11 Nov 2019 18:41:24 +0000 (10:41 -0800)]
Merge PR #31452 into master

* refs/pull/31452/head:
Add chown ceph:ceph for /tmp/ceph.mon.keyring

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr/orchestrator_cli: sort by service name 31539/head
Sage Weil [Mon, 11 Nov 2019 18:33:03 +0000 (12:33 -0600)]
mgr/orchestrator_cli: sort by service name

This is more consistent when applied across hosts.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/orchestrator_cli: collapse TYPE and ID columns
Sage Weil [Mon, 11 Nov 2019 18:32:42 +0000 (12:32 -0600)]
mgr/orchestrator_cli: collapse TYPE and ID columns

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31538 into master
Sage Weil [Mon, 11 Nov 2019 18:14:35 +0000 (12:14 -0600)]
Merge PR #31538 into master

* refs/pull/31538/head:
ceph-daemon: do not fetch daemon detail when removing a cluster
ceph-daemon: ls: add --no-detail

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoceph-daemon: do not fetch daemon detail when removing a cluster 31538/head
Sage Weil [Mon, 11 Nov 2019 17:05:00 +0000 (11:05 -0600)]
ceph-daemon: do not fetch daemon detail when removing a cluster

It's slow and not needed.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-daemon: ls: add --no-detail
Sage Weil [Mon, 11 Nov 2019 17:04:22 +0000 (11:04 -0600)]
ceph-daemon: ls: add --no-detail

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-daemon: add `--base-dir` arg to `adopt` command 31487/head
Michael Fritch [Fri, 8 Nov 2019 22:59:30 +0000 (15:59 -0700)]
ceph-daemon: add `--base-dir` arg to `adopt` command

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #31387 into master
Sage Weil [Mon, 11 Nov 2019 16:15:45 +0000 (10:15 -0600)]
Merge PR #31387 into master

* refs/pull/31387/head:
src/CMakeLists: remove leading 'v' from 'git describe' version

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31524 into master
Sage Weil [Mon, 11 Nov 2019 16:15:18 +0000 (10:15 -0600)]
Merge PR #31524 into master

* refs/pull/31524/head:
mgr/ssh: Fix various Python issues.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
5 years agomgr/dashboard: Improve position of MDS chart tooltip (#31368)
Lenz Grimmer [Mon, 11 Nov 2019 15:29:11 +0000 (15:29 +0000)]
mgr/dashboard: Improve position of MDS chart tooltip (#31368)

mgr/dashboard: Improve position of MDS chart tooltip

Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge PR #31512 into master
Sage Weil [Mon, 11 Nov 2019 15:28:01 +0000 (09:28 -0600)]
Merge PR #31512 into master

* refs/pull/31512/head:
mgr/ssh: allow passing LV to 'orchestrator osd create'

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agomgr/dashboard: Support RBD namespaces 30935/head
Ricardo Marques [Wed, 31 Jul 2019 09:34:57 +0000 (10:34 +0100)]
mgr/dashboard: Support RBD namespaces

Fixes: https://tracker.ceph.com/issues/25125
Signed-off-by: Ricardo Marques <rimarques@suse.com>
5 years agomgr/dashboard: Fix data point alignment in MDS counters chart (#31288)
Lenz Grimmer [Mon, 11 Nov 2019 13:19:54 +0000 (13:19 +0000)]
mgr/dashboard: Fix data point alignment in MDS counters chart (#31288)

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31519 from votdev/fix_ssh_vagrant
Sebastian Wagner [Mon, 11 Nov 2019 13:00:24 +0000 (14:00 +0100)]
Merge pull request #31519 from votdev/fix_ssh_vagrant

mgr/ssh: Install SSH public key in Vagrantfile box fails

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/ssh: Fix various Python issues. 31524/head
Volker Theile [Mon, 11 Nov 2019 10:52:35 +0000 (11:52 +0100)]
mgr/ssh: Fix various Python issues.

Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: RBD tests must use pools with power-of-two pg_n… (#31490)
Lenz Grimmer [Mon, 11 Nov 2019 09:58:39 +0000 (09:58 +0000)]
mgr/dashboard: RBD tests must use pools with power-of-two pg_n… (#31490)

mgr/dashboard: RBD tests must use pools with power-of-two pg_num

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/orchestrator: move InventoryDevice to python-common
Sebastian Wagner [Wed, 16 Oct 2019 11:07:31 +0000 (13:07 +0200)]
mgr/orchestrator: move InventoryDevice to python-common

Adapted:
* `mgr/dashboard`
* `mgr/ansible`
* `mgr/rook`
* `mgr/ssh`
* `mgr/orchestrator_cli`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
Co-authored--by: Kiefer Chang <kiefer.chang@suse.com>
5 years agomgr/ssh: Install SSH public key in Vagrantfile box fails 31519/head
Volker Theile [Mon, 11 Nov 2019 09:15:18 +0000 (10:15 +0100)]
mgr/ssh: Install SSH public key in Vagrantfile box fails

The current implementation to copy the host users SSH public key into the Vagrant box does not work with Vagrant 2.2.6.

Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31419 from smithfarm/wip-cbs-5
Nathan Cutler [Mon, 11 Nov 2019 08:31:24 +0000 (09:31 +0100)]
Merge pull request #31419 from smithfarm/wip-cbs-5

ceph-backport.sh: guess component with --existing-pr

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoosd/OSDMap: Show health warning if a pool is configured with size 1 31416/head
Sridhar Seshasayee [Tue, 5 Nov 2019 10:40:14 +0000 (16:10 +0530)]
osd/OSDMap: Show health warning if a pool is configured with size 1

Introduce a config option called 'mon_warn_on_pool_no_redundancy' that is
used to show a health warning if any pool in the ceph cluster is
configured with a size of 1. The user can mute/unmute the warning using
'ceph health mute/unmute POOL_NO_REDUNDANCY'.

Add standalone test to verify warning on setting pool size=1. Set the
associated warning to 'false' in ceph.conf.template under qa/tasks so
that existing tests do not break.

Fixes: https://tracker.ceph.com/issues/41666
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
5 years agoAdd chown ceph:ceph for /tmp/ceph.mon.keyring 31452/head
oneoneonepig [Thu, 7 Nov 2019 05:01:53 +0000 (13:01 +0800)]
Add chown ceph:ceph for /tmp/ceph.mon.keyring

The keyring will be 600 by default with the owner of the current user who issues the command, which will make command "sudo -u ceph ceph-mon --mkfs" fail since the user "ceph" don't have access to the keyring file.
Because of that, the mon data directory won't have keyring and when "sudo systemctl start ceph-mon" it will show error "unable to read magic from mon data"

Signed-off-by: Jeffrey Chu <peihuachu1112@gmail.com>
5 years agoMerge pull request #31271 from ivancich/wip-fix-cancel-bucket-reshard
J. Eric Ivancich [Sun, 10 Nov 2019 18:16:49 +0000 (13:16 -0500)]
Merge pull request #31271 from ivancich/wip-fix-cancel-bucket-reshard

rgw: allow reshard log entries for non-existent buckets to be cancelled

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #31492 from jan--f/c-v-add-part-size
Jan Fajerski [Sun, 10 Nov 2019 16:25:26 +0000 (17:25 +0100)]
Merge pull request #31492 from jan--f/c-v-add-part-size

ceph-volume: add proper size attribute to partitions

5 years agomgr/ssh: allow passing LV to 'orchestrator osd create' 31512/head
Sage Weil [Sun, 10 Nov 2019 15:08:56 +0000 (09:08 -0600)]
mgr/ssh: allow passing LV to 'orchestrator osd create'

In this case,

 ceph orchestrator osd create smithi009:/dev/vg_nvme/lv_1

produced

    "0": [
        {
            "devices": [
                "/dev/nvme0n1"
            ],
            "lv_name": "lv_1",
            "lv_path": "/dev/vg_nvme/lv_1",
            "lv_size": "89.40g",
            "lv_tags": "ceph.block_device=/dev/vg_nvme/lv_1,ceph.block_uuid=a1vfDi-0jor-VEPK-DZVd-K90y-cqG1-QoXr9l,ceph.cephx_lockbox_secret=,ceph.cluster_fsid=5d6d2c1c-0362-11ea-825a-001a4aab830c,ceph.cluster_name=ceph,ceph.crush_device_class=None,ceph.encrypted=0,ceph.osd_fsid=04175a6e-55e7-4244-b683-79da76f723af,ceph.osd_id=0,ceph.type=block,ceph.vdo=0",
            "lv_uuid": "a1vfDi-0jor-VEPK-DZVd-K90y-cqG1-QoXr9l",
            "name": "lv_1",
            "path": "/dev/vg_nvme/lv_1",
            "tags": {
                "ceph.block_device": "/dev/vg_nvme/lv_1",
                "ceph.block_uuid": "a1vfDi-0jor-VEPK-DZVd-K90y-cqG1-QoXr9l",
                "ceph.cephx_lockbox_secret": "",
                "ceph.cluster_fsid": "5d6d2c1c-0362-11ea-825a-001a4aab830c",
                "ceph.cluster_name": "ceph",
                "ceph.crush_device_class": "None",
                "ceph.encrypted": "0",
                "ceph.osd_fsid": "04175a6e-55e7-4244-b683-79da76f723af",
                "ceph.osd_id": "0",
                "ceph.type": "block",
                "ceph.vdo": "0"
            },
            "type": "block",
            "vg_name": "vg_nvme"
        }
    ],

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agorgw/amqp: remove a test that requires syncronization 31510/head
Yuval Lifshitz [Sun, 10 Nov 2019 09:57:57 +0000 (11:57 +0200)]
rgw/amqp: remove a test that requires syncronization
betwen the amqp manager internal thread and the test itself
amqp reconnect should be tested by system test instead

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agorbd/bench: outputs bytes/s format dynamically 31491/head
zhengyin [Fri, 8 Nov 2019 16:51:27 +0000 (00:51 +0800)]
rbd/bench: outputs bytes/s format dynamically

Fixes: https://tracker.ceph.com/issues/40256
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
5 years agoMerge pull request #30853 from ivancich/wip-tune-sharded-bucket-listing
J. Eric Ivancich [Sun, 10 Nov 2019 05:07:15 +0000 (00:07 -0500)]
Merge pull request #30853 from ivancich/wip-tune-sharded-bucket-listing

rgw: reduce per-shard entry count during ordered bucket listing

5 years agoMerge pull request #31323 from ivancich/wip-autoclean-reshard-long-entries
J. Eric Ivancich [Sun, 10 Nov 2019 05:06:21 +0000 (00:06 -0500)]
Merge pull request #31323 from ivancich/wip-autoclean-reshard-long-entries

rgw: auto-clean reshard queue entries for non-existent buckets

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge PR #31505 into master
Sage Weil [Sun, 10 Nov 2019 02:38:49 +0000 (20:38 -0600)]
Merge PR #31505 into master

* refs/pull/31505/head:
mgr/ssh: take IP, CIDR, or addrvec for new mon(s)

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #31507 into master
Sage Weil [Sun, 10 Nov 2019 02:38:35 +0000 (20:38 -0600)]
Merge PR #31507 into master

* refs/pull/31507/head:
ceph-daemon: ceph/daemon-base:latest-master-devel

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoceph-mon: bind to public_addrv if set (before public_addr or public_network) 31501/head
Sage Weil [Fri, 8 Nov 2019 22:35:28 +0000 (16:35 -0600)]
ceph-mon: bind to public_addrv if set (before public_addr or public_network)

This lets you specify a precise addrvec for the monitor to bind to,
instead of inferring a v1 or v2 address from the port number, or assuming
both with default ports, or v2 only with an unrecognized port.

I unfortunately don't quite remember why I didn't make public_addr a
ADDRVEC option way back in nautilus--I only remmeber that it was going to
cause problems.  Adding a separate addrv option here is safe.

Signed-off-by: Sage Weil <sage@redhat.com>