]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agomgr/balancer: avoid pulling pg_dump twice 32266/head
xie xingguo [Mon, 16 Dec 2019 05:54:50 +0000 (13:54 +0800)]
mgr/balancer: avoid pulling pg_dump twice

For large cluster with thousands of osds/pgs, it may take
seconds even mitutes to refresh the relevant stats.
Since we already have pulling them down at initialization,
make a direct use of them whenever possible.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #32142 from changchengx/doc_libvirt
Jason Dillaman [Sun, 15 Dec 2019 23:46:40 +0000 (18:46 -0500)]
Merge pull request #32142 from changchengx/doc_libvirt

doc/rbd: simplify libvirt usage

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32243 from trociny/wip-43289
Jason Dillaman [Sun, 15 Dec 2019 23:29:17 +0000 (18:29 -0500)]
Merge pull request #32243 from trociny/wip-43289

rbd-mirror: fix race on namespace replayer initialization failure

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32184 from trociny/wip-43004
Jason Dillaman [Sun, 15 Dec 2019 23:28:52 +0000 (18:28 -0500)]
Merge pull request #32184 from trociny/wip-43004

rbd-mirror: rename per-image replication perf counters

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32113 from lixiaoy1/master
Jason Dillaman [Sun, 15 Dec 2019 23:27:23 +0000 (18:27 -0500)]
Merge pull request #32113 from lixiaoy1/master

librbd: finish write request early

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge PR #32251 into master
Sage Weil [Sun, 15 Dec 2019 22:40:45 +0000 (16:40 -0600)]
Merge PR #32251 into master

* refs/pull/32251/head:
mds/MDSDaemon: fix asok 'exit' and 'respawn' commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32260 into master
Sage Weil [Sun, 15 Dec 2019 19:08:35 +0000 (13:08 -0600)]
Merge PR #32260 into master

* refs/pull/32260/head:
.organizationmap: Wido 42on -> 42on

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years ago.organizationmap: Wido 42on -> 42on 32260/head
Sage Weil [Sun, 15 Dec 2019 16:21:07 +0000 (10:21 -0600)]
.organizationmap: Wido 42on -> 42on

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32158 into master
Sage Weil [Sun, 15 Dec 2019 01:43:08 +0000 (19:43 -0600)]
Merge PR #32158 into master

* refs/pull/32158/head:
cephadm: fix exception when no time sync is running
cephadm: properly extract osd fsid during adoption
cephadm: do ceph-volume activate+deactivate as part of systemd unit
ceph-daemon: behave with no /etc/ceph/ceph.conf

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agocephadm: fix exception when no time sync is running 32158/head
Sage Weil [Sat, 14 Dec 2019 14:22:12 +0000 (08:22 -0600)]
cephadm: fix exception when no time sync is running

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: properly extract osd fsid during adoption
Sage Weil [Fri, 13 Dec 2019 23:14:12 +0000 (17:14 -0600)]
cephadm: properly extract osd fsid during adoption

This needs to be passed to the deploy_daemon_units method so that we can
set up the pre and post c-v calls properly.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: do ceph-volume activate+deactivate as part of systemd unit
Sage Weil [Fri, 13 Dec 2019 14:37:29 +0000 (08:37 -0600)]
cephadm: do ceph-volume activate+deactivate as part of systemd unit

1- Do the activate as part of the unit on start, since it may include
setup that disappears on a reboot, like starting up the dmcrypted volume.

2- Do the matching deactivate step when the container stops, like shutting
down the dmcrypt volume.

Right now the OSD is the only thing that needs this special behavior.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-daemon: behave with no /etc/ceph/ceph.conf
Sage Weil [Tue, 10 Dec 2019 16:20:52 +0000 (10:20 -0600)]
ceph-daemon: behave with no /etc/ceph/ceph.conf

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32244 into master
Sage Weil [Sat, 14 Dec 2019 04:03:45 +0000 (22:03 -0600)]
Merge PR #32244 into master

* refs/pull/32244/head:
qa/workunits/cephadm/test_cephadm.sh: re-enable `adopt` tests

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomds/MDSDaemon: fix asok 'exit' and 'respawn' commands 32251/head
Sage Weil [Fri, 13 Dec 2019 20:34:31 +0000 (14:34 -0600)]
mds/MDSDaemon: fix asok 'exit' and 'respawn' commands

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32253 into master
Sage Weil [Sat, 14 Dec 2019 02:13:55 +0000 (20:13 -0600)]
Merge PR #32253 into master

* refs/pull/32253/head:
mgr/orchestrator: make hosts and label args consistent

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32209 into master
Sage Weil [Sat, 14 Dec 2019 02:12:53 +0000 (20:12 -0600)]
Merge PR #32209 into master

* refs/pull/32209/head:
mgr/cephadm: Add unittest for service_action

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomgr/orchestrator: make hosts and label args consistent 32253/head
Sage Weil [Fri, 13 Dec 2019 22:30:29 +0000 (16:30 -0600)]
mgr/orchestrator: make hosts and label args consistent

- hosts is always n=N; labels is not
- hosts always before labels

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32192 into master
Sage Weil [Fri, 13 Dec 2019 20:41:14 +0000 (14:41 -0600)]
Merge PR #32192 into master

* refs/pull/32192/head:
common: handle return value from read(2)

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32195 into master
Sage Weil [Fri, 13 Dec 2019 20:40:13 +0000 (14:40 -0600)]
Merge PR #32195 into master

* refs/pull/32195/head:
osd/PeeringState.cc: skip peer_purged when discovering all missing

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge PR #32203 into master
Sage Weil [Fri, 13 Dec 2019 20:39:40 +0000 (14:39 -0600)]
Merge PR #32203 into master

* refs/pull/32203/head:
Revert "mgr/DaemonServer: safe-to-destroy - do not consider irrelevant pgs"

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32219 into master
Sage Weil [Fri, 13 Dec 2019 20:39:20 +0000 (14:39 -0600)]
Merge PR #32219 into master

* refs/pull/32219/head:
common: move xattr -> os/filestore/os_xattr

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32250 into master
Sage Weil [Fri, 13 Dec 2019 19:50:42 +0000 (13:50 -0600)]
Merge PR #32250 into master

* refs/pull/32250/head:
mgr/cephadm: fix temp file prefixes
qa: fix lingering ceph-mgr-ssh -> ceph-mgr-cephadm refs

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32144 into master
Patrick Donnelly [Fri, 13 Dec 2019 19:29:04 +0000 (11:29 -0800)]
Merge PR #32144 into master

* refs/pull/32144/head:
doc: mention multimds suite in dev guide
doc: clarify difference between fs and kcephfs suite

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32024 into master
Patrick Donnelly [Fri, 13 Dec 2019 19:07:21 +0000 (11:07 -0800)]
Merge PR #32024 into master

* refs/pull/32024/head:
stop: Unmount cephFS volumes

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr/cephadm: fix temp file prefixes 32250/head
Sage Weil [Fri, 13 Dec 2019 18:48:44 +0000 (12:48 -0600)]
mgr/cephadm: fix temp file prefixes

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa: fix lingering ceph-mgr-ssh -> ceph-mgr-cephadm refs
Sage Weil [Fri, 13 Dec 2019 18:48:06 +0000 (12:48 -0600)]
qa: fix lingering ceph-mgr-ssh -> ceph-mgr-cephadm refs

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32226 from neha-ojha/wip-four-percent
Neha Ojha [Fri, 13 Dec 2019 18:23:34 +0000 (10:23 -0800)]
Merge pull request #32226 from neha-ojha/wip-four-percent

doc/rados: Better block.db size recommendations for bluestore

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agodoc/rados: Better block.db size recommendations for bluestore 32226/head
Neha [Thu, 12 Dec 2019 22:04:57 +0000 (22:04 +0000)]
doc/rados: Better block.db size recommendations for bluestore

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32040 from smithfarm/wip-rn-13-2-8-mimic
Nathan Cutler [Fri, 13 Dec 2019 16:49:43 +0000 (17:49 +0100)]
Merge pull request #32040 from smithfarm/wip-rn-13-2-8-mimic

doc/releases: add release notes for mimic v13.2.8

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agodoc/releases: add Mimic v13.2.8 to releases timeline 32040/head
Nathan Cutler [Tue, 10 Dec 2019 16:55:54 +0000 (17:55 +0100)]
doc/releases: add Mimic v13.2.8 to releases timeline

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge PR #32236 into master
Sage Weil [Fri, 13 Dec 2019 15:34:43 +0000 (09:34 -0600)]
Merge PR #32236 into master

* refs/pull/32236/head:
pybind/mgr: add_tox_test: Add mypy to TOX_ENVS

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoqa/workunits/cephadm/test_cephadm.sh: re-enable `adopt` tests 32244/head
Michael Fritch [Fri, 13 Dec 2019 14:33:54 +0000 (07:33 -0700)]
qa/workunits/cephadm/test_cephadm.sh: re-enable `adopt` tests

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #32005 from s0nea/wip-dashboard-reactivate-suites
Laura Paduano [Fri, 13 Dec 2019 14:40:31 +0000 (15:40 +0100)]
Merge pull request #32005 from s0nea/wip-dashboard-reactivate-suites

mgr/dashboard: reactivate dashboard test suites

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agopybind/mgr: add_tox_test: Add mypy to TOX_ENVS 32236/head
Sebastian Wagner [Fri, 13 Dec 2019 11:01:57 +0000 (12:01 +0100)]
pybind/mgr: add_tox_test: Add mypy to TOX_ENVS

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agorbd-mirror: fix race on namespace replayer initialization failure 32243/head
Mykola Golub [Fri, 13 Dec 2019 13:16:17 +0000 (15:16 +0200)]
rbd-mirror: fix race on namespace replayer initialization failure

Fixes: https://tracker.ceph.com/issues/43289
Signed-off-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #31851 from votdev/issue_42609_device_lights
Laura Paduano [Fri, 13 Dec 2019 12:20:25 +0000 (13:20 +0100)]
Merge pull request #31851 from votdev/issue_42609_device_lights

mgr/dashboard: Add support for blinking enclosure LEDs

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agostop: Unmount cephFS volumes 32024/head
Kotresh HR [Thu, 5 Dec 2019 05:53:00 +0000 (11:23 +0530)]
stop: Unmount cephFS volumes

When stop.sh is run while the cephFS is mounted,
mount processes are retained and can't be killed.
And also the mount and df commands hang after this.
This patch unmounts the mounted volumes cleanly.

Signed-off-by: Kotresh HR <khiremat@redhat.com>
5 years agoMerge pull request #32186 from rhcs-dashboard/43263-fix-rgw-subuser-key
Laura Paduano [Fri, 13 Dec 2019 11:59:58 +0000 (12:59 +0100)]
Merge pull request #32186 from rhcs-dashboard/43263-fix-rgw-subuser-key

mgr/dashboard: fix RGW subuser auto-generate key.

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31753 from smithfarm/wip-bci-resolve-fix
Nathan Cutler [Fri, 13 Dec 2019 11:47:42 +0000 (12:47 +0100)]
Merge pull request #31753 from smithfarm/wip-bci-resolve-fix

backport-create-issue: resolve parent only if parent has backport issues

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Simplify PrometheusService::getRules implementa… (#32130)
Lenz Grimmer [Fri, 13 Dec 2019 11:33:11 +0000 (11:33 +0000)]
mgr/dashboard: Simplify PrometheusService::getRules implementa… (#32130)

mgr/dashboard: Simplify PrometheusService::getRules implementation

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/cephadm: Add unittest for service_action 32209/head
Sebastian Wagner [Fri, 13 Dec 2019 10:37:03 +0000 (11:37 +0100)]
mgr/cephadm: Add unittest for service_action

(That was missing previously)

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #32177 from Takios/ceph_volume_fix
Jan Fajerski [Fri, 13 Dec 2019 09:09:03 +0000 (10:09 +0100)]
Merge pull request #32177 from Takios/ceph_volume_fix

ceph-volume: use correct extents if using db-devices and >1 osds_per_device

5 years agomgr/dashboard: reactivate dashboard test suites 32005/head
Tatjana Dehler [Wed, 4 Dec 2019 13:43:24 +0000 (14:43 +0100)]
mgr/dashboard: reactivate dashboard test suites

Reactivate the dashboard test suites that were commented
out in https://github.com/ceph/ceph/pull/30864 because
https://tracker.ceph.com/issues/41538 has been resolved
in the meanwhile.

Fixes: https://tracker.ceph.com/issues/42652
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #32224 from tspmelo/wip-e2e-insecure
Laura Paduano [Fri, 13 Dec 2019 06:58:30 +0000 (07:58 +0100)]
Merge pull request #32224 from tspmelo/wip-e2e-insecure

mgr/dashboard: Fix e2e chromedriver problem

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge PR #31255 into master
Patrick Donnelly [Fri, 13 Dec 2019 05:07:32 +0000 (21:07 -0800)]
Merge PR #31255 into master

* refs/pull/31255/head:
mds/MDSDaemon: make con disposable before passing message to asok
mds/SessionMap: interpret bare id as a valid filter
mds: get rid of unused send_command_reply helpers
mds: remove old handle_command machinery
mds/MDSRank: remove C_ExecAndReply helpers
mds/MDSRank: too many words about op_tracker
mds: convert 'cache drop'
mds: convert 'damage ls' and 'damage rm'
mds: convert '{session,client} config'
mds: convert 'scrub {start,abort,pause,resume,status}'
mds: convert 'session ls' and 'client ls'
mds: convert 'session evict' and 'session kill'
mds: convert 'heap' and 'cpu_profiler'
mds: convert 'exit', 'respawn'
mds/MDSDaemon: remove old duplicated tell commands
mds: send tell commands to asok infrastructure
common/admin_socket: switch tell queue to cref_t (from ref_t)
mds: switch asok calls over to call_async interface

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32230 from shellwedance/ceph-volume_typo_fix
Neha Ojha [Fri, 13 Dec 2019 04:31:24 +0000 (20:31 -0800)]
Merge pull request #32230 from shellwedance/ceph-volume_typo_fix

doc: fix a typo in a command

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32170 from rosinL/wip-rss
Kefu Chai [Fri, 13 Dec 2019 04:25:36 +0000 (12:25 +0800)]
Merge pull request #32170 from rosinL/wip-rss

msg/async/DPDK: refactor set_rss_table to support DPDK 19.05

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agodoc: fix a typo in a command 32230/head
taeuk_kim [Fri, 13 Dec 2019 02:26:45 +0000 (11:26 +0900)]
doc: fix a typo in a command

Co-authored-by: donggyu_park <donggyu_park@tmax.co.kr>
Signed-off-by: taeuk_kim <taeuk_kim@tmax.co.kr>
5 years agodoc/rbd: align with other part in the context 32142/head
Changcheng Liu [Thu, 12 Dec 2019 01:15:43 +0000 (09:15 +0800)]
doc/rbd: align with other part in the context

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
5 years agoMerge PR #32179 into master
Sage Weil [Fri, 13 Dec 2019 02:00:23 +0000 (20:00 -0600)]
Merge PR #32179 into master

* refs/pull/32179/head:
lvm: add deactivate subcommand
util/system: add unmount_tmpfs helper
api/lvm: add get_lv_by_osd_id method
api/lvm: add deactivate method to Volume class

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agodoc/rbd: correct targe dev name and existence check
Changcheng Liu [Thu, 12 Dec 2019 01:05:33 +0000 (09:05 +0800)]
doc/rbd: correct targe dev name and existence check

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
5 years agoMerge PR #32225 into master
Sage Weil [Thu, 12 Dec 2019 23:14:51 +0000 (17:14 -0600)]
Merge PR #32225 into master

* refs/pull/32225/head:
qa: add force-branch to suites running s3readwrite & s3roundtrip tasks

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #32003 into master
Sage Weil [Thu, 12 Dec 2019 23:05:11 +0000 (17:05 -0600)]
Merge PR #32003 into master

* refs/pull/32003/head:
mgr/ssh fix tests for update_mds/mgr/mds/rgw/rbd-mirror
Allow List[HostSpec] in PlacementSpec
mgr/rook: adapt to arg passing change in orchestrator_cli.py
mgr/ssh: Add SimpleScheduler and streamline arg passing
orch_cli: adapt to changes in PlacementSpec and ServiceSpec
orch: extend PlacementSpec and add StatefulServiceSpec

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32218 into master
Sage Weil [Thu, 12 Dec 2019 23:04:02 +0000 (17:04 -0600)]
Merge PR #32218 into master

* refs/pull/32218/head:
cephadm: use raw string during `re.sub`
cephadm: fix ConfigParser DeprecationWarning in py3

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32187 into master
Sage Weil [Thu, 12 Dec 2019 22:07:16 +0000 (16:07 -0600)]
Merge PR #32187 into master

* refs/pull/32187/head:
ceph.in: (py3) use binary stdout
pybind/mgr: index=4, sort_keys=True for json.dumps throughput

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoMerge pull request #32013 from liewegas/doc-foundation
Mike Perez [Thu, 12 Dec 2019 22:04:35 +0000 (14:04 -0800)]
Merge pull request #32013 from liewegas/doc-foundation

doc/foundation: add cloudbase and vexxhost

5 years agoMerge pull request #32197 from neha-ojha/wip-report-doc-bug
Neha Ojha [Thu, 12 Dec 2019 21:38:46 +0000 (13:38 -0800)]
Merge pull request #32197 from neha-ojha/wip-report-doc-bug

doc/_templates/page.html: redirect to etherpad

Reviewed-by: Zac Dover zac.dover@gmail.com
Reviewed-by: Sage Weil sage@redhat.com
5 years agoqa: add force-branch to suites running s3readwrite & s3roundtrip tasks 32225/head
Ali Maredia [Thu, 12 Dec 2019 21:09:07 +0000 (16:09 -0500)]
qa: add force-branch to suites running s3readwrite & s3roundtrip tasks

Signed-off-by: Ali Maredia <amaredia@redhat.com>
5 years agoMerge PR #32220 into master
Sage Weil [Thu, 12 Dec 2019 20:23:06 +0000 (14:23 -0600)]
Merge PR #32220 into master

* refs/pull/32220/head:
qa/workunits/cephadm/test_cephadm.sh: need --fsid always

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agomds/MDSDaemon: make con disposable before passing message to asok 31255/head
Sage Weil [Tue, 10 Dec 2019 04:38:57 +0000 (22:38 -0600)]
mds/MDSDaemon: make con disposable before passing message to asok

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds/SessionMap: interpret bare id as a valid filter
Sage Weil [Fri, 15 Nov 2019 18:31:46 +0000 (12:31 -0600)]
mds/SessionMap: interpret bare id as a valid filter

This works around the fact that the old asok 'session evict' took a bare
id and the tell version took a filter.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds: get rid of unused send_command_reply helpers
Sage Weil [Wed, 30 Oct 2019 12:31:33 +0000 (07:31 -0500)]
mds: get rid of unused send_command_reply helpers

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds: remove old handle_command machinery
Sage Weil [Wed, 30 Oct 2019 12:29:05 +0000 (07:29 -0500)]
mds: remove old handle_command machinery

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds/MDSRank: remove C_ExecAndReply helpers
Sage Weil [Wed, 30 Oct 2019 12:26:13 +0000 (07:26 -0500)]
mds/MDSRank: remove C_ExecAndReply helpers

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds/MDSRank: too many words about op_tracker
Sage Weil [Wed, 30 Oct 2019 12:25:32 +0000 (07:25 -0500)]
mds/MDSRank: too many words about op_tracker

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds: convert 'cache drop'
Sage Weil [Wed, 30 Oct 2019 12:24:59 +0000 (07:24 -0500)]
mds: convert 'cache drop'

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomds: convert 'damage ls' and 'damage rm'
Sage Weil [Wed, 30 Oct 2019 12:08:58 +0000 (07:08 -0500)]
mds: convert 'damage ls' and 'damage rm'

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31629 into master
Patrick Donnelly [Thu, 12 Dec 2019 18:30:55 +0000 (10:30 -0800)]
Merge PR #31629 into master

* refs/pull/31629/head:
cephfs-shell: rearrange code for convenience

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr/dashboard: Fix e2e chromedriver problem 32224/head
Tiago Melo [Thu, 12 Dec 2019 18:00:57 +0000 (17:00 -0100)]
mgr/dashboard: Fix e2e chromedriver problem

New version of Chrome/ChromeDriver seems to have a problem with insecure
certificates.

Since we use a vStart cluster with no real certificate,
we always face this problem when running e2e tests.

This will fix the current problem and hopefully any future problems related to
certificates.

Fixes: https://tracker.ceph.com/issues/43254
Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agoqa/workunits/cephadm/test_cephadm.sh: need --fsid always 32220/head
Sage Weil [Thu, 12 Dec 2019 13:36:23 +0000 (07:36 -0600)]
qa/workunits/cephadm/test_cephadm.sh: need --fsid always

Otherwise the test breaks if there are other cluster(s) on the host (like
there normally are in my dev environment).

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agobackport-create-issue: resolve parent only if parent has backport issues 31753/head
Nathan Cutler [Wed, 20 Nov 2019 08:15:33 +0000 (09:15 +0100)]
backport-create-issue: resolve parent only if parent has backport issues

This fixes an edge case. If a parent issue is in "Pending Backport" status
but without any backport issues, the script (when running with --resolve-parent)
was wrongly changing the status to "Resolved".

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge PR #32129 into master
Sage Weil [Thu, 12 Dec 2019 16:26:17 +0000 (10:26 -0600)]
Merge PR #32129 into master

* refs/pull/32129/head:
qa: Enable flake8 tox and fix failures

5 years agoceph.in: (py3) use binary stdout 32187/head
Sage Weil [Wed, 11 Dec 2019 16:59:24 +0000 (10:59 -0600)]
ceph.in: (py3) use binary stdout

This fixes an error like

$ ceph -s -o -
Traceback (most recent call last):
  File "bin/ceph", line 1267, in <module>
    retval = main()
  File "bin/ceph", line 1229, in main
    outf.write(outbuf)
TypeError: write() argument must be str, not bytes

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agopybind/mgr: index=4, sort_keys=True for json.dumps throughput
Sage Weil [Wed, 11 Dec 2019 16:33:17 +0000 (10:33 -0600)]
pybind/mgr: index=4, sort_keys=True for json.dumps throughput

- fixes balancer test on py3 by making the pool ls order deterministic
- makes everybody else behave consistently

I left internal json storage alone--no need to sort/normalize.  I also
left out some CLI commands returning non-indented json.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32094 from cbodley/wip-40585
Casey Bodley [Thu, 12 Dec 2019 16:20:16 +0000 (11:20 -0500)]
Merge pull request #32094 from cbodley/wip-40585

test/rgw: raise timer durations for unittest_rgw_reshard_wait

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agocommon: move xattr -> os/filestore/os_xattr 32219/head
David Disseldorp [Thu, 12 Dec 2019 15:26:42 +0000 (16:26 +0100)]
common: move xattr -> os/filestore/os_xattr

Aside from unittest_chain_xattr, these functions are only used by
filestore, so it makes sense to move them out of common.

Signed-off-by: David Disseldorp <ddiss@suse.de>
5 years agoMerge pull request #32153 from smithfarm/wip-23981
Nathan Cutler [Thu, 12 Dec 2019 15:19:40 +0000 (16:19 +0100)]
Merge pull request #32153 from smithfarm/wip-23981

install-deps.sh: install python2-{virtualenv,devel} on SUSE if needed

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
5 years agocephadm: use raw string during `re.sub` 32218/head
Michael Fritch [Thu, 12 Dec 2019 15:10:44 +0000 (08:10 -0700)]
cephadm: use raw string during `re.sub`

cephadm:198: DeprecationWarning: invalid escape sequence \s
  nice_conf = re.sub('\n(\s)+', '\n', raw_conf)

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agocephadm: fix ConfigParser DeprecationWarning in py3
Michael Fritch [Thu, 12 Dec 2019 15:02:34 +0000 (08:02 -0700)]
cephadm: fix ConfigParser DeprecationWarning in py3

DeprecationWarning: This method will be removed in future versions.
Use 'parser.read_file()' instead.

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #32151 from liewegas/fix-scipy
Kefu Chai [Thu, 12 Dec 2019 14:06:20 +0000 (22:06 +0800)]
Merge pull request #32151 from liewegas/fix-scipy

install-deps.sh: preload wheel for all mgr requirements.txt files

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agolvm: add deactivate subcommand 32179/head
Jan Fajerski [Wed, 11 Dec 2019 13:54:16 +0000 (14:54 +0100)]
lvm: add deactivate subcommand

This new subcommand unmounts and OSDs tmpfs mount and closes crypt
devices if there are any.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
5 years agoutil/system: add unmount_tmpfs helper
Jan Fajerski [Thu, 12 Dec 2019 08:28:27 +0000 (09:28 +0100)]
util/system: add unmount_tmpfs helper

Thsi unmounts a path if and only if it's a tmpfs mount.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
5 years agomsg/async/dpdk: refactor set_rss_table to support DPDK 19.05 32170/head
f00391043 [Thu, 14 Nov 2019 07:58:34 +0000 (15:58 +0800)]
msg/async/dpdk: refactor set_rss_table to support DPDK 19.05

The filter API was deprecated in DPDK 19.05, using the flow
API to set rss table.

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Signed-off-by: luo rixin <luorixin@huawei.com>
5 years agomgr/dashboard: Add support for blinking enclosure LEDs 31851/head
Volker Theile [Mon, 11 Nov 2019 15:30:50 +0000 (16:30 +0100)]
mgr/dashboard: Add support for blinking enclosure LEDs

Fixes: https://tracker.ceph.com/issues/42609
Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agoinstall-deps.sh: install python2-{virtualenv,devel} on SUSE if needed 32153/head
Nathan Cutler [Tue, 10 Dec 2019 17:13:49 +0000 (18:13 +0100)]
install-deps.sh: install python2-{virtualenv,devel} on SUSE if needed

Recent versions of openSUSE are fully Python 3 systems, but Python 2 can still
be installed on them. When Python 2 *and* Python 3 are installed, tox will try
to run unit tests ("make check" tests) on both. But the spec-file-based
mechanism used by install-deps.sh for determining "make check" dependencies only
installs python3-virtualenv and python3-devel.

Fixes: https://tracker.ceph.com/issues/23981
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #32172 from wjwithagen/wjw-fix-test_cls_rbd-compat
Mykola Golub [Thu, 12 Dec 2019 12:00:43 +0000 (14:00 +0200)]
Merge pull request #32172 from wjwithagen/wjw-fix-test_cls_rbd-compat

test/cls_rbd: include compat.h for ERESTART

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agorbd-mirror: allow to have different priority levels 32184/head
Mykola Golub [Thu, 12 Dec 2019 11:41:34 +0000 (13:41 +0200)]
rbd-mirror: allow to have different priority levels

for aggregated and per-image perf counters

Signed-off-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #32182 from sebastian-philipp/upstream-pull-31757
Sebastian Wagner [Thu, 12 Dec 2019 11:27:46 +0000 (12:27 +0100)]
Merge pull request #32182 from sebastian-philipp/upstream-pull-31757

mgr/test_orchestrator: Add dummy data

Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31920 from ricardoasmarques/fix-sso-certs
Lenz Grimmer [Thu, 12 Dec 2019 09:47:12 +0000 (09:47 +0000)]
Merge pull request #31920 from ricardoasmarques/fix-sso-certs

mgr/dashboard: Invalid SSO configuration when certificate path does not exist

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agomgr/dashboard: Use badges for counters in tabs (#31938)
Lenz Grimmer [Thu, 12 Dec 2019 09:44:18 +0000 (09:44 +0000)]
mgr/dashboard: Use badges for counters in tabs (#31938)

mgr/dashboard: Use badges for counters in tabs

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31787 from shyukri/wip-36728-c_v-util-which-path
Jan Fajerski [Thu, 12 Dec 2019 09:26:39 +0000 (10:26 +0100)]
Merge pull request #31787 from shyukri/wip-36728-c_v-util-which-path

ceph-volume: util: look for executable in $PATH

5 years agomgr/ssh fix tests for update_mds/mgr/mds/rgw/rbd-mirror 32003/head
Joshua Schmid [Thu, 5 Dec 2019 13:21:19 +0000 (14:21 +0100)]
mgr/ssh fix tests for update_mds/mgr/mds/rgw/rbd-mirror

Signed-off-by: Joshua Schmid <jschmid@suse.de>
5 years agoAllow List[HostSpec] in PlacementSpec
Joshua Schmid [Thu, 5 Dec 2019 11:17:04 +0000 (12:17 +0100)]
Allow List[HostSpec] in PlacementSpec

Signed-off-by: Joshua Schmid <jschmid@suse.de>
5 years agoqa: Enable flake8 tox and fix failures 32129/head
Thomas Bechtold [Mon, 9 Dec 2019 15:17:23 +0000 (16:17 +0100)]
qa: Enable flake8 tox and fix failures

There were a couple of problems found by flake8 in the qa/
directory (most of them fixed now). Enabling flake8 during the usual
check runs hopefully avoids adding new issues in the future.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
5 years agoMerge pull request #32080 from smithfarm/wip-43171
Nathan Cutler [Thu, 12 Dec 2019 09:18:13 +0000 (10:18 +0100)]
Merge pull request #32080 from smithfarm/wip-43171

ceph.spec.in: move distro-conditional deps to dedicated section

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agomgr/rook: adapt to arg passing change in orchestrator_cli.py
Joshua Schmid [Wed, 4 Dec 2019 12:45:42 +0000 (13:45 +0100)]
mgr/rook: adapt to arg passing change in orchestrator_cli.py

Signed-off-by: Joshua Schmid <jschmid@suse.de>
5 years agomgr/ssh: Add SimpleScheduler and streamline arg passing
Joshua Schmid [Wed, 4 Dec 2019 12:42:30 +0000 (13:42 +0100)]
mgr/ssh: Add SimpleScheduler and streamline arg passing

* adding a mechanism to augment specs.placement.nodes
  even when no nodes are provided via dynamic determination
  from host_pools. (NodeAssignment)

* added SimpleScheduler
  implements most simple placment algorithm possible.
  Choose from a shuffled list of hosts.

* streamlined args passed to the public update_$service
  functions. They all take `spec` now.

Signed-off-by: Joshua Schmid <jschmid@suse.de>
5 years agoorch_cli: adapt to changes in PlacementSpec and ServiceSpec
Joshua Schmid [Wed, 4 Dec 2019 12:39:56 +0000 (13:39 +0100)]
orch_cli: adapt to changes in PlacementSpec and ServiceSpec

* adapt to changes in PlacementSpec (count moved to PlacementSpec)
* added label param to update_& functions

Signed-off-by: Joshua Schmid <jschmid@suse.de>
5 years agoorch: extend PlacementSpec and add StatefulServiceSpec
Joshua Schmid [Wed, 4 Dec 2019 12:37:58 +0000 (13:37 +0100)]
orch: extend PlacementSpec and add StatefulServiceSpec

* add public set_nodes()
* add StatefulServiceSpec

Signed-off-by: Joshua Schmid <jschmid@suse.de>