]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agocephadm: fix error handling in `command_check_host()` 33048/head
Guillaume Abrioux [Mon, 3 Feb 2020 17:34:11 +0000 (18:34 +0100)]
cephadm: fix error handling in `command_check_host()`

`find_program()` raises `ValueError` when the executable hasn't been
found. It means we need to catch `ValueError` exception in
`command_check_host()` and raise `Error` instead of `RuntimeError` since
only `Error` is caught at the end.

Typical failure:

```
INFO:cephadm:/usr/bin/ceph:stderr Error ENOENT: New host mon1 failed check: ['INFO:cephadm:podman|docker (/bin/podman) is present', 'INFO:cephadm:systemctl is present', 'Traceback (most recent call last):', '  File "<stdin>", line 2820, in <module>', '  File "<stdin>", line 2434, in command_check_host', '  File "<stdin>", line 796, in find_program', 'ValueError: lvcreate not found']
```

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
5 years agocephadm: increase default retry_max value
Guillaume Abrioux [Mon, 3 Feb 2020 16:25:06 +0000 (17:25 +0100)]
cephadm: increase default retry_max value

When playing with cephadm, at multiple times, I've reached the max
number of attempt in `is_available()`

Increasing the `retry_max` helps to avoid failure like following:

```
INFO:cephadm:mgr not available, waiting (1/5)...
INFO:cephadm:mgr not available, waiting (2/5)...
INFO:cephadm:mgr not available, waiting (3/5)...
INFO:cephadm:mgr not available, waiting (4/5)...
INFO:cephadm:mgr not available, waiting (5/5)...
ERROR: mgr not available after 5 tries

```

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
5 years agoMerge pull request #32155 from yuvalif/wip-yuval-multidelete-notifications
Yuval Lifshitz [Mon, 3 Feb 2020 16:02:06 +0000 (18:02 +0200)]
Merge pull request #32155 from yuvalif/wip-yuval-multidelete-notifications

rgw/pubsub: send notifications from multi-delete op

5 years agoMerge pull request #32859 from liewegas/wip-cephadm-services
Sebastian Wagner [Mon, 3 Feb 2020 13:27:38 +0000 (14:27 +0100)]
Merge pull request #32859 from liewegas/wip-cephadm-services

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #33030 from smithfarm/wip-luminous-12.2.13-release-notes
Abhishek L [Mon, 3 Feb 2020 12:32:50 +0000 (13:32 +0100)]
Merge pull request #33030 from smithfarm/wip-luminous-12.2.13-release-notes

doc: release notes for Luminous v12.2.13

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #33031 from smithfarm/wip-nautilus-14.2.7-release-notes
Abhishek L [Mon, 3 Feb 2020 12:32:05 +0000 (13:32 +0100)]
Merge pull request #33031 from smithfarm/wip-nautilus-14.2.7-release-notes

doc: release notes for Nautilus 14.2.7

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #33038 from tchaikov/wip-librados-reinterpret-cast
Kefu Chai [Mon, 3 Feb 2020 11:58:13 +0000 (19:58 +0800)]
Merge pull request #33038 from tchaikov/wip-librados-reinterpret-cast

librados: prefer reinterpret_cast over c-style cast

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
5 years agoMerge pull request #32933 from DimStar77/obs-mini
Kefu Chai [Mon, 3 Feb 2020 11:45:07 +0000 (19:45 +0800)]
Merge pull request #32933 from DimStar77/obs-mini

ceph.spec.in: Use pkgconfig() style BuildRequires for udev/libudev-devel

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32553 from tspmelo/wip-ts-strict
Lenz Grimmer [Mon, 3 Feb 2020 11:33:33 +0000 (11:33 +0000)]
Merge pull request #32553 from tspmelo/wip-ts-strict

mgr/dashboard: Enable compiler options used by Angular --strict flag

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agolibrados: prefer reinterpret_cast over c-style cast 33038/head
Kefu Chai [Mon, 3 Feb 2020 10:15:30 +0000 (18:15 +0800)]
librados: prefer reinterpret_cast over c-style cast

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #33016 from tchaikov/wip-do-cmake
Kefu Chai [Mon, 3 Feb 2020 09:15:16 +0000 (17:15 +0800)]
Merge pull request #33016 from tchaikov/wip-do-cmake

do_cmake.sh: bail out if something goes wrong

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge PR #32570 into master
Patrick Donnelly [Sun, 2 Feb 2020 14:56:50 +0000 (06:56 -0800)]
Merge PR #32570 into master

* refs/pull/32570/head:
cephfs-shell: Add tests for setxattr, getxattr and listxattr
cephfs-shell: Add listxattr command
cephfs-shell: Add getxattr command
cephfs-shell: Add setxattr command
doc: Update about extended attributes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31633 into master
Patrick Donnelly [Sun, 2 Feb 2020 14:52:23 +0000 (06:52 -0800)]
Merge PR #31633 into master

* refs/pull/31633/head:
cephfs-shell: Instead of assert use stat for tests in rmdir
cephfs-shell: Add function for common rmdir test code
cephfs-shell: Add rmdir test for non empty directory
cephfs-shell: Add rmdir -p test for non empty directory
cephfs-shell: Add rmdir -p test for non existing dir
cephfs-shell: Add rmdir -p test to delete all dirs in given path
cephfs-shell: Add rmdir -p test for root directory with empty directories
cephfs-shell: Add rmdir test for valid file
cephfs-shell: Add rmdir test for invalid directory
cephfs-shell: Add rmdir test for valid directory
cephfs-shell: Fix rmdir '-p' issues

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32986 into master
Sage Weil [Sat, 1 Feb 2020 16:47:56 +0000 (10:47 -0600)]
Merge PR #32986 into master

* refs/pull/32986/head:
qa/tasks/ceph_manager: fix movement of cot exports with cephadm

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agodoc: release notes for Nautilus 14.2.7 33031/head
Nathan Cutler [Sat, 1 Feb 2020 11:12:56 +0000 (12:12 +0100)]
doc: release notes for Nautilus 14.2.7

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc: release notes for Luminous v12.2.13 33030/head
Nathan Cutler [Sat, 1 Feb 2020 10:54:38 +0000 (11:54 +0100)]
doc: release notes for Luminous v12.2.13

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #32030 from vshankar/wip-mgr-volumes-clone
Ramana Raja [Sat, 1 Feb 2020 07:47:51 +0000 (13:17 +0530)]
Merge pull request #32030 from vshankar/wip-mgr-volumes-clone

mgr/volumes: clone from snapshot

5 years agoMerge PR #33014 into master
Sage Weil [Sat, 1 Feb 2020 05:28:44 +0000 (23:28 -0600)]
Merge PR #33014 into master

* refs/pull/33014/head:
mgr/dashboard: pass a list of drive_group to create_osds

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32973 into master
Sage Weil [Sat, 1 Feb 2020 03:26:46 +0000 (21:26 -0600)]
Merge PR #32973 into master

* refs/pull/32973/head:
mgr/insights: make 'insights prune-health-history 0' zap current state

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #32987 into master
Sage Weil [Fri, 31 Jan 2020 23:40:23 +0000 (17:40 -0600)]
Merge PR #32987 into master

* refs/pull/32987/head:
qa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #32989 into master
Sage Weil [Fri, 31 Jan 2020 23:40:13 +0000 (17:40 -0600)]
Merge PR #32989 into master

* refs/pull/32989/head:
qa/tasks/ceph_manager: add --log-early to raw_cluster_cmd

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #32830 into master
Sage Weil [Fri, 31 Jan 2020 23:31:44 +0000 (17:31 -0600)]
Merge PR #32830 into master

* refs/pull/32830/head:
global: ensure CEPH_ARGS is decoded before early arg processing

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32806 into master
Sage Weil [Fri, 31 Jan 2020 23:31:31 +0000 (17:31 -0600)]
Merge PR #32806 into master

* refs/pull/32806/head:
common/bl: fix accessibility of bptr's _off and _len fields.
common/bl: drop get_raw() from the public buffer::ptr interface.
common: drop sharing of buffer::raw outside bufferlist.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoqa/tasks/ceph_manager: fix movement of cot exports with cephadm 32986/head
Sage Weil [Thu, 30 Jan 2020 13:39:32 +0000 (07:39 -0600)]
qa/tasks/ceph_manager: fix movement of cot exports with cephadm

I think this will finally work...

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #33017 from linuxbox2/wip-rgw-beastc
Matt Benjamin [Fri, 31 Jan 2020 16:55:35 +0000 (11:55 -0500)]
Merge pull request #33017 from linuxbox2/wip-rgw-beastc

rgw: improve beast

5 years agoMerge pull request #33010 from tchaikov/wip-cmd-getval
Kefu Chai [Fri, 31 Jan 2020 16:26:39 +0000 (00:26 +0800)]
Merge pull request #33010 from tchaikov/wip-cmd-getval

src/: drop cct from cmd_getval()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agodo_cmake.sh: bail out if something goes wrong 33016/head
Kefu Chai [Fri, 31 Jan 2020 16:13:32 +0000 (00:13 +0800)]
do_cmake.sh: bail out if something goes wrong

so we can be aware if some updated submodule reference is missing in our
repo

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: pass a list of drive_group to create_osds 33014/head
Kefu Chai [Fri, 31 Jan 2020 15:42:49 +0000 (23:42 +0800)]
mgr/dashboard: pass a list of drive_group to create_osds

as orchestrator backends expect a list of drive_groups.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: Unable to remove an iSCSI gateway that is alrea… (#32984)
Lenz Grimmer [Fri, 31 Jan 2020 15:52:51 +0000 (15:52 +0000)]
mgr/dashboard: Unable to remove an iSCSI gateway that is alrea… (#32984)

mgr/dashboard: Unable to remove an iSCSI gateway that is already in use

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Add Modified filter to Configuration table (#32923)
Lenz Grimmer [Fri, 31 Jan 2020 15:50:15 +0000 (15:50 +0000)]
mgr/dashboard: Add Modified filter to Configuration table (#32923)

mgr/dashboard: Add Modified filter to Configuration table

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agorgw: improve beast 33017/head
Or Friedmann [Wed, 15 Jan 2020 19:15:53 +0000 (21:15 +0200)]
rgw: improve beast

Avoid leaking connections that had partially-consumed
client data on unexpected disconnect.

Resolves CVE-2020-1700 (moderate impact flaw).

Fixes: https://tracker.ceph.com/issues/42531
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
5 years agoMerge branch 'octopus'
Sage Weil [Fri, 31 Jan 2020 14:55:49 +0000 (08:55 -0600)]
Merge branch 'octopus'

5 years agomgr/dashboard: Enable noImplicitAny TS compiler option 32553/head
Tiago Melo [Mon, 30 Dec 2019 13:13:59 +0000 (12:13 -0100)]
mgr/dashboard: Enable noImplicitAny TS compiler option

Fixes: https://tracker.ceph.com/issues/43525
Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Enable noImplicitReturns TS compiler option
Tiago Melo [Fri, 20 Dec 2019 12:15:34 +0000 (11:15 -0100)]
mgr/dashboard: Enable noImplicitReturns TS compiler option

Fixes: https://tracker.ceph.com/issues/43525
Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Enable noImplicitThis TS compiler option
Tiago Melo [Fri, 20 Dec 2019 01:20:11 +0000 (00:20 -0100)]
mgr/dashboard: Enable noImplicitThis TS compiler option

Fixes: https://tracker.ceph.com/issues/43525
Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Enable noFallthroughCasesInSwitch TS compiler option
Tiago Melo [Thu, 19 Dec 2019 11:31:47 +0000 (10:31 -0100)]
mgr/dashboard: Enable noFallthroughCasesInSwitch TS compiler option

Fixes: https://tracker.ceph.com/issues/43525
Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Move TS compile rules into tsconfig.json
Tiago Melo [Thu, 19 Dec 2019 01:47:39 +0000 (00:47 -0100)]
mgr/dashboard: Move TS compile rules into tsconfig.json

Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #32999 from liewegas/fix-found
Mike Perez [Fri, 31 Jan 2020 13:27:48 +0000 (05:27 -0800)]
Merge pull request #32999 from liewegas/fix-found

doc/foundation: fix amihan

5 years agomgr/cephadm: Don't duplicate cache entries in _create_daemon 32859/head
Sebastian Wagner [Fri, 31 Jan 2020 10:59:10 +0000 (11:59 +0100)]
mgr/cephadm: Don't duplicate cache entries in _create_daemon

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/cephadm: test_cephadm: always set cluster fsid
Sebastian Wagner [Fri, 31 Jan 2020 10:47:55 +0000 (11:47 +0100)]
mgr/cephadm: test_cephadm: always set cluster fsid

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/cephadm: less noisy pytest failue messages
Sebastian Wagner [Fri, 31 Jan 2020 10:31:14 +0000 (11:31 +0100)]
mgr/cephadm: less noisy pytest failue messages

Let's hide the `import pydevd` exception, as it doesn't provide any useful info

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agosrc/: drop cct from cmd_getval() 33010/head
Kefu Chai [Fri, 31 Jan 2020 10:59:39 +0000 (18:59 +0800)]
src/: drop cct from cmd_getval()

it's not used.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agodoc: add mgr/volumes clone commands 32030/head
Venky Shankar [Fri, 24 Jan 2020 06:31:19 +0000 (12:01 +0530)]
doc: add mgr/volumes clone commands

Fixes: http://tracker.ceph.com/issues/24880
Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agotest: add subvolume clone tests
Venky Shankar [Mon, 2 Dec 2019 08:50:23 +0000 (03:50 -0500)]
test: add subvolume clone tests

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: allow force removal of incomplete failed clones
Venky Shankar [Wed, 15 Jan 2020 03:52:52 +0000 (22:52 -0500)]
mgr/volumes: allow force removal of incomplete failed clones

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: asynchronous cloner module
Venky Shankar [Wed, 4 Dec 2019 05:23:48 +0000 (00:23 -0500)]
mgr/volumes: asynchronous cloner module

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: purge thread uses new async interface
Venky Shankar [Wed, 4 Dec 2019 04:49:12 +0000 (23:49 -0500)]
mgr/volumes: purge thread uses new async interface

This also makes `_cancel_jobs()` thread safe, which was not the
case earlier (with `_cancel_purge_job()`) -- this also makes the
code simpler by sharing the lock betweent two condition variables.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: fetch oldest clone entry
Venky Shankar [Tue, 3 Dec 2019 06:47:20 +0000 (01:47 -0500)]
mgr/volumes: fetch oldest clone entry

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: add clone specific commands
Venky Shankar [Mon, 2 Dec 2019 08:11:45 +0000 (03:11 -0500)]
mgr/volumes: add clone specific commands

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: interface for fetching cloned subvolume status
Venky Shankar [Mon, 2 Dec 2019 08:10:36 +0000 (03:10 -0500)]
mgr/volumes: interface for fetching cloned subvolume status

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: add protect/unprotect and snap clone interface
Venky Shankar [Mon, 2 Dec 2019 08:08:45 +0000 (03:08 -0500)]
mgr/volumes: add protect/unprotect and snap clone interface

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: handle transient subvolume states
Venky Shankar [Mon, 2 Dec 2019 08:00:30 +0000 (03:00 -0500)]
mgr/volumes: handle transient subvolume states

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: interface for creating a cloned subvolume
Venky Shankar [Mon, 2 Dec 2019 07:56:48 +0000 (02:56 -0500)]
mgr/volumes: interface for creating a cloned subvolume

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: get/set property for subvolume mode/uid/gid
Venky Shankar [Thu, 16 Jan 2020 12:07:08 +0000 (07:07 -0500)]
mgr/volumes: get/set property for subvolume mode/uid/gid

This will be required when creating a clone as the clone would
inherit source subvolumes creation mode and uid/gid.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: module to track pending clone operations
Venky Shankar [Mon, 2 Dec 2019 06:56:25 +0000 (01:56 -0500)]
mgr/volumes: module to track pending clone operations

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/volumes: add operation state machine table
Venky Shankar [Mon, 2 Dec 2019 06:27:55 +0000 (01:27 -0500)]
mgr/volumes: add operation state machine table

... and fetch creation state from state machine table.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #33001 from tchaikov/wip-drop-dpdk-submodule
Kefu Chai [Fri, 31 Jan 2020 08:16:39 +0000 (16:16 +0800)]
Merge pull request #33001 from tchaikov/wip-drop-dpdk-submodule

dpdk: drop dpdk submodule

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #32814 from mty22/au_ceph_branch_correct_docs
Kefu Chai [Fri, 31 Jan 2020 07:22:40 +0000 (15:22 +0800)]
Merge pull request #32814 from mty22/au_ceph_branch_correct_docs

docs: Update au.ceph.com maintainers, update README.md.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agodpdk: drop dpdk submodule 33001/head
Kefu Chai [Mon, 7 May 2018 14:31:51 +0000 (22:31 +0800)]
dpdk: drop dpdk submodule

we are using spdk/dpdk for async msgr's dpdk backend since 01a9f178. so
no need to keep dpdk submodule anymore.

Fixes: http://tracker.ceph.com/issues/24032
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32947 into master
Sage Weil [Fri, 31 Jan 2020 03:57:04 +0000 (21:57 -0600)]
Merge PR #32947 into master

* refs/pull/32947/head:
OSD: Allow 64-char hostname to be added as the "host" in CRUSH

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32974 into master
Sage Weil [Fri, 31 Jan 2020 03:56:53 +0000 (21:56 -0600)]
Merge PR #32974 into master

* refs/pull/32974/head:
mon: dump json from 'sessions' asok/tell command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32976 into master
Sage Weil [Fri, 31 Jan 2020 03:56:43 +0000 (21:56 -0600)]
Merge PR #32976 into master

* refs/pull/32976/head:
cls_hello: fix typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32981 into master
Sage Weil [Fri, 31 Jan 2020 03:56:18 +0000 (21:56 -0600)]
Merge PR #32981 into master

* refs/pull/32981/head:
mon: elector: return after triggering a new election

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #32988 into master
Sage Weil [Fri, 31 Jan 2020 03:56:05 +0000 (21:56 -0600)]
Merge PR #32988 into master

* refs/pull/32988/head:
qa/tasks/ceph: only re-request scrub on unscrubbed pgs

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agodoc/foundation: fix amihan 32999/head
Sage Weil [Thu, 30 Jan 2020 23:02:43 +0000 (17:02 -0600)]
doc/foundation: fix amihan

I misunderstood the status of their foundation membership.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32992 from ceph/wip-revert-dpdk
David Galloway [Thu, 30 Jan 2020 19:20:29 +0000 (14:20 -0500)]
Merge pull request #32992 from ceph/wip-revert-dpdk

Revert "dpdk: drop dpdk submodule"

5 years agoRevert "dpdk: drop dpdk submodule" 32992/head
David Galloway [Thu, 30 Jan 2020 18:41:28 +0000 (13:41 -0500)]
Revert "dpdk: drop dpdk submodule"

This reverts commit cb8087dfac31b8490fefdfca28d389b7b9901ef8.

The seastar submodule's .gitmodules links to `../dpdk` which is no longer present after removing dpdk from ceph.git's .gitmodules.

```
<dwfreed> the ceph/seastar repo uses awful URLs for the submodules
<dwfreed> and those awful URLs are the real reason it's failing
<dwfreed> dgalloway: ^^^
<dwfreed> seastar's .gitmodules references repos in the parent directory, so that when it's checked out as a submodule of ceph, you don't download the repos twice (and git will probably also use references instead of duplicating the local .git); however, ceph doesn't have a submodule for dpdk anymore
<dwfreed> so seastar's referencing a dpdk repo that doesn't exist
<dgalloway> i think i follow.  so you're suggesting revert https://github.com/ceph/ceph/commit/cb8087dfac31b8490fefdfca28d389b7b9901ef8 ?
<dwfreed> yep
<dwfreed> that'd be one way to fix it
...
<joshd> dgalloway: I'd suggest revert for now, and let the crimson folks figure out the longer term fix when they're back
```

Signed-off-by: David Galloway <dgallowa@redhat.com>
5 years agomgr/insights: make 'insights prune-health-history 0' zap current state 32973/head
Sage Weil [Thu, 30 Jan 2020 17:40:48 +0000 (11:40 -0600)]
mgr/insights: make 'insights prune-health-history 0' zap current state

The self._health_slot value needs to be updated too if the current key
is removed.

Fixes: https://tracker.ceph.com/issues/43886
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: fix style of placeholder * services entry
Sage Weil [Mon, 27 Jan 2020 14:59:40 +0000 (08:59 -0600)]
mgr/cephadm: fix style of placeholder * services entry

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: prime cached service state with newly created services
Sage Weil [Mon, 27 Jan 2020 14:59:24 +0000 (08:59 -0600)]
mgr/cephadm: prime cached service state with newly created services

If we create a service, add the expected state to our cache, so that it
immediately appears in the get_services result.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: by default, return current service state
Sage Weil [Sat, 25 Jan 2020 16:40:08 +0000 (10:40 -0600)]
mgr/cephadm: by default, return current service state

In the normal case, return whatever state we currently have.

In the serve loop, refresh if the state is old.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32958 into master
Sage Weil [Thu, 30 Jan 2020 17:01:24 +0000 (11:01 -0600)]
Merge PR #32958 into master

* refs/pull/32958/head:
qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #32789 into master
Sage Weil [Thu, 30 Jan 2020 16:42:45 +0000 (10:42 -0600)]
Merge PR #32789 into master

* refs/pull/32789/head:
test: fix unused assert's variable in ceph_test_osd_stale_read.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32961 into master
Sage Weil [Thu, 30 Jan 2020 16:42:17 +0000 (10:42 -0600)]
Merge PR #32961 into master

* refs/pull/32961/head:
qa/standalone/osd/osd-bench: debug bluestore

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #32968 into master
Sage Weil [Thu, 30 Jan 2020 16:42:05 +0000 (10:42 -0600)]
Merge PR #32968 into master

* refs/pull/32968/head:
qa/suites/rados/verify: debug monc = 20

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoqa/tasks/ceph_manager: add --log-early to raw_cluster_cmd 32989/head
Sage Weil [Thu, 30 Jan 2020 16:36:28 +0000 (10:36 -0600)]
qa/tasks/ceph_manager: add --log-early to raw_cluster_cmd

This is harmless if logging is low, but adds useful info when it is turned
up.

Hunting bug https://tracker.ceph.com/issues/43914

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/tasks/ceph: only re-request scrub on unscrubbed pgs 32988/head
Sage Weil [Thu, 30 Jan 2020 16:22:49 +0000 (10:22 -0600)]
qa/tasks/ceph: only re-request scrub on unscrubbed pgs

If we haven't scrubbed everything, we occasinoally re-request scrub in case
the request was missed by the OSD (this can happen).  But we were
re-requesting scrub on ALL pgs, and if they are done in a
semi-deterministic order and are slow, then we may never get to the final
ones.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32771 from xxcs/xxcs07
Abhishek L [Thu, 30 Jan 2020 15:46:15 +0000 (16:46 +0100)]
Merge pull request #32771 from xxcs/xxcs07

rgw: fix multipart upload's error response

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #32878 into master
Sage Weil [Thu, 30 Jan 2020 15:28:38 +0000 (09:28 -0600)]
Merge PR #32878 into master

* refs/pull/32878/head:
cephadm: share code between 'pull' and 'inspect-image'
mgr/cephadm: upgrade: pull image after upgrade start, and for each host
cephadm: add inspect-image command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #30969 into master
Patrick Donnelly [Thu, 30 Jan 2020 15:20:11 +0000 (07:20 -0800)]
Merge PR #30969 into master

* refs/pull/30969/head:
mds : clean up data written to unsafe inodes

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32397 into master
Patrick Donnelly [Thu, 30 Jan 2020 15:06:21 +0000 (07:06 -0800)]
Merge PR #32397 into master

* refs/pull/32397/head:
mds: Move StrayManager initializations to its header
mds: Remove extra spaces in StrayManager header.
mds: Reorganize structure members in StrayManager header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found 32987/head
Sage Weil [Thu, 30 Jan 2020 14:32:50 +0000 (08:32 -0600)]
qa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found

Fixes:

2020-01-30T04:41:24.697 INFO:tasks.thrashosds.thrasher:fixing pg num pool None
2020-01-30T04:41:24.698 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 1070, in wrapper
    return func(self)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 1200, in _do_thrash
    self.choose_action()()
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 768, in fix_pgp_num
    if self.ceph_manager.set_pool_pgpnum(pool, force):
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 2088, in set_pool_pgpnum
    assert isinstance(pool_name, six.string_types)
AssertionError

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32969 into master
Sage Weil [Thu, 30 Jan 2020 14:28:25 +0000 (08:28 -0600)]
Merge PR #32969 into master

* refs/pull/32969/head:
qa/suites/rados/cephadm: explicitly test many distros

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge PR #32854 into master
Patrick Donnelly [Thu, 30 Jan 2020 14:25:25 +0000 (06:25 -0800)]
Merge PR #32854 into master

* refs/pull/32854/head:
qa: fix testing kernel branch link

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32801 into master
Patrick Donnelly [Thu, 30 Jan 2020 13:55:10 +0000 (05:55 -0800)]
Merge PR #32801 into master

* refs/pull/32801/head:
cephfs-shell: Fix ls -l

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
5 years agomgr/dashboard: Change project name to "Ceph Dashboard" (#32959)
Lenz Grimmer [Thu, 30 Jan 2020 13:43:46 +0000 (13:43 +0000)]
mgr/dashboard: Change project name to "Ceph Dashboard" (#32959)

mgr/dashboard: Change project name to "Ceph Dashboard"

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Unable to remove an iSCSI gateway that is already in use 32984/head
Ricardo Marques [Thu, 30 Jan 2020 13:19:48 +0000 (13:19 +0000)]
mgr/dashboard: Unable to remove an iSCSI gateway that is already in use

Fixes: https://tracker.ceph.com/issues/43900
Signed-off-by: Ricardo Marques <rimarques@suse.com>
5 years agomgr/cephadm: tolerate unknown service state
Sage Weil [Sat, 25 Jan 2020 16:38:50 +0000 (10:38 -0600)]
mgr/cephadm: tolerate unknown service state

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: periodically refresh services in the background
Sage Weil [Fri, 24 Jan 2020 17:59:33 +0000 (11:59 -0600)]
mgr/cephadm: periodically refresh services in the background

Pass them into check_for_strays to avoid double-work.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: periodically check hosts, and warn if the host check fails
Sage Weil [Fri, 24 Jan 2020 17:46:40 +0000 (11:46 -0600)]
mgr/cephadm: periodically check hosts, and warn if the host check fails

If we manually run the check, wake up the serve thread to recheck things.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: remove notify hook
Sage Weil [Fri, 24 Jan 2020 17:42:43 +0000 (11:42 -0600)]
mgr/cephadm: remove notify hook

We don't want to wake up serve so often.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: fix 'cephadm check-host' error output
Sage Weil [Fri, 24 Jan 2020 17:42:08 +0000 (11:42 -0600)]
mgr/cephadm: fix 'cephadm check-host' error output

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: fix check-host incancations
Sage Weil [Fri, 24 Jan 2020 17:41:53 +0000 (11:41 -0600)]
mgr/cephadm: fix check-host incancations

Use 'client' as entity to get the global container_image setting.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/cephadm: cache ssh connections
Sage Weil [Fri, 24 Jan 2020 15:04:12 +0000 (09:04 -0600)]
mgr/cephadm: cache ssh connections

Instead of opening a fresh connection each time we run a command, keep
a handle for open connections.

- close the connection on any error
- close all connections if the ssh config changes
- close the connection when we remove a host

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32978 from tchaikov/wip-seastar
Kefu Chai [Thu, 30 Jan 2020 13:02:31 +0000 (21:02 +0800)]
Merge pull request #32978 from tchaikov/wip-seastar

seastar: pickup change to fix cgroups V2 support

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
5 years agoMerge PR #32972 into master
Sage Weil [Thu, 30 Jan 2020 13:01:47 +0000 (07:01 -0600)]
Merge PR #32972 into master

* refs/pull/32972/head:
python-common/ceph/deployment/translate: use 'prepare' instead of 'batch' for trivial case
qa/tasks/cephadm: pass short dev name to osd prepare
mgr/cephadm: fix detection of just-created OSDs
mgr/cephadm: properly indent raise conditions
mgr/cephadm: add warning to other orchestrators
mgr/cephadm: separate acceptance criterias for Devices
mgr/cephadm: fix typos
mgr/cephadm: move utils in test/utils.py
mgr/ssh: increase disk size to 20G
drivegroups: add support for drivegroups + tests
mgr/orch_cli: allow multiple drivegroups
drivegroups: translate disk spec to ceph-volume call

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
5 years agomon: elector: return after triggering a new election 32981/head
Greg Farnum [Thu, 30 Jan 2020 12:43:13 +0000 (04:43 -0800)]
mon: elector: return after triggering a new election

When receiving an old propose, we were correctly triggering a new election
but not then returning out of receive_propose(), so we processed the
"should I defer" logic and perhaps sent out a deferal (in the current epoch!).

Fixes: https://tracker.ceph.com/issues/42977
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
5 years agoMerge pull request #32980 from ceph/gregsfortytwo-doc-rm-hadoop-2
Gregory Farnum [Thu, 30 Jan 2020 12:40:58 +0000 (13:40 +0100)]
Merge pull request #32980 from ceph/gregsfortytwo-doc-rm-hadoop-2

doc: remove the CephFS-Hadoop instructions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agorgw: fix multipart upload's error response 32771/head
xxcs [Wed, 22 Jan 2020 02:55:51 +0000 (10:55 +0800)]
rgw: fix multipart upload's error response
Fixes: https://tracker.ceph.com/issues/43751
Signed-off-by: GaryHyg <huygbj@inspur.com>
5 years agoMerge pull request #32967 from rhcs-dashboard/ignore-python-common-build
Sebastian Wagner [Thu, 30 Jan 2020 11:57:27 +0000 (12:57 +0100)]
Merge pull request #32967 from rhcs-dashboard/ignore-python-common-build

.gitignore: ignore /src/python-common/build

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>