]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoMerge pull request #30404 from shun-s/cleanup-failure-pending
Kefu Chai [Fri, 27 Sep 2019 05:50:17 +0000 (13:50 +0800)]
Merge pull request #30404 from shun-s/cleanup-failure-pending

osd: make osd recover more smoothly by avoiding failure peer info to resent

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30517 from tchaikov/wip-test/dashboard/scheme-allow-unknown
Kefu Chai [Fri, 27 Sep 2019 05:36:23 +0000 (13:36 +0800)]
Merge pull request #30517 from tchaikov/wip-test/dashboard/scheme-allow-unknown

qa/tasks/mgr/dashboard/test_health: add "allow_unknown" in mgr_map

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agoMerge PR #30297 into master
Patrick Donnelly [Fri, 27 Sep 2019 05:34:28 +0000 (22:34 -0700)]
Merge PR #30297 into master

* refs/pull/30297/head:
test_cephfs_shell: add note on how to run this testsuite
cephfs-shell: rewrite help text for put and get commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #30533 from cxytt/fix-complete-to-not-reset
Kefu Chai [Fri, 27 Sep 2019 05:32:19 +0000 (13:32 +0800)]
Merge pull request #30533 from cxytt/fix-complete-to-not-reset

osd/PGLog: reset log.complete_to when recover obect failed

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30538 from tchaikov/wip/test/ceph_argparse/yet-another-test
Kefu Chai [Fri, 27 Sep 2019 05:31:38 +0000 (13:31 +0800)]
Merge pull request #30538 from tchaikov/wip/test/ceph_argparse/yet-another-test

mon.test: improve validation and add a test for "osd pool create"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30504 from Songweibin/wip-app-meta-get
Kefu Chai [Fri, 27 Sep 2019 05:24:56 +0000 (13:24 +0800)]
Merge pull request #30504 from Songweibin/wip-app-meta-get

pybind/rados: add application_metadata_get

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30421 from sebastian-philipp/prometheus-always-on-modules
Kefu Chai [Fri, 27 Sep 2019 05:21:10 +0000 (13:21 +0800)]
Merge pull request #30421 from sebastian-philipp/prometheus-always-on-modules

mgr/prometheus: Fix KeyError in get_mgr_status

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30200 from NancySu05/dev
Kefu Chai [Fri, 27 Sep 2019 05:18:19 +0000 (13:18 +0800)]
Merge pull request #30200 from NancySu05/dev

mon/OSDMonitor: trim not-longer-exist failure reporters

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #29906 into master
Patrick Donnelly [Fri, 27 Sep 2019 05:12:03 +0000 (22:12 -0700)]
Merge PR #29906 into master

* refs/pull/29906/head:
vstart_runner: name booleans for options differently
qa/vstart_runner.py: add an option to remove old log
qa/vstart_runner.py: make log initialization code reusable
qa/vstart_runner.py: make printing of stdout of ps optional
qa/vstart_runner.py: add timeout for vstart.sh and stop.sh
qa/vstart_runner.py: add an option to teardown cluster

Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #30612 from tchaikov/wip-install-deps.sh/do-not-fail-if-already...
Kefu Chai [Fri, 27 Sep 2019 03:24:09 +0000 (11:24 +0800)]
Merge pull request #30612 from tchaikov/wip-install-deps.sh/do-not-fail-if-already-installed

install-deps: do not install if rpm already installed

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoinstall-deps: do not install if rpm already installed 30612/head
Kefu Chai [Fri, 27 Sep 2019 02:26:54 +0000 (10:26 +0800)]
install-deps: do not install if rpm already installed

there is chance that the system already have epel-release-latest-7.noarch.rpm
installed, in that case, install-deps.sh should not fail.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30466 from xiexingguo/wip-41924
Xie Xingguo [Fri, 27 Sep 2019 02:18:33 +0000 (10:18 +0800)]
Merge pull request #30466 from xiexingguo/wip-41924

osd/PGLog: persist num_objects_missing for replicas when peering is done

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30576 from xiexingguo/wip-42052
Xie Xingguo [Fri, 27 Sep 2019 02:17:54 +0000 (10:17 +0800)]
Merge pull request #30576 from xiexingguo/wip-42052

osd/OSDMap: do not trust partially simplified pg_upmap_item

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30560 from xiexingguo/wip-balancer-upmap-cli
Xie Xingguo [Fri, 27 Sep 2019 02:17:09 +0000 (10:17 +0800)]
Merge pull request #30560 from xiexingguo/wip-balancer-upmap-cli

mgr/balancer: enable pg_upmap cli for future use

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #30223 into master
Sage Weil [Fri, 27 Sep 2019 00:28:51 +0000 (19:28 -0500)]
Merge PR #30223 into master

* refs/pull/30223/head:
msg/async: do not register lossy client connections
msg/async: allow anonymous client-side connections

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
5 years agomgr/dashboard: REST API: OpenAPI docs require internet connect… (#30477)
Lenz Grimmer [Thu, 26 Sep 2019 16:14:45 +0000 (16:14 +0000)]
mgr/dashboard: REST API: OpenAPI docs require internet connect… (#30477)

mgr/dashboard: REST API: OpenAPI docs require internet connection

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30557 from smithfarm/wip-42023
Nathan Cutler [Thu, 26 Sep 2019 16:03:50 +0000 (18:03 +0200)]
Merge pull request #30557 from smithfarm/wip-42023

install-deps.sh: add EPEL repo for non-x86_64 archs as well

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30590 from jtlayton/wip-42032
jtlayton [Thu, 26 Sep 2019 15:35:36 +0000 (11:35 -0400)]
Merge pull request #30590 from jtlayton/wip-42032

ceph.spec.in: fix Cython package dependency for Fedora

5 years agoMerge pull request #29460 from rhcs-dashboard/bucket-versioning
Lenz Grimmer [Thu, 26 Sep 2019 15:27:58 +0000 (15:27 +0000)]
Merge pull request #29460 from rhcs-dashboard/bucket-versioning

mgr/dashboard: enable/disable versioning on RGW bucket

Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30208 from ricardoasmarques/support-iscsi-controls-types
Ricardo Marques [Thu, 26 Sep 2019 13:45:58 +0000 (14:45 +0100)]
Merge pull request #30208 from ricardoasmarques/support-iscsi-controls-types

mgr/dashboard: Controls UI inputs based on "type"

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge PR #28834 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:26:46 +0000 (06:26 -0700)]
Merge PR #28834 into master

* refs/pull/28834/head:
libcephfs: Add test for lazyio via libcephfs
libcephfs: Add lazyio_propogate and lazyio_synchronize methods to libcephfs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #29818 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:25:17 +0000 (06:25 -0700)]
Merge PR #29818 into master

* refs/pull/29818/head:
client/MetaRequest: Add age to MetaRequest dump
osdc/Objecter: Add age to the ops
common/ceph_time: Use fixed floating-point notation for mono_clock

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #29902 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:23:18 +0000 (06:23 -0700)]
Merge PR #29902 into master

* refs/pull/29902/head:
mds: Revert "properly setup client_need_snapflush for snap inode"
mds: cleanup dirty snap caps tracking

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #29921 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:22:01 +0000 (06:22 -0700)]
Merge PR #29921 into master

* refs/pull/29921/head:
mds: split the dir if the op makes it oversized

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
5 years agoMerge PR #30202 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:20:48 +0000 (06:20 -0700)]
Merge PR #30202 into master

* refs/pull/30202/head:
mds: Explicitly call slave_updates with 0 size
mds: Move log_segment_seq_t into class LogSegment
mds: Reorganize class members in LogSegment header

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30403 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:19:39 +0000 (06:19 -0700)]
Merge PR #30403 into master

* refs/pull/30403/head:
mds: mds returns -5 error when the deleted file does not exist

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #30462 into master
Patrick Donnelly [Thu, 26 Sep 2019 13:17:10 +0000 (06:17 -0700)]
Merge PR #30462 into master

* refs/pull/30462/head:
qa: have kclient tests use new mount.ceph functionality

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 years agomgr/dashboard: Support iSCSI target-level CHAP auth (#30011)
Lenz Grimmer [Thu, 26 Sep 2019 12:33:33 +0000 (12:33 +0000)]
mgr/dashboard: Support iSCSI target-level CHAP auth (#30011)

mgr/dashboard: Support iSCSI target-level CHAP auth

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #30588 from ricardoasmarques/fix-iscsi-test-put
Kefu Chai [Thu, 26 Sep 2019 12:22:39 +0000 (20:22 +0800)]
Merge pull request #30588 from ricardoasmarques/fix-iscsi-test-put

mgr/dashboard: Wait for iSCSI target put and delete

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoceph.spec.in: fix Cython package dependency for Fedora 30590/head
Jeff Layton [Thu, 26 Sep 2019 11:50:28 +0000 (07:50 -0400)]
ceph.spec.in: fix Cython package dependency for Fedora

Fedora distros do not have python3?-Cython packages, but they do have
python3-Cython ones. Fix the BuildRequires so that we only use the
python3_version_nodots based version string for RHEL.

Fixes: https://tracker.ceph.com/issues/42032
Signed-off-by: Jeff Layton <jlayton@redhat.com>
5 years agomgr/dashboard: Wait for iSCSI target put and delete 30588/head
Ricardo Marques [Thu, 26 Sep 2019 09:42:21 +0000 (10:42 +0100)]
mgr/dashboard: Wait for iSCSI target put and delete

Signed-off-by: Ricardo Marques <rimarques@suse.com>
5 years agoMerge pull request #30571 from smithfarm/wip-bci-force
Nathan Cutler [Thu, 26 Sep 2019 10:25:35 +0000 (12:25 +0200)]
Merge pull request #30571 from smithfarm/wip-bci-force

src/script/backport-create-issue: implement --force option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomgr/dashboard: Controls UI inputs based on "type" 30208/head
Ricardo Marques [Fri, 6 Sep 2019 10:54:08 +0000 (11:54 +0100)]
mgr/dashboard: Controls UI inputs based on "type"

iSCSI controls UI inputs should be rendered based
on the control "type" returned by `ceph-iscsi`.

Fixes: https://tracker.ceph.com/issues/41682
Signed-off-by: Ricardo Marques <rimarques@suse.com>
5 years agomgr/dashboard: test_mgr_module QA test has not been adapted to… (#30513)
Lenz Grimmer [Thu, 26 Sep 2019 08:48:31 +0000 (08:48 +0000)]
mgr/dashboard: test_mgr_module QA test has not been adapted to… (#30513)

mgr/dashboard: Adapt test_mgr_module QA test to latest controller changes

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agomgr/dashboard: wait for iscsi/target create/put (#30582)
Lenz Grimmer [Thu, 26 Sep 2019 07:11:49 +0000 (07:11 +0000)]
mgr/dashboard: wait for iscsi/target create/put (#30582)

mgr/dashboard: wait for iscsi/target create/put

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agomgr/dashboard: enable/disable versioning on RGW bucket 29460/head
Alfonso Martínez [Thu, 26 Sep 2019 06:41:14 +0000 (08:41 +0200)]
mgr/dashboard: enable/disable versioning on RGW bucket

Fixes: https://tracker.ceph.com/issues/40920
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
5 years agoMerge pull request #30578 from tchaikov/wip-seastar-unix-domain-socket
Kefu Chai [Thu, 26 Sep 2019 04:42:07 +0000 (12:42 +0800)]
Merge pull request #30578 from tchaikov/wip-seastar-unix-domain-socket

seastar: pickup unix domain socket support

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
5 years agomgr/dashboard: wait for iscsi/target create/put 30582/head
Kefu Chai [Thu, 26 Sep 2019 00:54:01 +0000 (08:54 +0800)]
mgr/dashboard: wait for iscsi/target create/put

IscsiTarget.create() returns a Task, so we need to wait for its
completion before moving on.

the same applies to IscsiTarget.put()

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomsg/async: do not register lossy client connections 30223/head
Sage Weil [Fri, 6 Sep 2019 20:04:11 +0000 (15:04 -0500)]
msg/async: do not register lossy client connections

If our policy is server + lossy, we do not need to track our incoming
client connections by address.  First, because it doesn't do us any good.
Second, it is nicer if we don't, because we can allow multiple incoming
connections from the same peer addr.

Update a couple of tests: one doesn't apply any more, and the other needs
a different way of getting the just-accepted con ref.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomsg/async: allow anonymous client-side connections
Sage Weil [Fri, 6 Sep 2019 19:34:05 +0000 (14:34 -0500)]
msg/async: allow anonymous client-side connections

If the connection mode is lossy, allow us to open a new connection to
a target, regardless of whether other such connections are already open.
This allows for single-use connections.  If you call this multiple times,
you'll get separate, distinct connections.

We are lucky that the cleanup infrastructure for AsyncMessenger just works
without modification.  :)

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoseastar: pickup unix domain socket support 30578/head
Kefu Chai [Wed, 25 Sep 2019 15:33:07 +0000 (23:33 +0800)]
seastar: pickup unix domain socket support

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #30523 into master
Sage Weil [Wed, 25 Sep 2019 14:49:57 +0000 (09:49 -0500)]
Merge PR #30523 into master

* refs/pull/30523/head:
mon/MonClient: skip CEPHX_V2 challenge if client doesn't support it

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
5 years agoosd/OSDMap: do not trust partially simplified pg_upmap_item 30576/head
xie xingguo [Wed, 25 Sep 2019 11:36:10 +0000 (19:36 +0800)]
osd/OSDMap: do not trust partially simplified pg_upmap_item

If we simplified a partially no-op pg_upmap_item, we shall still
continue to verify that the remaining part is valid.
The bug is introduced by 02e5499b350bcd7d9eac98b2072052a9a4a1f535,
before which we always validate the correctness of a pg_upmap_item
before trying to cancel or simplify it.

Fixes: https://tracker.ceph.com/issues/42052
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agomgr/dashboard: Support iSCSI target-level CHAP auth 30011/head
Ricardo Marques [Thu, 29 Aug 2019 14:28:23 +0000 (15:28 +0100)]
mgr/dashboard: Support iSCSI target-level CHAP auth

Requires `ceph-iscsi` config v11

Fixes: https://tracker.ceph.com/issues/41576
Signed-off-by: Ricardo Marques <rimarques@suse.com>
5 years agomgr/dashboard: Display the "destroyed" state in OSD list (#30514)
Lenz Grimmer [Wed, 25 Sep 2019 09:49:21 +0000 (09:49 +0000)]
mgr/dashboard: Display the "destroyed" state in OSD list (#30514)

mgr/dashboard: Display the "destroyed" state in OSD list

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoinstall-deps.sh: add EPEL repo for non-x86_64 archs as well 30557/head
Nathan Cutler [Tue, 24 Sep 2019 19:48:27 +0000 (21:48 +0200)]
install-deps.sh: add EPEL repo for non-x86_64 archs as well

Fixes: https://tracker.ceph.com/issues/42023
Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agosrc/script/backport-create-issue: implement --force option 30571/head
Nathan Cutler [Wed, 25 Sep 2019 08:47:28 +0000 (10:47 +0200)]
src/script/backport-create-issue: implement --force option

If --force option is given along with an explicit list of issue numbers,
backport issues will be created regardless of issue status.

In all other usage scenarios, script behavior remains the same (backport
issues are created only if issue status is "Pending Backport").

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #30420 from runsisi/wip-remove-requests
Kefu Chai [Wed, 25 Sep 2019 08:31:13 +0000 (16:31 +0800)]
Merge pull request #30420 from runsisi/wip-remove-requests

rpm,deb: python-requests is not needed for ceph-common

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30422 from rishabh-d-dave/cv-fix-pytest-warning
Jan Fajerski [Wed, 25 Sep 2019 07:05:06 +0000 (09:05 +0200)]
Merge pull request #30422 from rishabh-d-dave/cv-fix-pytest-warning

ceph-volume: fix warnings raised by pytest

5 years agovstart_runner: name booleans for options differently 29906/head
Rishabh Dave [Wed, 25 Sep 2019 06:35:55 +0000 (12:05 +0530)]
vstart_runner: name booleans for options differently

This achieves 2 things: makes it more understandable for the reader that
the boolean variable is an option and reads less like a method name.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner.py: add an option to remove old log
Rishabh Dave [Mon, 26 Aug 2019 13:30:43 +0000 (19:00 +0530)]
qa/vstart_runner.py: add an option to remove old log

Add an option "--clear-old-log" to get rid of log entries before making
entries for current batch of tests.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner.py: make log initialization code reusable
Rishabh Dave [Mon, 26 Aug 2019 12:14:22 +0000 (17:44 +0530)]
qa/vstart_runner.py: make log initialization code reusable

Move it to a method so that the code be can be reused.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner.py: make printing of stdout of ps optional
Rishabh Dave [Sat, 17 Aug 2019 07:42:38 +0000 (13:12 +0530)]
qa/vstart_runner.py: make printing of stdout of ps optional

stdout of ps command is generally pretty huge which makes it harder to
interpret logs. Don't print it by default and add "--log-ps-output" to
enable printing it.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner.py: add timeout for vstart.sh and stop.sh
Rishabh Dave [Sat, 17 Aug 2019 06:40:08 +0000 (12:10 +0530)]
qa/vstart_runner.py: add timeout for vstart.sh and stop.sh

Override default timeout for execution of vstart.sh and stop.sh since
neither scripts take more than 100 seconds normally.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoqa/vstart_runner.py: add an option to teardown cluster
Rishabh Dave [Sat, 17 Aug 2019 06:35:33 +0000 (12:05 +0530)]
qa/vstart_runner.py: add an option to teardown cluster

Add "--teardown" option so that vstart_runner.py tears down Ceph
cluster automatically after the batch of tests has completed running.
Also delete build/dev and build/out directories, after running stop.sh.

Update the doc for vstart_runner.py as well.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agomgr/balancer: enable pg_upmap cli for future use 30560/head
xie xingguo [Wed, 25 Sep 2019 05:09:39 +0000 (13:09 +0800)]
mgr/balancer: enable pg_upmap cli for future use

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30036 from tchaikov/wip-python3-pkgversion
Kefu Chai [Tue, 24 Sep 2019 17:40:44 +0000 (01:40 +0800)]
Merge pull request #30036 from tchaikov/wip-python3-pkgversion

ceph.spec.in: s/pkgversion/version_nodots/

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
5 years agoceph.spec.in: s/pkgversion/version_nodots/ 30036/head
Kefu Chai [Fri, 30 Aug 2019 11:49:28 +0000 (19:49 +0800)]
ceph.spec.in: s/pkgversion/version_nodots/

`python3_pkgversion` is now defined as 3, while we don't have packages
like python3-Cython yet in EPEL7. but we do have `python36-Cython`. so
let's use `python3_version_nodots` instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: Gracefully handle client/target info not found (#30349)
Lenz Grimmer [Tue, 24 Sep 2019 15:11:47 +0000 (15:11 +0000)]
mgr/dashboard: Gracefully handle client/target info not found (#30349)

mgr/dashboard: Gracefully handle client/target info not found

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Using wrong identifiers in RGW user/bucket data… (#30492)
Lenz Grimmer [Tue, 24 Sep 2019 13:58:50 +0000 (13:58 +0000)]
mgr/dashboard: Using wrong identifiers in RGW user/bucket data… (#30492)

mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge PR #30537 into master
Sage Weil [Tue, 24 Sep 2019 13:25:44 +0000 (08:25 -0500)]
Merge PR #30537 into master

* refs/pull/30537/head:
test/pybind: fix local variables for emacs
crush: add editor property variables

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomgr/dashboard: Gracefully handle client/target info not found 30349/head
Ricardo Marques [Wed, 11 Sep 2019 17:42:44 +0000 (18:42 +0100)]
mgr/dashboard: Gracefully handle client/target info not found

Fixes: https://tracker.ceph.com/issues/41779
Signed-off-by: Ricardo Marques <rimarques@suse.com>
5 years agoMerge PR #29824 into master
Patrick Donnelly [Tue, 24 Sep 2019 11:32:28 +0000 (04:32 -0700)]
Merge PR #29824 into master

* refs/pull/29824/head:
qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
mds: add a HEALTH_WARN message when inline_data is enabled
mds: log a warning message when mds is started on an fs with inline_data
mon: deprecate CephFS inline_data support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Douglas Fuller <dfuller@redhat.com>
5 years agoMerge PR #29526 into master
Patrick Donnelly [Tue, 24 Sep 2019 11:31:28 +0000 (04:31 -0700)]
Merge PR #29526 into master

* refs/pull/29526/head:
client: _readdir_cache_cb() may use the readdir_cache already clear

Reviewed-by: Zheng Yan <zyan@redhat.com>
5 years agoMerge pull request #30426 from votdev/harden_mgr_modules_list
Lenz Grimmer [Tue, 24 Sep 2019 11:23:50 +0000 (11:23 +0000)]
Merge pull request #30426 from votdev/harden_mgr_modules_list

mgr/dashboard: Prevent KeyError when requesting always_on_modules

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge PR #30164 into master
Patrick Donnelly [Tue, 24 Sep 2019 11:15:02 +0000 (04:15 -0700)]
Merge PR #30164 into master

* refs/pull/30164/head:
mds: Remove unnecessary headers in Locker
mds: Reorganize class members in Locker header

Reviewed-by: Jos Collin <jcollin@redhat.com>
5 years agoMerge PR #30312 into master
Patrick Donnelly [Tue, 24 Sep 2019 11:11:00 +0000 (04:11 -0700)]
Merge PR #30312 into master

* refs/pull/30312/head:
client:EINVAL may be returned when offset is 0 ,Loff_t pos = f->pos should be the best.

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #30493 from p-se/wip-pse-osd-improvements
Lenz Grimmer [Tue, 24 Sep 2019 11:00:34 +0000 (11:00 +0000)]
Merge pull request #30493 from p-se/wip-pse-osd-improvements

mgr/dashboard: OSD improvements

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: enable run-frontend-unittest.sh to run from any… (#30496)
Lenz Grimmer [Tue, 24 Sep 2019 10:59:22 +0000 (10:59 +0000)]
mgr/dashboard: enable run-frontend-unittest.sh to run from any… (#30496)

mgr/dashboard: enable run-frontend-unittest.sh to run from any directory

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Fix error editing iSCSI disk controls (#30100)
Lenz Grimmer [Tue, 24 Sep 2019 09:02:38 +0000 (09:02 +0000)]
mgr/dashboard: Fix error editing iSCSI disk controls (#30100)

mgr/dashboard: Fix error editing iSCSI disk controls

Reviewed-by: Ricardo Dias <rdias@suse.com>
5 years agopybind/rados: add application_metadata_get 30504/head
songweibin [Sat, 21 Sep 2019 00:37:09 +0000 (08:37 +0800)]
pybind/rados: add application_metadata_get

Signed-off-by: songweibin <song.weibin@zte.com.cn>
5 years agotest/pybind/test_ceph_argparse.py: add a test for "osd pool create" 30538/head
Kefu Chai [Tue, 24 Sep 2019 07:13:51 +0000 (15:13 +0800)]
test/pybind/test_ceph_argparse.py: add a test for "osd pool create"

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomon/MonCommands: improve "osd pool create" command validation
Kefu Chai [Tue, 24 Sep 2019 07:04:56 +0000 (15:04 +0800)]
mon/MonCommands: improve "osd pool create" command validation

both `expected_num_objects` and `size` are required to be greater or
equal to 0, and monitor will return -EINVAL at seeing a negative value
of either of them. so let's fail earlier.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30535 from xiexingguo/wip-test_ceph_argparse
Kefu Chai [Tue, 24 Sep 2019 07:03:28 +0000 (15:03 +0800)]
Merge pull request #30535 from xiexingguo/wip-test_ceph_argparse

test/pybind/test_ceph_argparse.py: pg_num of pool creation now optional

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agotest/pybind: fix local variables for emacs 30537/head
Kefu Chai [Tue, 24 Sep 2019 06:51:49 +0000 (14:51 +0800)]
test/pybind: fix local variables for emacs

* pass CEPH_BIN env variable if necessary
* do not 'make' unless necessary
* use `cmake --build` as developer might be using some different cmake
  generator for building ceph.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocrush: add editor property variables
Kefu Chai [Tue, 24 Sep 2019 06:48:55 +0000 (14:48 +0800)]
crush: add editor property variables

so the local settings won't interfere when working on ceph.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agotest/pybind/test_ceph_argparse.py: pg_num of pool creation now optional 30535/head
xie xingguo [Tue, 24 Sep 2019 04:18:21 +0000 (12:18 +0800)]
test/pybind/test_ceph_argparse.py: pg_num of pool creation now optional

introduced by f88d95bef6948410603bd877aa4714a2afefd5a5

note that we remove the bad pg_num = -1 test too, which will now
be treated as the the crush rule name (invalid but allowed) since
pg_num is optional

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoosd/PGLog: reset log.complete_to when recover obect failed 30533/head
Tao Ning [Tue, 24 Sep 2019 04:45:24 +0000 (12:45 +0800)]
osd/PGLog: reset log.complete_to when recover obect failed

1. Injection read fault, recover failed object is added to the missing set, log.complete_to == log.end()
2. Before the first object recovery, the new object writes, update info.last_update, because num_missing() != 0, so last_complete will not be updated
3. After the first object recovery, PeeringState::recover_got generates the error: ceph_assert(info.last_complete == info.last_update);

Fixed: https://tracker.ceph.com/issues/42019

Signed-off-by: Tao Ning <ningtao@sangfor.com.cn>
5 years agoMerge PR #30348 into master
Patrick Donnelly [Tue, 24 Sep 2019 02:36:17 +0000 (19:36 -0700)]
Merge PR #30348 into master

* refs/pull/30348/head:
doc: Add a new document on Dynamic Metadata Management in CephFS

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #30512 from xiexingguo/wip-vstart-inc-osd
Xie Xingguo [Tue, 24 Sep 2019 00:56:17 +0000 (08:56 +0800)]
Merge pull request #30512 from xiexingguo/wip-vstart-inc-osd

vstart: add --inc-osd option

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30490 from ceph/guits-41392
Alfredo Deza [Mon, 23 Sep 2019 18:53:38 +0000 (14:53 -0400)]
Merge pull request #30490 from ceph/guits-41392

ceph-volume: do not fail when trying to remove crypt mapper

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agomon/MonClient: skip CEPHX_V2 challenge if client doesn't support it 30523/head
Sage Weil [Mon, 23 Sep 2019 18:20:29 +0000 (13:20 -0500)]
mon/MonClient: skip CEPHX_V2 challenge if client doesn't support it

If the client doesn't support the CEPHX_V2 challenge, and we don't require
it, skip it.  This allows the client to authenticate without getting an
error like

  cephx: verify_reply couldn't decrypt with error: error decoding block for decryption

Note that we don't have this problem in the monitor exchange in
Monitor::handle_auth_request() because that verify_authorizer() caller is
only used for msgrv2, and all such clients support CEPHX_V2.  Instead,
those client authenticate via the MAuth messages, a path that does not use
authorizers at all.

Fixes: https://tracker.ceph.com/issues/40716
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/dashboard: Display the "destroyed" state in OSD list 30514/head
Tiago Melo [Mon, 23 Sep 2019 13:15:35 +0000 (13:15 +0000)]
mgr/dashboard: Display the "destroyed" state in OSD list

Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agoqa/tasks/mgr/dashboard/test_health: add "allow_unknown" in mgr_map 30517/head
Kefu Chai [Mon, 23 Sep 2019 15:25:13 +0000 (23:25 +0800)]
qa/tasks/mgr/dashboard/test_health: add "allow_unknown" in mgr_map

tests/functionalities are not broken if we add more fields to mgr_map.

see also #30507

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30507 from tchaikov/wip-mgr-features-in-mgrmap
Kefu Chai [Mon, 23 Sep 2019 15:18:01 +0000 (23:18 +0800)]
Merge pull request #30507 from tchaikov/wip-mgr-features-in-mgrmap

qa/tasks/mgr/dashboard/test_health: update schema

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
5 years agodoc: Add a new document on Dynamic Metadata Management in CephFS 30348/head
Sidharth Anupkrishnan [Wed, 11 Sep 2019 14:19:54 +0000 (19:49 +0530)]
doc: Add a new document on Dynamic Metadata Management in CephFS

Signed-off-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
5 years agoMerge PR #30475 into master
Sage Weil [Mon, 23 Sep 2019 14:12:42 +0000 (09:12 -0500)]
Merge PR #30475 into master

* refs/pull/30475/head:
qa/standalone/ceph-helpers: default pg autoscale mode off for standalone
os/bluestore: fix objectstore_blackhole read-after-write
test,misc: do not specify pg_num per pool
mgr/volumes: do not specify pg_num
pybind/ceph_volume_client: do not specify pg_num for new pools
doc: remove all pg_num arguments to 'osd pool create'
mon: do not require pg_num to 'osd pool create'
common: default pg_autoscale_mode=on for new pools

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge PR #30503 into master
Sage Weil [Mon, 23 Sep 2019 14:11:57 +0000 (09:11 -0500)]
Merge PR #30503 into master

* refs/pull/30503/head:
osd/PeeringState: recover_got - add special handler for empty log

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #30506 into master
Sage Weil [Mon, 23 Sep 2019 14:11:34 +0000 (09:11 -0500)]
Merge PR #30506 into master

* refs/pull/30506/head:
qa/standalone/osd/divergent-priors: add reproducer for bug 41816

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agomgr/dashboard: Fix spacing between cards (#30461)
Lenz Grimmer [Mon, 23 Sep 2019 11:17:21 +0000 (11:17 +0000)]
mgr/dashboard: Fix spacing between cards (#30461)

mgr/dashboard: Fix spacing between cards

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: test_mgr_module QA test has not been adapted to latest controller... 30513/head
Volker Theile [Mon, 23 Sep 2019 10:47:55 +0000 (12:47 +0200)]
mgr/dashboard: test_mgr_module QA test has not been adapted to latest controller changes

Fixes: https://tracker.ceph.com/issues/41993
Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Improve and simplify OsdListComponent 30493/head
Patrick Seidensal [Fri, 20 Sep 2019 13:55:18 +0000 (15:55 +0200)]
mgr/dashboard: Improve and simplify OsdListComponent

Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agomgr/dashboard: fix error when linking a bucket to a tenanted u… (#30123)
Lenz Grimmer [Mon, 23 Sep 2019 10:49:48 +0000 (10:49 +0000)]
mgr/dashboard: fix error when linking a bucket to a tenanted u… (#30123)

mgr/dashboard: fix error when linking a bucket to a tenanted user

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: OSD list component improvements (#30488)
Lenz Grimmer [Mon, 23 Sep 2019 10:37:49 +0000 (10:37 +0000)]
mgr/dashboard: OSD list component improvements (#30488)

mgr/dashboard: OSD list component improvements

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: NFS list should display the "Pseudo Path" (#30395)
Lenz Grimmer [Mon, 23 Sep 2019 09:45:48 +0000 (09:45 +0000)]
mgr/dashboard: NFS list should display the "Pseudo Path" (#30395)

mgr/dashboard: NFS list should display the "Pseudo Path"

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoceph-volume: do not fail when trying to remove crypt mapper 30490/head
Guillaume Abrioux [Fri, 20 Sep 2019 12:57:58 +0000 (14:57 +0200)]
ceph-volume: do not fail when trying to remove crypt mapper

In a containerized context, at some point, need to run `simple scan` on a device
from a separate container (not the existing and running corresponding container
to that device), but this can't work because when it tries to remove the
mapper which is still in use by the corresponding running osd container,
it fails.
This can be a bit more permissive and simply throw a warning.

Closes: https://tracker.ceph.com/issues/41392
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
5 years agoMerge pull request #30411 from dillaman/wip-41653
Mykola Golub [Mon, 23 Sep 2019 07:50:01 +0000 (10:50 +0300)]
Merge pull request #30411 from dillaman/wip-41653

rbd-mirror: simplify peer bootstrapping

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge PR #30428 into master
Patrick Donnelly [Mon, 23 Sep 2019 04:26:50 +0000 (21:26 -0700)]
Merge PR #30428 into master

* refs/pull/30428/head:
doc/dev/developer_guide: fix heading level

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30435 into master
Patrick Donnelly [Mon, 23 Sep 2019 04:07:02 +0000 (21:07 -0700)]
Merge PR #30435 into master

* refs/pull/30435/head:
doc: improve developer guide doc

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30497 into master
Patrick Donnelly [Mon, 23 Sep 2019 03:58:45 +0000 (20:58 -0700)]
Merge PR #30497 into master

* refs/pull/30497/head:
ceph-volume: systemd fix typo in log message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>