]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoqa/tests: added v14.2.1 28416/head
Yuri Weinstein [Wed, 5 Jun 2019 22:18:36 +0000 (15:18 -0700)]
qa/tests: added v14.2.1

Also white listed "failed to encode map"
Ref: https://tracker.ceph.com/issues/40251

Fixes: http://tracker.ceph.com/issues/40181
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #27772 from smithfarm/wip-39430-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:55:34 +0000 (12:55 -0700)]
Merge pull request #27772 from smithfarm/wip-39430-nautilus

nautilus: qa: test_sessionmap assumes simple messenger

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28141 from pdvian/wip-39476-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:54:56 +0000 (12:54 -0700)]
Merge pull request #28141 from pdvian/wip-39476-nautilus

nautilus: common/util: handle long lines in /proc/cpuinfo

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28248 from pdvian/wip-39671-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:54:19 +0000 (12:54 -0700)]
Merge pull request #28248 from pdvian/wip-39671-nautilus

nautilus: commom: make cluster_network work.

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27818 from liewegas/wip-runtime-configs-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:42:19 +0000 (12:42 -0700)]
Merge pull request #27818 from liewegas/wip-runtime-configs-nautilus

nautilus: common/options: annotate some options; enable some runtime updates

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28299 from smithfarm/wip-40067-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:41:13 +0000 (12:41 -0700)]
Merge pull request #28299 from smithfarm/wip-40067-nautilus

nautilus: build/ops: Ceph RPM build fails on openSUSE Tumbleweed with GCC 9

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #28325 from cbodley/wip-40087
Yuri Weinstein [Wed, 5 Jun 2019 19:39:47 +0000 (12:39 -0700)]
Merge pull request #28325 from cbodley/wip-40087

nautilus: common: parse ISO 8601 datetime format

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28347 from smithfarm/wip-40090-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:39:12 +0000 (12:39 -0700)]
Merge pull request #28347 from smithfarm/wip-40090-nautilus

nautilus: mgr: log an error if we can't find any modules to load

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoMerge pull request #28028 from ifed01/wip-ifed-dump-before-nospanid-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 21:04:17 +0000 (14:04 -0700)]
Merge pull request #28028 from ifed01/wip-ifed-dump-before-nospanid-nautilus

nautilus: os/bluestore: dump before "no-spanning blob id" abort

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27525 from ifed01/wip-ifed-fix-21312-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:47:44 +0000 (13:47 -0700)]
Merge pull request #27525 from ifed01/wip-ifed-fix-21312-nautilus

nautilus: os/bluestore: call fault_range prior to looking for blob to reuse

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27645 from ifed01/wip-ifed-legacy-statfs-alert-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:47:14 +0000 (13:47 -0700)]
Merge pull request #27645 from ifed01/wip-ifed-legacy-statfs-alert-nautilus

nautilus: os/bluestore: backport more bluestore alerts

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27819 from liewegas/wip-bluestore-deferred-metric-fix-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:46:30 +0000 (13:46 -0700)]
Merge pull request #27819 from liewegas/wip-bluestore-deferred-metric-fix-nautilus

nautilus: os/bluestore: correctly measure deferred writes into new blobs

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge pull request #28007 from smithfarm/wip-39612-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:45:18 +0000 (13:45 -0700)]
Merge pull request #28007 from smithfarm/wip-39612-nautilus

nautilus: os/bluestore: fix for FreeBSD iocb structure

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoMerge pull request #28369 from batrick/i40116
Yuri Weinstein [Mon, 3 Jun 2019 21:07:32 +0000 (14:07 -0700)]
Merge pull request #28369 from batrick/i40116

nautilus: qa: cannot schedule kcephfs/multimds

6 years agoqa: kcephfs/multimds test latest rhel 28369/head
Patrick Donnelly [Mon, 3 Jun 2019 20:58:37 +0000 (13:58 -0700)]
qa: kcephfs/multimds test latest rhel

Fixes: http://tracker.ceph.com/issues/40116
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: fix missing yaml fragment
Patrick Donnelly [Mon, 3 Jun 2019 20:52:59 +0000 (13:52 -0700)]
qa: fix missing yaml fragment

This is preventing kcephfs/multimds from being scheduled.

Introduced-by: 2526cc6e649cded87113beae745e7c7984569c0d
Partial-revert: 2526cc6e649cded87113beae745e7c7984569c0d
Fixes: http://tracker.ceph.com/issues/40116
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28218 from bk201/wip-39993-nautilus
Yuri Weinstein [Mon, 3 Jun 2019 15:11:32 +0000 (08:11 -0700)]
Merge pull request #28218 from bk201/wip-39993-nautilus

nautilus: mgr/dashboard: inconsistent result when editing a RBD image's features

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28022 from Devp00l/wip-39560-nautilus
Yuri Weinstein [Mon, 3 Jun 2019 15:09:03 +0000 (08:09 -0700)]
Merge pull request #28022 from Devp00l/wip-39560-nautilus

 nautilus:  mgr/dashboard: Queue notifications as default

Reviewed-by:  Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #27884 from smithfarm/wip-39530-nautilus
Yuri Weinstein [Fri, 31 May 2019 20:23:30 +0000 (13:23 -0700)]
Merge pull request #27884 from smithfarm/wip-39530-nautilus

nautilus: tests: mgr: tox failures when running make check

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #27998 from smithfarm/wip-39540-nautilus
Yuri Weinstein [Fri, 31 May 2019 20:22:43 +0000 (13:22 -0700)]
Merge pull request #27998 from smithfarm/wip-39540-nautilus

nautilus: monitoring: Provide a base set of Prometheus alert manager rules that notify the user about common Ceph error conditions

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #28098 from pdvian/wip-39425-nautilus
Yuri Weinstein [Fri, 31 May 2019 20:21:50 +0000 (13:21 -0700)]
Merge pull request #28098 from pdvian/wip-39425-nautilus

nautilus: mgr: deadlock

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28189 from votdev/fix_dialog_title
Yuri Weinstein [Fri, 31 May 2019 20:21:21 +0000 (13:21 -0700)]
Merge pull request #28189 from votdev/fix_dialog_title

nautilus: mgr/dashboard: Display correct dialog title

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agoMerge pull request #28262 from jecluis/nautilus-fix-backport-mon-min-release
Yuri Weinstein [Fri, 31 May 2019 20:18:49 +0000 (13:18 -0700)]
Merge pull request #28262 from jecluis/nautilus-fix-backport-mon-min-release

mon/Monitor: allow probe if MMonProbe::mon_release == 0

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28101 from jan--f/wip-39932-nautilus
Yuri Weinstein [Fri, 31 May 2019 15:36:54 +0000 (08:36 -0700)]
Merge pull request #28101 from jan--f/wip-39932-nautilus

nautilus: monitoring: update Grafana dashboards

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by:  Kanika Murarka <kmurarka@redhat.com>

6 years agomgr/PyModuleRegistry: log error if we can't find any modules to load 28347/head
Tim Serong [Fri, 10 May 2019 05:08:30 +0000 (15:08 +1000)]
mgr/PyModuleRegistry: log error if we can't find any modules to load

Fixes: https://tracker.ceph.com/issues/39662
Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 67a47951053bbca0d5951ac3f49fd99d100a9d14)

6 years agoMerge pull request #27864 from sebastian-philipp/wip-39312-nautilus
Nathan Cutler [Fri, 31 May 2019 11:31:43 +0000 (13:31 +0200)]
Merge pull request #27864 from sebastian-philipp/wip-39312-nautilus

nautilus: mgr/rook: Added missing rgw daemons in service ls

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27863 from sebastian-philipp/wip-39313-nautilus
Nathan Cutler [Fri, 31 May 2019 11:30:47 +0000 (13:30 +0200)]
Merge pull request #27863 from sebastian-philipp/wip-39313-nautilus

nautilus: mgr/rook: Fix RGW creation

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27862 from sebastian-philipp/wip-39356-nautilus
Nathan Cutler [Fri, 31 May 2019 11:29:44 +0000 (13:29 +0200)]
Merge pull request #27862 from sebastian-philipp/wip-39356-nautilus

nautilus: mgr/rook: Remove support for Rook older than v0.9

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27918 from pdvian/wip-39273-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:37:06 +0000 (13:37 -0700)]
Merge pull request #27918 from pdvian/wip-39273-nautilus

nautilus: rgw: Evaluating bucket policies also while reading permissions for an…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27921 from cbodley/wip-38918
Yuri Weinstein [Thu, 30 May 2019 20:36:38 +0000 (13:36 -0700)]
Merge pull request #27921 from cbodley/wip-38918

nautilus: rgw multisite: add perf counters to data sync

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27924 from Vicente-Cheng/wip-39410-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:36:02 +0000 (13:36 -0700)]
Merge pull request #27924 from Vicente-Cheng/wip-39410-nautilus

nautilus: rgw: inefficient unordered bucket listing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27944 from smithfarm/wip-39577-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:35:39 +0000 (13:35 -0700)]
Merge pull request #27944 from smithfarm/wip-39577-nautilus

nautilus: build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES #26799

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoMerge pull request #27952 from Vicente-Cheng/wip-39414-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:34:46 +0000 (13:34 -0700)]
Merge pull request #27952 from Vicente-Cheng/wip-39414-nautilus

nautilus: multisite: period pusher gets 403 Forbidden against other zonegroups

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27953 from Vicente-Cheng/wip-39503-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:34:21 +0000 (13:34 -0700)]
Merge pull request #27953 from Vicente-Cheng/wip-39503-nautilus

nautilus: rgw: clean up some logging

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27954 from Vicente-Cheng/wip-39574-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:33:10 +0000 (13:33 -0700)]
Merge pull request #27954 from Vicente-Cheng/wip-39574-nautilus

nautilus: rgw: cloud sync module logs attrs in the log

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #27955 from Vicente-Cheng/wip-39575-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:32:25 +0000 (13:32 -0700)]
Merge pull request #27955 from Vicente-Cheng/wip-39575-nautilus

nautilus: librgw: unexpected crash when creating bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28064 from theanalyst/nautilus-cloud-sync-fixes
Yuri Weinstein [Thu, 30 May 2019 20:31:53 +0000 (13:31 -0700)]
Merge pull request #28064 from theanalyst/nautilus-cloud-sync-fixes

nautilus: rgw: cloud sync module fails to sync multipart objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27630 from pdvian/wip-39018-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:28:59 +0000 (13:28 -0700)]
Merge pull request #27630 from pdvian/wip-39018-nautilus

nautilus: rgw admin: add tenant argument to reshard cancel

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27660 from pdvian/wip-39048-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:28:29 +0000 (13:28 -0700)]
Merge pull request #27660 from pdvian/wip-39048-nautilus

nautilus: rgw: beast: set a default port for endpoints

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27664 from pdvian/wip-39178-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:27:46 +0000 (13:27 -0700)]
Merge pull request #27664 from pdvian/wip-39178-nautilus

nautilus: rgw: limit entries in remove_olh_pending_entries()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27779 from s0nea/wip-39479-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:27:14 +0000 (13:27 -0700)]
Merge pull request #27779 from s0nea/wip-39479-nautilus

nautilus: test/rgw: fix race in test_rgw_reshard_wait and test_rgw_reshard_wait uses same clock for timing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27800 from pdvian/wip-39202-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:26:39 +0000 (13:26 -0700)]
Merge pull request #27800 from pdvian/wip-39202-nautilus

nautilus: rgw: race condition between resharding and ops waiting on resharding

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27814 from ashishkumsingh/wip-39417-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:26:12 +0000 (13:26 -0700)]
Merge pull request #27814 from ashishkumsingh/wip-39417-nautilus

nautilus: rgw: multisite log trimming only checks peers that sync from us

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27826 from ashishkumsingh/wip-39502-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:25:28 +0000 (13:25 -0700)]
Merge pull request #27826 from ashishkumsingh/wip-39502-nautilus

nautilus: rgw: bucket stats report mtime in UTC

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27827 from ashishkumsingh/wip-39496-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:25:01 +0000 (13:25 -0700)]
Merge pull request #27827 from ashishkumsingh/wip-39496-nautilus

nautilus: rgw: admin: handle delete_at attr in object stat output

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27904 from pdvian/wip-39228-nautilus
Yuri Weinstein [Thu, 30 May 2019 20:24:30 +0000 (13:24 -0700)]
Merge pull request #27904 from pdvian/wip-39228-nautilus

nautilus: rgw_file: save etag and acl info in setattr

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
6 years agoMerge pull request #27890 from Devp00l/wip-39534-nautilus
Yuri Weinstein [Thu, 30 May 2019 19:24:41 +0000 (12:24 -0700)]
Merge pull request #27890 from Devp00l/wip-39534-nautilus

 nautilus: mgr/dashboard: RBD snapshot name suggestion with local time suffix

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoMerge pull request #28021 from Devp00l/wip-39558-nautilus
Yuri Weinstein [Thu, 30 May 2019 19:24:11 +0000 (12:24 -0700)]
Merge pull request #28021 from Devp00l/wip-39558-nautilus

 nautilus: mgr/dashboard: KV-table transforms dates through pipe

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agocommon/utime: don't pass %z to utime if there is a 'Z' 28325/head
Sage Weil [Fri, 24 May 2019 22:09:53 +0000 (17:09 -0500)]
common/utime: don't pass %z to utime if there is a 'Z'

This fails on centos 7 for some reason.

If it's UTC, we don't need to parse the tz portion, so avoid the issue by
leaving the %z out of the fmt string.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1d1c4782eea1fac0e9230ed5ac32b19517fdd616)

6 years agocommon/utime: make parse() handle (our) ISO 8601 output
Sage Weil [Thu, 25 Apr 2019 22:15:09 +0000 (17:15 -0500)]
common/utime: make parse() handle (our) ISO 8601 output

- optional subsecond values
- optional timezone offset

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 668d6e7f97bd37f1896611249cfae85bced4b096)

6 years agoMerge pull request #28091 from pdvian/wip-39423-nautilus
Yuri Weinstein [Wed, 29 May 2019 22:10:20 +0000 (15:10 -0700)]
Merge pull request #28091 from pdvian/wip-39423-nautilus

nautilus: test/librbd: drop 'ceph_test_librbd_api' target

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28120 from dillaman/wip-38869-nautilus
Yuri Weinstein [Wed, 29 May 2019 22:09:37 +0000 (15:09 -0700)]
Merge pull request #28120 from dillaman/wip-38869-nautilus

nautilus: librbd: make flush be queued by QOS throttler

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28121 from dillaman/wip-39428-nautilus
Yuri Weinstein [Wed, 29 May 2019 22:08:52 +0000 (15:08 -0700)]
Merge pull request #28121 from dillaman/wip-39428-nautilus

nautilus: librbd: async open/close should free ImageCtx before issuing callback

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28122 from dillaman/wip-39462-nautilus
Yuri Weinstein [Wed, 29 May 2019 22:08:14 +0000 (15:08 -0700)]
Merge pull request #28122 from dillaman/wip-39462-nautilus

nautilus: rbd-mirror: clear out bufferlist prior to listing mirror images

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28203 from dzafman/wip-39699
Yuri Weinstein [Wed, 29 May 2019 22:07:24 +0000 (15:07 -0700)]
Merge pull request #28203 from dzafman/wip-39699

nautilus: osd: Don't include user changeable flag in snaptrim related assert

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #28258 from pdvian/wip-39672-nautilus
Yuri Weinstein [Wed, 29 May 2019 22:06:25 +0000 (15:06 -0700)]
Merge pull request #28258 from pdvian/wip-39672-nautilus

nautilus: os/bluestore: fix missing discard in BlueStore::_kv_sync_thread

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27746 from LenzGr/wip-39345-nautilus
Yuri Weinstein [Wed, 29 May 2019 21:59:52 +0000 (14:59 -0700)]
Merge pull request #27746 from LenzGr/wip-39345-nautilus

nautilus: mgr/dashboard: code documentation

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #27760 from ricardoasmarques/wip-39454-nautilus
Yuri Weinstein [Wed, 29 May 2019 21:58:49 +0000 (14:58 -0700)]
Merge pull request #27760 from ricardoasmarques/wip-39454-nautilus

nautilus: mgr/dashboard: Validate if any client belongs to more than one group

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #27868 from LenzGr/wip-39467-nautilus
Yuri Weinstein [Wed, 29 May 2019 21:57:39 +0000 (14:57 -0700)]
Merge pull request #27868 from LenzGr/wip-39467-nautilus

nautilus: mgr/dashboard: Admin resource not honored

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Wido den Hollander <wido@widodh.nl>
6 years agoMerge pull request #28011 from ricardoasmarques/wip-39616-nautilus
Yuri Weinstein [Wed, 29 May 2019 21:54:56 +0000 (14:54 -0700)]
Merge pull request #28011 from ricardoasmarques/wip-39616-nautilus

nautilus: mgr/dashboard: iSCSI should allow exporting an RBD image with Journaling enabled

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #28026 from ricardoasmarques/wip-39631-nautilus
Yuri Weinstein [Wed, 29 May 2019 21:51:44 +0000 (14:51 -0700)]
Merge pull request #28026 from ricardoasmarques/wip-39631-nautilus

nautilus: mgr/dashboard: iSCSI form does not support IPv6

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agorpm: Disable LTO in spec when being used 28299/head
Martin Liska [Mon, 20 May 2019 09:37:52 +0000 (11:37 +0200)]
rpm: Disable LTO in spec when being used

Fixes: http://tracker.ceph.com/issues/39974
Works around: https://tracker.ceph.com/issues/40060

Signed-off-by: Martin Liška <Martin.Liska@suse.com>
(cherry picked from commit 6ab109bb9b3f37a2bb87a934faa10b8311e6504c)

6 years agopybind/tox: handle possible WITH_PYTHON3 values other than "3" 27884/head
Nathan Cutler [Tue, 7 May 2019 12:10:56 +0000 (14:10 +0200)]
pybind/tox: handle possible WITH_PYTHON3 values other than "3"

WITH_PYTHON3 might be set to "ON" or to the python3 RPM version number
prevailing on the system - e.g. "3", "36"

Fixes: 9426f1f2045d0ae0f319530c3dc3a9240d838d07
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit f8aac6f69b2d5e28f428e9f7a64beac5878452ff)

6 years agopybind/tox: pass additional command line arguments through to tox
Nathan Cutler [Fri, 3 May 2019 10:58:59 +0000 (12:58 +0200)]
pybind/tox: pass additional command line arguments through to tox

Fixes: 9426f1f2045d0ae0f319530c3dc3a9240d838d07
Fixes: https://tracker.ceph.com/issues/39579
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit d04b44816028079ee65564d8244fe2b56c49047e)

6 years agotests: mgr/tox: make run-tox.sh scripts more robust
Nathan Cutler [Tue, 16 Apr 2019 13:47:42 +0000 (15:47 +0200)]
tests: mgr/tox: make run-tox.sh scripts more robust

Also take into account that, following a recent code change, WITH_PYTHON3 now
gets set to "3" instead of "ON".

Fixes: http://tracker.ceph.com/issues/39323
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 9426f1f2045d0ae0f319530c3dc3a9240d838d07)

6 years agoMerge pull request #27920 from sebastian-philipp/wip-39536-nautilus
Nathan Cutler [Wed, 29 May 2019 10:16:42 +0000 (12:16 +0200)]
Merge pull request #27920 from sebastian-philipp/wip-39536-nautilus

nautilus: mgr/test_orchestrator: AttributeError: 'TestWriteCompletion' object has no attribute 'id'

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agomgr/dashboard: Display correct dialog title 28189/head
Volker Theile [Wed, 29 May 2019 09:30:21 +0000 (11:30 +0200)]
mgr/dashboard: Display correct dialog title

The dialog to create a new S3 key shows the title 'Show S3 key' instead of 'Create S3 key'.

Fixes: https://tracker.ceph.com/issues/40047
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit c87e21da7729c395f9ff12486d38fceaf106a37c)

6 years agoMerge pull request #28035 from pdvian/wip-39375-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:10:26 +0000 (09:10 -0700)]
Merge pull request #28035 from pdvian/wip-39375-nautilus

nautilus: osd/OSD.cc: make osd bench description consistent with parameters

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #28072 from pdvian/wip-39421-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:09:57 +0000 (09:09 -0700)]
Merge pull request #28072 from pdvian/wip-39421-nautilus

nautilus: osd/OSDMap: Replace get_out_osds with get_out_existing_osds

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
6 years agoMerge pull request #28088 from dzafman/wip-39721
Yuri Weinstein [Tue, 28 May 2019 16:09:23 +0000 (09:09 -0700)]
Merge pull request #28088 from dzafman/wip-39721

nautilus: osd: Include dups in copy_after() and copy_up_to()

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #28160 from pdvian/wip-39512-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:08:51 +0000 (09:08 -0700)]
Merge pull request #28160 from pdvian/wip-39512-nautilus

nautilus: osd/PG: do not use approx_missing_objects pre-nautilus

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #28164 from pdvian/wip-39514-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:08:17 +0000 (09:08 -0700)]
Merge pull request #28164 from pdvian/wip-39514-nautilus

nautilus: osd: take heartbeat_lock when calling heartbeat()

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
6 years agoMerge pull request #28205 from pdvian/wip-39519-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:07:47 +0000 (09:07 -0700)]
Merge pull request #28205 from pdvian/wip-39519-nautilus

nautilus: osd: Don't evict after a flush if intersecting scrub range

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #28219 from pdvian/wip-39539-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:07:15 +0000 (09:07 -0700)]
Merge pull request #28219 from pdvian/wip-39539-nautilus

nautilus: osd/PG: fix last_complete re-calculation on splitting

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27632 from pdvian/wip-39043-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:06:08 +0000 (09:06 -0700)]
Merge pull request #27632 from pdvian/wip-39043-nautilus

nautilus: osd/PGLog: preserve original_crt to check rollbackability

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
6 years agoMerge pull request #27699 from liewegas/wip-39335-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:05:00 +0000 (09:05 -0700)]
Merge pull request #27699 from liewegas/wip-39335-nautilus

nautilus: mgr/BaseMgrModule: run MonCommandCompletion on the finisher

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27711 from pdvian/wip-39184-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:04:34 +0000 (09:04 -0700)]
Merge pull request #27711 from pdvian/wip-39184-nautilus

nautilus: osd: Primary won't automatically repair replica on pulling error

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #27744 from ashishkumsingh/wip-39432-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:04:00 +0000 (09:04 -0700)]
Merge pull request #27744 from ashishkumsingh/wip-39432-nautilus

nautilus: osd/PG: discover missing objects when an OSD peers and PG is degraded

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27771 from smithfarm/wip-39419-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:03:28 +0000 (09:03 -0700)]
Merge pull request #27771 from smithfarm/wip-39419-nautilus

nautilus: mon/Elector: format mon_release correctly

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27839 from pdvian/wip-39219-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:02:55 +0000 (09:02 -0700)]
Merge pull request #27839 from pdvian/wip-39219-nautilus

nautilus: osd: FAILED ceph_assert(attrs || !pg_log.get_missing().is_missing(soid) || (it_objects != pg_log.get_log().objects.end() && it_objects->second->op == pg_log_entry_t::LOST_REVERT)) in PrimaryLogPG::get_object_context()

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27876 from liewegas/wip-autoscaler-fixes-nautilus
Yuri Weinstein [Tue, 28 May 2019 16:02:28 +0000 (09:02 -0700)]
Merge pull request #27876 from liewegas/wip-autoscaler-fixes-nautilus

nautilus: mgr: fix pgp_num adjustments

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agomon/Monitor: allow probe if MMonProbe::mon_release == 0 28262/head
Sage Weil [Sat, 27 Apr 2019 16:03:30 +0000 (11:03 -0500)]
mon/Monitor: allow probe if MMonProbe::mon_release == 0

Mimic doesn't set this, but we still need to allow them to probe us.

(and so does luminous)

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 90e4c5fad569a39504ad3444a41122360cab77bd)

6 years agomon: fix min_mon_release print
Sage Weil [Sat, 27 Apr 2019 15:55:57 +0000 (10:55 -0500)]
mon: fix min_mon_release print

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit dcde01e3068d5d52da61323aa5b20b3bc14f7280)

6 years agoos/bluestore: fix missing discard in BlueStore::_kv_sync_thread 28258/head
Tang Junhui [Mon, 29 Apr 2019 08:31:55 +0000 (16:31 +0800)]
os/bluestore: fix missing discard in BlueStore::_kv_sync_thread

Discard comand should be issued before space released.

Signed-off-by: Junhui Tang <tangjunhui@sangfor.com.cn>
Fixes: https://tracker.ceph.com/issues/39621
(cherry picked from commit f6205d2eb2b8297b914afbaf54a8311f087eec90)

6 years agoMerge pull request #28215 from smithfarm/wip-40003-nautilus
Nathan Cutler [Mon, 27 May 2019 13:54:57 +0000 (15:54 +0200)]
Merge pull request #28215 from smithfarm/wip-40003-nautilus

nautilus: do_cmake.sh: source not found

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoMerge pull request #28062 from bk201/wip-39664-nautilus
Lenz Grimmer [Mon, 27 May 2019 13:01:08 +0000 (15:01 +0200)]
Merge pull request #28062 from bk201/wip-39664-nautilus

nautilus: mgr/dashboard: incorrect help message for minimum blob size

Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agocommom: make cluster_network work. 28248/head
Jianpeng Ma [Fri, 26 Apr 2019 08:44:20 +0000 (16:44 +0800)]
commom: make cluster_network work.

This temporary parameter make address is zero. So make cluster_addr is
equal public_addr and make cluster_network disable.

Fixes: https://tracker.ceph.com/issues/39623
Reported-by: Jiang Xu <xu.jiang@dccsh.icbc.com.cn>
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 1b17061bf1d047c2d1f3c6b513a5e5ab4a48f350)

6 years agomgr/dashboard: fix some performance data are not displayed 28101/head
Kiefer Chang [Mon, 20 May 2019 06:18:32 +0000 (14:18 +0800)]
mgr/dashboard: fix some performance data are not displayed

Several Grafana dashboards were updated and their uids are changed.
Update corresponding uids in angular templates. Also fix that when a user
clicks performance details of an OSD, wrong OSD metrics are displayed.

Fixes: http://tracker.ceph.com/issues/39971
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit acf90c5512678c43b4424d592c2212e4f45d3c0c)

6 years agomgr/dashboard: fix backend error when updating RBD interlocked features 28218/head
Kiefer Chang [Thu, 16 May 2019 07:53:35 +0000 (15:53 +0800)]
mgr/dashboard: fix backend error when updating RBD interlocked features

Now object-map and fast-diff features are interlocked. Allow
enabling/disabling these two features together without raising an already
enabled/disabled error.

Fixes: http://tracker.ceph.com/issues/39933
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
(cherry picked from commit d654e8c620537718cb85ccd4c327faedb001ad02)

6 years agoosd/PG: fix last_complete re-calculation on splitting 28219/head
xie xingguo [Sat, 20 Apr 2019 08:34:12 +0000 (16:34 +0800)]
osd/PG: fix last_complete re-calculation on splitting

We add hard-limit for pg_logs now, which means we might keep trimming
old log entries irrespective of pg's current missing_set. This as a
result can cause the last_complete pointer moving far ahead of the real
on-disk version (the oldest need of missing_set, for instance) the
corresponding pg should have on splitting:

```
2019-04-19 06:41:52.559247 7efd4725c700 10 osd.2 271 Splitting pg[5.6( v 270'943 lc 0'0 (238'300,270'943] local-lis/les=250/251 n=943 ec=223/223 lis/c 250/223 les/251/224/0 250/271/229) [5,2] r=1 lpr=271 pi=[223,271)/4 crt=270'943 unknown NOTIFY m=518 mbc={}] into 5.16
2019-04-19 06:41:52.561413 7efd4725c700 10 osd.2 pg_epoch: 271 pg[5.6( v 270'943 lc 238'300 (238'300,270'943] local-lis/les=250/251 n=943 ec=223/223 lis/c 250/223 c/f 251/224/0 250/271/229) [5,2] r=1 lpr=271 pi=[223,271)/4 crt=270'943 lcod 0'0 unknown NOTIFY m=261 mbc={}] release_backoffs [MIN,MAX)
```

For the above example, parent's last_complete cursor changed from **0'0** to
**238'300** directly due to the effort of trying to catch up the oldest
log entry changing when splitting was done. However, back into v12.2.9 primary
would still reference shard's last_complete field when trying to figure out all
possible locations of a currently missing object (see PG::MissingLoc::add_source_info):

```c++
  if (oinfo.last_complete < need) {
    if (omissing.is_missing(soid)) {
      ldout(pg->cct, 10) << "search_for_missing " << soid << " " << need
                         << " also missing on osd." << fromosd << dendl;
      continue;
    }
  }
```

Hence a wrongly calculated last_complete could then make primary mis-consider
that a specific shard might have the authoritative object it currently
looking for:

```
2019-04-19 06:41:52.904163 7fd4cfb5a700 10 osd.5 pg_epoch: 271 pg[5.6( v 270'943 lc 238'300 (238'300,270'943] local-lis/les=250/251 n=471 ec=223/223 lis/c 250/223 les/
c/f 251/224/0 250/271/229) [5,2] r=0 lpr=271 pi=[223,271)/4 crt=270'943 lcod 226'77 mlcod 0'0 peering m=16 mbc={}] proc_replica_log for osd.2: 5.6( v 270'943 lc 238'30
0 (238'300,270'943] local-lis/les=250/251 n=471 ec=223/223 lis/c 250/223 les/c/f 251/224/0 250/271/229) log((249'563,270'943], crt=270'943) missing(261 may_include_del
etes = 1)
2019-04-19 06:41:52.904645 7fd4cfb5a700 20 osd.5 pg_epoch: 271 pg[5.6( v 270'943 lc 238'300 (238'300,270'943] local-lis/les=250/251 n=471 ec=223/223 lis/c 250/223 les/
c/f 251/224/0 250/271/229) [5,2] r=0 lpr=271 pi=[223,271)/4 crt=270'943 lcod 226'77 mlcod 0'0 peering m=16 mbc={}]  after missing 5:624c3a7a:::benchmark_data_smithi190
_39968_object1382:head need 226'110 have 0'0
2019-04-19 06:41:53.567820 7fd4d035b700 10 osd.5 pg_epoch: 272 pg[5.6( v 270'943 lc 0'0 (238'300,270'943] local-lis/les=271/272 n=471 ec=223/223 lis/c 250/223 les/c/f
251/224/0 250/271/229) [5,2] r=0 lpr=271 pi=[223,271)/4 crt=270'943 lcod 226'77 mlcod 0'0 unknown m=16 u=13 mbc={255={(1+0)=220,(2+0)=28}}] search_for_missing 5:624c3a
7a:::benchmark_data_smithi190_39968_object1382:head 226'110 is on osd.2
```

note that ```5:624c3a7a:::benchmark_data_smithi190_39968_object1382:head 226'110```
was actually missing on both primary and shard osd.2 whereas primary insisted that
object should exist on shard osd.2!

https://github.com/ceph/ceph/pull/26175 posted an indirect fix
for the above problem by ignoring last_complete when checking the missing set,
but it should generally make more sense to fill in the last_complete field correctly
whenever possible.
Hence coming this additional fix.

Fixes: http://tracker.ceph.com/issues/26958
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit aad5d47be64ed7feba79f540ec1debc45625a74f)

6 years agoMerge pull request #27937 from pdvian/wip-39288-nautilus
Yuri Weinstein [Wed, 22 May 2019 19:49:12 +0000 (12:49 -0700)]
Merge pull request #27937 from pdvian/wip-39288-nautilus

nautilus: [rbd-mirror] image replayer should periodically flush IO and commit positions

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27989 from smithfarm/wip-39590-nautilus
Nathan Cutler [Wed, 22 May 2019 16:15:59 +0000 (18:15 +0200)]
Merge pull request #27989 from smithfarm/wip-39590-nautilus

nautilus: qa/tasks/rbd_fio: fixed missing delimiter between 'cd' and 'configure'

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27882 from pdvian/wip-39224-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:15:09 +0000 (09:15 -0700)]
Merge pull request #27882 from pdvian/wip-39224-nautilus

nautlius: librbd: do not allow to deep copy migrating image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27903 from pdvian/wip-39226-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:14:39 +0000 (09:14 -0700)]
Merge pull request #27903 from pdvian/wip-39226-nautilus

nautilus: librbd: support EC data pool images sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #27988 from smithfarm/wip-39541-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:13:25 +0000 (09:13 -0700)]
Merge pull request #27988 from smithfarm/wip-39541-nautilus

nautilus: tests: rbd: qemu-iotests tests fail under latest Ubuntu kernel

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28019 from pdvian/wip-39315-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:11:32 +0000 (09:11 -0700)]
Merge pull request #28019 from pdvian/wip-39315-nautilus

nautilus: krbd: fix rbd map hang due to udev return subsystem unordered

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28128 from dillaman/wip-39729-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:10:56 +0000 (09:10 -0700)]
Merge pull request #28128 from dillaman/wip-39729-nautilus

nautilus: qa/workunits/rbd: use https protocol for devstack git operations

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28132 from dillaman/wip-39195-nautilus
Yuri Weinstein [Wed, 22 May 2019 16:10:18 +0000 (09:10 -0700)]
Merge pull request #28132 from dillaman/wip-39195-nautilus

nautilus: librbd: fixed several race conditions related to copyup

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agodo_cmake.sh: use bash 28215/head
Nathan Cutler [Mon, 20 May 2019 15:01:40 +0000 (17:01 +0200)]
do_cmake.sh: use bash

Fixes: http://tracker.ceph.com/issues/39981
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit ac8d7c5fd4045d79ab6caacc0b72d64866fcc5c8)

6 years agoosd: Don't evict after a flush if intersecting scrub range 28205/head
David Zafman [Tue, 26 Mar 2019 22:53:10 +0000 (15:53 -0700)]
osd: Don't evict after a flush if intersecting scrub range

Fixes: http://tracker.ceph.com/issues/38840
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 459cbb5a6ca3b521b20f36f328f25f398d0ef1c4)