]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agorgw: add xml attributes test, override xml_handle_data 26682/head
Yuval Lifshitz [Sun, 3 Mar 2019 10:02:37 +0000 (12:02 +0200)]
rgw: add xml attributes test, override xml_handle_data

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
6 years agoMerge branch 'add_rgw_xml_unit_tests' of https://github.com/yuvalif/ceph into add_rgw...
Yuval Lifshitz [Thu, 28 Feb 2019 06:51:51 +0000 (08:51 +0200)]
Merge branch 'add_rgw_xml_unit_tests' of https://github.com/yuvalif/ceph into add_rgw_xml_unit_tests

6 years agoMerge PR #26671 into master
Sage Weil [Wed, 27 Feb 2019 17:40:50 +0000 (11:40 -0600)]
Merge PR #26671 into master

* refs/pull/26671/head:
doc: Replaced "plugin" with "module" in the Mgr documentation

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agorgw: xml unit tests. simplify API. add docs
Yuval Lifshitz [Wed, 27 Feb 2019 17:39:14 +0000 (19:39 +0200)]
rgw: xml unit tests. simplify API. add docs

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
6 years agoMerge PR #26628 into master
Sage Weil [Wed, 27 Feb 2019 16:25:39 +0000 (10:25 -0600)]
Merge PR #26628 into master

* refs/pull/26628/head:
msg/async: msgr2: expected tags validation
msg/async: msgr2: template specialized write function for frames
msg/async: msgr2: extract frame classes into its own header

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26227 from Tinatinak/api_documentation
Lenz Grimmer [Wed, 27 Feb 2019 15:49:38 +0000 (16:49 +0100)]
Merge pull request #26227 from Tinatinak/api_documentation

mgr/dashboard: Improved support for generating OpenAPI Spec documentation

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26575 from tspmelo/wip-multi-backstore-ui
Lenz Grimmer [Wed, 27 Feb 2019 15:48:31 +0000 (16:48 +0100)]
Merge pull request #26575 from tspmelo/wip-multi-backstore-ui

mgr/dashboard: Add support for iSCSI's multi backstores (UI)

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoMerge pull request #26622 from Songweibin/wip-fix-rbd-group
Mykola Golub [Wed, 27 Feb 2019 15:31:15 +0000 (17:31 +0200)]
Merge pull request #26622 from Songweibin/wip-fix-rbd-group

rbd: fix segmentation fault when rbd_group_image_list() getting -ENOENT

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #26432 from dillaman/wip-librbd-discard
Mykola Golub [Wed, 27 Feb 2019 15:11:44 +0000 (17:11 +0200)]
Merge pull request #26432 from dillaman/wip-librbd-discard

librbd: skip small, unaligned discard extents by default

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agodoc: Replaced "plugin" with "module" in the Mgr documentation 26671/head
Lenz Grimmer [Wed, 27 Feb 2019 12:49:47 +0000 (13:49 +0100)]
doc: Replaced "plugin" with "module" in the Mgr documentation

The documentation currently refers to Ceph Manager Modules as
"plugins" in many places, while the command line interface uses
"module" to enable/disable modules. Replaced all occurences
of "plugin" with "module" in the docs, to avoid confusion and to
be in alignment with the CLI. Also fixed the capitalizations of some
module chapters.

Fixes: https://tracker.ceph.com/issues/38481
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agomgr/dashboard: Add support for iSCSI's multi backstores (UI) 26575/head
Tiago Melo [Wed, 20 Feb 2019 10:58:54 +0000 (10:58 +0000)]
mgr/dashboard: Add support for iSCSI's multi backstores (UI)

Fixes: https://tracker.ceph.com/issues/38286
Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26586 from votdev/change_notify_icon_color
Lenz Grimmer [Wed, 27 Feb 2019 11:05:19 +0000 (12:05 +0100)]
Merge pull request #26586 from votdev/change_notify_icon_color

mgr/dashboard: Change icon color in notifications

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #26649 from tspmelo/wip-i18n
Lenz Grimmer [Wed, 27 Feb 2019 11:01:06 +0000 (12:01 +0100)]
Merge pull request #26649 from tspmelo/wip-i18n

mgr/dashboard: Update I18N translation

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26589 from Devp00l/issue-38382
Lenz Grimmer [Wed, 27 Feb 2019 10:04:21 +0000 (11:04 +0100)]
Merge pull request #26589 from Devp00l/issue-38382

mgr/dashboard: PGs will update as expected

Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #26116 from votdev/feature_37934
Lenz Grimmer [Wed, 27 Feb 2019 10:01:25 +0000 (11:01 +0100)]
Merge pull request #26116 from votdev/feature_37934

mgr/dashboard: Configure all mgr modules in UI

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #26592 from nathan-weinberg/fs-breadcrumb
Lenz Grimmer [Wed, 27 Feb 2019 09:59:22 +0000 (10:59 +0100)]
Merge pull request #26592 from nathan-weinberg/fs-breadcrumb

mgr/dashboard: Added breadcrumb tests to Filesystems menu

6 years agoMerge pull request #26647 from tspmelo/wip-npm-update-19-03
Lenz Grimmer [Wed, 27 Feb 2019 09:57:06 +0000 (10:57 +0100)]
Merge pull request #26647 from tspmelo/wip-npm-update-19-03

mgr/dashboard: Update npm packages

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
6 years agoMerge pull request #26219 from yaozongyou/mon-cleanups
Joao Eduardo Luis [Wed, 27 Feb 2019 09:33:42 +0000 (09:33 +0000)]
Merge pull request #26219 from yaozongyou/mon-cleanups

mon: some tiny cleanups related class forward declaration

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonell@redhat.com>
6 years agoMerge pull request #26527 from iotcg/doc
Kefu Chai [Wed, 27 Feb 2019 03:08:05 +0000 (11:08 +0800)]
Merge pull request #26527 from iotcg/doc

use preferred commands for ceph config-key

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26558 from k0ste/prometheus_metadata
Kefu Chai [Wed, 27 Feb 2019 02:49:24 +0000 (10:49 +0800)]
Merge pull request #26558 from k0ste/prometheus_metadata

mgr/prometheus: get osd_objectstore once instead twice.

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #26646 into master
Patrick Donnelly [Tue, 26 Feb 2019 20:04:20 +0000 (12:04 -0800)]
Merge PR #26646 into master

* refs/pull/26646/head:
doc: fix typo in objectops.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #26627 from jan--f/c-v-38472
Andrew Schoen [Tue, 26 Feb 2019 16:35:22 +0000 (10:35 -0600)]
Merge pull request #26627 from jan--f/c-v-38472

ceph-volume: don't create osd['block.db'] by default

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agomsg/async: msgr2: expected tags validation 26628/head
Ricardo Dias [Fri, 22 Feb 2019 11:06:19 +0000 (11:06 +0000)]
msg/async: msgr2: expected tags validation

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26225 from jan--f/c-v-simple-activate-all
Andrew Schoen [Tue, 26 Feb 2019 15:27:10 +0000 (09:27 -0600)]
Merge pull request #26225 from jan--f/c-v-simple-activate-all

ceph-volume: add --all flag to simple activate

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #26481 from votdev/gitignore_wheelhouse
Lenz Grimmer [Tue, 26 Feb 2019 14:44:42 +0000 (15:44 +0100)]
Merge pull request #26481 from votdev/gitignore_wheelhouse

mgr: Ignore __pycache__ and wheelhouse dirs

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agomgr/dashboard: Update I18N translation 26649/head
Tiago Melo [Tue, 26 Feb 2019 12:11:59 +0000 (12:11 +0000)]
mgr/dashboard: Update I18N translation

Add support for Chinese (Simplified), Czech, French, Indonesian and Spanish.

Fixed Portuguese (PT) locale source.

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26338 from rhcs-dashboard/ts-cleanup
Lenz Grimmer [Tue, 26 Feb 2019 14:06:43 +0000 (15:06 +0100)]
Merge pull request #26338 from rhcs-dashboard/ts-cleanup

mgr/dashboard: typescript cleanup

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Introduce upperFirst pipe 26116/head
Volker Theile [Tue, 19 Feb 2019 13:22:13 +0000 (14:22 +0100)]
mgr/dashboard: Introduce upperFirst pipe

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Configure all mgr modules in UI
Volker Theile [Tue, 22 Jan 2019 09:31:14 +0000 (10:31 +0100)]
mgr/dashboard: Configure all mgr modules in UI

Fixes: https://tracker.ceph.com/issues/37934
Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agoqa/suites/rbd: enable partial discard test 26432/head
Jason Dillaman [Fri, 22 Feb 2019 13:44:27 +0000 (08:44 -0500)]
qa/suites/rbd: enable partial discard test

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: align discard requests to default bluestore allocation size
Jason Dillaman [Thu, 14 Feb 2019 14:53:34 +0000 (09:53 -0500)]
librbd: align discard requests to default bluestore allocation size

This will match the new krbd behavior of aligning discards to the
default bluestore minimum allocation size. Requests that are too
small (or the misaligned head / tail of the request) will be
ignored since it will not result in freed space.

Fixes: http://tracker.ceph.com/issues/38146
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge PR #26636 into master
Sage Weil [Tue, 26 Feb 2019 12:40:48 +0000 (06:40 -0600)]
Merge PR #26636 into master

* refs/pull/26636/head:
messages/MMonMgrDigest: use set_data() to avoid screwing up byte_throttler

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26130 from minshenglin/wip-37855
Matt Benjamin [Tue, 26 Feb 2019 12:05:09 +0000 (07:05 -0500)]
Merge pull request #26130 from minshenglin/wip-37855

rgw_file: use correct secret key to check auth

6 years agomgr/dashboard: Update npm packages 26647/head
Tiago Melo [Tue, 26 Feb 2019 11:24:09 +0000 (11:24 +0000)]
mgr/dashboard: Update npm packages

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agodoc: fix typo in objectops.rst 26646/head
Lan Liu [Tue, 26 Feb 2019 10:07:43 +0000 (18:07 +0800)]
doc: fix typo in objectops.rst

Signed-off-by: Lan Liu <liulan@umcloud.com>
6 years agolibrbd: set *image_size to 0 when getting ENOENT in rbd_group_image_list() 26622/head
songweibin [Mon, 25 Feb 2019 06:59:25 +0000 (14:59 +0800)]
librbd: set *image_size to 0 when getting ENOENT in rbd_group_image_list()

Fixes: http://tracker.ceph.com/issues/38468
Signed-off-by: songweibin <song.weibin@zte.com.cn>
6 years agodoc: use preferred commands for ceph config-key 26527/head
Changcheng Liu [Wed, 20 Feb 2019 03:22:04 +0000 (11:22 +0800)]
doc: use preferred commands for ceph config-key

'del' & 'list' & 'put' are deprecated. It's preferred to
using 'rm' & 'ls' & 'set' for ceph config-key

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
6 years agoMerge pull request #26611 from falcon78921/wip-doc-log-based-pg
Xie Xingguo [Tue, 26 Feb 2019 00:42:37 +0000 (08:42 +0800)]
Merge pull request #26611 from falcon78921/wip-doc-log-based-pg

doc: updated reference link for log based PG

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge PR #26617 into master
Sage Weil [Mon, 25 Feb 2019 22:41:40 +0000 (16:41 -0600)]
Merge PR #26617 into master

* refs/pull/26617/head:
rpm: Fix pyOpenSSL dependency

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
6 years agoMerge PR #26623 into master
Sage Weil [Mon, 25 Feb 2019 22:41:16 +0000 (16:41 -0600)]
Merge PR #26623 into master

* refs/pull/26623/head:
mgr/PyModule: put mgr_module_path first in sys.path

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #26543 into master
Sage Weil [Mon, 25 Feb 2019 22:40:46 +0000 (16:40 -0600)]
Merge PR #26543 into master

* refs/pull/26543/head:
Revert "ceph.spec.in: python-kubernetes broken on rhel"

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge PR #26625 into master
Sage Weil [Mon, 25 Feb 2019 22:40:12 +0000 (16:40 -0600)]
Merge PR #26625 into master

* refs/pull/26625/head:
rpm,cmake: additional fixes to make amqp support optional

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #22755 from zhangsw/feature-rgw-appendobj
Matt Benjamin [Mon, 25 Feb 2019 22:29:10 +0000 (17:29 -0500)]
Merge pull request #22755 from zhangsw/feature-rgw-appendobj

rgw: Add append object api.

6 years agoMerge PR #26610 into master
Patrick Donnelly [Mon, 25 Feb 2019 20:25:11 +0000 (12:25 -0800)]
Merge PR #26610 into master

* refs/pull/26610/head:
doc: updated governance link for Ceph project leads

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agolibrbd: skip partial discards by default
Jason Dillaman [Wed, 13 Feb 2019 18:18:17 +0000 (13:18 -0500)]
librbd: skip partial discards by default

Avoid the IO expense of writing zeros mid-object when a discard
is attempting to free space.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #26603 from dillaman/wip-38453
Mykola Golub [Mon, 25 Feb 2019 19:13:16 +0000 (21:13 +0200)]
Merge pull request #26603 from dillaman/wip-38453

rbd-mirror: use active/active policy by default

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agomessages/MMonMgrDigest: use set_data() to avoid screwing up byte_throttler 26636/head
Sage Weil [Mon, 25 Feb 2019 18:41:01 +0000 (12:41 -0600)]
messages/MMonMgrDigest: use set_data() to avoid screwing up byte_throttler

Use the existing set_data() helper to avoid breaking the byte_throttler
accounting.

Fixes e4ae368ff7a5396194f8bdd5692429af5457998b

Fixes: http://tracker.ceph.com/issues/38295
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26632 into master 26632/head
Sage Weil [Mon, 25 Feb 2019 16:44:43 +0000 (10:44 -0600)]
Merge PR #26632 into master

* refs/pull/26632/head:
14.1.0

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agomsg/async: msgr2: template specialized write function for frames
Ricardo Dias [Fri, 22 Feb 2019 11:05:38 +0000 (11:05 +0000)]
msg/async: msgr2: template specialized write function for frames

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agomsg/async: msgr2: extract frame classes into its own header
Ricardo Dias [Mon, 25 Feb 2019 16:23:04 +0000 (16:23 +0000)]
msg/async: msgr2: extract frame classes into its own header

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge PR #26609 into master
Sage Weil [Mon, 25 Feb 2019 16:32:01 +0000 (10:32 -0600)]
Merge PR #26609 into master

* refs/pull/26609/head:
ceph_test_msgr: skip injection test for simplemessenger

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26600 from jtlayton/wip-dashboard-rook
jtlayton [Mon, 25 Feb 2019 16:28:43 +0000 (17:28 +0100)]
Merge pull request #26600 from jtlayton/wip-dashboard-rook

mgr/dashboard: special casing for minikube in run-backend-rook-api-request.sh

6 years agorbd-mirror: use active/active policy by default 26603/head
Mykola Golub [Mon, 25 Feb 2019 09:50:00 +0000 (11:50 +0200)]
rbd-mirror: use active/active policy by default

Fixes: http://tracker.ceph.com/issues/38453
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #26522 from ashishkumsingh/wip-doc-38310
David Zafman [Mon, 25 Feb 2019 16:20:49 +0000 (08:20 -0800)]
Merge pull request #26522 from ashishkumsingh/wip-doc-38310

doc: Fix incorrect mention of 'osd_deep_mon_scrub_interval'

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge PR #26598 into master
Sage Weil [Mon, 25 Feb 2019 16:08:07 +0000 (10:08 -0600)]
Merge PR #26598 into master

* refs/pull/26598/head:
doc/releases/nautilus: note about msgr2
doc/releases/nautilus: rgw highlights
doc/releases/nautilus: draft notes

Reviewed-by: Kai Wagner <kwagner@suse.com>
6 years agomgr/dashboard: Change icon color in notifications 26586/head
Volker Theile [Mon, 25 Feb 2019 14:21:51 +0000 (15:21 +0100)]
mgr/dashboard: Change icon color in notifications

- Use CSS filters to convert the existing icons to white.
- Add new Prometheus SVG image, the previous PNG image has used the color white instead or transparent to fill some areas.

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agoMerge PR #26280 into master
Sage Weil [Mon, 25 Feb 2019 14:44:23 +0000 (08:44 -0600)]
Merge PR #26280 into master

* refs/pull/26280/head:
mgr: Remove _ceph_(g|s)et_module_option_ex() method
mgr: remove _ceph_get_module_option_ex() method

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge PR #26487 into master
Sage Weil [Mon, 25 Feb 2019 14:43:57 +0000 (08:43 -0600)]
Merge PR #26487 into master

* refs/pull/26487/head:
CLI: ability to change file ownership

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #26591 into master
Sage Weil [Mon, 25 Feb 2019 14:43:40 +0000 (08:43 -0600)]
Merge PR #26591 into master

* refs/pull/26591/head:
osd/PrimaryLogPG: handle object !exists in handle_watch_timeout

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agodoc/releases/nautilus: note about msgr2
Sage Weil [Fri, 22 Feb 2019 22:05:41 +0000 (16:05 -0600)]
doc/releases/nautilus: note about msgr2

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agodoc/releases/nautilus: rgw highlights
Sage Weil [Fri, 22 Feb 2019 18:38:57 +0000 (12:38 -0600)]
doc/releases/nautilus: rgw highlights

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agodoc/releases/nautilus: draft notes
Sage Weil [Fri, 22 Feb 2019 17:54:15 +0000 (11:54 -0600)]
doc/releases/nautilus: draft notes

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoceph_test_msgr: skip injection test for simplemessenger 26609/head
Sage Weil [Sun, 24 Feb 2019 15:36:57 +0000 (09:36 -0600)]
ceph_test_msgr: skip injection test for simplemessenger

The interceptor is only implemented in asyncmessenger.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26539 from tspmelo/wip-nfs-status
Lenz Grimmer [Mon, 25 Feb 2019 12:12:22 +0000 (13:12 +0100)]
Merge pull request #26539 from tspmelo/wip-nfs-status

mgr/dashboard: Add NFS status endpoint

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoceph-volume: don't create osd['block.db'] by default 26627/head
Jan Fajerski [Mon, 25 Feb 2019 11:55:42 +0000 (12:55 +0100)]
ceph-volume: don't create osd['block.db'] by default

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agorpm,cmake: additional fixes to make amqp support optional 26625/head
Tim Serong [Mon, 25 Feb 2019 08:48:11 +0000 (19:48 +1100)]
rpm,cmake: additional fixes to make amqp support optional

Signed-off-by: Tim Serong <tserong@suse.com>
6 years agoMerge pull request #26620 from cyx1231st/wip-seastar-async-echo
Kefu Chai [Mon, 25 Feb 2019 08:44:20 +0000 (16:44 +0800)]
Merge pull request #26620 from cyx1231st/wip-seastar-async-echo

test/crimson: split async-msgr out of alien_echo

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/PyModule: put mgr_module_path first in sys.path 26623/head
Tim Serong [Mon, 25 Feb 2019 03:47:12 +0000 (14:47 +1100)]
mgr/PyModule: put mgr_module_path first in sys.path

If the various python site packages appear first in sys.path, and there
happens to be a package whose name is the same as an mgr module, mgr will
try to load that thing instead of the expected mgr module.  This results
in a very terse couple of errors:

  mgr[py] Class not found in module 'deepsea'
  mgr[py] Error loading module 'deepsea': (22) Invalid argument

Before this commit, sys.path on my SLE 11 SP1 dev system is:

  /usr/lib/python36.zip
  /usr/lib64/python3.6
  /usr/lib64/python3.6
  /usr/lib64/python3.6/lib-dynload
  /usr/lib64/python3.6/site-packages
  /usr/lib/python3.6/site-packages
  /usr/local/lib64/python3.6/site-packages
  /usr/local/lib/python3.6/site-packages
  /usr/lib64/ceph/mgr

After this commit, /usr/share/ceph/mgr comes before python's site-packages,
and everything works properly:

  /usr/lib/python36.zip
  /usr/lib64/python3.6
  /usr/lib64/python3.6
  /usr/lib64/python3.6/lib-dynload
  /usr/share/ceph/mgr
  /usr/lib64/python3.6/site-packages
  /usr/lib/python3.6/site-packages
  /usr/local/lib64/python3.6/site-packages
  /usr/local/lib/python3.6/site-packages

(If you're interested in seeing what's in sys.path, turn "debug mgr" up
to at least 10, then grep the logs for "Computed sys.path")

Fixes: https://tracker.ceph.com/issues/38469
Signed-off-by: Tim Serong <tserong@suse.com>
6 years agorbd/pybind: add __enter__ and __exit__ for class Group
songweibin [Mon, 25 Feb 2019 06:58:44 +0000 (14:58 +0800)]
rbd/pybind: add __enter__ and __exit__ for class Group

Fixes: http://tracker.ceph.com/issues/38468
Signed-off-by: songweibin <song.weibin@zte.com.cn>
6 years agotest/crimson: enable unauthenticated connections for async_echo 26620/head
Yingxin Cheng [Mon, 25 Feb 2019 06:36:29 +0000 (14:36 +0800)]
test/crimson: enable unauthenticated connections for async_echo

Enable co-operability with crimson-msgr in unittest_alien_echo.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agotest/crimson: split async-msgr out of alien_echo
Yingxin Cheng [Mon, 25 Feb 2019 06:32:13 +0000 (14:32 +0800)]
test/crimson: split async-msgr out of alien_echo

async-msgr is not compatible with custom-built libs for seastar, so
split it.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agorpm: Fix pyOpenSSL dependency 26617/head
Brad Hubbard [Mon, 25 Feb 2019 02:06:57 +0000 (12:06 +1000)]
rpm: Fix pyOpenSSL dependency

Fedora29 does not have pyOpenSSL but it does have python-pyOpenSSL

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
6 years agodoc: updated reference link for log based PG 26611/head
James McClune [Sun, 24 Feb 2019 21:08:44 +0000 (16:08 -0500)]
doc: updated reference link for log based PG

Added :ref: label to Log Based PG page. Referenced <log-based-pg>
label on Asynchronous Recovery page.

Fixes: https://tracker.ceph.com/issues/38465
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
6 years agodoc: updated governance link for Ceph project leads 26610/head
James McClune [Sun, 24 Feb 2019 20:58:02 +0000 (15:58 -0500)]
doc: updated governance link for Ceph project leads

Added :ref: label to Governance page. Referenced <governance>
label on Development Workflow page.

Fixes: https://tracker.ceph.com/issues/38464
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
6 years agoMerge PR #26466 into master
Sage Weil [Sun, 24 Feb 2019 15:33:32 +0000 (09:33 -0600)]
Merge PR #26466 into master

* refs/pull/26466/head:
msg/async, v2: fix wrong base for KeepAliveFrameAck.
msg/async, v2: frame decoding operates on bufferlist.
msg/async, v2: drop ceph_msg_header2 fields duplicating segment info.
msg/async, v2: drop the scaffolding in preamble parsing.
msg/async, v2: handle msg authentication failures.
msg/async, v2: drop depedency on uint128_t. Clean up onwire crypto.
msg/async, v2: fix cur_msg_size in ::reset_recv_state().
msg/async, v2: drop magic numbers for segments.
msg/async, v2: get rid of magic number in SignedEncryptedFrame.
msg/async, v2: get rid of the magic number for default alignment.
msg/async, v2: decouple onwire segment length from logical length.
msg/async, v2: follow the const bl& concept in authenticated_encrypt_update().
msg/async, v2: drop handling of extra segments in ::fill_preamble().
msg/async, v2: get rid of magic numbers for alignment.
msg/async, v2: drop reserve() from onwire crypto's TxHandler.
msg/async: add con_mode to debug lines
msg/DispatchQueue: include con_mode in <== line
common/ceph_strings: get_con_mode_name()
msg/Connection: add get_con_mode()
msg/async/ProtocolV2: clean up preamble comments
msg/async, v2: improve debug around sending client indent.
msg/async, v2: bring back the no-encryption ability.
msg/async, v2: workaround con_mode handling.
msg/async, v2: drop the throttles bypass.
msg/async, v2: READ_MESSAGE_FRONT -> THROTTLE_DONE.
msg/async: WaitFrame of V2 can be crypto processed now.
msg/async: initial multi-segment support for V2.
msg/async: V2 bypasses throttles just for development.
msg/async: rectify reseting security state in ProtocolV2::reset_recv_state().
msg/async: switch to CRC32 for V2 preamble blocks.
msg/async: bump up preamble block size to 32 bytes.
msg/async: get rid of the distiction on main and extra V2 preamble.
msg/async: add debug around empty ClientIdent::addrs.
msg/async: V2 uses segments instead of next_payload_len, part 1.
msg/async: perform V2 frame dispatch in dedicated method.
msg/async: implement crc checking for main preamble of V2.
msg/async: receive V2 messages with new preable format.
msg/async: transmit V2 messages with new preable format.
msg/async: reset crypto processors in ProtocolV2::reset_recv_state().
msg/async: preamble of V2 Frames is now encrypted and authenticated.
msg/async: slightly rework ProtocolV2 preamble crafting.
msg/async: reset the rx stream handler in ::handle_read_frame_length_and_tag.
auth, msg/async, v2: drop AuthStreamHandler and AES128GCM_StreamHandler.
msg/async: Messages in Protocol2 are crypto-processed only once.
msg/async: SignedEncryptedFrame uses ceph::crypto::onwire.
msg/async: expose message segmentation to ::write_message().
auth: implement ceph::crypto::onwire with OpenSSL EVP.
auth: introduce ceph::crypto::onwire interfaces.
msg/async: decouple MessageHeaderFrame from SignedEncryptedFrame.
msg/async: move Protocol* asserts in SignedEncryptedFrame to compile time.
msg/async: simplify encryption handling in the PayloadFrame class.
auth: drop AES128CBC_HMACSHA256_StreamHandler.
msg/async: ensure consistency between con_mode and session_security.
msg/async: drop MessageFrame. Use MessageHeaderFrame instead.
msg/async: set con_mode and session_security at both peers.
msg/async, auth: switch AuthStreamHandler::rxtx_t to std::unique_ptr.
crypto: AES128GCM_StreamHandler brings authenticated encryption with AES-GCM.
include: uint128_t -> ceph::uint128_t + using.
msg/async: move crypto handling from ProtocolV2 into AuthStreamHandler.
auth, msg: dissect AuthStreamHandler from AuthSessionHandler.
auth/cephx: make _calc_signature() of CephxSessionHandler private.
auth: drop {en,de}crypt_message() from AuthSessionHandler.
auth: introduce DummyAuthSessionHandler.
auth: make AuthSessionHandler purely abstract.
auth: drop no_security() from AuthSessionHandler.
auth: drop get_protocol() and get_key() from AuthSessionHandler.
auth: drop sign_bufferlist() from AuthSessionHandler.
msg/async: drop get_auth_meta() from Protocol.
msg/async: emphasize ProtocolV2 does authenticated encryption.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26560 from xiexingguo/wip-pool-force-recovery
Xie Xingguo [Sat, 23 Feb 2019 07:30:14 +0000 (15:30 +0800)]
Merge pull request #26560 from xiexingguo/wip-pool-force-recovery

mgr: add per pool force-recovery/backfill commands

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agomgr: add per pool force-recovery/backfill commands 26560/head
xie xingguo [Wed, 20 Feb 2019 10:40:02 +0000 (18:40 +0800)]
mgr: add per pool force-recovery/backfill commands

For those with multiple storage pools sharing the same devices,
I think it would make much more sense to offer per-pool
commands to bring pools with high priority, e.g., because they
are hosting data of more importance than others, back to normal
quickly.

Fixes: http://tracker.ceph.com/issues/38456
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agomsg/async, v2: fix wrong base for KeepAliveFrameAck. 26466/head
Radoslaw Zarzynski [Sat, 23 Feb 2019 00:49:17 +0000 (01:49 +0100)]
msg/async, v2: fix wrong base for KeepAliveFrameAck.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge PR #26602 into master
Sage Weil [Fri, 22 Feb 2019 22:00:25 +0000 (16:00 -0600)]
Merge PR #26602 into master

* refs/pull/26602/head:
Revert "pybind: set language_level for cythonize explicitly"
Revert "pybind: auto encode/decode cstr"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #26436 from dzafman/wip-bionic-core
David Zafman [Fri, 22 Feb 2019 20:52:37 +0000 (12:52 -0800)]
Merge pull request #26436 from dzafman/wip-bionic-core

run-standalone.sh: Need double-quotes to handle | in core_pattern on all distributions

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agomgr/dashboard: special casing for minikube in run-backend-rook-api-request.sh 26600/head
Jeff Layton [Fri, 22 Feb 2019 19:40:51 +0000 (14:40 -0500)]
mgr/dashboard: special casing for minikube in run-backend-rook-api-request.sh

For people running minikube for testing, the hostname "minikube" is
often not resolvable. If that's what the hostname is, then get
the address from "minikube ip" instead.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agoRevert "pybind: set language_level for cythonize explicitly" 26602/head
Neha Ojha [Fri, 22 Feb 2019 19:41:55 +0000 (11:41 -0800)]
Revert "pybind: set language_level for cythonize explicitly"

This reverts commit ded3d43dbf8a36daa65d8efe406af4d12ffc7dd8.

Signed-off-by: Neha Ojha <nojha@redhat.com>
6 years agoRevert "pybind: auto encode/decode cstr"
Neha Ojha [Fri, 22 Feb 2019 19:39:20 +0000 (11:39 -0800)]
Revert "pybind: auto encode/decode cstr"

This reverts commit c36d0f1a7de4668eb81075e4a94846cf81fc30cd.

Signed-off-by: Neha Ojha <nojha@redhat.com>
6 years ago14.1.0 v14.1.0
Jenkins Build Slave User [Fri, 22 Feb 2019 18:07:07 +0000 (18:07 +0000)]
14.1.0

6 years agoMerge pull request #25438 from MahatiC/wip-move-to-trash
Mykola Golub [Fri, 22 Feb 2019 16:57:10 +0000 (18:57 +0200)]
Merge pull request #25438 from MahatiC/wip-move-to-trash

rbd: move image to trash as first step when removing

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #26506 from ricardoasmarques/multi-backstore-backend
Lenz Grimmer [Fri, 22 Feb 2019 16:48:25 +0000 (17:48 +0100)]
Merge pull request #26506 from ricardoasmarques/multi-backstore-backend

mgr/dashboard: iSCSI - Infrastructure for multiple backstores (backend)

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoosd/PrimaryLogPG: handle object !exists in handle_watch_timeout 26591/head
Sage Weil [Fri, 22 Feb 2019 14:56:16 +0000 (08:56 -0600)]
osd/PrimaryLogPG: handle object !exists in handle_watch_timeout

- watch on object
- watch timeout queued
- rados op deletes object
- handle_watch_timeout tries to delete it again

Fixes: http://tracker.ceph.com/issues/38432
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/dashboard: Added breadcrumb tests to Filesystems menu 26592/head
Nathan Weinberg [Fri, 22 Feb 2019 14:50:24 +0000 (09:50 -0500)]
mgr/dashboard: Added breadcrumb tests to Filesystems menu

Fixes: https://tracker.ceph.com/issues/38343
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
6 years agoMerge pull request #26515 from theanalyst/civetweb-fixes-n
Matt Benjamin [Fri, 22 Feb 2019 14:20:38 +0000 (09:20 -0500)]
Merge pull request #26515 from theanalyst/civetweb-fixes-n

civetweb: pull up to ceph-master

6 years agomgr/dashboard: Updated messages.xlf 26589/head
Stephan Müller [Thu, 21 Feb 2019 16:40:58 +0000 (17:40 +0100)]
mgr/dashboard: Updated messages.xlf

Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agomgr/dashboard: Pgs will update as expected
Stephan Müller [Thu, 21 Feb 2019 16:40:17 +0000 (17:40 +0100)]
mgr/dashboard: Pgs will update as expected

The problem was that PGs jumped over the next calculated number when
pressing "up".

Fixes: https://tracker.ceph.com/issues/38382
Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agoRevert "ceph.spec.in: python-kubernetes broken on rhel" 26543/head
Jeff Layton [Wed, 20 Feb 2019 15:12:31 +0000 (10:12 -0500)]
Revert "ceph.spec.in: python-kubernetes broken on rhel"

This reverts commit c32c4874e139d0e97116d6f3d368ac9c3e393c9f.

An updated python2-kubernetes package that does not depend on
python-adal has made it into the epel7 repos. With that change,
we can now revert this patch.

When we readd it back though, add in %{_python_buildid} so that
this works correctly on python3-based distros as well.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agoMerge PR #26550 into master
Sage Weil [Fri, 22 Feb 2019 13:14:33 +0000 (07:14 -0600)]
Merge PR #26550 into master

* refs/pull/26550/head:
mon/AuthMonitor: provide auth_lock-safe _assign_global_id()
mon/AuthMonitor: provide AuthMonitor with mon count and rank *only* while active

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
6 years agoMerge PR #26476 into master
Sage Weil [Fri, 22 Feb 2019 13:11:28 +0000 (07:11 -0600)]
Merge PR #26476 into master

* refs/pull/26476/head:
pybind: auto encode/decode cstr
pybind: set language_level for cythonize explicitly

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26552 into master
Sage Weil [Fri, 22 Feb 2019 13:10:51 +0000 (07:10 -0600)]
Merge PR #26552 into master

* refs/pull/26552/head:
osdc/Objecter: invalidate crcs on preallocated rx buffers

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26568 into master
Sage Weil [Fri, 22 Feb 2019 13:10:32 +0000 (07:10 -0600)]
Merge PR #26568 into master

* refs/pull/26568/head:
unittest_auth: add unit tests for AuthRegistry con_mode selection
auth/AuthRegistry: register as an observer
auth/AuthRegistry: clear output vectors
common/options: add ms_mon_client_mode
auth: push con_mode selection into AuthRegistry helper

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agocivetweb: pull up to ceph-master 26515/head
Abhishek Lekshmanan [Tue, 19 Feb 2019 16:03:38 +0000 (17:03 +0100)]
civetweb: pull up to ceph-master

Contains the following fixes
- absolute url fixes
- ssl socket closing fixes

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge pull request #26584 from capri1989/doc-fixes
Kefu Chai [Fri, 22 Feb 2019 11:31:58 +0000 (19:31 +0800)]
Merge pull request #26584 from capri1989/doc-fixes

doc: Remove value 'mon_osd_max_split_count'

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agodoc: Remove value 'mon_osd_max_split_count' from the docs 26584/head
Kai Wagner [Fri, 22 Feb 2019 09:18:44 +0000 (10:18 +0100)]
doc: Remove value 'mon_osd_max_split_count' from the docs

Signed-off-by: Kai Wagner <kwagner@suse.com>
6 years agoMerge pull request #26510 from callithea/wip-add-ganesha-qa-tests
Lenz Grimmer [Fri, 22 Feb 2019 09:28:41 +0000 (10:28 +0100)]
Merge pull request #26510 from callithea/wip-add-ganesha-qa-tests

mgr/dashboard: Added NFS Ganesha suite to QA tests

Reviewed-by: Jeff Layton <jlayton@redhat.com>