]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoMerge pull request #26047 from pdvian/wip-37923-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:39:01 +0000 (08:39 -0800)]
Merge pull request #26047 from pdvian/wip-37923-mimic

mimic: qa: test_damage performs truncate test on same object repeatedly

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26051 from ukernel/mimic-37594
Yuri Weinstein [Wed, 30 Jan 2019 16:37:52 +0000 (08:37 -0800)]
Merge pull request #26051 from ukernel/mimic-37594

mimic: mds: handle state change race

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26066 from pdvian/wip-37986-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:36:51 +0000 (08:36 -0800)]
Merge pull request #26066 from pdvian/wip-37986-mimic

mimic: core: Objecter::calc_op_budget: Fix invalid access to extent union member

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26069 from pdvian/wip-37988-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:36:20 +0000 (08:36 -0800)]
Merge pull request #26069 from pdvian/wip-37988-mimic

mimic: MDSMonitor: missing osdmon writeable check

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26072 from smithfarm/wip-37952-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:35:52 +0000 (08:35 -0800)]
Merge pull request #26072 from smithfarm/wip-37952-mimic

mimic: qa: test_damage needs to silence MDS_READ_ONLY

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26180 from pdvian/wip-37894-mimic
Nathan Cutler [Wed, 30 Jan 2019 13:22:39 +0000 (14:22 +0100)]
Merge pull request #26180 from pdvian/wip-37894-mimic

mimic: doc: updated Ceph documentation links

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #25511 from smithfarm/wip-37465-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:57:50 +0000 (08:57 -0800)]
Merge pull request #25511 from smithfarm/wip-37465-mimic

mimic: rgw: master zone deletion without a zonegroup rm would break rgw rados init

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #25578 from pdvian/wip-37556-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:57:13 +0000 (08:57 -0800)]
Merge pull request #25578 from pdvian/wip-37556-mimic

mimic: multisite: es sync null versioned object failed because of olh info

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25624 from pdvian/wip-37560-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:56:40 +0000 (08:56 -0800)]
Merge pull request #25624 from pdvian/wip-37560-mimic

mimic: rgw: rgwgc: process coredump in some special case

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25954 from pdvian/wip-37890-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:56:08 +0000 (08:56 -0800)]
Merge pull request #25954 from pdvian/wip-37890-mimic

mimic: rbd: fix delay time calculation for trash move

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #26049 from pdvian/wip-37920-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:55:31 +0000 (08:55 -0800)]
Merge pull request #26049 from pdvian/wip-37920-mimic

mimic: test/rbd_mirror: wait for release leader lock fully complete

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #26137 from ashishkumsingh/wip-38032-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:54:37 +0000 (08:54 -0800)]
Merge pull request #26137 from ashishkumsingh/wip-38032-mimic

mimic: librbd: properly filter out trashed non-user images on purge

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agodoc: updated Ceph documentation links 26180/head
James McClune [Fri, 4 Jan 2019 21:32:21 +0000 (16:32 -0500)]
doc: updated Ceph documentation links

Fixes include:

- Updating Doxygen link for reference (http://docs.ceph.com/docs/master/dev/documenting/)
- Adding :ref: label for User Management page (http://docs.ceph.com/docs/master/rados/operations/user-management/)
- Update User Management link for reference (http://docs.ceph.com/docs/master/rbd/rbd-snapshot/)

Fixes: https://tracker.ceph.com/issues/37793
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
(cherry picked from commit 7ff2f215a3d051c4ef226bfdc81184d89520e152)

6 years agoMerge pull request #25699 from xiexingguo/wip-37744
Yuri Weinstein [Fri, 25 Jan 2019 16:14:30 +0000 (08:14 -0800)]
Merge pull request #25699 from xiexingguo/wip-37744

mimic: osd/OSDMap: cancel mapping if target osd is out

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25292 from smithfarm/wip-37417-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:13:30 +0000 (08:13 -0800)]
Merge pull request #25292 from smithfarm/wip-37417-mimic

mimic: mgr: various python3 fixes

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #25299 from smithfarm/wip-37428-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:12:47 +0000 (08:12 -0800)]
Merge pull request #25299 from smithfarm/wip-37428-mimic

mimic: msg/async: crashes when authenticator provided by verify_authorizer not implemented

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #25718 from ashishkumsingh/wip-37552-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:11:54 +0000 (08:11 -0800)]
Merge pull request #25718 from ashishkumsingh/wip-37552-mimic

mimic: osdc/Objecter: update op_target_t::paused in _calc_target

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #25759 from pdvian/wip-37599-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:11:14 +0000 (08:11 -0800)]
Merge pull request #25759 from pdvian/wip-37599-mimic

mimic: pybind/mgr: drop unnecessary iterkeys usage to make py-3 compatible

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #25864 from ashishkumsingh/wip-37826-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:10:18 +0000 (08:10 -0800)]
Merge pull request #25864 from ashishkumsingh/wip-37826-mimic

mimic: mgr: fix crash due to multiple sessions from daemons with same name

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #25368 from pdvian/wip-37477-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:09:09 +0000 (08:09 -0800)]
Merge pull request #25368 from pdvian/wip-37477-mimic

mimic: mgr: race between daemon state and service map in 'service status'

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #25513 from smithfarm/wip-37342-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:08:34 +0000 (08:08 -0800)]
Merge pull request #25513 from smithfarm/wip-37342-mimic

mimic: osd: Prioritize user specified scrubs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #25605 from smithfarm/wip-37698-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:07:54 +0000 (08:07 -0800)]
Merge pull request #25605 from smithfarm/wip-37698-mimic

mimic: osd: failed assert when osd_memory_target options mismatch

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #25809 from pdvian/wip-37742-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:06:41 +0000 (08:06 -0800)]
Merge pull request #25809 from pdvian/wip-37742-mimic

mimic: build/ops: rpm: require ceph-base instead of ceph-common

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #25844 from pdvian/wip-37810-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:06:10 +0000 (08:06 -0800)]
Merge pull request #25844 from pdvian/wip-37810-mimic

mimic: mon/OSDMonitor: do not populate void pg_temp into nextmap

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25846 from pdvian/wip-37812-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:05:34 +0000 (08:05 -0800)]
Merge pull request #25846 from pdvian/wip-37812-mimic

mimic: mon: shutdown messenger early to avoid accessing deleted logger

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #25850 from ashishkumsingh/wip-37814-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:04:33 +0000 (08:04 -0800)]
Merge pull request #25850 from ashishkumsingh/wip-37814-mimic

mimic: qa/workunits/rados/test_health_warnings: prevent out osds

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #25854 from ashishkumsingh/wip-37824-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:03:44 +0000 (08:03 -0800)]
Merge pull request #25854 from ashishkumsingh/wip-37824-mimic

mimic: os/bluestore: KernelDevice::read() does the EIO mapping now.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge pull request #25958 from xiexingguo/wip-mimic-async-fixes
Yuri Weinstein [Fri, 25 Jan 2019 16:03:07 +0000 (08:03 -0800)]
Merge pull request #25958 from xiexingguo/wip-mimic-async-fixes

mimic: msg/async: backport recent messenger fixes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26118 from ceph/backport-mimic-26084
Alfredo Deza [Fri, 25 Jan 2019 16:01:42 +0000 (11:01 -0500)]
Merge pull request #26118 from ceph/backport-mimic-26084

mimic: ceph-volume: mark a device not available if it belongs to ceph-disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #25386 from pdvian/wip-37483-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:01:12 +0000 (08:01 -0800)]
Merge pull request #25386 from pdvian/wip-37483-mimic

mimic: rgw: Don't treat colons specially in resource part of ARN

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25449 from smithfarm/wip-37518-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:00:43 +0000 (08:00 -0800)]
Merge pull request #25449 from smithfarm/wip-37518-mimic

mimic: rgw: fix max-size in radosgw-admin and REST Admin API

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25459 from pdvian/wip-37536-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:00:10 +0000 (08:00 -0800)]
Merge pull request #25459 from pdvian/wip-37536-mimic

mimic: librbd: reset snaps in rbd_snap_list()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #25485 from pdvian/wip-37548-mimic
Yuri Weinstein [Fri, 25 Jan 2019 15:59:34 +0000 (07:59 -0800)]
Merge pull request #25485 from pdvian/wip-37548-mimic

mimic: rgw_file: user info never synced since librgw init

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
6 years agoMerge pull request #25505 from smithfarm/wip-37550-mimic
Yuri Weinstein [Fri, 25 Jan 2019 15:59:04 +0000 (07:59 -0800)]
Merge pull request #25505 from smithfarm/wip-37550-mimic

mimic: rgw: multisite: sync gets stuck retrying deletes that fail with ERR_PRECONDITION_FAILED

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25643 from pdvian/wip-37562-mimic
Yuri Weinstein [Fri, 25 Jan 2019 15:58:35 +0000 (07:58 -0800)]
Merge pull request #25643 from pdvian/wip-37562-mimic

mimic: rgw: fix version bucket stats

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25740 from pdvian/wip-37649-mimic
Yuri Weinstein [Fri, 25 Jan 2019 15:57:49 +0000 (07:57 -0800)]
Merge pull request #25740 from pdvian/wip-37649-mimic

mimic: rgw: feature -- log successful bucket resharding events

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #25899 from ashishkumsingh/wip-37558-mimic
Yuri Weinstein [Fri, 25 Jan 2019 15:56:44 +0000 (07:56 -0800)]
Merge pull request #25899 from ashishkumsingh/wip-37558-mimic

mimic:  rgw: handle S3 version 2 pre-signed urls with meta-data

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
6 years agoMerge pull request #26003 from smithfarm/wip-37948-mimic
Yuri Weinstein [Fri, 25 Jan 2019 15:56:08 +0000 (07:56 -0800)]
Merge pull request #26003 from smithfarm/wip-37948-mimic

mimic: rgw: debug logging for v4 auth does not sanitize encryption keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25607 from joscollin/wip-37684-mimic
Nathan Cutler [Fri, 25 Jan 2019 13:34:10 +0000 (14:34 +0100)]
Merge pull request #25607 from joscollin/wip-37684-mimic

mimic: doc/user-management: Remove obsolete reset caps command

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #25501 from joscollin/wip-37601-mimic
Nathan Cutler [Fri, 25 Jan 2019 13:27:09 +0000 (14:27 +0100)]
Merge pull request #25501 from joscollin/wip-37601-mimic

mimic: doc: broken link on troubleshooting-mon page

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agolibrbd: properly filter out trashed non-user images on purge 26137/head
Mykola Golub [Tue, 22 Jan 2019 15:54:20 +0000 (17:54 +0200)]
librbd: properly filter out trashed non-user images on purge

Fixes: https://tracker.ceph.com/issues/38006
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 3d01cc627137d7f270969653fbae4b6230361d7a)

Conflicts:
- src/librbd/api/Trash.cc
- src/tools/rbd/action/Trash.cc
    In mimic, the code that needs fixing was in
            'tools/rbd/action/Trash.cc'.

6 years agoceph-volume: mark a device not available if it belongs to ceph-disk 26118/head
Andrew Schoen [Tue, 22 Jan 2019 15:32:00 +0000 (09:32 -0600)]
ceph-volume: mark a device not available if it belongs to ceph-disk

The `ceph-volume inventory` command will now show if a device is being
used by ceph-disk and mark it not available if so.

Fixes: https://tracker.ceph.com/issues/24871
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit d14a6b284c44a3f61c0dd8c60ccc474203003653)

6 years agoMerge pull request #26113 from alfredodeza/mimic-rm37963
Andrew Schoen [Thu, 24 Jan 2019 15:45:29 +0000 (09:45 -0600)]
Merge pull request #26113 from alfredodeza/mimic-rm37963

mimic ceph-volume fix TypeError on dmcrypt when using Python3

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests verify behavior of create_dmcrypt_key in python 3 26113/head
Alfredo Deza [Fri, 18 Jan 2019 17:51:04 +0000 (12:51 -0500)]
ceph-volume tests verify behavior of create_dmcrypt_key in python 3

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 69613cc5a8b2e111e24b75ad5b69f924c89fd75b)

6 years agoceph-volume util.encryption ensure int is used for urandom (py3 compat)
Alfredo Deza [Fri, 18 Jan 2019 17:50:38 +0000 (12:50 -0500)]
ceph-volume util.encryption ensure int is used for urandom (py3 compat)

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0ab9fa62d6d46464b16f08d3a5bb3da50f5030e7)

6 years agoqa: silence read-only WRN for damage testing 26072/head
Patrick Donnelly [Wed, 16 Jan 2019 18:52:09 +0000 (10:52 -0800)]
qa: silence read-only WRN for damage testing

Fixes: http://tracker.ceph.com/issues/37944
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit ac302de7b7725c259fee1852e3f402533d69f8cf)

6 years agoMDSMonitor: add missing OSDMonitor writeable check 26069/head
Patrick Donnelly [Tue, 15 Jan 2019 21:45:14 +0000 (13:45 -0800)]
MDSMonitor: add missing OSDMonitor writeable check

Fixes: http://tracker.ceph.com/issues/37929
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 8ef68663d311f71d1598297c14fad39274ada41d)

6 years agoMDSMonitor: codify constraint for writeable OSDMap
Patrick Donnelly [Tue, 15 Jan 2019 20:58:13 +0000 (12:58 -0800)]
MDSMonitor: codify constraint for writeable OSDMap

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 1a3457be4ef049b4b9d6a202455fbc21c09524b9)

6 years agoObjecter::calc_op_budget: Fix invalid access to extent union member 26066/head
Simon Ruggier [Sat, 15 Dec 2018 04:32:22 +0000 (23:32 -0500)]
Objecter::calc_op_budget: Fix invalid access to extent union member

Previously, the function was checking the extent length for any
operation with the CEPH_OSD_OP_MODE_RD and CEPH_OSD_OP_TYPE_DATA bits
set, but some operation types that have these bits set use a different
interpretation of the ceph_osd_op union.

This leads to a type safety problem where another field, such as the
object version, is interpreted as an extent length and added to the
budget. In addition to producing an incorrectly high budget for the
operation, this also triggers an assertion failure if the value is large
enough to overflow a signed 32-bit integer, as described in bug #9592
and bug #37932.

This change uses the ceph_osd_op_uses_extent function to prevent invalid
access to the union, instead of ceph_osd_op_type_data.

Fixes: http://tracker.ceph.com/issues/37932
Signed-off-by: Simon Ruggier <simon@platform.sh>
(cherry picked from commit 1cb91c2cdfa7556b23b9800c8d10033d0c815b4e)

6 years agoMerge pull request #26035 from noahdesu/mimic-pr26015
Noah Watkins [Mon, 21 Jan 2019 21:32:39 +0000 (13:32 -0800)]
Merge pull request #26035 from noahdesu/mimic-pr26015

mimic: cli: dump osd-fsid as part of osd find <id>

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26029 from alfredodeza/mimic-fix_raw_input
Andrew Schoen [Mon, 21 Jan 2019 21:28:57 +0000 (15:28 -0600)]
Merge pull request #26029 from alfredodeza/mimic-fix_raw_input

mimic ceph-volume: Adapt code to support Python3

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #26013 from alfredodeza/mimic-bz1644847
Andrew Schoen [Mon, 21 Jan 2019 19:40:53 +0000 (13:40 -0600)]
Merge pull request #26013 from alfredodeza/mimic-bz1644847

mimic ceph-volume zap devices associated with an OSD ID and/or OSD FSID

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agomds: handle state change race 26051/head
Yan, Zheng [Mon, 29 Oct 2018 03:03:00 +0000 (11:03 +0800)]
mds: handle state change race

In multi-mds cluster, recovering mds may receive mdsmap that changes
its state after other mds. Furthermore, the recovering mds may receive
messages tiggered by its state change from other mds before it receive
corresponding mdsmap.

Fixes: http://tracker.ceph.com/issues/37594
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit d3a444473abc98e5ce8121af24538a141a292777)

 Conflicts:
src/mds/Locker.cc
src/mds/MDCache.cc
src/mds/MDSRank.h

6 years agotest/rbd_mirror: wait for release leader lock fully complete 26049/head
Mykola Golub [Sat, 12 Jan 2019 15:55:25 +0000 (15:55 +0000)]
test/rbd_mirror: wait for release leader lock fully complete

Previously the wait context was completed at post_release_lock
stage, which still was not the end of the lock releasing process.

Fixes: https://tracker.ceph.com/issues/37883
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit f1b2c6a841ff90e48e8b602a9f0454a14b8f32f8)

6 years agoqa: fix damage expectation setting 26047/head
Patrick Donnelly [Wed, 9 Jan 2019 00:26:14 +0000 (16:26 -0800)]
qa: fix damage expectation setting

The purge queue expectation was being ignored.

Fixes: http://tracker.ceph.com/issues/37837
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 360550b1ab143bb59fd38c77569f7f5ef762801a)

6 years agoqa: fix loop variable reference
Patrick Donnelly [Tue, 8 Jan 2019 23:51:53 +0000 (15:51 -0800)]
qa: fix loop variable reference

Otherwise the Mutation for Truncate is done on obj_id of the last iteration of the previous loop.

Fixes: http://tracker.ceph.com/issues/37836
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 909d0f1333a730c648c08cda047bb5f356a61986)

6 years agocli: dump osd-fsid as part of osd find <id> 26035/head
Noah Watkins [Thu, 17 Jan 2019 19:16:44 +0000 (11:16 -0800)]
cli: dump osd-fsid as part of osd find <id>

Dumps the osd-fsid uuid as part of the `osd find <id>` command.
Currently this uuid is only available as part of `osd dump` but
ceph-ansible has a use case to interrogate a single osd without needing
the entire osdmap dump.

Fixes: http://tracker.ceph.com/issues/37966
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
(cherry picked from commit 4d01b2c96e0ea1122225c30da21bc39c40e15c0e)

6 years agoceph-volume: Adapt code to support Python3 26029/head
Volker Theile [Thu, 29 Nov 2018 12:48:30 +0000 (13:48 +0100)]
ceph-volume: Adapt code to support Python3

- raw_input() has been renamed to input() in Python3
- Changed signature of prompt_bool. Variables that are named like built-ins must be named like xxx_ and not _xxx

Fixes: https://tracker.ceph.com/issues/37470
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit fe25a0ea625e75c598f6d0749e7259eef167fa8e)

6 years agoceph-volume tests.functional.batch symlink test_zap to all batch scenarios 26013/head
Alfredo Deza [Fri, 7 Dec 2018 17:29:45 +0000 (12:29 -0500)]
ceph-volume tests.functional.batch symlink test_zap to all batch scenarios

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d3c0058911fd0b3e273a7afb1a9f4f6072942d75)

6 years agoceph-volume tests.functional.batch add test_zap yaml to tox.ini
Alfredo Deza [Fri, 7 Dec 2018 17:28:37 +0000 (12:28 -0500)]
ceph-volume tests.functional.batch add test_zap yaml to tox.ini

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 25843b762953e53c08e6475d1f9dbfd5102a283f)

6 years agoceph-volume tests.functional.batch create a separate test_zap playbook
Alfredo Deza [Fri, 7 Dec 2018 17:08:44 +0000 (12:08 -0500)]
ceph-volume tests.functional.batch create a separate test_zap playbook

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 6b8f0d483a6203de204fcc605ade536749a9f6c8)

6 years agoceph-volume lvm.zap update success message for OSD IDs
Alfredo Deza [Fri, 7 Dec 2018 12:53:43 +0000 (07:53 -0500)]
ceph-volume lvm.zap update success message for OSD IDs

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 73bb17f79a5b67b28ceace9dc7dcc2dde38dad5e)

6 years agodoc/man/ceph-volume add zapping by osd-id examples
Alfredo Deza [Thu, 6 Dec 2018 20:30:38 +0000 (15:30 -0500)]
doc/man/ceph-volume add zapping by osd-id examples

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit acbf7c9b2ad2810621d7ed3987e814cd8c2a2f65)

6 years agodoc/ceph-volume add zapping by osd-id examples
Alfredo Deza [Thu, 6 Dec 2018 20:30:22 +0000 (15:30 -0500)]
doc/ceph-volume add zapping by osd-id examples

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f82304f4b5f5ecd865b6a208f894b59cec6386e2)

6 years agoceph-volume tests.lvm verify associated lvs by osd id+fsid behavior
Alfredo Deza [Thu, 6 Dec 2018 20:00:00 +0000 (15:00 -0500)]
ceph-volume tests.lvm verify associated lvs by osd id+fsid behavior

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 40a414464727375d5c558532aed3b70766ec5b78)

6 years agoceph-volume lvm.zap initial take on zapping by OSD ID, FSID
Alfredo Deza [Thu, 6 Dec 2018 15:54:11 +0000 (10:54 -0500)]
ceph-volume lvm.zap initial take on zapping by OSD ID, FSID

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 59f6cec6dd0687a2528f75a518bd0d4617c27fe0)

6 years agoMerge pull request #25554 from jan--f/25238-mimic
Alfredo Deza [Thu, 17 Jan 2019 17:05:55 +0000 (12:05 -0500)]
Merge pull request #25554 from jan--f/25238-mimic

mimic ceph-volume: introduce class hierachy for strategies

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agorgw: sanitize customer encryption keys from log output in v4 auth 26003/head
Casey Bodley [Mon, 10 Dec 2018 17:38:01 +0000 (12:38 -0500)]
rgw: sanitize customer encryption keys from log output in v4 auth

Fixes: http://tracker.ceph.com/issues/37847
CVE-2018-16889

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 000797941fd303c3adc24f0089aeee0e902da205)

6 years agoceph-volume lvm.strategies remove unused import 25554/head
Alfredo Deza [Mon, 17 Dec 2018 18:34:58 +0000 (13:34 -0500)]
ceph-volume lvm.strategies remove unused import

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d127ae3e5901c6477ed44f4d50be834040c44b6f)

  Conflicts:
  src/ceph-volume/ceph_volume/devices/lvm/strategies/bluestore.py
          resolved by removing str_to_int import

6 years agoceph-volume: filestore strategy use strategy class hierarchy
Jan Fajerski [Mon, 26 Nov 2018 13:03:56 +0000 (14:03 +0100)]
ceph-volume: filestore strategy use strategy class hierarchy

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 34df12ea6a8686f161b4bdfde92e557743f59cf4)

6 years agoceph-volume: bluestore strategy use strategy class hierarchy
Jan Fajerski [Mon, 26 Nov 2018 13:03:03 +0000 (14:03 +0100)]
ceph-volume: bluestore strategy use strategy class hierarchy

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 302334ac6a4375125b6c1e68bf7160f8bc0597c2)

6 years agoceph-volume: add strategies.py to for shared code
Jan Fajerski [Mon, 26 Nov 2018 13:01:57 +0000 (14:01 +0100)]
ceph-volume: add strategies.py to for shared code

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit b38987ee9652527e4845f2beb6406cbd398dac9b)

6 years agomsg/async: do not force updating rotating keys inline 25958/head
xie xingguo [Tue, 15 Jan 2019 05:49:40 +0000 (13:49 +0800)]
msg/async: do not force updating rotating keys inline

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agomsg/async: fix mark_down vs accept race
xie xingguo [Tue, 15 Jan 2019 05:47:09 +0000 (13:47 +0800)]
msg/async: fix mark_down vs accept race

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agomsg/async: bump global_seq when retrying connection
xie xingguo [Tue, 15 Jan 2019 05:40:00 +0000 (13:40 +0800)]
msg/async: bump global_seq when retrying connection

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agomsg/async: unregister con from accept vs mark_down race
xie xingguo [Tue, 15 Jan 2019 05:36:12 +0000 (13:36 +0800)]
msg/async: unregister con from accept vs mark_down race

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agorbd: fix delay time calculation for trash move 25954/head
Mykola Golub [Thu, 10 Jan 2019 15:15:36 +0000 (15:15 +0000)]
rbd: fix delay time calculation for trash move

Fixes: https://tracker.ceph.com/issues/37861
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 947351e62644bc64f8215ee2ce47ff0264c732b1)

6 years agoMerge pull request #25923 from alfredodeza/mimic-ceph-volume-fix-json
Andrew Schoen [Fri, 11 Jan 2019 21:41:16 +0000 (15:41 -0600)]
Merge pull request #25923 from alfredodeza/mimic-ceph-volume-fix-json

mimic ceph-volume: fix JSON output in `inventory`

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume: fix JSON output in `inventory` 25923/head
Sebastian Wagner [Thu, 22 Nov 2018 17:01:50 +0000 (18:01 +0100)]
ceph-volume: fix JSON output in `inventory`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit a3e6f569b4fa0419dff4690a72e9be6fe0a255c1)

6 years agoMerge pull request #25819 from batrick/mimic-pr24562
Nathan Cutler [Fri, 11 Jan 2019 12:18:35 +0000 (13:18 +0100)]
Merge pull request #25819 from batrick/mimic-pr24562

doc: removed warning for resolved errata

Reviewed-by: John Wilkins <jowilkin@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agorgw: handle S3 version 2 pre-signed urls with meta-data 25899/head
Matt Benjamin [Fri, 19 Oct 2018 19:59:29 +0000 (15:59 -0400)]
rgw: handle S3 version 2 pre-signed urls with meta-data

Add CanonicalizedAmzHeaders to the v2 signing document, as required
in https://docs.aws.amazon.com/AmazonS3/latest/dev/RESTAuthentication.html

Also lift qs metadata into x_meta_map in RGWPutObj_ObjStore_S3::get_parms(),
so they are applied to the stored object.

Fixes: https://tracker.ceph.com/issues/23470
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 3b0480ed136cebd3fba2322a77c7d047ef6ad5e3)

6 years agorgw: distinguish parse_v4_credentials
Matt Benjamin [Fri, 19 Oct 2018 20:40:19 +0000 (16:40 -0400)]
rgw: distinguish parse_v4_credentials

The caller and callees of this method are v4-specific, and their
names contain a v4 infix.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit aa8c686da10ce1211a706f3519757045dfe34bed)

Conflicts:
src/rgw/rgw_auth_s3.cc
src/rgw/rgw_auth_s3.h
src/rgw/rgw_rest_s3.cc
  - Included v4 infix in 'parse_credentials()' and removed
    "session_token" param from definition, declaration and call
    of 'parse_v4_credentials()'.

6 years agoMerge pull request #25868 from dillaman/wip-37842-mimic
Jason Dillaman [Wed, 9 Jan 2019 22:17:20 +0000 (17:17 -0500)]
Merge pull request #25868 from dillaman/wip-37842-mimic

mimic: test/pybind/test_rbd: filter out unknown list_children2 keys

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agotest/pybind/test_rbd: filter out unknown list_children2 keys 25868/head
Mykola Golub [Tue, 8 Jan 2019 10:49:55 +0000 (12:49 +0200)]
test/pybind/test_rbd: filter out unknown list_children2 keys

Fixes: http://tracker.ceph.com/issues/37729
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 24cc60335d86ff625e0c5d98cab0c4449a24f296)

6 years agomgr: fix crash due to multiple sessions from daemons with same name 25864/head
Mykola Golub [Thu, 13 Dec 2018 11:12:14 +0000 (13:12 +0200)]
mgr: fix crash due to multiple sessions from daemons with same name

Don't assume perf counter instances are stable. If there are
multiple sessions from daemons reporting the same name (e.g. rgws),
the instances are cleared in DaemonServer::handle_open.
If the daemons have different counter names (for counters like
"objecter-0x55b6f4f1a630.op_active") it will throw out_of_range in
DaemonPerfCounters::update when accessing the instance removed by
another session.

The regression was introduced when adding avgcount support.

Fixes: https://tracker.ceph.com/issues/36244
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 5b6037aeb43aff90111fdae08807ddda290bc570)

6 years agoos/bluestore: KernelDevice::read() does the EIO mapping now. 25854/head
Radoslaw Zarzynski [Fri, 21 Dec 2018 11:22:20 +0000 (12:22 +0100)]
os/bluestore: KernelDevice::read() does the EIO mapping now.

Fixes: http://tracker.ceph.com/issues/36455
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit a1e0ece7f987c7a563b25ec0d02fc6f8445ef54e)

6 years agoqa/workunits/rados/test_health_warnings: prevent out osds 25850/head
Sage Weil [Mon, 31 Dec 2018 17:18:05 +0000 (11:18 -0600)]
qa/workunits/rados/test_health_warnings: prevent out osds

Fixes: http://tracker.ceph.com/issues/37776
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit d8d16ba6aa9b00379aac7d2732f60bfd68b20c0c)

6 years agomon: shutdown messenger early to avoid accessing deleted logger 25846/head
ningtao [Thu, 3 Jan 2019 15:20:12 +0000 (23:20 +0800)]
mon: shutdown messenger early to avoid accessing deleted logger

In the monitor shutdown process, the MSG thread exits after the logger is released,
causing the null pointer to be accessed. So move the logger release to the MSG thread after it exits

Fixes: http://tracker.ceph.com/issues/37780
Signed-off-by: ningtao <ningtao@sangfor.com.cn>
(cherry picked from commit 47da5a0caa7edec17ff4253e363571b78372506a)

6 years agomon/OSDMonitor: do not populate void pg_temp into nextmap 25844/head
xie xingguo [Fri, 4 Jan 2019 00:39:01 +0000 (08:39 +0800)]
mon/OSDMonitor: do not populate void pg_temp into nextmap

Due to commit ea723fb, pg_temp with clean acting set are added to inc map.
The original intent was to clear out pg_temps during priming, but as
written it would set a new_pg_temp item clearing the pg_temp even if one
didn't already exist.  Adding the up != acting condition in there makes us
only take that path if there is an existing pg_temp entry to remove.

Fixes: https://tracker.ceph.com/issues/37784
Signed-off-by: Aleksei Zakharov <zakharov.a.g@yandex.ru>
(cherry picked from commit b1d3ca5e78eaee509c923f06e9024c23cc6ce31a)

6 years agoMerge pull request #25837 from alfredodeza/mimic-rm37805
Andrew Schoen [Tue, 8 Jan 2019 20:18:29 +0000 (14:18 -0600)]
Merge pull request #25837 from alfredodeza/mimic-rm37805

mimic ceph-volume tests/functional declare ceph-ansible roles instead of importing them

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #25775 from alfredodeza/mimic-rm37442
Andrew Schoen [Tue, 8 Jan 2019 20:17:24 +0000 (14:17 -0600)]
Merge pull request #25775 from alfredodeza/mimic-rm37442

mimic ceph-volume normalize comma to dot for string to int conversions

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests/functional declare ceph-ansible roles instead of importing them 25837/head
Alfredo Deza [Mon, 7 Jan 2019 20:15:21 +0000 (15:15 -0500)]
ceph-volume tests/functional declare ceph-ansible roles instead of importing them

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit ad6b924e2bf3b06ec66eb5bc4fea065f5babc512)

6 years agoceph-volume tests.util ensure ints and strings with commas can be converted to ints 25775/head
Alfredo Deza [Wed, 2 Jan 2019 19:18:14 +0000 (14:18 -0500)]
ceph-volume tests.util ensure ints and strings with commas can be converted to ints

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 91bc3a1479c550be7b48128d5755228a2007e4b0)

6 years agoceph-volume test verify strings with a comma can be converted to ints
Alfredo Deza [Fri, 21 Dec 2018 20:26:39 +0000 (15:26 -0500)]
ceph-volume test verify strings with a comma can be converted to ints

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 818902e568adaefecc6da9afee58b3a804a0e4d0)

6 years agoceph-volume util normalize comma with dot for str-to-int conversion
Alfredo Deza [Fri, 21 Dec 2018 20:24:25 +0000 (15:24 -0500)]
ceph-volume util normalize comma with dot for str-to-int conversion

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit aa5323fbcfdc6c21177cb800884712b0252b84a0)

6 years agoMerge pull request #25777 from alfredodeza/mimic-rm37486
Andrew Schoen [Tue, 8 Jan 2019 15:39:24 +0000 (09:39 -0600)]
Merge pull request #25777 from alfredodeza/mimic-rm37486

mimic ceph-volume: set permissions right before prime-osd-dir

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests.functional fix typo when stopping osd.0 in filestore 25777/head
Alfredo Deza [Mon, 17 Dec 2018 17:35:27 +0000 (12:35 -0500)]
ceph-volume tests.functional fix typo when stopping osd.0 in filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit fba43289a2ff8a94361cc016e7a4dfdc61f324e8)

6 years agoceph-volume tests.functional.lvm stop all osds before activating again to test permis...
Alfredo Deza [Thu, 13 Dec 2018 14:49:41 +0000 (09:49 -0500)]
ceph-volume tests.functional.lvm stop all osds before activating again to test permissions

Otherwise, ``ceph-volume lvm activate --all`` will skip OSDs that are
already running. So the test that verifies that permissions are
corrected will fail because ``activate`` will simply skip them

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9be6b15d3316c8eab159bc5d374e95e23d082dde)

6 years agoceph-volume lvm.activate ensure filestore osd path is chowned always
Alfredo Deza [Thu, 13 Dec 2018 12:45:00 +0000 (07:45 -0500)]
ceph-volume lvm.activate ensure filestore osd path is chowned always

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7d6c32b5db0627d95c2ffb9428e86271daa4a336)

6 years agoceph-volume: include the ceph-facts role when needed during testing
Andrew Schoen [Wed, 12 Dec 2018 20:10:59 +0000 (14:10 -0600)]
ceph-volume: include the ceph-facts role when needed during testing

The ceph-ansible stable-3.2 branch does not have the ceph-facts role
but master does. We need to make sure to import this role only when
it's supported.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 569b4fb7b3894275a3b9f4ab603e32099301f9aa)