]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 years agoqa/suites/rados/singleton: more whitelist 19225/head
Kefu Chai [Wed, 29 Nov 2017 05:51:49 +0000 (13:51 +0800)]
qa/suites/rados/singleton: more whitelist

* SLOW_OPS is normal in a cluster with flattering OSDs
* so is OBJECT_MISPLACED.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #19154 from Fusl/master
Xie Xingguo [Mon, 27 Nov 2017 00:21:56 +0000 (08:21 +0800)]
Merge pull request #19154 from Fusl/master

doc: correcting typos in bluestore-config-ref and bluestore-migration

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agodoc: correcting typos in bluestore-config-ref and bluestore-migration 19154/head
Katie Holly [Sun, 26 Nov 2017 16:47:35 +0000 (17:47 +0100)]
doc: correcting typos in bluestore-config-ref and bluestore-migration

Signed-off-by: Katie Holly <git@meo.ws>
7 years agoMerge pull request #18961 from tchaikov/wip-rgw-print-iam-policy
Kefu Chai [Sun, 26 Nov 2017 09:53:18 +0000 (17:53 +0800)]
Merge pull request #18961 from tchaikov/wip-rgw-print-iam-policy

rgw: iam policy printing cleanups

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
7 years agoMerge pull request #19124 from tchaikov/wip-make-dist-boost
Kefu Chai [Sat, 25 Nov 2017 00:19:57 +0000 (08:19 +0800)]
Merge pull request #19124 from tchaikov/wip-make-dist-boost

make-dist,cmake: avoid re-downloading boost

Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge pull request #19081 from smithfarm/wip-ceph-volume-spec
Kefu Chai [Fri, 24 Nov 2017 15:49:56 +0000 (23:49 +0800)]
Merge pull request #19081 from smithfarm/wip-ceph-volume-spec

build/ops: rpm: fix systemd macros for ceph-volume@.service

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
7 years agoMerge pull request #19097 from tchaikov/wip-osd-prefix-inc
Kefu Chai [Fri, 24 Nov 2017 15:48:52 +0000 (23:48 +0800)]
Merge pull request #19097 from tchaikov/wip-osd-prefix-inc

osd: use prefix increment for non trivial iterator

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
7 years agoMerge pull request #19094 from tchaikov/wip-coverity-cid-1395794
Kefu Chai [Fri, 24 Nov 2017 15:48:14 +0000 (23:48 +0800)]
Merge pull request #19094 from tchaikov/wip-coverity-cid-1395794

msg/simple: pass a char for reading from shutdown_rd_fd

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
7 years agoMerge pull request #18997 from tchaikov/wip-rpm-cunit-for-suse
Nathan Cutler [Fri, 24 Nov 2017 14:08:13 +0000 (15:08 +0100)]
Merge pull request #18997 from tchaikov/wip-rpm-cunit-for-suse

rpm: build-depends on "cunit-devel" for suse

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
7 years agomake-dist: exclude unused bits in boost 19124/head
Kefu Chai [Fri, 24 Nov 2017 05:56:02 +0000 (13:56 +0800)]
make-dist: exclude unused bits in boost

the docs, examples and tests are not used. so drop them. we could go
further by removing unused components in boost. but that'd be an issue
if somebody added a component in CMakeLists but forgets to update this
script. also, we need to remove boost/$component and lib/$component to
achieve this goal. this also introduces extra complicity. so leave it
for another change.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #19127 from tchaikov/wip-mon-better-logging
Xie Xingguo [Fri, 24 Nov 2017 09:52:34 +0000 (17:52 +0800)]
Merge pull request #19127 from tchaikov/wip-mon-better-logging

mon/OSDMonitor: add space after __func__ in log msg

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agomon/OSDMonitor: add space after __func__ in log msg 19127/head
Kefu Chai [Fri, 24 Nov 2017 08:57:31 +0000 (16:57 +0800)]
mon/OSDMonitor: add space after __func__ in log msg

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agocmake: check bootstrap.sh instead before downloading boost
Kefu Chai [Fri, 24 Nov 2017 02:35:00 +0000 (10:35 +0800)]
cmake: check bootstrap.sh instead before downloading boost

config.hpp does not exist if boost is not configured. so a boost source
directory unpacked from dist tarball does not have this file. the
bootstrap.sh instead, it is used to create the necessary config files
for jam.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomake-dist: repackage boost in the correct path
Kefu Chai [Fri, 24 Nov 2017 02:27:19 +0000 (10:27 +0800)]
make-dist: repackage boost in the correct path

before this change, boost is put into ./src. after this change, it is
put into $outfile/src. i.e. something like
ceph-12.1.2-4592-gf5f2ced624/src .

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #19026 from badone/wip-selinux-policy-doc-rawhide-build
Boris Ranto [Thu, 23 Nov 2017 12:54:52 +0000 (13:54 +0100)]
Merge pull request #19026 from badone/wip-selinux-policy-doc-rawhide-build

build/ops: rpm: selinux-policy fixes

Reviewed - by: branto@redhat.com

7 years agoMerge pull request #18614 from tchaikov/wip-osd-mgrreport
Kefu Chai [Thu, 23 Nov 2017 07:01:01 +0000 (15:01 +0800)]
Merge pull request #18614 from tchaikov/wip-osd-mgrreport

osd,mgr: report slow requests and pending creating pgs to mgr

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #18890 from pjjw/pjjw/prom-deep-scrub-state-missing
Kefu Chai [Thu, 23 Nov 2017 06:06:16 +0000 (14:06 +0800)]
Merge pull request #18890 from pjjw/pjjw/prom-deep-scrub-state-missing

mgr/prometheus: add missing 'deep' state to PG_STATES in ceph-mgr prometheus plugin

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #19030 from tangwenjun3/wip-fix-bluefs-allocate
Kefu Chai [Thu, 23 Nov 2017 06:05:34 +0000 (14:05 +0800)]
Merge pull request #19030 from tangwenjun3/wip-fix-bluefs-allocate

os/bluestore: fix the allocate in bluefs

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
7 years agoMerge pull request #18785 from majianpeng/bluestore-remove-collection
Kefu Chai [Thu, 23 Nov 2017 06:04:07 +0000 (14:04 +0800)]
Merge pull request #18785 from majianpeng/bluestore-remove-collection

os/bluestore: avoid omit cache for remove-collection.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoMerge pull request #18760 from david-z/wip-mon-ceph-report
Kefu Chai [Thu, 23 Nov 2017 06:03:07 +0000 (14:03 +0800)]
Merge pull request #18760 from david-z/wip-mon-ceph-report

mon: dump servicemap along with MgrStatMonitor dump info

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #17596 from amitkumar50/cov-message-10
Kefu Chai [Thu, 23 Nov 2017 06:01:42 +0000 (14:01 +0800)]
Merge pull request #17596 from amitkumar50/cov-message-10

messages: Silence uninitialized member warnings

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoqa: silence SLOW_OPS,PENDING_CREATING_PGS warnings 18614/head
Kefu Chai [Thu, 23 Nov 2017 04:56:31 +0000 (12:56 +0800)]
qa: silence SLOW_OPS,PENDING_CREATING_PGS warnings

this is an intermediate step to deprecate REQUEST_SLOW warnings.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomgr: summarize osd metrics in MMgrReport and sent it to mon
Kefu Chai [Wed, 1 Nov 2017 15:17:57 +0000 (23:17 +0800)]
mgr: summarize osd metrics in MMgrReport and sent it to mon

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge PR #18697 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:40:21 +0000 (13:40 -0800)]
Merge PR #18697 into master

* refs/pull/18697/head:
mds: limit size of MExportDir message
mds: optimize MDCache::try_subtree_merge
mds: optimize import/export state access

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #18748 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:40:14 +0000 (13:40 -0800)]
Merge PR #18748 into master

* refs/pull/18748/head:
client/Client.cc: trivial [Cleanup] Stop different types comparison

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge PR #18787 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:40:07 +0000 (13:40 -0800)]
Merge PR #18787 into master

* refs/pull/18787/head:
mds: prevent filelock from being stuck at XSYN state
mds: implement LOCK_XSYN_LOCK and LOCK_XSYN_MIX
mds: cleanup set/drop loner code

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #18818 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:39:59 +0000 (13:39 -0800)]
Merge PR #18818 into master

* refs/pull/18818/head:
libceph: Avoiding divide by zero

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge PR #18942 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:39:53 +0000 (13:39 -0800)]
Merge PR #18942 into master

* refs/pull/18942/head:
mds: lookup snapped inodes by vinodeno_t

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #19007 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:39:46 +0000 (13:39 -0800)]
Merge PR #19007 into master

* refs/pull/19007/head:
src/libcephfs.cc: Cleanup nullptr initializations against deleted objects, etc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
7 years agoMerge PR #19014 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:39:40 +0000 (13:39 -0800)]
Merge PR #19014 into master

* refs/pull/19014/head:
mds: properly execute scrub finish context

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #19018 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:39:32 +0000 (13:39 -0800)]
Merge PR #19018 into master

* refs/pull/19018/head:
mds: don't delay processing completed requests in replay queue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #19060 into master
Patrick Donnelly [Wed, 22 Nov 2017 21:39:19 +0000 (13:39 -0800)]
Merge PR #19060 into master

* refs/pull/19060/head:
client: anchor Inode while trimming caps

Reviewed-by: Zheng Yan <zyan@redhat.com>
7 years agoMerge pull request #19102 from jecluis/wip-qa-find-used-ports
Sage Weil [Wed, 22 Nov 2017 20:34:34 +0000 (14:34 -0600)]
Merge pull request #19102 from jecluis/wip-qa-find-used-ports

qa: add simple and dirty script to find ports being used

7 years agoMerge pull request #19044 from idryomov/wip-resurrect-msg-auth
Ilya Dryomov [Wed, 22 Nov 2017 17:43:25 +0000 (18:43 +0100)]
Merge pull request #19044 from idryomov/wip-resurrect-msg-auth

msg: resurrect support for !CEPH_FEATURE_MSG_AUTH

Reviewed-by: Haomai Wang <haomai@xsky.com>
7 years agoqa: add simple and dirty script to find ports being used 19102/head
Joao Eduardo Luis [Wed, 22 Nov 2017 16:58:34 +0000 (16:58 +0000)]
qa: add simple and dirty script to find ports being used

Seriously, having this is way better than realizing that one needs to
find an unused port each time a new test is created.

It's far from a perfect script. It's downright not elegant.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
7 years agoMerge pull request #19082 from trociny/wip-qa-demote-fixup
Jason Dillaman [Wed, 22 Nov 2017 16:26:38 +0000 (11:26 -0500)]
Merge pull request #19082 from trociny/wip-qa-demote-fixup

qa/workunits/rbd: wait for status propagated only if daemon started

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agoosd: use prefix increment for non trivial iterator 19097/head
Kefu Chai [Wed, 22 Nov 2017 08:25:18 +0000 (16:25 +0800)]
osd: use prefix increment for non trivial iterator

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomds: limit size of MExportDir message 18697/head
Yan, Zheng [Fri, 3 Nov 2017 06:14:07 +0000 (14:14 +0800)]
mds: limit size of MExportDir message

Only export port of subtree if whole subtree tree is too large for
sinlge MExportDir message. The un-exported portion are added to
export queue.

Fixes: http://tracker.ceph.com/issues/21892
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
7 years agomds: optimize MDCache::try_subtree_merge
Yan, Zheng [Fri, 3 Nov 2017 08:13:32 +0000 (16:13 +0800)]
mds: optimize MDCache::try_subtree_merge

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
7 years agoMerge pull request #19067 from tchaikov/wip-nvme-mgr-fixes
Kefu Chai [Wed, 22 Nov 2017 07:03:16 +0000 (15:03 +0800)]
Merge pull request #19067 from tchaikov/wip-nvme-mgr-fixes

bluestore/NVMEDevice: do not deference a dangling pointer

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
7 years agobuild/ops: rpm: selinux-policy fixes 19026/head
Brad Hubbard [Fri, 17 Nov 2017 01:54:38 +0000 (11:54 +1000)]
build/ops: rpm: selinux-policy fixes

Requiring the file /usr/share/selinux/devel/policyhelp breaks fc27 and
Rawhide builds as they do not have that file. This exposed the fact this
code had not worked in some time due to changes in selinux policy
modules packaging. See
https://bugzilla.redhat.com/show_bug.cgi?id=999584

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoMerge pull request #19035 from ifed01/wip-ifed-rep-backend-speedup
Kefu Chai [Wed, 22 Nov 2017 06:50:44 +0000 (14:50 +0800)]
Merge pull request #19035 from ifed01/wip-ifed-rep-backend-speedup

osd: make operations on ReplicatedBackend::in_progress_ops more effective

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoMerge pull request #17799 from amitkumar50/cov-misc-7
Kefu Chai [Wed, 22 Nov 2017 06:44:24 +0000 (14:44 +0800)]
Merge pull request #17799 from amitkumar50/cov-misc-7

osd,messages: Initialize read_length,options,send_reply

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #17792 from amitkumar50/cov-misc-5
Kefu Chai [Wed, 22 Nov 2017 06:44:06 +0000 (14:44 +0800)]
Merge pull request #17792 from amitkumar50/cov-misc-5

messages,journal: Initialization of stats_period,m_active_set

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #17772 from amitkumar50/cov-misc-3
Kefu Chai [Wed, 22 Nov 2017 06:42:58 +0000 (14:42 +0800)]
Merge pull request #17772 from amitkumar50/cov-misc-3

client,osd,test: Initialize fuse_req_key,snap,who,seq

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #17767 from amitkumar50/cov-misc-2
Kefu Chai [Wed, 22 Nov 2017 06:42:32 +0000 (14:42 +0800)]
Merge pull request #17767 from amitkumar50/cov-misc-2

messages,test,msg: initialize h,reply_type,owner

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #17766 from amitkumar50/cov-misc-1
Kefu Chai [Wed, 22 Nov 2017 06:42:03 +0000 (14:42 +0800)]
Merge pull request #17766 from amitkumar50/cov-misc-1

common,os: initialize commit_data,cmount,iocb

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #17443 from JiYou/restapi-default-port
Kefu Chai [Wed, 22 Nov 2017 06:40:56 +0000 (14:40 +0800)]
Merge pull request #17443 from JiYou/restapi-default-port

ceph-rest-api: when port=0 use the DEFAULT_PORT instead

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #17085 from yaozongyou/remove_unused_using
Kefu Chai [Wed, 22 Nov 2017 05:25:41 +0000 (13:25 +0800)]
Merge pull request #17085 from yaozongyou/remove_unused_using

librgw_file: remove unused `using` statement.

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agomsg/simple: pass a char for reading from shutdown_rd_fd 19094/head
Kefu Chai [Wed, 22 Nov 2017 04:57:18 +0000 (12:57 +0800)]
msg/simple: pass a char for reading from shutdown_rd_fd

Fixes the coverity issue:

> CID 1395794 (#1 of 1): Wrong size argument (SIZEOF_MISMATCH)
> suspicious_sizeof: Passing argument &ch of type int * and
> argument 1UL to function read is suspicious because sizeof
> (int) /*4*/ is expected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #19017 from tchaikov/wip-bluestore-without-aio
Kefu Chai [Wed, 22 Nov 2017 04:26:34 +0000 (12:26 +0800)]
Merge pull request #19017 from tchaikov/wip-bluestore-without-aio

bluestore,cmake: enable building bluestore without aio

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoMerge pull request #19029 from tchaikov/wip-cmake-sysctl-cleanup
Kefu Chai [Wed, 22 Nov 2017 04:23:48 +0000 (12:23 +0800)]
Merge pull request #19029 from tchaikov/wip-cmake-sysctl-cleanup

cmake: only create sysctl file on linux

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge pull request #19072 from smithfarm/wip-22207
Kefu Chai [Wed, 22 Nov 2017 03:12:15 +0000 (11:12 +0800)]
Merge pull request #19072 from smithfarm/wip-22207

tests: ceph-disk: ignore E722 in flake8 test

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge PR #17678 into master
Patrick Donnelly [Tue, 21 Nov 2017 21:49:24 +0000 (13:49 -0800)]
Merge PR #17678 into master

* refs/pull/17678/head:
mon/AuthMonitor: improve error message
mon/OSDMonitor: disallow "all" as a key or value name
cephfs, mon/AuthMonitor, OSD/osdcap: make 'all' a synonym for '*'
vstart.sh: Create an admin user for each CephFS
mon/AuthMonitor: Allow * wildcard for filesystem name
OSD/OSDCap: Allow namespace and pool tag to be combined
OSD/OSDCap: Namespace globbing
mon/AuthMonitor: Use new osd auth caps for ceph fs authorize
OSD/auth caps: Add OSD auth caps based on pool tag
mon/FSCommands: Tag pools used for cephfs by default
mon/OSDMonitor: Add key/value arguments for pool tagging

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agobuild/ops: rpm: fix systemd macros for ceph-volume@.service 19081/head
Nathan Cutler [Tue, 21 Nov 2017 20:32:57 +0000 (21:32 +0100)]
build/ops: rpm: fix systemd macros for ceph-volume@.service

Fixes: http://tracker.ceph.com/issues/22217
Signed-off-by: Nathan Cutler <ncutler@suse.com>
7 years agoqa/workunits/rbd: wait for status propagated only if daemon started 19082/head
Mykola Golub [Tue, 21 Nov 2017 20:29:16 +0000 (22:29 +0200)]
qa/workunits/rbd: wait for status propagated only if daemon started

Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoMerge pull request #19000 from dillaman/wip-15322
Mykola Golub [Tue, 21 Nov 2017 19:21:41 +0000 (21:21 +0200)]
Merge pull request #19000 from dillaman/wip-15322

rbd-mirror: removed dedicated thread from image deleter

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoMerge pull request #17072 from rzarzynski/wip-rgw-21015
Yehuda Sadeh [Tue, 21 Nov 2017 18:23:27 +0000 (13:23 -0500)]
Merge pull request #17072 from rzarzynski/wip-rgw-21015

rgw: incorporate the Transfer-Encoding fix for CivetWeb.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #19073 from trociny/wip-qa-demote
Jason Dillaman [Tue, 21 Nov 2017 17:52:08 +0000 (12:52 -0500)]
Merge pull request #19073 from trociny/wip-qa-demote

qa/workunits/rbd: wait for demote status is propagated

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #19075 from tchaikov/wip-22154
Andrew Schoen [Tue, 21 Nov 2017 15:42:30 +0000 (09:42 -0600)]
Merge pull request #19075 from tchaikov/wip-22154

qa/workunits: silence py warnings for ceph-disk tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agorbd-mirror: fix possible race condition in error path tests 19000/head
Jason Dillaman [Tue, 21 Nov 2017 15:08:13 +0000 (10:08 -0500)]
rbd-mirror: fix possible race condition in error path tests

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #19064 from qrGitHub/wip-rgw-typo-refity
Sage Weil [Tue, 21 Nov 2017 14:35:09 +0000 (08:35 -0600)]
Merge pull request #19064 from qrGitHub/wip-rgw-typo-refity

rgw: correct typo refity to refit

Reviewed-by: Amit Kumar <amitkuma@redhat.com>
7 years agorbd-mirror: removed dedicated thread from image deleter
Jason Dillaman [Fri, 17 Nov 2017 18:01:56 +0000 (13:01 -0500)]
rbd-mirror: removed dedicated thread from image deleter

Fixes: http://tracker.ceph.com/issues/15322
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agorbd-mirror: image deleter now takes a librados::IoCtx shared pointer
Jason Dillaman [Fri, 17 Nov 2017 20:51:14 +0000 (15:51 -0500)]
rbd-mirror: image deleter now takes a librados::IoCtx shared pointer

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agorbd-mirror: move image deletion to standalone state machine
Jason Dillaman [Thu, 16 Nov 2017 21:59:33 +0000 (16:59 -0500)]
rbd-mirror: move image deletion to standalone state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agorbd-mirror: move snap purge to standalone state machine
Jason Dillaman [Thu, 16 Nov 2017 20:34:04 +0000 (15:34 -0500)]
rbd-mirror: move snap purge to standalone state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agolibrbd: ensure deep-copy can remove an unprotected snapshot
Jason Dillaman [Thu, 16 Nov 2017 20:39:24 +0000 (15:39 -0500)]
librbd: ensure deep-copy can remove an unprotected snapshot

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agocls/rbd: added async version of get_snapcontext
Jason Dillaman [Thu, 16 Nov 2017 21:46:11 +0000 (16:46 -0500)]
cls/rbd: added async version of get_snapcontext

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #18790 from amitkumar50/cov-rbd-6
Jason Dillaman [Tue, 21 Nov 2017 13:51:03 +0000 (08:51 -0500)]
Merge pull request #18790 from amitkumar50/cov-rbd-6

rbd: null check before pool_name use

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agorbd: null check before pool_name use 18790/head
amitkuma [Tue, 7 Nov 2017 18:26:02 +0000 (23:56 +0530)]
rbd: null check before pool_name use

Fixes the coverity issue:

CID 1394846 (#1 of 1): Dereference after null check (FORWARD_NULL)
15. var_deref_model: Passing null pointer pool_name to regex_match,
which dereferences it.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
7 years agoqa/workunits: silence py warnings for ceph-disk tests 19075/head
Kefu Chai [Tue, 21 Nov 2017 13:47:30 +0000 (21:47 +0800)]
qa/workunits: silence py warnings for ceph-disk tests

ceph-disk now prints "depreacted" warning message when it starts. but
the tests parses its stdout and stderr for a json string. so we need to
silence the warnings for the tests.

Fixes: http://tracker.ceph.com/issues/22154
Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoos/bluestore: fix the allocate in bluefs 19030/head
tangwenjun [Mon, 20 Nov 2017 07:28:29 +0000 (15:28 +0800)]
os/bluestore: fix the allocate in bluefs

when bluefs succeed to reserve but failed to alloc in db space,

it will cause a assert, just because of the space fragmentation.

in this situation, it could not use slow device space,

and it would happen in stupid or avl allocator.

Signed-off-by: tangwenjun <tang.wenjun3@zte.com.cn>
7 years agoqa/workunits/rbd: wait for demote status is propagated 19073/head
Mykola Golub [Tue, 21 Nov 2017 11:16:57 +0000 (13:16 +0200)]
qa/workunits/rbd: wait for demote status is propagated

(before promoting the image on another cluster)

Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoMerge pull request #19045 from dillaman/wip-22200
Mykola Golub [Tue, 21 Nov 2017 10:48:34 +0000 (12:48 +0200)]
Merge pull request #19045 from dillaman/wip-22200

rbd: disk usage on empty pool no longer returns an error message

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agotests: ceph-disk: ignore E722 in flake8 test 19072/head
Nathan Cutler [Tue, 21 Nov 2017 10:36:02 +0000 (11:36 +0100)]
tests: ceph-disk: ignore E722 in flake8 test

Very old, and very new, versions of flake8 treat E722 as an error:

flake8 runtests: commands[0] | flake8 --ignore=H105,H405,E127 ceph_disk tests
ceph_disk/main.py:1575:9: E722 do not use bare except'
ceph_disk/main.py:1582:9: E722 do not use bare except'
ceph_disk/main.py:3252:5: E722 do not use bare except'
ceph_disk/main.py:3288:21: E722 do not use bare except'
ceph_disk/main.py:3296:17: E722 do not use bare except'
ceph_disk/main.py:4358:5: E722 do not use bare except'
tests/test_main.py:26:1: E722 do not use bare except'
ERROR: InvocationError: '/opt/j/ws/mkck/src/ceph-disk/.tox/flake8/bin/flake8 --ignore=H105,H405,E127 ceph_disk tests'

Fixes: http://tracker.ceph.com/issues/22207
References: https://gitlab.com/pycqa/flake8/issues/361

Signed-off-by: Nathan Cutler <ncutler@suse.com>
7 years agocmake: BuildDPDK: use ${CMAKE_MAKE_PROGRAM} when appropriate 19017/head
Kefu Chai [Tue, 21 Nov 2017 09:45:44 +0000 (17:45 +0800)]
cmake: BuildDPDK: use ${CMAKE_MAKE_PROGRAM} when appropriate

DPDK requires GNU Make. see
spdk/dpdk/doc/guides/freebsd_gsg/build_dpdk.rst. so, we should use the
configured make program to do the job.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomon/health_check: s/std::list/list/
Kefu Chai [Thu, 9 Nov 2017 13:37:11 +0000 (21:37 +0800)]
mon/health_check: s/std::list/list/

so it's self-contained, and .cc files including it are not obliged to `using namespace std`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoosd: send health-checks to mgr
Kefu Chai [Mon, 23 Oct 2017 04:29:31 +0000 (12:29 +0800)]
osd: send health-checks to mgr

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agocmake: BuildDPDK: use POSIX compliant syntax
Kefu Chai [Tue, 21 Nov 2017 02:52:50 +0000 (10:52 +0800)]
cmake: BuildDPDK: use POSIX compliant syntax

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoosd: remember is_primary when adding pending creating pgs
Kefu Chai [Sun, 29 Oct 2017 11:07:54 +0000 (19:07 +0800)]
osd: remember is_primary when adding pending creating pgs

so mgr can avoid calculating the same PG from different OSDs.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agocommon/OpTracker: refactor check_ops_in_flight()
Kefu Chai [Fri, 27 Oct 2017 08:55:14 +0000 (16:55 +0800)]
common/OpTracker: refactor check_ops_in_flight()

* add a function visit_ops_in_flight() so it accepts a std::function,
  which can be applied to all ops in flight. and is used to count
  slow ops. the # of slow ops will be sent to mgr.
* add a function with_slow_ops_in_flight(), so we can use it to
  implement command like "dump_slow_ops_in_flight". unlike the
  existing feature which dumps slow ops to clog periodically, it
  will dump the slow ops on demand. and backoff the warning
  interval only when the slow ops are dumped.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomgr/MgrClient: send health_checks using MMgrReport
Kefu Chai [Tue, 24 Oct 2017 14:41:30 +0000 (22:41 +0800)]
mgr/MgrClient: send health_checks using MMgrReport

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agobluestore/NVMEDevice: do not deference a dangled pointer 19067/head
Kefu Chai [Tue, 21 Nov 2017 07:09:22 +0000 (15:09 +0800)]
bluestore/NVMEDevice: do not deference a dangled pointer

* pass coremask_arg to the working thread by value.
  after 81249ab9d, get_val<>() returns a temporary variables instead of a
  reference to the variant held by config. so calling string::c_str(), and
  passing the returned `const char*` to a thread is not advisable. instead
  we should pass a string by value. since spdk_env_init() will copy the
  settings passed in by opt. it's safe even to destruct the coremask_arg
  afterward.
* use ffsll() to find the LSB. it's not a bottleneck, but it's easier
  and simpler, and probably improves the readability.
* refactor the NVMEManager::try_get() method: to define the variables
  when they are used for the first time.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge PR #18274 into master
Patrick Donnelly [Tue, 21 Nov 2017 05:48:12 +0000 (21:48 -0800)]
Merge PR #18274 into master

* refs/pull/18274/head:
mds: fold mds_revoke_cap_timeout into mds_session_timeout
client: add new delegation testcases
client: add delegation support for cephfs
common: remove data_dir_option from common_preinit and global_pre_init

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agorgw: correct typo refity to refit 19064/head
Bingyin Zhang [Tue, 21 Nov 2017 03:40:17 +0000 (11:40 +0800)]
rgw: correct typo refity to refit

Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
7 years agoclient: anchor Inode while trimming caps 19060/head
Patrick Donnelly [Sun, 19 Nov 2017 23:08:18 +0000 (15:08 -0800)]
client: anchor Inode while trimming caps

This prevents the Inode from being deleted until after cap trimming is
finished. In particular, this prevents remove_all_caps from being called which
screws up the traversal of caps in trim_caps.

Fixes: http://tracker.ceph.com/issues/22157
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #18710 from com6056/wip-doc-fix-cephfs-snap-dir
Gregory Farnum [Tue, 21 Nov 2017 00:46:44 +0000 (16:46 -0800)]
Merge pull request #18710 from com6056/wip-doc-fix-cephfs-snap-dir

doc: Fixes the name of the CephFS snapshot directory.

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years agoMerge pull request #10992 from zhangsw/fix-rgw-cache-bug
Yuri Weinstein [Mon, 20 Nov 2017 22:30:13 +0000 (14:30 -0800)]
Merge pull request #10992 from zhangsw/fix-rgw-cache-bug

rgw: fix a bug in rgw cache in delete_system_obj and get_system_obj.

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
7 years agomon/AuthMonitor: improve error message 17678/head
Douglas Fuller [Mon, 20 Nov 2017 18:12:08 +0000 (13:12 -0500)]
mon/AuthMonitor: improve error message

Improve the error message for 'ceph fs authorize' where the
given entity exists but has different auth caps.

Fixes: http://tracker.ceph.com/issues/21765
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
7 years agoMerge pull request #19011 from trociny/wip-mirror-missing-lock
Jason Dillaman [Mon, 20 Nov 2017 18:22:36 +0000 (13:22 -0500)]
Merge pull request #19011 from trociny/wip-mirror-missing-lock

rbd-mirror: missing lock when re-sending update_sync_point

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #19016 from trociny/wip-valgrind-unittest_rbd_mirror
Jason Dillaman [Mon, 20 Nov 2017 18:16:23 +0000 (13:16 -0500)]
Merge pull request #19016 from trociny/wip-valgrind-unittest_rbd_mirror

test/rbd_mirror: fix valgrind warnings in unittest

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #18799 from ivancich/wip-remove-StreamObjData
Casey Bodley [Mon, 20 Nov 2017 18:02:23 +0000 (13:02 -0500)]
Merge pull request #18799 from ivancich/wip-remove-StreamObjData

rgw clean-up: remove unreferenced pure virtual class StreamObjData

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
7 years agoMerge PR #19022 into master
Patrick Donnelly [Mon, 20 Nov 2017 17:52:33 +0000 (09:52 -0800)]
Merge PR #19022 into master

* refs/pull/19022/head:
githubmap: Add oritwas

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agorbd: disk usage on empty pool no longer returns an error message 19045/head
Jason Dillaman [Mon, 20 Nov 2017 16:03:17 +0000 (11:03 -0500)]
rbd: disk usage on empty pool no longer returns an error message

Fixes: http://tracker.ceph.com/issues/22200
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agomsg/simple/Pipe: resurrect support for !CEPH_FEATURE_MSG_AUTH 19044/head
Ilya Dryomov [Mon, 20 Nov 2017 15:27:20 +0000 (16:27 +0100)]
msg/simple/Pipe: resurrect support for !CEPH_FEATURE_MSG_AUTH

Revert CEPH_FEATURE_MSG_AUTH-related hunks of commit 7ba4d5324e2d
("msg/simple/Pipe: remove legacy feature case handle"), which
removed code that handled !CEPH_FEATURE_MSG_AUTH footers.  It's needed
for kernels prior to 3.19, where cephx signatures aren't supported.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
7 years agoMerge pull request #18987 from ivancich/wip-remove-sys-obj-get-state
Casey Bodley [Mon, 20 Nov 2017 15:48:01 +0000 (10:48 -0500)]
Merge pull request #18987 from ivancich/wip-remove-sys-obj-get-state

rgw clean-up: remove unused var & func in RGWRados::SystemObject

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
7 years agomsg/async/AsyncConnection: resurrect support for !CEPH_FEATURE_MSG_AUTH
Ilya Dryomov [Mon, 20 Nov 2017 15:23:15 +0000 (16:23 +0100)]
msg/async/AsyncConnection: resurrect support for !CEPH_FEATURE_MSG_AUTH

Revert CEPH_FEATURE_MSG_AUTH-related hunks of commit 83f7e392a163
("msg/async/AsyncConnection: remove legacy feature case handle"), which
removed code that handled !CEPH_FEATURE_MSG_AUTH footers.  It's needed
for kernels prior to 3.19, where cephx signatures aren't supported.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
7 years agoMerge pull request #18173 from gmayyyha/osd-status-21707
John Spray [Mon, 20 Nov 2017 15:35:09 +0000 (15:35 +0000)]
Merge pull request #18173 from gmayyyha/osd-status-21707

mgr: fix "osd status" command exception if OSD not in pgmap stats

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #19024 from tchaikov/wip-21474
Kefu Chai [Mon, 20 Nov 2017 14:54:27 +0000 (22:54 +0800)]
Merge pull request #19024 from tchaikov/wip-21474

qa/tasks: prolong revive_osd() timeout to 6 min

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18667 from Leeshine/wip-rgw-bug-21615
Casey Bodley [Mon, 20 Nov 2017 14:15:04 +0000 (09:15 -0500)]
Merge pull request #18667 from Leeshine/wip-rgw-bug-21615

rgw: radosgw-admin zonegroup get and zone get return defaults when there is no realm

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>