]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoceph_test_objectstore: fix Rename test 12261/head
Sage Weil [Thu, 1 Dec 2016 16:57:17 +0000 (11:57 -0500)]
ceph_test_objectstore: fix Rename test

We were doing a no-op setattr here, even though the intenral
ENOENT used to be ignored, because it previously triggered a
bug in bluestore.  We're no longer ignoring that internal
error, though, as of 6ecb44f0c6216f3fb29b384a2d10c7d33bf1d19c,
so remove this part of the test.

The original bluestore bug we used to trigger was fixed by
0210f1fde6f8e17affdd0c49055a71a01f109447.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #10086 from Yan-waller/yj-wip-rgwrests3ccstringfind
Yehuda Sadeh [Thu, 1 Dec 2016 16:55:42 +0000 (08:55 -0800)]
Merge pull request #10086 from Yan-waller/yj-wip-rgwrests3ccstringfind

rgw: conform to the standard usage of string::find

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #12229 from cbodley/wip-rgw-bucket-sync-status-assert
Yehuda Sadeh [Thu, 1 Dec 2016 15:41:13 +0000 (07:41 -0800)]
Merge pull request #12229 from cbodley/wip-rgw-bucket-sync-status-assert

rgw: RGWBucketSyncStatusManager uses existing async_rados

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #12254 from Adirl/disconnect_log
Haomai Wang [Thu, 1 Dec 2016 15:20:52 +0000 (23:20 +0800)]
Merge pull request #12254 from Adirl/disconnect_log

msg/async/rdma: fix disconnect log line

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #9846 from stiopaa1/msg_asyncmess_removeUnneededInclude
Haomai Wang [Thu, 1 Dec 2016 15:18:34 +0000 (23:18 +0800)]
Merge pull request #9846 from stiopaa1/msg_asyncmess_removeUnneededInclude

msg/AsyncMessenger: remove unneeded include

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #12246 from tchaikov/wip-17809
Sage Weil [Thu, 1 Dec 2016 15:17:19 +0000 (10:17 -0500)]
Merge pull request #12246 from tchaikov/wip-17809

buffer: add copy(unsigned, ptr) back

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12206 from jdurgin/wip-librados-setxattr-overload
Sage Weil [Thu, 1 Dec 2016 15:15:32 +0000 (10:15 -0500)]
Merge pull request #12206 from jdurgin/wip-librados-setxattr-overload

librados: remove new setxattr overload to avoid breaking the C++ ABI

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12234 from liewegas/wip-17942-again
Sage Weil [Thu, 1 Dec 2016 15:14:28 +0000 (10:14 -0500)]
Merge pull request #12234 from liewegas/wip-17942-again

osdc/Objecter: fix relock race

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #12228 from ceph/wip-jlayton-umount
jtlayton [Thu, 1 Dec 2016 15:00:47 +0000 (10:00 -0500)]
Merge pull request #12228 from ceph/wip-jlayton-umount

libcephfs and test suite fixes

8 years agomsg/async/rdma: fix disconnect log line 12254/head
Adir Lev [Thu, 1 Dec 2016 13:00:15 +0000 (15:00 +0200)]
msg/async/rdma: fix disconnect log line

issue: none

Change-Id: I29e2a6ae78dda3cf4a1817b9ab41bea0f636bda5
Signed-off-by: Adir Lev <adirl@mellanox.com>
8 years agoMerge pull request #12222 from dillaman/wip-18070
Mykola Golub [Thu, 1 Dec 2016 13:19:44 +0000 (15:19 +0200)]
Merge pull request #12222 from dillaman/wip-18070

rbd-nbd: restart parent process logger after forking

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agobuffer: add copy(unsigned, ptr) back 12246/head
Kefu Chai [Thu, 1 Dec 2016 03:01:14 +0000 (11:01 +0800)]
buffer: add copy(unsigned, ptr) back

to be ABI-compatible with prior versions.

copy(unsigned, ptr) was renamed to copy_deep() in 6d7f748

Fixes: http://tracker.ceph.com/issues/17809
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #12244 from ceph/wip-rgw-compression-doc
Yehuda Sadeh [Thu, 1 Dec 2016 02:31:41 +0000 (18:31 -0800)]
Merge pull request #12244 from ceph/wip-rgw-compression-doc

doc: add docs for raw compression

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #12113 from ceph/wip-rgw-zone-compression
Yehuda Sadeh [Thu, 1 Dec 2016 02:29:02 +0000 (18:29 -0800)]
Merge pull request #12113 from ceph/wip-rgw-zone-compression

rgw: move compression config into zone placement

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #12232 from liewegas/wip-rgw-lclist
Yehuda Sadeh [Thu, 1 Dec 2016 02:16:16 +0000 (18:16 -0800)]
Merge pull request #12232 from liewegas/wip-rgw-lclist

rgw: need to close_section in lc list op

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agorgw: remove config option rgw_compression_type 12113/head
Casey Bodley [Mon, 21 Nov 2016 18:22:02 +0000 (13:22 -0500)]
rgw: remove config option rgw_compression_type

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agorgw: ops use zone placement's compression type
Casey Bodley [Mon, 21 Nov 2016 18:21:07 +0000 (13:21 -0500)]
rgw: ops use zone placement's compression type

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoradosgw-admin: add --compression for zone placement add/modify
Casey Bodley [Wed, 30 Nov 2016 18:09:35 +0000 (13:09 -0500)]
radosgw-admin: add --compression for zone placement add/modify

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agorgw: add compression_type field to RGWZonePlacementInfo
Casey Bodley [Wed, 30 Nov 2016 14:45:14 +0000 (09:45 -0500)]
rgw: add compression_type field to RGWZonePlacementInfo

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12105 from cbodley/wip-rgw-curl-upload
Matt Benjamin [Wed, 30 Nov 2016 21:39:00 +0000 (16:39 -0500)]
Merge pull request #12105 from cbodley/wip-rgw-curl-upload

rgw: dont set CURLOPT_UPLOAD for GET requests

8 years agoMerge pull request #12242 from cbodley/wip-rgw-admin-placement
Matt Benjamin [Wed, 30 Nov 2016 21:38:22 +0000 (16:38 -0500)]
Merge pull request #12242 from cbodley/wip-rgw-admin-placement

radosgw-admin: more on placement configuration

8 years agodoc: add docs for rgw compression 12244/head
Casey Bodley [Mon, 21 Nov 2016 21:10:02 +0000 (16:10 -0500)]
doc: add docs for rgw compression

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12185 from xiexingguo/xxg-wip-bluestore-1125
Sage Weil [Wed, 30 Nov 2016 20:19:33 +0000 (15:19 -0500)]
Merge pull request #12185 from xiexingguo/xxg-wip-bluestore-1125

os/bluestore: drop member "space" from Onode

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoradosgw-admin: 'zone placement modify' doesnt require pool names 12242/head
Casey Bodley [Wed, 30 Nov 2016 19:36:38 +0000 (14:36 -0500)]
radosgw-admin: 'zone placement modify' doesnt require pool names

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoradosgw-admin: add 'zonegroup placement default' command
Casey Bodley [Wed, 30 Nov 2016 18:43:28 +0000 (13:43 -0500)]
radosgw-admin: add 'zonegroup placement default' command

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoradosgw-admin: fix 'placment' typos
Casey Bodley [Wed, 30 Nov 2016 18:08:38 +0000 (13:08 -0500)]
radosgw-admin: fix 'placment' typos

Fixes: http://tracker.ceph.com/issues/18078
Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12230 from yehudasa/wip-18078
Casey Bodley [Wed, 30 Nov 2016 17:21:10 +0000 (12:21 -0500)]
Merge pull request #12230 from yehudasa/wip-18078

rgw-admin: new commands to control placement

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agorgw_admin: commands to manage placement targets 12230/head
Yehuda Sadeh [Tue, 29 Nov 2016 22:55:52 +0000 (14:55 -0800)]
rgw_admin: commands to manage placement targets

Fixes: http://tracker.ceph.com/issues/18078
added the following commands:

 radosgw-admin zone placement add
 radosgw-admin zone placement modify
 radosgw-admin zone placement rm
 radosgw-admin zone placement list

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agorgw-admin: add commands to manage zonegroup placement fields
Yehuda Sadeh [Tue, 29 Nov 2016 22:15:09 +0000 (14:15 -0800)]
rgw-admin: add commands to manage zonegroup placement fields

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #12236 from gongchuang/gc-wip-1130
Haomai Wang [Wed, 30 Nov 2016 15:35:07 +0000 (23:35 +0800)]
Merge pull request #12236 from gongchuang/gc-wip-1130

msg/async/rdma: fixup memory free

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #12138 from oritwas/wip-rgw-doc-upgrade-region-pool
Casey Bodley [Wed, 30 Nov 2016 14:50:45 +0000 (09:50 -0500)]
Merge pull request #12138 from oritwas/wip-rgw-doc-upgrade-region-pool

rgw: add documentation for upgrading with rgw_region_root_pool

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
8 years agoMerge pull request #12061 from guihecheng/my-fix
John Spray [Wed, 30 Nov 2016 13:36:37 +0000 (13:36 +0000)]
Merge pull request #12061 from guihecheng/my-fix

cephfs: fix missing ll_get for ll_walk

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agotest/libcephfs: ensure that we set the mode of the libcephfs root before testing 12228/head
Jeff Layton [Wed, 30 Nov 2016 12:37:52 +0000 (07:37 -0500)]
test/libcephfs: ensure that we set the mode of the libcephfs root before testing

Patrick noticed that the libcephfs tests failed to run unless they were
run after the ceph-fuse tests had run. The ceph-fuse tests set the root
of the share to mode 01777, but the libcephfs tests don't do that even
though they rely on the directory being world-writable.

Fix this by adding a new main() function for ceph_test_libcephfs, and
calling a function (copied from access.cc) that resets the permissions
of the root before running the tests.

Fixes: http://tracker.ceph.com/issues/18013
Signed-off-by: Jeff Layton <jlayton@redhat.com>
8 years agoclient: fix some potential locking problems in InodeRef handling
Jeff Layton [Wed, 30 Nov 2016 12:37:52 +0000 (07:37 -0500)]
client: fix some potential locking problems in InodeRef handling

As Zheng points out, declaring an InodeRef before you take the mutex
means that its destructor gets called after the mutex has already been
released. Handling the refcount however, requires that you hold the
mutex so this could cause refcount leaks if two threads do a
load/decrement/store at the same time. Reverse the order.

Adding a fixes line here for the currently reported bug, but it's
not yet clear whether this will fix it.

Fixes: http://tracker.ceph.com/issues/17982
Signed-off-by: Jeff Layton <jlayton@redhat.com>
8 years agomsg/async/rdma: fixup memory free 12236/head
gongchuang [Wed, 30 Nov 2016 08:06:56 +0000 (16:06 +0800)]
msg/async/rdma: fixup memory free

Signed-off-by: gongchuang <gong.chuang@zte.com.cn>
8 years agoMerge pull request #12235 from tchaikov/wip-osd_stat_t-decode
Kefu Chai [Wed, 30 Nov 2016 07:51:56 +0000 (15:51 +0800)]
Merge pull request #12235 from tchaikov/wip-osd_stat_t-decode

osd/osd_types: fix the osd_stat_t::decode()

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoosd/osd_types: fix the osd_stat_t::decode() 12235/head
Kefu Chai [Wed, 30 Nov 2016 07:03:34 +0000 (15:03 +0800)]
osd/osd_types: fix the osd_stat_t::decode()

should decode the deprecated num_hb_out as vector<int> instead of uint32_t.

it's a regression introduced by 85f22ec

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoosdc/Objecter: fix relock race 12234/head
Sage Weil [Wed, 30 Nov 2016 03:55:11 +0000 (22:55 -0500)]
osdc/Objecter: fix relock race

In commit a863ae1c0fab636eabced0979889cbb3be74bf74 we tried
to fix a race but failed because we didn't update the
session pointer.  Add a proper test for this case with
a delay injection and fix the bug.

Fixes: http://tracker.ceph.com/issues/17942
Signed-off-by: Sage Weil <sage@redhat.com>
8 years agorgw: need to close_section in lc list op 12232/head
weiqiaomiao [Thu, 28 Jul 2016 11:45:15 +0000 (19:45 +0800)]
rgw: need to close_section in lc list op

Signed-off-by: weiqiaomiao <wei.qiaomiao@zte.com.cn>
8 years agoMerge pull request #12194 from tchaikov/wip-unit.cc
Kefu Chai [Wed, 30 Nov 2016 02:01:00 +0000 (10:01 +0800)]
Merge pull request #12194 from tchaikov/wip-unit.cc

test,cmake: turn unit.h into unit.cc to speed up compilation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agocephfs: fix missing ll_get for ll_walk 12061/head
Gui Hecheng [Thu, 17 Nov 2016 10:01:22 +0000 (18:01 +0800)]
cephfs: fix missing ll_get for ll_walk

Fixs: http://tracker.ceph.com/issues/18086

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
8 years agoMerge pull request #12178 from liupan1111/wip-fix-bug-hb-out
Josh Durgin [Tue, 29 Nov 2016 22:26:04 +0000 (14:26 -0800)]
Merge pull request #12178 from liupan1111/wip-fix-bug-hb-out

osd: replace hb_out and hb_in with a single hb_peers

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agorgw: RGWBucketSyncStatusManager uses existing async_rados 12229/head
Casey Bodley [Tue, 29 Nov 2016 22:15:27 +0000 (17:15 -0500)]
rgw: RGWBucketSyncStatusManager uses existing async_rados

RGWBucketSyncStatusManager was creating its own RGWAsyncRadosProcessor
and failing to clean it up on destruction. A recent change turned
global_init()'s return value into an intrusive_ptr to guarantee that our
CephContext is freed, and this triggered an assertion that all worker
threads were shut down

Fixes: http://tracker.ceph.com/issues/18083
Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agorgw: use set for zonegroup placement target tags
Yehuda Sadeh [Tue, 29 Nov 2016 22:05:27 +0000 (14:05 -0800)]
rgw: use set for zonegroup placement target tags

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agorgw: only set CURLOPT_UPLOAD for PUT/POST requests 12105/head
Casey Bodley [Mon, 21 Nov 2016 16:18:42 +0000 (11:18 -0500)]
rgw: only set CURLOPT_UPLOAD for PUT/POST requests

when set on GET requests, curl sends a 'Transfer-encoding: chunked'
header, but doesn't do the actual encoding to terminate the message

Fixes: http://tracker.ceph.com/issues/17822
Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12220 from liewegas/wip-coverity
Jason Dillaman [Tue, 29 Nov 2016 20:47:36 +0000 (15:47 -0500)]
Merge pull request #12220 from liewegas/wip-coverity

librbd/ImageCtx: no need for virtual dtor

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #12219 from zealoussnow/wip-1130
Sage Weil [Tue, 29 Nov 2016 20:14:25 +0000 (15:14 -0500)]
Merge pull request #12219 from zealoussnow/wip-1130

osdc: pass a string reference type to "osdmap->lookup_pg_pool_name"

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12166 from liewegas/wip-osdmap-encoding
Sage Weil [Tue, 29 Nov 2016 20:10:04 +0000 (15:10 -0500)]
Merge pull request #12166 from liewegas/wip-osdmap-encoding

osd: condition OSDMap encoding on features

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoMerge pull request #12202 from liewegas/wip-bluestore-coverity
Mark Nelson [Tue, 29 Nov 2016 19:44:55 +0000 (13:44 -0600)]
Merge pull request #12202 from liewegas/wip-bluestore-coverity

os/bluestore: misc coverity fixes/cleanups

8 years agoMerge pull request #12047 from rzarzynski/wip-rgw-17931
Matt Benjamin [Tue, 29 Nov 2016 19:27:09 +0000 (14:27 -0500)]
Merge pull request #12047 from rzarzynski/wip-rgw-17931

rgw: add support for the prefix parameter in account listing of Swift API

8 years agoMerge pull request #11671 from linuxbox2/rgw_file-17663
Yehuda Sadeh [Tue, 29 Nov 2016 18:42:12 +0000 (10:42 -0800)]
Merge pull request #11671 from linuxbox2/rgw_file-17663

rgw_file:  apply missed base64 try-catch

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #11751 from yehudasa/wip-17788
Matt Benjamin [Tue, 29 Nov 2016 18:41:36 +0000 (13:41 -0500)]
Merge pull request #11751 from yehudasa/wip-17788

rgw: extract host name from host:port string

8 years agoMerge pull request #12217 from dzafman/wip-tests-off
Samuel Just [Tue, 29 Nov 2016 18:13:54 +0000 (10:13 -0800)]
Merge pull request #12217 from dzafman/wip-tests-off

Turn off tests again due to Jenkins failures

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agorbd-nbd: restart parent process logger after forking 12222/head
Jason Dillaman [Tue, 29 Nov 2016 17:36:00 +0000 (12:36 -0500)]
rbd-nbd: restart parent process logger after forking

Fixes: http://tracker.ceph.com/issues/18070
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #12204 from liewegas/wip-bluestore-17824
Mark Nelson [Tue, 29 Nov 2016 17:20:31 +0000 (11:20 -0600)]
Merge pull request #12204 from liewegas/wip-bluestore-17824

os/bluestore/KernelDevice: fix race in aio_thread vs aio_wait

8 years agoMerge pull request #12130 from liupan1111/wip-osd-hearteat
Sage Weil [Tue, 29 Nov 2016 17:13:19 +0000 (12:13 -0500)]
Merge pull request #12130 from liupan1111/wip-osd-hearteat

osd: remove redudant call of heartbeat_check

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #12169 from liewegas/wip-rados-bench-hints
Sage Weil [Tue, 29 Nov 2016 17:11:53 +0000 (12:11 -0500)]
Merge pull request #12169 from liewegas/wip-rados-bench-hints

rados: add hints to rados bench

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoosdc: pass a string reference type to "osdmap->lookup_pg_pool_name" 12219/head
Leo Zhang [Tue, 29 Nov 2016 16:32:29 +0000 (00:32 +0800)]
osdc: pass a string reference type to "osdmap->lookup_pg_pool_name"

Signed-off-by: Leo Zhang <nguzcf@gmail.com>
8 years agotest: Turn off test-erasure-eio.sh due to Jenkins failures 12217/head
David Zafman [Tue, 29 Nov 2016 16:04:19 +0000 (08:04 -0800)]
test: Turn off test-erasure-eio.sh due to Jenkins failures

Signed-off-by: David Zafman <dzafman@redhat.com>
8 years agotest: Turn off osd-scrub-repair.sh due to Jenkins failures
David Zafman [Tue, 29 Nov 2016 16:02:50 +0000 (08:02 -0800)]
test: Turn off osd-scrub-repair.sh due to Jenkins failures

Signed-off-by: David Zafman <dzafman@redhat.com>
8 years agoMerge pull request #11764 from bassamtabbara/wip-embedded
Kefu Chai [Tue, 29 Nov 2016 11:53:45 +0000 (19:53 +0800)]
Merge pull request #11764 from bassamtabbara/wip-embedded

cmake: Support for embedding Ceph Daemons

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #12097 from ceph/wip-17837
John Spray [Tue, 29 Nov 2016 11:50:09 +0000 (11:50 +0000)]
Merge pull request #12097 from ceph/wip-17837

src/mds: fix MDSMap upgrade decoding

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
8 years agoMerge pull request #12090 from wjwithagen/wip-wjw-do_freebsd.sh
Kefu Chai [Tue, 29 Nov 2016 11:45:07 +0000 (19:45 +0800)]
Merge pull request #12090 from wjwithagen/wip-wjw-do_freebsd.sh

FreeBSD: do_freebsd.sh

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoosd: replace hb_out and hb_in with a single hb_peers 12178/head
Pan Liu [Tue, 29 Nov 2016 09:39:51 +0000 (17:39 +0800)]
osd: replace hb_out and hb_in with a single hb_peers

Signed-off-by: Pan Liu <pan.liu@istuary.com>
8 years agoMerge pull request #12200 from ddiss/tracker18049_ceph_disk_trigger_flock_timeout
Loic Dachary [Tue, 29 Nov 2016 08:08:49 +0000 (09:08 +0100)]
Merge pull request #12200 from ddiss/tracker18049_ceph_disk_trigger_flock_timeout

systemd/ceph-disk: reduce ceph-disk flock contention

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #12180 from tchaikov/wip-silence-get_timeout_delays
Loic Dachary [Tue, 29 Nov 2016 08:06:43 +0000 (09:06 +0100)]
Merge pull request #12180 from tchaikov/wip-silence-get_timeout_delays

tests: disable the echo when running get_timeout_delays()

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoembedded: Add RADOS classes to embedded cephd library 11764/head
Bassam Tabbara [Sat, 5 Nov 2016 01:10:08 +0000 (18:10 -0700)]
embedded: Add RADOS classes to embedded cephd library

RADOS classes can now be statically compiled and added to
the embedded cephd library.

The RADOS ClassHandler now has an option to skip calling dlclose
just like PluginRegistry.

All RADOS classes where changed to use a CLS_INIT macro that
will either use __cls_init or classname_cls_init. this enables
the static compiling of all RADOS classes in a single library. Also
global method definitions where moved to inside cls_init.

Also added a few aconfig defines including WITH_EMBEDDED, WITH_CEPHFS,
WITH_RBD, and WITH_KVS. Note that WITH_RBD was not defined before
and the ceph-dencoder was broken when it was turned on.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
8 years agoembedded: Add librbd and librados to embedded ceph
Bassam Tabbara [Sat, 5 Nov 2016 01:10:08 +0000 (18:10 -0700)]
embedded: Add librbd and librados to embedded ceph

This commit add librados, librbd to the embedded ceph static library. This is needed to support daemons built with libcephd that want to run mon commands, create rbd volumes, snapshots etc.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
8 years agoembedded: Support for running MON and OSD from libcephd
Bassam Tabbara [Sat, 5 Nov 2016 01:10:08 +0000 (18:10 -0700)]
embedded: Support for running MON and OSD from libcephd

Added supported for running MON and OSD daemon code almost
untouched directly from libcephd.

Also added two API functions for generating an FSID and secret
key that can be used to bootstrap a new cluster.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
8 years agoembedded: add compression and EC plugins to libcephd
Bassam Tabbara [Sat, 5 Nov 2016 01:10:08 +0000 (18:10 -0700)]
embedded: add compression and EC plugins to libcephd

Compression and erasure coding plugins are now statically compiled
into libcephd. A new method is added to load them into the
respective registry.

The static libraries are only built when WITH_EMBEDDED is enabled
and existing plugins are unaffected.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
8 years agoembedded: Add a skeleton libcephd library
Bassam Tabbara [Sat, 5 Nov 2016 01:10:08 +0000 (18:10 -0700)]
embedded: Add a skeleton libcephd library

libcephd is a library that contains ceph daemon code
that can be statically linked in other applications.

Added MergeStaticLibraries.cmake that can merge static libraries
to form a bigger one. This approach avoids the need to mess with
STATIC libraries all over the code base.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
8 years agolibrados: remove new setxattr overload to avoid breaking the C++ ABI 12206/head
Josh Durgin [Tue, 29 Nov 2016 06:06:56 +0000 (22:06 -0800)]
librados: remove new setxattr overload to avoid breaking the C++ ABI

Fixes: http://tracker.ceph.com/issues/18058
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
8 years agolibrbd/ImageCtx: no need for virtual dtor 12220/head
Sage Weil [Tue, 29 Nov 2016 03:47:53 +0000 (22:47 -0500)]
librbd/ImageCtx: no need for virtual dtor

CID 1396232 (#1 of 1): Non-virtual destructor (VIRTUAL_DTOR)
1. nonvirtual_dtor: Class librbd::<unnamed>::SafeTimerSingleton has a destructor and a pointer to it is upcast to class SafeTimer which doesn't have a virtual destructor.

The SafeTimerSingleton is not polymorphic; no need for
a virtual dtor.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12170 from dzafman/wip-ec-error-tests
Kefu Chai [Tue, 29 Nov 2016 03:47:35 +0000 (11:47 +0800)]
Merge pull request #12170 from dzafman/wip-ec-error-tests

test: test-erasure-eio.sh fix recovery testing and enable it

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #10672 from ceph/wip-rgw-http-getcmd
Yehuda Sadeh [Mon, 28 Nov 2016 23:06:12 +0000 (15:06 -0800)]
Merge pull request #10672 from ceph/wip-rgw-http-getcmd

RGWHTTPArgs::get_str() - return argument string that was set.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #10546 from cbodley/wip-rgw-log-trim-lease
Yehuda Sadeh [Mon, 28 Nov 2016 23:04:15 +0000 (15:04 -0800)]
Merge pull request #10546 from cbodley/wip-rgw-log-trim-lease

rgw multisite: use a rados lock to coordinate data log trimming

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #12114 from liewegas/wip-bluestore-failops
Sage Weil [Mon, 28 Nov 2016 22:06:19 +0000 (17:06 -0500)]
Merge pull request #12114 from liewegas/wip-bluestore-failops

os/bluestore: mark ops that can't tolerate ENOENT

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoMerge pull request #12022 from jcsp/wip-17853
Gregory Farnum [Mon, 28 Nov 2016 21:28:21 +0000 (16:28 -0500)]
Merge pull request #12022 from jcsp/wip-17853

mds: more deterministic timing on frag split/join

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge pull request #12094 from 363921219/cleanup_C_CompleteSplits
Sage Weil [Mon, 28 Nov 2016 21:21:52 +0000 (16:21 -0500)]
Merge pull request #12094 from 363921219/cleanup_C_CompleteSplits

osd: cleanup C_CompleteSplits::finish()

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoMerge pull request #12148 from tchaikov/wip-scan-build-fixes
Sage Weil [Mon, 28 Nov 2016 21:21:08 +0000 (16:21 -0500)]
Merge pull request #12148 from tchaikov/wip-scan-build-fixes

scan build fixes

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12099 from wjin/fix_filestore_perfcounter
Sage Weil [Mon, 28 Nov 2016 21:18:56 +0000 (16:18 -0500)]
Merge pull request #12099 from wjin/fix_filestore_perfcounter

os/filestore: fix journal logger

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoos/bluestore/KernelDevice: fix race in aio_thread vs aio_wait 12204/head
Sage Weil [Mon, 28 Nov 2016 20:56:29 +0000 (15:56 -0500)]
os/bluestore/KernelDevice: fix race in aio_thread vs aio_wait

The caller is free to destroy the aio vector contents
once aio_wait completes.  This is exactly what
BlueFS::_fsync() does.  Delay the num_running dec
(which is what aio_wait waits for) until after we've
examined the aios.

Fixes: http://tracker.ceph.com/issues/17824
Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/Transaction: add missing break 12202/head
Sage Weil [Mon, 28 Nov 2016 19:26:51 +0000 (14:26 -0500)]
os/Transaction: add missing break

CID 1395137 (#1 of 1): Missing break in switch (MISSING_BREAK)
unterminated_case: The case for value ObjectStore::Transaction::OP_TRY_RENAME is not terminated by a 'break' statement.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/ObjectStore: pass by ref to clone
Sage Weil [Mon, 28 Nov 2016 19:26:21 +0000 (14:26 -0500)]
os/ObjectStore: pass by ref to clone

CID 1395658 (#1 of 1): Big parameter passed by value (PASS_BY_VALUE)
pass_by_value: Passing parameter noid of type ghobject_t (size 144 bytes) by value.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/ObjectStore: pass by ref to clone_range
Sage Weil [Mon, 28 Nov 2016 19:25:39 +0000 (14:25 -0500)]
os/ObjectStore: pass by ref to clone_range

CID 1395650 (#1 of 1): Big parameter passed by value (PASS_BY_VALUE)
pass_by_value: Passing parameter noid of type ghobject_t (size 144 bytes) by value.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/ObjectStore: add missing break
Sage Weil [Mon, 28 Nov 2016 19:24:57 +0000 (14:24 -0500)]
os/ObjectStore: add missing break

CID 1394998 (#1 of 1): Missing break in switch (MISSING_BREAK)
unterminated_case: The case for value ObjectStore::Transaction::OP_TRY_RENAME is not terminated by a 'break' statement.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: be pedantic about kv_stop locking
Sage Weil [Mon, 28 Nov 2016 19:23:36 +0000 (14:23 -0500)]
os/bluestore: be pedantic about kv_stop locking

Makes coverity happy.

CID 1395346 (#1 of 1): Data race condition (MISSING_LOCK)
1. missing_lock: Accessing this->kv_stop without holding lock BlueStore.kv_lock. Elsewhere, "BlueStore.kv_stop" is accessed with BlueStore.kv_lock held 1 out of 2 times (1 of these accesses strongly imply that it is necessary).

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: init all fields
Sage Weil [Mon, 28 Nov 2016 19:22:32 +0000 (14:22 -0500)]
os/bluestore: init all fields

9. uninit_member: Non-static class member block_size is not initialized in this constructor nor in any functions that it calls.
     11. uninit_member: Non-static class member block_mask is not initialized in this constructor nor in any functions that it calls.
     13. uninit_member: Non-static class member block_size_order is not initialized in this constructor nor in any functions that it calls.

CID 1396159 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
15. uninit_member: Non-static class member max_alloc_size is not initialized in this constructor nor in any functions that it calls.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/ObjectStore: pass by ref to collection_list
Sage Weil [Mon, 28 Nov 2016 19:21:27 +0000 (14:21 -0500)]
os/ObjectStore: pass by ref to collection_list

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: pass by ref to _collection_list
Sage Weil [Mon, 28 Nov 2016 19:15:33 +0000 (14:15 -0500)]
os/bluestore: pass by ref to _collection_list

CID 1395617 (#1 of 1): Big parameter passed by value (PASS_BY_VALUE)
pass_by_value: Passing parameter end of type ghobject_t (size 144 bytes) by value.
     pass_by_value: Passing parameter start of type ghobject_t (size 144 bytes) by value.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/BlueRocksEnv: fix strerror args
Sage Weil [Mon, 28 Nov 2016 19:11:54 +0000 (14:11 -0500)]
os/bluestore/BlueRocksEnv: fix strerror args

CID 1395399 (#1 of 1): Argument cannot be negative (NEGATIVE_RETURNS)
negative_returns: A negative constant -2 is passed as an argument to a parameter that cannot be negative.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/BlueFS: init iocv
Sage Weil [Mon, 28 Nov 2016 19:09:45 +0000 (14:09 -0500)]
os/bluestore/BlueFS: init iocv

CID 1396119 (#1 of 1): Uninitialized pointer field (UNINIT_CTOR)
2. uninit_member: Non-static class member field iocv._M_elems is not initialized in this constructor nor in any functions that it calls.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/BlueFS: check flush result
Sage Weil [Mon, 28 Nov 2016 18:45:35 +0000 (13:45 -0500)]
os/bluestore/BlueFS: check flush result

CID 1394759 (#1 of 1): Unchecked return value (CHECKED_RETURN)
20. check_return: Calling _flush without checking return value (as is done elsewhere 4 out of 5 times).

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/BlockDevice: init rotational
Sage Weil [Mon, 28 Nov 2016 18:44:05 +0000 (13:44 -0500)]
os/bluestore/BlockDevice: init rotational

CID 1396126 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member rotational is not initialized in this constructor nor in any functions that it calls.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12201 from tchaikov/wip-memstore-leak
Kefu Chai [Mon, 28 Nov 2016 17:08:14 +0000 (01:08 +0800)]
Merge pull request #12201 from tchaikov/wip-memstore-leak

os/memstore: fix a mem leak in MemStore::Collection::create_object()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agosystemd/ceph-disk: reduce ceph-disk flock contention 12200/head
David Disseldorp [Mon, 28 Nov 2016 13:16:22 +0000 (14:16 +0100)]
systemd/ceph-disk: reduce ceph-disk flock contention

"ceph-disk trigger" invocation is currently performed in a mutually
exclusive fashion, with each call first taking an flock on the path
/var/lock/ceph-disk. On systems with a lot of osds, this leads to a
large amount of lock contention during boot-up, and can cause some
service instances to trip the 120 second timeout.

Take an flock on a device specific path instead of /var/lock/ceph-disk,
so that concurrent "ceph-disk trigger" invocations are permitted for
independent osds. This greatly reduces lock contention and consequently
the chance of service timeout. Per-device concurrency restrictions
required for http://tracker.ceph.com/issues/13160 are maintained.

Fixes: http://tracker.ceph.com/issues/18049
Signed-off-by: David Disseldorp <ddiss@suse.de>
8 years agoos/memstore: fix a mem leak in MemStore::Collection::create_object() 12201/head
Kefu Chai [Mon, 28 Nov 2016 14:47:19 +0000 (22:47 +0800)]
os/memstore: fix a mem leak in MemStore::Collection::create_object()

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agorgw: add documentation for upgrading with rgw_region_root_pool 12138/head
Orit Wasserman [Mon, 28 Nov 2016 15:32:55 +0000 (16:32 +0100)]
rgw: add documentation for upgrading with rgw_region_root_pool

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
8 years agorados: add hints to rados bench 12169/head
Sage Weil [Wed, 23 Nov 2016 23:16:56 +0000 (18:16 -0500)]
rados: add hints to rados bench

By default, hint with the rados bench IO size and with sequential read
and write flags.  Unless the --no-hints option is passed.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12168 from liewegas/doc-perf
Kefu Chai [Mon, 28 Nov 2016 07:27:52 +0000 (15:27 +0800)]
Merge pull request #12168 from liewegas/doc-perf

doc/dev/perf: a few notes on perf

Reviewed-by: Kefu Chai <kchai@redhat.com>