]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agocrush: verify weights is influenced by the number of replicas 13083/head
Loic Dachary [Tue, 24 Jan 2017 12:08:32 +0000 (13:08 +0100)]
crush: verify weights is influenced by the number of replicas

Refs: http://tracker.ceph.com/issues/15653

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
Signed-off-by: Loic Dachary <loic@dachary.org>
8 years agoMerge pull request #12956 from liuhongtong/wip-nvmedevice
Haomai Wang [Tue, 24 Jan 2017 10:07:05 +0000 (18:07 +0800)]
Merge pull request #12956 from liuhongtong/wip-nvmedevice

os/bluestore: fix NVMEDevice::open failure if serial number ends with a …

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan liu <liupan1111@gmail.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agoMerge pull request #13055 from optimistyzy/2017123_random_read
Haomai Wang [Tue, 24 Jan 2017 04:01:27 +0000 (12:01 +0800)]
Merge pull request #13055 from optimistyzy/2017123_random_read

os/bluestore/NVMEDevice.cc: fix the random read issue.

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoos/bluestore/NVMEDevice.cc: use aio_wake in both read and read_random 13055/head
optimistyzy [Mon, 23 Jan 2017 01:56:03 +0000 (09:56 +0800)]
os/bluestore/NVMEDevice.cc: use aio_wake in both read and read_random

There are some issues with random read, it seems that
we did not call aio_wake.

Signed-off-by: optimistyzy <optimistyzy@gmail.com>
8 years agoMerge pull request #12929 from wjwithagen/wip-wjw-empty-cluster_network
Sage Weil [Tue, 24 Jan 2017 03:16:21 +0000 (21:16 -0600)]
Merge pull request #12929 from wjwithagen/wip-wjw-empty-cluster_network

common/pick_address.cc: Copy public_netw to cluster_netw if cluster empty

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge branch 'master' into wip-wjw-empty-cluster_network 12929/head
Sage Weil [Tue, 24 Jan 2017 03:16:09 +0000 (21:16 -0600)]
Merge branch 'master' into wip-wjw-empty-cluster_network

8 years agoMerge pull request #12901 from yuyuyu101/wip-msgr-client-bind
Yuri Weinstein [Mon, 23 Jan 2017 23:00:26 +0000 (15:00 -0800)]
Merge pull request #12901 from yuyuyu101/wip-msgr-client-bind

msg: client bind

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #13036 from SUSE/wip-michal-koutny
Nathan Cutler [Mon, 23 Jan 2017 21:25:34 +0000 (22:25 +0100)]
Merge pull request #13036 from SUSE/wip-michal-koutny

mailmap: Michal Koutny affiliation

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Michal Koutný <mkoutny@suse.com>
8 years agoMerge pull request #12326 from vshankar/wip-15028
Jason Dillaman [Mon, 23 Jan 2017 15:39:16 +0000 (10:39 -0500)]
Merge pull request #12326 from vshankar/wip-15028

librbd: create fewer empty objects during copyup

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agounittest_bit_alloc race fix
Ramesh Chander [Mon, 2 Jan 2017 08:01:55 +0000 (00:01 -0800)]
unittest_bit_alloc race fix

Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #13056 from optimistyzy/123_logic
Haomai Wang [Mon, 23 Jan 2017 14:44:07 +0000 (22:44 +0800)]
Merge pull request #13056 from optimistyzy/123_logic

NVMEDevice.cc: cleanup the logic in data_buf_next_sge

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #12938 from LiumxNL/fix-process-osd-failure
Kefu Chai [Mon, 23 Jan 2017 12:07:35 +0000 (20:07 +0800)]
Merge pull request #12938 from LiumxNL/fix-process-osd-failure

mon/OSDMonitor: fix process osd failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #9419 from songbaisen/a4
Kefu Chai [Mon, 23 Jan 2017 11:43:35 +0000 (19:43 +0800)]
Merge pull request #9419 from songbaisen/a4

osdmaptool: show all the pg map to osds info

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12828 from donglinpeng/dlppull
Kefu Chai [Mon, 23 Jan 2017 11:42:14 +0000 (19:42 +0800)]
Merge pull request #12828 from donglinpeng/dlppull

common/buffer: close pipe fd if set nonblocking fails.

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoNVMEDevice.cc: cleanup the logic in data_buf_next_sge 13056/head
optimistyzy [Mon, 23 Jan 2017 02:53:32 +0000 (10:53 +0800)]
NVMEDevice.cc: cleanup the logic in data_buf_next_sge

Signed-off-by: optimistyzy <optimistyzy@gmail.com>
8 years agoMerge pull request #12980 from liewegas/wip-osdop-printer
Sage Weil [Sun, 22 Jan 2017 16:45:37 +0000 (10:45 -0600)]
Merge pull request #12980 from liewegas/wip-osdop-printer

osd/osd_types: clean up OSDOp printers

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoosd/osd_types: clean up OSDOp printers 12980/head
Sage Weil [Thu, 19 Jan 2017 12:57:29 +0000 (06:57 -0600)]
osd/osd_types: clean up OSDOp printers

Specify which ones get offset~length instead of blacklisting those that
don't.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12950 from liewegas/wip-omap-getkeys
Sage Weil [Sun, 22 Jan 2017 16:44:04 +0000 (10:44 -0600)]
Merge pull request #12950 from liewegas/wip-omap-getkeys

osd: extend OMAP_GETKEYS and GETVALS to include a 'more' output field

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
8 years agoMerge pull request #12961 from songbaisen/s10
Sage Weil [Sun, 22 Jan 2017 16:43:27 +0000 (10:43 -0600)]
Merge pull request #12961 from songbaisen/s10

crush:  when osd_location_hook does not exist, we should exit error.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12975 from wonzhq/fix-pgstats-down
Sage Weil [Sun, 22 Jan 2017 16:43:00 +0000 (10:43 -0600)]
Merge pull request #12975 from wonzhq/fix-pgstats-down

mon: don't set last_osd_report when the pg stats msg is ignored

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #12976 from LiumxNL/wip-170118
Sage Weil [Sun, 22 Jan 2017 16:42:33 +0000 (10:42 -0600)]
Merge pull request #12976 from LiumxNL/wip-170118

osd/OSDMap: get_previous_up_osd_before() may run into endless loop

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12981 from liewegas/wip-crush-move-osd
Sage Weil [Sun, 22 Jan 2017 16:42:08 +0000 (10:42 -0600)]
Merge pull request #12981 from liewegas/wip-crush-move-osd

mon/OSDMonitor: make 'osd crush move ...' work on osds

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #13008 from athanatos/wip-clone-range
Sage Weil [Sun, 22 Jan 2017 16:41:55 +0000 (10:41 -0600)]
Merge pull request #13008 from athanatos/wip-clone-range

osd,librados: remove clone_range and associated multi-object cruft

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #13033 from dillaman/wip-18618
Mykola Golub [Sun, 22 Jan 2017 12:52:32 +0000 (14:52 +0200)]
Merge pull request #13033 from dillaman/wip-18618

journal: don't hold future lock during assignment

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agobluestore: Release segs before delete task when write fails 12956/head
Hongtong Liu [Tue, 17 Jan 2017 07:41:08 +0000 (15:41 +0800)]
bluestore: Release segs before delete task when write fails

Fix assert failure in ~Task().

Signed-off-by: Hongtong Liu <hongtong.liu@istuary.com>
8 years agoos/bluestore: fix NVMEDevice::open failure if serial number ends with a number
Hongtong Liu [Sun, 22 Jan 2017 09:25:04 +0000 (17:25 +0800)]
os/bluestore: fix NVMEDevice::open failure if serial number ends with a number

buf in effect is the serial number in ceph.conf and
the serial number consists of 16 hexadecimal characters.
1. In order to avoid ignoring the numbers, scan buf
with isxdigit.
2. In order to ignore all the potential garbage,
scan buf from the beginning.

Signed-off-by: Hongtong Liu <hongtong.liu@istuary.com>
8 years agoMerge pull request #13051 from chuanhong-wang/dev_conf_clean
Xie Xingguo [Sun, 22 Jan 2017 05:35:50 +0000 (13:35 +0800)]
Merge pull request #13051 from chuanhong-wang/dev_conf_clean

common: delete unused conf "filestore_debug_disable_sharded_check"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agocommon: delete unused conf "filestore_debug_disable_sharded_check" 13051/head
chuanhong.wang [Sun, 22 Jan 2017 03:26:57 +0000 (11:26 +0800)]
common: delete unused conf "filestore_debug_disable_sharded_check"

Signed-off-by: Chuanhong Wang <chuanhong.wang@163.com>
8 years agoMerge pull request #13042 from dillaman/wip-librbd-compile-warning
Mykola Golub [Sat, 21 Jan 2017 15:52:42 +0000 (17:52 +0200)]
Merge pull request #13042 from dillaman/wip-librbd-compile-warning

librbd: fixed initializer list ordering

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agojournal: don't hold future lock during assignment 13033/head
Jason Dillaman [Fri, 20 Jan 2017 19:26:43 +0000 (14:26 -0500)]
journal: don't hold future lock during assignment

It's possible that the future raced with its owner and reaches
an empty reference count. This was resulting in the future being
destructed while its lock was still held.

Fixes: http://tracker.ceph.com/issues/18618
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agolibrbd: fixed initializer list ordering 13042/head
Jason Dillaman [Sat, 21 Jan 2017 14:17:36 +0000 (09:17 -0500)]
librbd: fixed initializer list ordering

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agotest / librbd: create few empty objects during flatten 12326/head
Venky Shankar [Mon, 5 Dec 2016 08:43:23 +0000 (14:13 +0530)]
test / librbd: create few empty objects during flatten

Fixes: http://tracker.ceph.com/issues/15028
Signed-off-by: Venky Shankar <vshankar@redhat.com>
8 years agotest / librbd: Write ones instead of zeroes to test images
Venky Shankar [Thu, 1 Dec 2016 05:00:25 +0000 (10:30 +0530)]
test / librbd: Write ones instead of zeroes to test images

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
8 years agolibrbd: Create few empty objects during copyup
Venky Shankar [Thu, 1 Dec 2016 04:57:30 +0000 (10:27 +0530)]
librbd: Create few empty objects during copyup

This is based out of Doug's (@fullerdj) work (PR #9329)
as an attempt to avoid creating empty objects when
flattening an image and otherwise whenever unnecessary.

This gives good optimization benefit when a parent image
is sparsely populated. Moreover, this change is required
for correct behavior when checking disk usage of a clone
(which used to report fully allocated image due to all,
including empty objects being created during flatten).

Signed-off-by: Douglas Fuller dfuller@redhat.com
Signed-off-by: Venky Shankar <vshankar@redhat.com>
8 years agolibrbd: make has_parent() prone to callers from copyup
Venky Shankar [Mon, 5 Dec 2016 09:20:06 +0000 (14:50 +0530)]
librbd: make has_parent() prone to callers from copyup

This is required when CopyupRequest would need to invoke
pre_object_map_update() as part of upcoming changes to
create fewer child image objects whenever possible.

CopyupRequest constructor accepts image extents as an
rvalue forcing the caller to transfer ownership to it
and leaving the original variable in an unspecified
stated making has_parent() return incorrect state when
invoked from CopyupRequest. Therefore, introduce a
private tracking state that can be used in place of
checking emptiness of parent image extents.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
8 years agoPendingReleaseNotes: mention old clients vs new OSDs 12950/head
Sage Weil [Wed, 18 Jan 2017 13:07:08 +0000 (07:07 -0600)]
PendingReleaseNotes: mention old clients vs new OSDs

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agorados: use bare omap_get_keys op
Sage Weil [Mon, 16 Jan 2017 21:51:13 +0000 (16:51 -0500)]
rados: use bare omap_get_keys op

This handles the client-side looping on 'more' if the OSD limits
the response size.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoceph_test_rados: pass nullptr for pmore for omap fetch
Sage Weil [Mon, 16 Jan 2017 20:17:03 +0000 (15:17 -0500)]
ceph_test_rados: pass nullptr for pmore for omap fetch

Assume OSD limits are hugh enough.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agorados: omap bench: pass null for pmore for omap fetch
Sage Weil [Mon, 16 Jan 2017 20:16:46 +0000 (15:16 -0500)]
rados: omap bench: pass null for pmore for omap fetch

Assume OSD limits are high enough for us.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoceph_test_rados_*: use new omap methods
Sage Weil [Mon, 16 Jan 2017 20:16:20 +0000 (15:16 -0500)]
ceph_test_rados_*: use new omap methods

Make these tests pass nullptr for pmore.  This codifies our
assumption that the OSD limits are high enough.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agolibrados: add omap_get_{keys,vals}2 with pmore output arg
Sage Weil [Mon, 16 Jan 2017 20:14:00 +0000 (15:14 -0500)]
librados: add omap_get_{keys,vals}2 with pmore output arg

Expose public methods that include a new output argument to indicate
whether there are more keys to fetch or not.

Mark the old interfaces deprecated.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoosdc/Objecter: infer ptruncated on old OSDs via max_entries
Sage Weil [Fri, 20 Jan 2017 03:09:35 +0000 (21:09 -0600)]
osdc/Objecter: infer ptruncated on old OSDs via max_entries

If we do not get an explicit 'more' value from the OSD, infer it by
checking whether we got the max requested entries.  On old OSDs, which
don't enforce a limit, this will work.  On new OSDs, we will get the
explicit result.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc: Michal Koutny affiliation 13036/head
Nathan Cutler [Fri, 20 Jan 2017 21:35:43 +0000 (22:35 +0100)]
doc: Michal Koutny affiliation

Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agoPendingReleaseNotes: Specify the change in behaviour of assigning to public_netw
Willem Jan Withagen [Mon, 16 Jan 2017 23:03:05 +0000 (00:03 +0100)]
PendingReleaseNotes: Specify the change in behaviour of assigning to public_netw

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agocommon/pick_address.cc: Copy public_netw to cluset_netw if cluster empty
Willem Jan Withagen [Fri, 13 Jan 2017 23:29:43 +0000 (00:29 +0100)]
common/pick_address.cc: Copy public_netw to cluset_netw if cluster empty

 - When public network is set, but cluster network is not, then
   the cluster-bindings would be on 0.0.0.0 which could be unexpeted.

 In this commit we copy the public network into the cluster network
 to make sure that the cluster backend is not bound on 0.0.0.0
 Which could be consideren an insecure, or unexpected, action.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agoMerge pull request #12991 from dillaman/wip-17447
Mykola Golub [Fri, 20 Jan 2017 17:50:02 +0000 (19:50 +0200)]
Merge pull request #12991 from dillaman/wip-17447

librbd: avoid possible recursive lock when racing acquire lock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #12982 from dillaman/wip-18524
Mykola Golub [Fri, 20 Jan 2017 17:49:36 +0000 (19:49 +0200)]
Merge pull request #12982 from dillaman/wip-18524

librbd: remove unnecessary dependencies of ManagedLock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #13010 from liewegas/wip-bluestore-allocator
Sage Weil [Fri, 20 Jan 2017 17:13:47 +0000 (11:13 -0600)]
Merge pull request #13010 from liewegas/wip-bluestore-allocator

os/bluestore: fix Allocator::allocate() int truncation

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #12908 from tchaikov/wip-rocksdb
Kefu Chai [Fri, 20 Jan 2017 14:41:04 +0000 (22:41 +0800)]
Merge pull request #12908 from tchaikov/wip-rocksdb

rocksdb: build with ppc64

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12830 from renhwztetecs/renhw-wip-libcephfs-misc
John Spray [Fri, 20 Jan 2017 14:29:30 +0000 (15:29 +0100)]
Merge pull request #12830 from renhwztetecs/renhw-wip-libcephfs-misc

libcephfs: cleanups

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #12994 from ukernel/wip-18487
John Spray [Fri, 20 Jan 2017 14:28:12 +0000 (15:28 +0100)]
Merge pull request #12994 from ukernel/wip-18487

mds: add authority check for delay dirfrag split

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoos/bluestore: fix Allocator::allocate() int truncation 13010/head
Sage Weil [Fri, 20 Jan 2017 01:51:45 +0000 (19:51 -0600)]
os/bluestore: fix Allocator::allocate() int truncation

An allocation of size 0x80000000 gets truncated to 0.  Larger values can
break things in similar ways.

Introduced in 5ab034345d7320fbc86a2133c0c29ec1aca4b71a.

Fixes: http://tracker.ceph.com/issues/18595
Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12947 from smatzek/fix_18538
Alfredo Deza [Thu, 19 Jan 2017 23:39:59 +0000 (18:39 -0500)]
Merge pull request #12947 from smatzek/fix_18538

ceph-disk: use correct user in check_journal_req

Reviewed-by: Alfredo Deza <adeza@redhat.com>
8 years agoosdc/Objecter: add pmore argument to omap_get_{keys,vals}
Sage Weil [Mon, 16 Jan 2017 18:48:06 +0000 (13:48 -0500)]
osdc/Objecter: add pmore argument to omap_get_{keys,vals}

Note that the MDS callers have new #warnings indicating that they
are not providing the pmore argument and are thus broken.  (They
were already broken.)

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoosd/PrimaryLogPG: tell client if we truncate results
Sage Weil [Sun, 15 Jan 2017 04:23:11 +0000 (23:23 -0500)]
osd/PrimaryLogPG: tell client if we truncate results

If we truncate the results of the omap read commands,
provide a flag so that the caller knows there is more
to be read.  We don't need to provide the name of the
next key because the interface is defined as
"start_after" (not "start_with"), allowing them to use
the last key they received.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12865 from ceph/wip-rgw-18476
Casey Bodley [Thu, 19 Jan 2017 16:00:12 +0000 (11:00 -0500)]
Merge pull request #12865 from ceph/wip-rgw-18476

rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agomsg: add ms_bind_before_connect to bind before connect 12901/head
Haomai Wang [Thu, 12 Jan 2017 07:14:42 +0000 (15:14 +0800)]
msg: add ms_bind_before_connect to bind before connect

Signed-off-by: Zengran Zhang <zhangzengran@h3c.com>
Signed-off-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #12968 from liewegas/wip-kraken-notes
Sage Weil [Thu, 19 Jan 2017 12:57:54 +0000 (06:57 -0600)]
Merge pull request #12968 from liewegas/wip-kraken-notes

doc/release-notes: final kraken notes

8 years agomon/OSDMonitor: make 'osd crush move ...' work on osds 12981/head
Sage Weil [Wed, 18 Jan 2017 23:02:54 +0000 (17:02 -0600)]
mon/OSDMonitor: make 'osd crush move ...' work on osds

Currently it only allows you to move buckets, which is annoying and much
less useful.  To move an OSD you need to use create-or-move, which is
harder to use.

Fixes: http://tracker.ceph.com/issues/18587
Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12963 from liewegas/wip-bluestore-extents
Sage Weil [Thu, 19 Jan 2017 12:29:25 +0000 (06:29 -0600)]
Merge pull request #12963 from liewegas/wip-bluestore-extents

os/bluestore: fix reclaim_blocks and clean up Allocator interface

Reviewed-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agoMerge pull request #12550 from stiopaa1/B9935_segfaultInRmDir
John Spray [Thu, 19 Jan 2017 08:15:27 +0000 (09:15 +0100)]
Merge pull request #12550 from stiopaa1/B9935_segfaultInRmDir

client/Client.cc: prevent segfaulting

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agomds: add authority check for delay dirfrag split 12994/head
Yan, Zheng [Thu, 19 Jan 2017 07:24:54 +0000 (15:24 +0800)]
mds: add authority check for delay dirfrag split

the dirfrag can be migareted to other mds while waiting in the
timer.

Fixes: http://tracker.ceph.com/issues/18487
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agoMerge pull request #12988 from SUSE/wip-submitting-patches
Kefu Chai [Thu, 19 Jan 2017 05:30:03 +0000 (13:30 +0800)]
Merge pull request #12988 from SUSE/wip-submitting-patches

doc: clarify SubmittingPatches.rst

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agolibrbd: avoid possible recursive lock when racing acquire lock 12991/head
Jason Dillaman [Thu, 19 Jan 2017 01:54:22 +0000 (20:54 -0500)]
librbd: avoid possible recursive lock when racing acquire lock

Fixes: http://tracker.ceph.com/issues/17447
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #12492 from yehudasa/wip-func-oid-tracing
Yehuda Sadeh [Wed, 18 Jan 2017 23:19:21 +0000 (15:19 -0800)]
Merge pull request #12492 from yehudasa/wip-func-oid-tracing

osd, messenger, librados: lttng oid tracing

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agolibrbd: clean up pre-release lock handling 12982/head
Jason Dillaman [Wed, 18 Jan 2017 16:14:56 +0000 (11:14 -0500)]
librbd: clean up pre-release lock handling

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agotest: separate testing of exclusive lock from managed lock
Jason Dillaman [Wed, 18 Jan 2017 15:44:52 +0000 (10:44 -0500)]
test: separate testing of exclusive lock from managed lock

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agolibrbd: removed ManagedLock dependency from ancillary classes
Jason Dillaman [Tue, 17 Jan 2017 18:42:43 +0000 (13:42 -0500)]
librbd: removed ManagedLock dependency from ancillary classes

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #12972 from linuxbox2/wip-librgw-shut
Matt Benjamin [Wed, 18 Jan 2017 21:31:26 +0000 (16:31 -0500)]
Merge pull request #12972 from linuxbox2/wip-librgw-shut

rgw: librgw shut

8 years agodoc: clarify SubmittingPatches.rst 12988/head
Nathan Cutler [Wed, 18 Jan 2017 21:17:49 +0000 (22:17 +0100)]
doc: clarify SubmittingPatches.rst

This commit clarifies that folks opening bugfix PRs that need backporting to
one or more stable branches should always target master, and that the
backporting itself takes place only after the master PR is merged.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12907 from theanalyst/wip-18064
Casey Bodley [Wed, 18 Jan 2017 19:21:41 +0000 (14:21 -0500)]
Merge pull request #12907 from theanalyst/wip-18064

rgw: sync status compares the current master period

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12357 from dongbula/fix-versioned-bucket-datasync-fail
Casey Bodley [Wed, 18 Jan 2017 19:21:00 +0000 (14:21 -0500)]
Merge pull request #12357 from dongbula/fix-versioned-bucket-datasync-fail

rgw: fix versioned bucket data sync fail when upload is busy

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12945 from jimmyway/wip-add-cmd-snap-set-limit-prompt
Jason Dillaman [Wed, 18 Jan 2017 19:15:58 +0000 (14:15 -0500)]
Merge pull request #12945 from jimmyway/wip-add-cmd-snap-set-limit-prompt

rbd: add error prompt when input command 'snap set limit' is incomplete

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #12886 from rjfd/wip-shared-managed-lock
Jason Dillaman [Wed, 18 Jan 2017 19:15:03 +0000 (14:15 -0500)]
Merge pull request #12886 from rjfd/wip-shared-managed-lock

librbd: support for shared locking in ManagedLock

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agorgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT. 12865/head
Radoslaw Zarzynski [Tue, 10 Jan 2017 11:09:50 +0000 (12:09 +0100)]
rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT.

Before this patch the flag was wrongly handled in the Swift API
implementation. In rare conditions this might result in setting
req_state::system_request.

This may happen only if both of those conditions are fulfilled:
 * RadosGW is running in a multi-site configuration (at least
   one user with the system flag turned on is present),
 * the "rgw_swift_account_in_url" configurable has been switched
   to true. The value is false by default and our documentation
   doesn't actually mention about the option.

The issue doesn't affect Jewel nor any previous release.

Fixes: http://tracker.ceph.com/issues/18476
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
8 years agolibrgw: remove call to crypto::shutdown 12972/head
Matt Benjamin [Wed, 18 Jan 2017 04:27:41 +0000 (23:27 -0500)]
librgw: remove call to crypto::shutdown

The call is cognate to removed code in radosgw, and triggers an
assert that the crypto module has already been shutdown.  With this
and preceding changes, I see clean shutdown on abnormal termination
of nfs-ganesha during startup.

Fixes: http://tracker.ceph.com/issues/18585
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
8 years agorgw: s/static std::map/static pointer/ for ext_mime_map
Matt Benjamin [Wed, 18 Jan 2017 04:10:58 +0000 (23:10 -0500)]
rgw:  s/static std::map/static pointer/ for ext_mime_map

In some librgw shutdown cases, it appears that the shared
object runtime has partially destructed the static map when
our shutdown code is running.

Fixes: http://tracker.ceph.com/issues/18585
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
8 years agorgw_file: signal RGWLibFrontend shutdown correctly
Matt Benjamin [Wed, 18 Jan 2017 04:07:17 +0000 (23:07 -0500)]
rgw_file:  signal RGWLibFrontend shutdown correctly

The shutdown member of RGWLibProcess should be set.

Fixes: http://tracker.ceph.com/issues/18585
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
8 years agoMerge pull request #12927 from rjfd/wip-fix-rpath-suse
Kefu Chai [Wed, 18 Jan 2017 15:08:09 +0000 (23:08 +0800)]
Merge pull request #12927 from rjfd/wip-fix-rpath-suse

cmake: fix rpath on shared libraries and binaries targets

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #12750 from zhangsw/feature-rgw-lc-validatei
Daniel Gryniewicz [Wed, 18 Jan 2017 14:36:50 +0000 (09:36 -0500)]
Merge pull request #12750 from zhangsw/feature-rgw-lc-validatei

rgw: add lifecycle validation according to S3.

8 years agoos/bluestore/BlueFS: dump allocator freelist on failure in reclaim_blocks 12963/head
Sage Weil [Wed, 18 Jan 2017 12:35:59 +0000 (07:35 -0500)]
os/bluestore/BlueFS: dump allocator freelist on failure in reclaim_blocks

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/BlueFS: handle failure to reclaim blocks without crashing
Sage Weil [Wed, 18 Jan 2017 12:24:06 +0000 (06:24 -0600)]
os/bluestore/BlueFS: handle failure to reclaim blocks without crashing

We shouldn't fail to reclaim space in general, but if we do, do not treat
it as a fatal error.  Log loudly.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12827 from Liuchang0812/wip-18459
Daniel Gryniewicz [Wed, 18 Jan 2017 14:08:39 +0000 (09:08 -0500)]
Merge pull request #12827 from Liuchang0812/wip-18459

doc: correct S3 lifecycle support explain

8 years agounitest_bit_alloc, unittest_alloc: fixes
Sage Weil [Tue, 17 Jan 2017 17:15:40 +0000 (12:15 -0500)]
unitest_bit_alloc, unittest_alloc: fixes

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: prealloc/reserve extent vector for common alloc path
Sage Weil [Tue, 17 Jan 2017 16:17:38 +0000 (11:17 -0500)]
os/bluestore: prealloc/reserve extent vector for common alloc path

No need to worry about the gift/reclaim path--those are very rare.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/Allocator: drop unused and goofy release_extents
Sage Weil [Tue, 17 Jan 2017 15:26:50 +0000 (10:26 -0500)]
os/bluestore/Allocator: drop unused and goofy release_extents

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: drop useless count arg to allocate
Sage Weil [Tue, 17 Jan 2017 15:25:34 +0000 (10:25 -0500)]
os/bluestore: drop useless count arg to allocate

The vector<> has a size.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: return blocks allocated from allocate()
Sage Weil [Tue, 17 Jan 2017 15:20:07 +0000 (10:20 -0500)]
os/bluestore: return blocks allocated from allocate()

Instead of having a separate output argument with the number of
blocks allocated, just return it via the return value.  Simplifies
the calling convention.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore: manage vector from ExtentList
Sage Weil [Tue, 17 Jan 2017 15:56:13 +0000 (10:56 -0500)]
os/bluestore: manage vector from ExtentList

ExtentList was previous relying the caller to preallocate/size the
vector to be large enough for the worst case allocation of extents,
and keeping it's own manual count of the extent list size.  Instead,
manage that from ExtentList, and remove the preallocation from the
callers.

Fixes: http://tracker.ceph.com/issues/18573
Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12681 from xiexingguo/xxg-wip-bluestore-1227
Sage Weil [Wed, 18 Jan 2017 13:37:15 +0000 (07:37 -0600)]
Merge pull request #12681 from xiexingguo/xxg-wip-bluestore-1227

os/bluestore: generate same onode extent-shard keys in a more efficient way

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agoMerge pull request #12696 from xiexingguo/xxg-wip-improve-loops
Sage Weil [Wed, 18 Jan 2017 13:36:45 +0000 (07:36 -0600)]
Merge pull request #12696 from xiexingguo/xxg-wip-improve-loops

os/bluestore: miscellaneous fixes to BitAllocator

Reviewed-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
8 years agoMerge pull request #12719 from xiexingguo/xxg-wip-bluestore-1229
Sage Weil [Wed, 18 Jan 2017 13:36:00 +0000 (07:36 -0600)]
Merge pull request #12719 from xiexingguo/xxg-wip-bluestore-1229

os/bluestore/BitmapFreelistManager: readability improvements

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12942 from Liuchang0812/cleanup-bluestore
Sage Weil [Wed, 18 Jan 2017 13:35:41 +0000 (07:35 -0600)]
Merge pull request #12942 from Liuchang0812/cleanup-bluestore

os/bluestore: avoid unnecessary memory copy, use variable reference in BlockDevice::Open

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agoMerge pull request #12946 from ifed01/wip-bluestore-pextent-vector-mempooled
Sage Weil [Wed, 18 Jan 2017 13:35:18 +0000 (07:35 -0600)]
Merge pull request #12946 from ifed01/wip-bluestore-pextent-vector-mempooled

os/bluestore: Add bluestore pextent vector to mempool

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agocmake: fix rpath on shared libraries and executables 12927/head
Ricardo Dias [Fri, 13 Jan 2017 20:15:02 +0000 (20:15 +0000)]
cmake: fix rpath on shared libraries and executables

The problem was due to the attempt of CMake to rewrite the RPATH of
the executables, or shared libraries, that didn't have any RPATH linked
during the building phase.

Currently INSTALL_RPATH is already set for all binaries. This patch
sets an empty INSTALL_RPATH for all binaries that don't depend on
any internal (also being built) target.

Signed-off-by: Ricardo Dias <rdias@suse.com>
8 years agoOSDMonitor: calculate failure time only when osd reported failed 12938/head
Mingxin Liu [Mon, 16 Jan 2017 03:54:34 +0000 (11:54 +0800)]
OSDMonitor: calculate failure time only when osd reported failed

Signed-off-by: Mingxin Liu <mingxin@xsky.com>
8 years agoOSDMonitor: drop report message from all another reporters is not reasonable
Mingxin Liu [Fri, 13 Jan 2017 07:12:34 +0000 (15:12 +0800)]
OSDMonitor: drop report message from all another reporters is not reasonable

if osd failed finally, this may make these reporters cannot receive lastest
update right away, besides, it's not effective to make a traverse of all reporters

Signed-off-by: Mingxin Liu <mingxin@xsky.com>
8 years agoosd/OSDMap: make get prev/next up osd more efficient 12976/head
Mingxin Liu [Wed, 18 Jan 2017 10:31:52 +0000 (18:31 +0800)]
osd/OSDMap: make get prev/next up osd more efficient

what's more, in get_previous_up_osd_before(), if arg n = 0, run into endless loop

Signed-off-by: Mingxin Liu <mingxin@xsky.com>
8 years agodoc: correct S3 lifecycle support explain 12827/head
liuchang0812 [Mon, 9 Jan 2017 03:34:02 +0000 (11:34 +0800)]
doc: correct S3 lifecycle support explain

Fixes: http://tracker.ceph.com/issues/18459
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
8 years agomon: don't set last_osd_report when the pg stats msg is ignored 12975/head
Zhiqiang Wang [Wed, 14 Sep 2016 10:43:41 +0000 (06:43 -0400)]
mon: don't set last_osd_report when the pg stats msg is ignored

In some cases, this may lead to mon wrongly marking an osd down
because of no pg stats after a specified time period.

Signed-off-by: Zhiqiang Wang <zhiqiang@xsky.com>