]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoos/bluestore: don't use virtual for accessing BitMapZone::is_exhausted. 14348/head
Radoslaw Zarzynski [Wed, 5 Apr 2017 00:31:53 +0000 (02:31 +0200)]
os/bluestore: don't use virtual for accessing BitMapZone::is_exhausted.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
8 years agoMerge pull request #13621 from Jing-Scott/add-remov-x-delete-feature
Radoslaw Zarzynski [Mon, 3 Apr 2017 13:19:12 +0000 (15:19 +0200)]
Merge pull request #13621 from Jing-Scott/add-remov-x-delete-feature

rgw: add the remove-x-delete feature to cancel swift object expiration

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
8 years agoMerge pull request #13862 from jcsp/wip-16523
John Spray [Mon, 3 Apr 2017 10:56:37 +0000 (11:56 +0100)]
Merge pull request #13862 from jcsp/wip-16523

qa, mds: add checks for fragmentation, and enable it by default

8 years agoMerge pull request #14156 from smithfarm/release-notes-add-rbd-mirror
Nathan Cutler [Mon, 3 Apr 2017 10:16:17 +0000 (12:16 +0200)]
Merge pull request #14156 from smithfarm/release-notes-add-rbd-mirror

tools: ceph-release-notes: prefixes and pep8 compliance

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
8 years agoMerge pull request #12084 from hansbogert/patch-4
Orit Wasserman [Mon, 3 Apr 2017 07:21:25 +0000 (10:21 +0300)]
Merge pull request #12084 from hansbogert/patch-4

rgw: Add --zonegroup-new-name  in usage
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #14269 from liewegas/wip-no-spinlock
Kefu Chai [Mon, 3 Apr 2017 07:16:58 +0000 (15:16 +0800)]
Merge pull request #14269 from liewegas/wip-no-spinlock

mon/OSDMonitor: spinlock -> std::mutex

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14274 from liewegas/wip-osd-beacon-fix
Kefu Chai [Mon, 3 Apr 2017 07:16:05 +0000 (15:16 +0800)]
Merge pull request #14274 from liewegas/wip-osd-beacon-fix

osd: fix some osd beacon bugs

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14288 from Adirl/small_leaks
Haomai Wang [Sun, 2 Apr 2017 20:28:56 +0000 (04:28 +0800)]
Merge pull request #14288 from Adirl/small_leaks

msg/async/rdma: Fix small memory leaks detected by valgrind

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agomsg/async/rdma: Fix small memory leaks detected by valgrind 14288/head
Amir Vadai [Sun, 26 Mar 2017 10:24:19 +0000 (13:24 +0300)]
msg/async/rdma: Fix small memory leaks detected by valgrind

Issue: 995322
Change-Id: Iccffbd0defd09aa51c4b51b78733921444ea1c5f
Signed-off-by: Amir Vadai <amir@vadai.me>
8 years agoMerge pull request #14170 from liewegas/wip-fewer-warnings
Kefu Chai [Sun, 2 Apr 2017 04:53:29 +0000 (12:53 +0800)]
Merge pull request #14170 from liewegas/wip-fewer-warnings

common/ceph_context: fewer warnings about experimental features

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14271 from joscollin/wip-krbd-warning
Brad Hubbard [Sat, 1 Apr 2017 22:59:38 +0000 (08:59 +1000)]
Merge pull request #14271 from joscollin/wip-krbd-warning

rbd: warning, ‘devno’ may be used uninitialized in this function

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #13909 from kestrels/wip-19217
Kefu Chai [Sat, 1 Apr 2017 17:44:03 +0000 (01:44 +0800)]
Merge pull request #13909 from kestrels/wip-19217

crc32c: Add crc32c function optimized for ppc architecture

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14124 from Fabian-Gruenbichler/ipv6_fix
Kefu Chai [Sat, 1 Apr 2017 17:41:50 +0000 (01:41 +0800)]
Merge pull request #14124 from Fabian-Gruenbichler/ipv6_fix

common: fix segfault in public IPv6 addr picking

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14173 from badone/wip-do_request-abort
Kefu Chai [Sat, 1 Apr 2017 17:40:30 +0000 (01:40 +0800)]
Merge pull request #14173 from badone/wip-do_request-abort

common: Fix heap buffer overflow in do_request

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14193 from liupan1111/wip-fix-delete-full
Kefu Chai [Sat, 1 Apr 2017 17:39:46 +0000 (01:39 +0800)]
Merge pull request #14193 from liupan1111/wip-fix-delete-full

librados: set the flag CEPH_OSD_FLAG_FULL_TRY of Op in the right place.

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #14248 from badone/wip-simple_spin_lock-delay
Kefu Chai [Sat, 1 Apr 2017 17:38:13 +0000 (01:38 +0800)]
Merge pull request #14248 from badone/wip-simple_spin_lock-delay

common: Make spinlock delay more conventional

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #13690 from jcsp/wip-17503
Kefu Chai [Sat, 1 Apr 2017 17:37:31 +0000 (01:37 +0800)]
Merge pull request #13690 from jcsp/wip-17503

mgr: pass through cluster log to plugins

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14276 from atheism/rgw-rgwop-remove-unused-iter
Orit Wasserman [Sat, 1 Apr 2017 06:48:46 +0000 (09:48 +0300)]
Merge pull request #14276 from atheism/rgw-rgwop-remove-unused-iter

rgw: rgw_op: remove unused variable iter
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agorgw: rgw_op: remove unused variable iter 14276/head
Weibing Zhang [Sat, 1 Apr 2017 03:52:59 +0000 (11:52 +0800)]
rgw: rgw_op: remove unused variable iter

    The variable iter is not used in  RGWInitMultipart::execute().

Signed-off-by: Weibing Zhang <zhangweibing@unitedstack.com>
8 years agoMerge pull request #13811 from rzarzynski/wip-bs-bitmap-mem-cleanup
Sage Weil [Sat, 1 Apr 2017 01:54:22 +0000 (20:54 -0500)]
Merge pull request #13811 from rzarzynski/wip-bs-bitmap-mem-cleanup

os/bluestore: memory and dereference clean-up in the BitAllocator

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #14121 from majianpeng/bluefs-get-allocated
Sage Weil [Sat, 1 Apr 2017 01:54:07 +0000 (20:54 -0500)]
Merge pull request #14121 from majianpeng/bluefs-get-allocated

os/bluestore/BlueFS: optimize get_allocated

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #14162 from majianpeng/optimize-bluestore-force-flush
Sage Weil [Sat, 1 Apr 2017 01:53:57 +0000 (20:53 -0500)]
Merge pull request #14162 from majianpeng/optimize-bluestore-force-flush

os/bluestore: clean up flush logic

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #14225 from ivancich/wip_fix_throttle_config_change
Sage Weil [Sat, 1 Apr 2017 01:52:59 +0000 (20:52 -0500)]
Merge pull request #14225 from ivancich/wip_fix_throttle_config_change

os/bluestore: make live changes for BlueStore throttle config work like initial config

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoosd: only send beacon on connect if active 14274/head
Sage Weil [Fri, 31 Mar 2017 19:23:27 +0000 (15:23 -0400)]
osd: only send beacon on connect if active

Otherwise the mon will just ignore it and we'll wait another
cycle.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoosd: fix beacon condition
Sage Weil [Fri, 31 Mar 2017 19:22:00 +0000 (15:22 -0400)]
osd: fix beacon condition

- && should have been ||
- change this to instead not send when monmap epoch==0,
  and only set last_sent_beacon if we actually send.  That
  way we'll send on the next tick after we get a real monmap.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #14229 from ceph/wip-systemd
vasukulkarni [Fri, 31 Mar 2017 16:15:53 +0000 (09:15 -0700)]
Merge pull request #14229 from ceph/wip-systemd

qa: Add reboot case for systemd test

8 years agoMerge pull request #14254 from idryomov/wip-vstart-runner-ps
John Spray [Fri, 31 Mar 2017 16:15:30 +0000 (17:15 +0100)]
Merge pull request #14254 from idryomov/wip-vstart-runner-ps

qa/vstart_runner: amend ps invocation

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #14226 from ceph/preset-mon
vasukulkarni [Fri, 31 Mar 2017 16:15:21 +0000 (09:15 -0700)]
Merge pull request #14226 from ceph/preset-mon

systemd: remove ceph-create-keys from presets

8 years agoMerge pull request #14266 from tchaikov/wip-require-mgr-for-pg-dump
Sage Weil [Fri, 31 Mar 2017 15:58:56 +0000 (10:58 -0500)]
Merge pull request #14266 from tchaikov/wip-require-mgr-for-pg-dump

tests: add MGR=1 so 'pg dump' won't be blocked

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
8 years agoMerge pull request #14259 from johnwilkins/wip-doc-multisite
Sage Weil [Fri, 31 Mar 2017 15:52:53 +0000 (10:52 -0500)]
Merge pull request #14259 from johnwilkins/wip-doc-multisite

doc: wip-doc-multisite ports downstream multisite document upstream.

8 years agorbd: warning, ‘devno’ may be used uninitialized in this function 14271/head
Jos Collin [Fri, 31 Mar 2017 14:31:23 +0000 (20:01 +0530)]
rbd: warning, ‘devno’ may be used uninitialized in this function

The following warning appears during make. Fixed in both unmap_image() functions in krbd.cc

--
krbd.cc: In function ‘int krbd_unmap_by_spec(krbd_ctx*, const char*, const char*, const char*, const char*)’:
krbd.cc:608:65: warning: ‘devno’ may be used uninitialized in this function [-Wmaybe-uninitialized]
   return do_unmap(ctx->udev, devno, build_unmap_buf(id, options));
                                                                 ^
krbd.cc:591:9: note: ‘devno’ was declared here
   dev_t devno;
--

Signed-off-by: Jos Collin <jcollin@redhat.com>
8 years agomon/OSDMonitor: spinlock -> std::mutex 14269/head
Sage Weil [Fri, 31 Mar 2017 13:33:19 +0000 (09:33 -0400)]
mon/OSDMonitor: spinlock -> std::mutex

I think spinlock is dangerous here: we're doing semi-unbounded
work (decode).  Also seemingly innocuous code like dout macros
take mutexes.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoosd/OSDMap: use _pg_to_up_acting_osds() to get_pg_acting_primary() 14266/head
Kefu Chai [Fri, 31 Mar 2017 10:32:41 +0000 (18:32 +0800)]
osd/OSDMap: use _pg_to_up_acting_osds() to get_pg_acting_primary()

avoid unnecessary swap() call of vector<int> which will be dropped on
the floor after getting its first element, which can be retrieved using
another parameter using _pg_to_up_acting_osds() directly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomgr: use OSDMap::get_pg_acting_primary() to get the primary
Kefu Chai [Fri, 31 Mar 2017 10:30:53 +0000 (18:30 +0800)]
mgr: use OSDMap::get_pg_acting_primary() to get the primary

OSDMap::pg_to_acting_osds() assumes that the "acting" parameter is not
null.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agotests: add MGR=1 so 'pg dump' won't be blocked
Kefu Chai [Fri, 31 Mar 2017 06:26:09 +0000 (14:26 +0800)]
tests: add MGR=1 so 'pg dump' won't be blocked

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14260 from dmick/wip-workunit-clone-with-branch
Kefu Chai [Fri, 31 Mar 2017 05:17:46 +0000 (13:17 +0800)]
Merge pull request #14260 from dmick/wip-workunit-clone-with-branch

workunit: request branch when cloning

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agocommon: Make spinlock delay more conventional 14248/head
Brad Hubbard [Thu, 30 Mar 2017 06:50:32 +0000 (16:50 +1000)]
common: Make spinlock delay more conventional

The accepted method of implementing a spinlock delay is the "pause"
instruction.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
8 years agotasks/workunit.py: specify the branch name when cloning a branch 14260/head
Kefu Chai [Thu, 30 Mar 2017 04:37:01 +0000 (12:37 +0800)]
tasks/workunit.py: specify the branch name when cloning a branch

c1309fb failed to specify a branch when cloning using --depth=1, which
by default clones the HEAD. and we can not "git checkout" a specific
sha1 if it is not HEAD, after cloning using '--depth=1', so in this
change, we dispatch "tag", "branch", "HEAD" using three Refspec classes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Dan Mick <dan.mick@redhat.com>
8 years agoMerge pull request #14219 from ShiqiCooperation/master
Sage Weil [Thu, 30 Mar 2017 22:23:09 +0000 (17:23 -0500)]
Merge pull request #14219 from ShiqiCooperation/master

os/bluestore: clean up Invalid return value judgment

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #14228 from ifed01/wip-bluestore-fix-store-test
Sage Weil [Thu, 30 Mar 2017 22:21:55 +0000 (17:21 -0500)]
Merge pull request #14228 from ifed01/wip-bluestore-fix-store-test

test/store_test: fix bluestore test cases disablement

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agoMerge pull request #13617 from liewegas/wip-mgr-commands
Sage Weil [Thu, 30 Mar 2017 22:12:00 +0000 (17:12 -0500)]
Merge pull request #13617 from liewegas/wip-mgr-commands

mon,mgr: tag some commands for ceph-mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agomon/ConfigKeyService: wait for quorum 13617/head
Sage Weil [Thu, 30 Mar 2017 16:42:31 +0000 (12:42 -0400)]
mon/ConfigKeyService: wait for quorum

Among other things, this prevents a mgr activation stall if it
happens to request config-keys from a mon that is out of
quorum.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomon/MgrMonitor: show delta
Sage Weil [Thu, 30 Mar 2017 16:31:35 +0000 (12:31 -0400)]
mon/MgrMonitor: show delta

This is mostly because I couldn't debug a weird state where
it kept updating but it appeared the addr was not changing
(always '-').

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomon/MgrMap: implement dump, add to ceph-dencoder
Sage Weil [Thu, 30 Mar 2017 16:19:41 +0000 (12:19 -0400)]
mon/MgrMap: implement dump, add to ceph-dencoder

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomon/MgrMonitor: print MgrMap to log on each change
Sage Weil [Thu, 30 Mar 2017 16:06:43 +0000 (12:06 -0400)]
mon/MgrMonitor: print MgrMap to log on each change

The other services do this.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomon/MgrMonitor: health warn/err if no active mgr
Sage Weil [Thu, 30 Mar 2017 14:40:23 +0000 (10:40 -0400)]
mon/MgrMonitor: health warn/err if no active mgr

Start warning once mons are luminous; start erroring once
require_luminous is set in osdmap.  Allow a grace period for
mgr to restart or standby to take over before we turn a warning
into an error.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoPorted the downstream (and tested) document upstream. 14259/head
John Wilkins [Thu, 30 Mar 2017 21:54:42 +0000 (14:54 -0700)]
Ported the downstream (and tested) document upstream.

Signed-off-by: John Wilkins <jowilkin@redhat.com>
8 years agoClarified index.
John Wilkins [Thu, 30 Mar 2017 21:53:49 +0000 (14:53 -0700)]
Clarified index.

Signed-off-by: John Wilkins <jowilkin@redhat.com>
8 years agodoc: Added a new version of the multi-site graphic.
John Wilkins [Thu, 30 Mar 2017 21:07:07 +0000 (14:07 -0700)]
doc: Added a new version of the multi-site graphic.

Signed-off-by: John Wilkins <jowilkin@redhat.com>
8 years agoMerge pull request #14183 from joscollin/wip-rgw-cleanup-removeunwantedheaders
Orit Wasserman [Thu, 30 Mar 2017 17:44:12 +0000 (20:44 +0300)]
Merge pull request #14183 from joscollin/wip-rgw-cleanup-removeunwantedheaders

rgw: Removed Unwanted headers
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #14194 from joscollin/wip-rgw_rados-warning
Yehuda Sadeh [Thu, 30 Mar 2017 17:43:37 +0000 (10:43 -0700)]
Merge pull request #14194 from joscollin/wip-rgw_rados-warning

rgw: warning, output may be truncated before the last format character

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
8 years agoqa/vstart_runner: amend ps invocation 14254/head
Ilya Dryomov [Thu, 30 Mar 2017 16:59:08 +0000 (18:59 +0200)]
qa/vstart_runner: amend ps invocation

"ps -xwwu<id>" is parsed as BSD, because -x is not a UNIX option.
"u" is a BSD option for user-oriented format, so the <id> ends up being
parsed as an old-style "select by pid".  The only reason this command
doesn't dump other user's processes is that the BSD "only yourself"
restriction is in effect.

I'm not sure what's wrong with a simple "ps xww", but if we want to
select by euid, let's do it right.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
8 years agoMerge pull request #14253 from liupan1111/wip-remove-debug-message
Mykola Golub [Thu, 30 Mar 2017 17:24:03 +0000 (20:24 +0300)]
Merge pull request #14253 from liupan1111/wip-remove-debug-message

rbd-nbd: remove debug messages from do_unmap

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #13999 from tchaikov/wip-extract-creating-pgs
Kefu Chai [Thu, 30 Mar 2017 16:35:45 +0000 (00:35 +0800)]
Merge pull request #13999 from tchaikov/wip-extract-creating-pgs

mon,osd: decouple creating pgs from pgmap

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agorbd-nbd: remove debug message from do_unmap 14253/head
Pan Liu [Thu, 30 Mar 2017 16:23:12 +0000 (00:23 +0800)]
rbd-nbd: remove debug message from do_unmap

Global context is not initialized when do_unmap is called.

Signed-off-by: Pan Liu <liupan1111@gmail.com>
8 years agotools/ceph-objectstore-tool: always set first_committed 13999/head
Kefu Chai [Wed, 29 Mar 2017 08:34:26 +0000 (16:34 +0800)]
tools/ceph-objectstore-tool: always set first_committed

otherwise the workaround of 7fb3804fb is triggered. we need to remove
that workaround later on.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon: switch to osdmon when handling osd_pg_creates subs
Kefu Chai [Mon, 27 Mar 2017 03:12:09 +0000 (11:12 +0800)]
mon: switch to osdmon when handling osd_pg_creates subs

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: avoid search and lookup anti-pattern
Kefu Chai [Sun, 26 Mar 2017 04:12:43 +0000 (12:12 +0800)]
mon/OSDMonitor: avoid search and lookup anti-pattern

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: pass by reference not pointer of const param
Kefu Chai [Sun, 26 Mar 2017 04:05:12 +0000 (12:05 +0800)]
mon/OSDMonitor: pass by reference not pointer of const param

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: switch to the new creating_pgs
Kefu Chai [Tue, 14 Mar 2017 12:03:59 +0000 (20:03 +0800)]
mon/OSDMonitor: switch to the new creating_pgs

* prime_pg_temp(): switch to the new creating_pgs
* get_trim_to(): switch to the new creating_pgs

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon: handle MOSDPGCreated messages
Kefu Chai [Mon, 13 Mar 2017 07:50:17 +0000 (15:50 +0800)]
mon: handle MOSDPGCreated messages

MOSDPGCreated messages are used to prune the creating_pgs_by_osd_epoch
and creating_pgs, by updating created_pools. as once a pool is created
we will not send MOSDPGCreate to its acting_primary OSD anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoosd: send pg-created message if any pg is newly created
Kefu Chai [Mon, 13 Mar 2017 07:13:03 +0000 (15:13 +0800)]
osd: send pg-created message if any pg is newly created

add an option named "osd_created_report_interval" to specify the
interval to check and send the "pg_created" mesages to mon

because pg could update its state when it is still in the pg_stat_queue,
for example, to change its state to PG_STATE_CLEAN, we cannot tell if we
have sent a "pg-created" message for it or not without introducing a new
member variable in PG.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomessages/MPGCreated: add MPGCreated
Kefu Chai [Sat, 11 Mar 2017 14:50:50 +0000 (22:50 +0800)]
messages/MPGCreated: add MPGCreated

add a new message type MPGCreated. osd is supposed to send this message
to monitor to inform that any pg(s) is created and activated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: add send_pg_create() to OSDMonitor
Kefu Chai [Thu, 9 Mar 2017 04:08:29 +0000 (12:08 +0800)]
mon/OSDMonitor: add send_pg_create() to OSDMonitor

OSDMonitor will handle the pg-create subscriptions after luminous.
1. scan new pools to get the pgs to be created
2. send pg creates using the collected pgs
3. trim the creating_pgs using the "created!" messages from OSD.

please note that we need to wait for the OSDMonitor::mapping to be fully
populated, so we cannot scan the incrementa map for creating pgs until
it is applied and accepted by other monitors.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon: acquire lock when accessing mon->session_map
Kefu Chai [Tue, 28 Mar 2017 03:29:20 +0000 (11:29 +0800)]
mon: acquire lock when accessing mon->session_map

we will access the mon->session_map for sending the osd-pg-creates
messages when finishing osdmapping in OSDMonitor, this could happen in
another thread without the protection of Monitor::lock, or in the same
thread already guarded by Monitor::lock. so instead of changing
Monitor::lock to a recursive lock, a new lock is introduced to protect
session_map.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: run mapping on peons also
Kefu Chai [Sun, 19 Mar 2017 06:02:15 +0000 (14:02 +0800)]
mon/OSDMonitor: run mapping on peons also

otherwise subcriptions on peons won't get the creating_pgs notification
mapping updated. we want to send the notification from peons also. and
the notifications should be updated with the updated pg mapping.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: mapping is not optional anymore
Kefu Chai [Thu, 16 Mar 2017 09:43:19 +0000 (17:43 +0800)]
mon/OSDMonitor: mapping is not optional anymore

as pg_creatings needs mapping to get the acting_primary osd of the
creating pg, so we can send the pg-create message to it if it subscribes
to this information, mapping should always be available now.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon: dispatch osd_beacon message to OSDMonitor
Kefu Chai [Thu, 9 Mar 2017 08:25:59 +0000 (16:25 +0800)]
mon: dispatch osd_beacon message to OSDMonitor

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoosd: send osd-beacon to mon periodically
Kefu Chai [Sat, 11 Mar 2017 09:51:13 +0000 (17:51 +0800)]
osd: send osd-beacon to mon periodically

add an option named "osd_beacon_report_interval" to specify the interval
to send osd-beacon.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomessages/MOSDBeacon: add beacon msg
Kefu Chai [Fri, 10 Mar 2017 17:27:59 +0000 (01:27 +0800)]
messages/MOSDBeacon: add beacon msg

osd will send beacon message to monitor periodically to inform it that
"i am still alive!", previously, monitor use the pg-stats to check the
status of OSD, but since osd will only send pg stat to mgr after
luminous, we use a dedicated msg for this purpose.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: s/check_sub/check_osdmap_sub/
Kefu Chai [Thu, 9 Mar 2017 02:27:43 +0000 (10:27 +0800)]
mon/OSDMonitor: s/check_sub/check_osdmap_sub/

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/OSDMonitor: update comment in update_from_paxos()
Kefu Chai [Thu, 9 Mar 2017 14:14:41 +0000 (22:14 +0800)]
mon/OSDMonitor: update comment in update_from_paxos()

this change updates the comment for 7fb3804fb97462a3 and e807770,
to reflect the reason why we need to fix latest_full in current code.
as the fix is not a workaround for cuttlefish anymore, it resolves the
issue where

0. mon.c has a latest_full of 5
1. mon.c is shutdown and out of sync with the quorum
2. mon.c starts sync
3. mon.c now has osdmap[31..50], and the latest_full is still 5.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/PGMonitor: remove unused variable
Kefu Chai [Mon, 6 Mar 2017 06:01:51 +0000 (14:01 +0800)]
mon/PGMonitor: remove unused variable

last_pg_scan is not used in PGMonitor::update_from_paxos(), so remove
it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon/PGmonitor: remove unused last_sent_pg_create
Kefu Chai [Mon, 6 Mar 2017 02:31:07 +0000 (10:31 +0800)]
mon/PGmonitor: remove unused last_sent_pg_create

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomon: pass const variables by const ref not pointer
Kefu Chai [Fri, 24 Feb 2017 12:38:03 +0000 (20:38 +0800)]
mon: pass const variables by const ref not pointer

* PGMapUpdater::check_down_pgs(): pass a const reference to pgmap
  instead of a pointer
* PGMapUpdater::register_new_pgs(): pass a const reference to pgmap
  instead of a pointer

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14250 from Adirl/fix_last_poll_dev
Haomai Wang [Thu, 30 Mar 2017 10:37:39 +0000 (18:37 +0800)]
Merge pull request #14250 from Adirl/fix_last_poll_dev

msg/async/rdma: Device::last_poll_dev must be positive

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agomsg/async/rdma: Device::last_poll_dev must be positive 14250/head
Amir Vadai [Sun, 26 Mar 2017 10:24:19 +0000 (13:24 +0300)]
msg/async/rdma: Device::last_poll_dev must be positive

Make Device::last_poll_dev `unsigned` - it could overlap and should not
be negative.
Also, add missing initialization.

Change-Id: I558f02292ae4f5d1ce48d9bcda5047d382604237
Signed-off-by: Amir Vadai <amir@vadai.me>
8 years agoMerge pull request #14249 from Adirl/rdma-cm-4_1
Haomai Wang [Thu, 30 Mar 2017 09:40:49 +0000 (17:40 +0800)]
Merge pull request #14249 from Adirl/rdma-cm-4_1

msg/async/rdma: Debug prints for ibv_*

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agomsg/async/rdma: Debug prints for ibv_* 14249/head
Amir Vadai [Tue, 31 Jan 2017 08:05:15 +0000 (10:05 +0200)]
msg/async/rdma: Debug prints for ibv_*

Setting RDMA_DEBUG to 1, will enable debug prints for every ibv_*
function called.
This makes it easier to debug RDMA issues.

Issue: 995322
Change-Id: I49d327d5d4386b44264f5619d50f2dbc7d76dcae
Signed-off-by: Amir Vadai <amir@vadai.me>
8 years agosystemd: remove all occurence of ceph-create-keys 14226/head
Sébastien Han [Thu, 30 Mar 2017 07:32:31 +0000 (09:32 +0200)]
systemd: remove all occurence of ceph-create-keys

ceph-create-keys unit file does not exist anymore so there is no need to
call it.

Signed-off-by: Sébastien Han <seb@redhat.com>
8 years agoos/bluestore: clean up Invalid return value judgment 14219/head
shiqi [Wed, 29 Mar 2017 06:33:55 +0000 (14:33 +0800)]
os/bluestore: clean up Invalid return value judgment

Signed-off-by: shiqi <1454927420@qq.com>
8 years agoMerge pull request #14245 from tchaikov/wip-revert-14201
Haomai Wang [Thu, 30 Mar 2017 05:21:36 +0000 (13:21 +0800)]
Merge pull request #14245 from tchaikov/wip-revert-14201

Revert "msg/async/rdma: Debug prints for ibv_*"

8 years agoRevert "msg/async/rdma: Debug prints for ibv_*" 14244/head 14245/head
Kefu Chai [Thu, 30 Mar 2017 04:57:58 +0000 (12:57 +0800)]
Revert "msg/async/rdma: Debug prints for ibv_*"

This reverts commit 7d1475f6274531988854cf62f6056f9cfd13ff29.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14201 from Adirl/rdma-cm-4
Haomai Wang [Thu, 30 Mar 2017 00:00:40 +0000 (08:00 +0800)]
Merge pull request #14201 from Adirl/rdma-cm-4

msg/async/rdma: Introduce RDMAConnMgr + Debug prints

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #14214 from dmick/wip-workunit-shallow-clone
Dan Mick [Wed, 29 Mar 2017 18:36:05 +0000 (11:36 -0700)]
Merge pull request #14214 from dmick/wip-workunit-shallow-clone

tasks/workunit.py: when cloning, use --depth=1

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #14202 from tchaikov/wip-cast-size_t-arm32
Jason Dillaman [Wed, 29 Mar 2017 17:33:49 +0000 (13:33 -0400)]
Merge pull request #14202 from tchaikov/wip-cast-size_t-arm32

rbd: use min<uint64_t>() explicitly

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoFix distro's, point to latest version 14229/head
Vasu Kulkarni [Wed, 29 Mar 2017 16:56:11 +0000 (09:56 -0700)]
Fix distro's, point to latest version

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8 years agoAdd reboot case for systemd test
Vasu Kulkarni [Wed, 29 Mar 2017 16:27:20 +0000 (09:27 -0700)]
Add reboot case for systemd test

test systemd units restart after reboot

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8 years agotest/store_test: fix bluestore test cases disablement 14228/head
Igor Fedotov [Wed, 29 Mar 2017 16:34:00 +0000 (16:34 +0000)]
test/store_test: fix bluestore test cases disablement

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agomon/PGMap: set initial pg timestamp as osdmap modified stamp
Sage Weil [Wed, 22 Mar 2017 18:21:46 +0000 (13:21 -0500)]
mon/PGMap: set initial pg timestamp as osdmap modified stamp

Currently the PGMap may register the new pg in multiple places: the
mgr or mon, and the timestamp is when the mon or mgr gets around to
recording it into its PGMap.  Make this deterministic by using the OSDMap
mtime (which is when the PG was *actually* created).

This fixes a problem where the pg create command has one timestamp (from
the mon) and the pgmap on the mgr has another, so an observer will see the
last_scrub_stamp (and other timestamps) change when nothing has actually
happened.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomon/MgrMonitor: do not tick() if not active or leader
Sage Weil [Wed, 22 Mar 2017 16:41:11 +0000 (11:41 -0500)]
mon/MgrMonitor: do not tick() if not active or leader

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomgr/MgrClient: assume missing MgrMap means no acces to mgr at all
Sage Weil [Wed, 22 Mar 2017 16:36:01 +0000 (11:36 -0500)]
mgr/MgrClient: assume missing MgrMap means no acces to mgr at all

If we get as far as authenticating and have no MgrMap that implies the
mon didn't provide us one (despite our request) and we have no access to
the mgr at all.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agolibrados: return error from mgr start_command
Sage Weil [Wed, 22 Mar 2017 16:34:52 +0000 (11:34 -0500)]
librados: return error from mgr start_command

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoqa/tasks/dump_stuck.py: stop making assertions about 'health' report
Sage Weil [Wed, 22 Mar 2017 16:16:23 +0000 (11:16 -0500)]
qa/tasks/dump_stuck.py: stop making assertions about 'health' report

Health comes from teh mon, while the pg stats come from teh mgr, so they
may be out of sync.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomgr/DaemonServer: log commands to cluster + audit logs
Sage Weil [Tue, 14 Mar 2017 13:57:17 +0000 (09:57 -0400)]
mgr/DaemonServer: log commands to cluster + audit logs

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomgr/MgrStandby: add LogClient
Sage Weil [Wed, 22 Mar 2017 01:24:24 +0000 (20:24 -0500)]
mgr/MgrStandby: add LogClient

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomgr/DaemonServer: debug on shutdown
Sage Weil [Wed, 22 Mar 2017 01:05:47 +0000 (20:05 -0500)]
mgr/DaemonServer: debug on shutdown

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomgr/DaemonServer: whitespace
Sage Weil [Tue, 14 Mar 2017 13:57:26 +0000 (09:57 -0400)]
mgr/DaemonServer: whitespace

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomgr/MgrClient: cope with disappearing perf_counters
Sage Weil [Fri, 10 Mar 2017 22:14:24 +0000 (17:14 -0500)]
mgr/MgrClient: cope with disappearing perf_counters

Perfcounters can go away; deal with it.  This collapses
into a single loop, but it means that the mgr might
stop getting certain counters without explicit
notification.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoqa/suites/upgrade/jewel-x: don't initially start mgr daemons
Sage Weil [Sat, 18 Mar 2017 19:02:16 +0000 (15:02 -0400)]
qa/suites/upgrade/jewel-x: don't initially start mgr daemons

Signed-off-by: Sage Weil <sage@redhat.com>