]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
9 years agoMerge pull request #9100 from Abhishekvrshny/wip-15856-jewel
Kefu Chai [Tue, 31 May 2016 05:42:28 +0000 (13:42 +0800)]
Merge pull request #9100 from Abhishekvrshny/wip-15856-jewel

jewel: Hammer (0.94.3) OSD does not delete old OSD Maps in a timely fashion (maybe at all?)

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agoMerge pull request #9245 from dreamhost/wip-15974-jewel
Yehuda Sadeh [Mon, 30 May 2016 10:53:45 +0000 (13:53 +0300)]
Merge pull request #9245 from dreamhost/wip-15974-jewel

rgw: fix manager selection when APIs customized

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
9 years agoMerge pull request #9239 from yehudasa/wip-15886-jewel
Orit Wasserman [Mon, 30 May 2016 09:15:18 +0000 (11:15 +0200)]
Merge pull request #9239 from yehudasa/wip-15886-jewel

rgw: keep track of written_objs correctly
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
9 years agorgw: fix manager selection when APIs customized 9245/head
Robin H. Johnson [Fri, 20 May 2016 23:00:33 +0000 (16:00 -0700)]
rgw: fix manager selection when APIs customized

When modifying rgw_enable_apis per RGW instance, such as for staticsites, you
can end up with RESTManager instance being null in some cases, which returns a
HTTP 405 MethodNotAllowed to all requests.

Example configuration to trigger the bug:
rgw_enable_apis = s3website

Backport: jewel
X-Note: Patch from Yehuda in private IRC discussion, 2016/05/20.
Fixes: http://tracker.ceph.com/issues/15973
Fixes: http://tracker.ceph.com/issues/15974
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
(cherry picked from commit 7c7a465b55f7100eab0f140bf54f9420abd1c776)

9 years agoosd/OpRequest: reset connection upon unregister 9100/head
Kefu Chai [Fri, 13 May 2016 03:26:31 +0000 (11:26 +0800)]
osd/OpRequest: reset connection upon unregister

this helps to free the resources referenced by the connection, among
other things, in the case of MOSDOp, the OSD::Session and OSDMap. this
helps to free the resource earlier and trim the osdmaps in time.

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 87850e96ea6fa45a8368bacabee50f9e95b40ae9)

9 years agoosd: reset session->osdmap if session is not waiting for a map anymore
Kefu Chai [Thu, 12 May 2016 12:28:11 +0000 (20:28 +0800)]
osd: reset session->osdmap if session is not waiting for a map anymore

we should release the osdmap reference once we are done with it,
otherwise we might need to wait very long to update that reference with
a newer osdmap ref. this appears to be an OSDMap leak: it is held by an
quiet OSD::Session forever.

the osdmap is not reset in OSD::session_notify_pg_create(), because its
only caller is wake_pg_waiters(), which will call
dispatch_session_waiting() later. and dispatch_session_waiting() will
check the session->osdmap, and will also reset the osdmap if
session->waiting_for_pg.empty().

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 82b0af7cedc3071cd83ee53479f834c23c62b7d0)

9 years agorgw: keep track of written_objs correctly 9239/head
Yehuda Sadeh [Mon, 16 May 2016 21:35:12 +0000 (14:35 -0700)]
rgw: keep track of written_objs correctly

Fixes: http://tracker.ceph.com/issues/15886
Only add a rados object to the written_objs list if the write
was successful. Otherwise if the write will be canceled for some
reason, we'd remove an object that we didn't write to. This was
a problem in a case where there's multiple writes that went to
the same part. The second writer should fail the write, since
we do an exclusive write. However, we added the object's name
to the written_objs list anyway, which was a real problem when
the old processor was disposed (as it was clearing the objects).

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 8fd74d11682f9d0c9085d2dc445fc3eb5631f6e0)

9 years agoMerge pull request #9232 from jdurgin/wip-mirror-workunit-jewel
Jason Dillaman [Fri, 20 May 2016 18:57:00 +0000 (14:57 -0400)]
Merge pull request #9232 from jdurgin/wip-mirror-workunit-jewel

jewel: qa/workunits/rbd: fixed rbd_mirror teuthology runtime errors

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoqa/workunits/rbd: fixed rbd_mirror teuthology runtime errors 9232/head
Jason Dillaman [Wed, 18 May 2016 18:17:13 +0000 (14:17 -0400)]
qa/workunits/rbd: fixed rbd_mirror teuthology runtime errors

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 8ef09c4d8d3c7c6fbc9b6f7ef17cca0179e73468)

9 years agoMerge pull request #9226 from dillaman/wip-15950
Jason Dillaman [Fri, 20 May 2016 13:02:51 +0000 (09:02 -0400)]
Merge pull request #9226 from dillaman/wip-15950

jewel: rbd-mirror: potential crash during image status update

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoMerge pull request #9069 from dillaman/fixup-mirror_image_status_list-jewel
Jason Dillaman [Fri, 20 May 2016 13:02:06 +0000 (09:02 -0400)]
Merge pull request #9069 from dillaman/fixup-mirror_image_status_list-jewel

jewel: cls::rbd: mirror_image_status_list returned max 64 items

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agojournal: reset watch step after pruning expired tag 9226/head
Jason Dillaman [Thu, 19 May 2016 14:11:12 +0000 (10:11 -0400)]
journal: reset watch step after pruning expired tag

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 48c2f4e079000021b6ebe807bb1dba0dc1a6a11d)

9 years agorbd-mirror: additional debug messages during image replayer start/stop
Jason Dillaman [Wed, 18 May 2016 15:01:22 +0000 (11:01 -0400)]
rbd-mirror: additional debug messages during image replayer start/stop

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit afc891f7fcb000d106b1d722386f6d81ddeddab6)

9 years agorbd-mirror: ensure proper handling of status updates during shutdown
Jason Dillaman [Wed, 18 May 2016 04:55:01 +0000 (00:55 -0400)]
rbd-mirror: ensure proper handling of status updates during shutdown

Previously, several shutdown race conditions could occur due to the
use of the async work queue for scheduling updates.

Fixes: http://tracker.ceph.com/issues/15909
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 9ae4edc05660665c3a135536a7c51d4070d28a40)

9 years agorbd-mirror: track bootstrap state within image status
Jason Dillaman [Wed, 18 May 2016 03:31:02 +0000 (23:31 -0400)]
rbd-mirror: track bootstrap state within image status

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit e5dd97b4bf4a993911febf34dce90470a2a91d59)

9 years agorbd-mirror: combine ImageReplayer stopped and uninitialized states
Jason Dillaman [Wed, 18 May 2016 03:25:25 +0000 (23:25 -0400)]
rbd-mirror: combine ImageReplayer stopped and uninitialized states

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit a8f6dde4dbae8039380f31e026030a22a89fb4bd)

9 years agorbd-mirror: lock ordering issue in status update callback
Jason Dillaman [Tue, 17 May 2016 20:14:42 +0000 (16:14 -0400)]
rbd-mirror: lock ordering issue in status update callback

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 5c04c1361074ca9e9df1bc1c2dd82dfafc2a1304)

9 years agorbd-mirror: don't unregister asok commands if image replayer start failed
Mykola Golub [Wed, 4 May 2016 12:23:11 +0000 (15:23 +0300)]
rbd-mirror: don't unregister asok commands if image replayer start failed

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 2fd6fdd3dc9ecb915362f5e3aa8a224210273540)

9 years agorbd-mirror: avoid potential deadlock
Mykola Golub [Wed, 4 May 2016 12:25:04 +0000 (15:25 +0300)]
rbd-mirror: avoid potential deadlock

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 46bf727d43af4975beeb514630a99d59cfb0a406)

9 years agoMerge pull request #9217 from dillaman/wip-15945
Jason Dillaman [Fri, 20 May 2016 13:01:50 +0000 (09:01 -0400)]
Merge pull request #9217 from dillaman/wip-15945

jewel: journal: live replay might skip entries from previous object set

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoqa/workunits/rbd: rbd-mirror daemon stress test 9217/head
Jason Dillaman [Tue, 17 May 2016 01:17:09 +0000 (21:17 -0400)]
qa/workunits/rbd: rbd-mirror daemon stress test

This test repeatedly runs rbd bench-write, kills the process
randomly to create an unclean journal shutdown, and verifies
that the image content replicates correctly.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit e2ab3128a37f4f36c9a1de6ddf2c0fe2e48aa7e2)

9 years agojournal: helper method to detect newer tags
Jason Dillaman [Mon, 16 May 2016 22:08:35 +0000 (18:08 -0400)]
journal: helper method to detect newer tags

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 0a8a6126ea35344e85af7eb64ffc490938edba51)

9 years agojournal: skip partially complete tag entries during playback
Jason Dillaman [Sun, 15 May 2016 13:52:41 +0000 (09:52 -0400)]
journal: skip partially complete tag entries during playback

If a journal client does not fully write out its buffered entries
before quiting, replay should skip over all remaining out-of-
sequence entries for the tag.

Fixes: http://tracker.ceph.com/issues/15864
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 9454f7e4c62437b1c288f371009feba1fd374584)

9 years agojournal: close, advance, and open object set ordering
Jason Dillaman [Sat, 14 May 2016 22:58:41 +0000 (18:58 -0400)]
journal: close, advance, and open object set ordering

Flush in-flight appends to open objects before advancing the
active object set.  Additionally, don't start recording to the
new objects until after advancing the active set.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit de830057d0f7286914e019540c6263423cb60428)

9 years agojournal: new ObjectRecorder closed callback
Jason Dillaman [Sat, 14 May 2016 22:13:38 +0000 (18:13 -0400)]
journal: new ObjectRecorder closed callback

The callback will be invoked if there were in-flight appends
when the close was requested.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit bba91437dbe3b7a9b6da8a61ccc4c597858c8efc)

9 years agojournal: do not flag append as full if already known to be full
Jason Dillaman [Fri, 13 May 2016 20:34:44 +0000 (16:34 -0400)]
journal: do not flag append as full if already known to be full

Once an object has overflowed or a close is in-progress, re-attempting
to close the object is not needed since the async process is already
underway.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 45620dc312ca2aeaf084638144aaa4783b622c4a)

9 years agojournal: delay object overflow event until in-flight appends settled
Jason Dillaman [Fri, 13 May 2016 20:28:50 +0000 (16:28 -0400)]
journal: delay object overflow event until in-flight appends settled

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit ee8d311a1fcdf7a85cdc168e1740fbaa252e87d3)

9 years agojournal: ignore flush on closed/overflowed object
Jason Dillaman [Fri, 13 May 2016 20:17:37 +0000 (16:17 -0400)]
journal: ignore flush on closed/overflowed object

The journal would be in-progress on transitioning to a new
object recorder in a newer object set.  Once the records
re-attach to the new object player they will automatically
flush.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit a13cb821f71b6b1b3378464bcc2d8318eb0da48a)

9 years agojournal: implicitly detach future's flush handler on append
Jason Dillaman [Fri, 13 May 2016 20:10:11 +0000 (16:10 -0400)]
journal: implicitly detach future's flush handler on append

If the future is already in-flight, there is no purpose served
by requesting the future be flushed to disk.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 1cb9b1a1b25d0f4c2d9a9e22661636e195fc70a0)

9 years agojournal: async callback for advancing the active object set
Jason Dillaman [Fri, 13 May 2016 19:22:30 +0000 (15:22 -0400)]
journal: async callback for advancing the active object set

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit ca89abfd9e6f0e8edc3234afea387757ef694826)

9 years agojournal: re-fetch active object before advancing set during replay
Jason Dillaman [Fri, 13 May 2016 18:49:07 +0000 (14:49 -0400)]
journal: re-fetch active object before advancing set during replay

During a live replay, it's possible that an append and and overflow
into the next object could race with the live playback of the same
object.  Re-fetch an "empty" object at least once before advancing
to next set to ensure all records have been read.

Fixes: http://tracker.ceph.com/issues/15665
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 6056f8c45c99bd37cb18933a37cc238c7e9a7c7d)

9 years agoMerge pull request #9210 from yehudasa/wip-15926-jewel
Yehuda Sadeh [Thu, 19 May 2016 20:08:00 +0000 (13:08 -0700)]
Merge pull request #9210 from yehudasa/wip-15926-jewel

radosgw-admin: fix 'period push' handling of --url

9 years agoradosgw-admin: fix 'period push' handling of --url 9210/head
Casey Bodley [Mon, 16 May 2016 13:37:05 +0000 (09:37 -0400)]
radosgw-admin: fix 'period push' handling of --url

was calling send_to_remote_gateway(), but passing 'url' instead of
'remote'. now uses send_to_remote_or_url() to accept either

Fixes: http://tracker.ceph.com/issues/15926
Signed-off-by: Casey Bodley <cbodley@redhat.com>
9 years agoMerge pull request #9194 from ceph/wip-jewel-no-lttng-global-link
Boris Ranto [Thu, 19 May 2016 10:56:15 +0000 (12:56 +0200)]
Merge pull request #9194 from ceph/wip-jewel-no-lttng-global-link

Do not link lttng into libglobal

Reviewed-by: Boris Ranto <branto@redhat.com>
9 years agoglobal: don't link lttng into libglobal 9194/head
Karol Mroz [Mon, 2 May 2016 12:01:27 +0000 (14:01 +0200)]
global: don't link lttng into libglobal

Rely on dynamic initialization instead. Linking lttng in this way had
the unfortunate side effect of causing radosgw to segfault (when
daemonized) during sigterm processing (ie. during lttng_ust_exit()).

This was originally removed in 638738f, but accidentally re-added via
5f61d36.

Signed-off-by: Karol Mroz <kmroz@suse.com>
9 years agoMerge pull request #9180 from dillaman/wip-15746-jewel
Jason Dillaman [Wed, 18 May 2016 17:23:39 +0000 (13:23 -0400)]
Merge pull request #9180 from dillaman/wip-15746-jewel

jewel: doc: update mirroring guide to include pool/image status commands

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agodoc: update mirroring guide to include pool/image status commands 9180/head
Mykola Golub [Thu, 12 May 2016 08:15:34 +0000 (11:15 +0300)]
doc: update mirroring guide to include pool/image status commands

Fixes: http://tracker.ceph.com/issues/15746
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 4381e341c435c80793b847115eed616b8359c4e6)

9 years agodoc: fixup: "rbd-mirror daemon" instead of "rbd-daemon"
Mykola Golub [Thu, 12 May 2016 08:11:55 +0000 (11:11 +0300)]
doc: fixup: "rbd-mirror daemon" instead of "rbd-daemon"

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit ddd6345f8f7edcff638ed435aef316ba3e0e40dd)

9 years agoMerge pull request #8815 from ktdreyer/wip-15646-jewel-system-targets
Sage Weil [Wed, 18 May 2016 09:11:55 +0000 (05:11 -0400)]
Merge pull request #8815 from ktdreyer/wip-15646-jewel-system-targets

jewel: debian: install systemd target files

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agodebian/control: dh_systemd_start is in the dh-systemd package 8815/head
Sage Weil [Thu, 28 Apr 2016 13:13:50 +0000 (09:13 -0400)]
debian/control: dh_systemd_start is in the dh-systemd package

Fixes: http://tracker.ceph.com/issues/15573
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 89154d1e01dbc58dc92f37741031f7ddb0448d2e)

9 years agodebian: install systemd target files
Kefu Chai [Fri, 22 Apr 2016 13:07:58 +0000 (21:07 +0800)]
debian: install systemd target files

* enable it using dh_systemd_enable
* start the target using dh_systemd_start
* move the dh_installinit, dh_systemd_enable, dh_systemd_start calls
  down, so they can identify the service files if they care about them.

Fixes: http://tracker.ceph.com/issues/15573
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit f950a0a7f5b35e13668379bc69dcb5d98a2dfc1f)

9 years ago10.2.1 v10.2.1
Jenkins Build Slave User [Thu, 12 May 2016 21:48:00 +0000 (21:48 +0000)]
10.2.1

9 years agoosd: remove all stale osdmaps in handle_osd_map()
Kefu Chai [Mon, 9 May 2016 06:15:36 +0000 (14:15 +0800)]
osd: remove all stale osdmaps in handle_osd_map()

in a large cluster, there are better chances that the OSD fails to trim
the cached osdmap in a timely manner. and sometimes, it is just unable
to keep up with the incoming osdmap if skip_maps, so the osdmap cache
can keep building up to over 250GB in size. in this change

* publish_superblock() before trimming the osdmaps, so other osdmap
  consumers of OSDService.superblock won't access the osdmaps being
  removed.
* trim all stale osdmaps in batch of conf->osd_target_transaction_size
  if skip_maps is true. in my test, it happens when the osd only
  receives the osdmap from monitor occasionally because the osd happens
  to be chosen when monitor wants to share a new osdmap with a random
  osd.
* always use dedicated transaction(s) for trimming osdmaps. so even in
  the normal case where we are able to trim all stale osdmaps in a
  single batch, a separated transaction is used. we can piggy back
  the commits for removing maps, but we keep it this way for simplicity.
* use std::min() instead MIN() for type safety

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 369db9930887d75b498927da9c97733bff4472b6)

9 years agoMerge pull request #8853 from ceph/wip-jewel-backports 9113/head
Loic Dachary [Thu, 12 May 2016 15:30:14 +0000 (17:30 +0200)]
Merge pull request #8853 from ceph/wip-jewel-backports

jewel: several backports

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #9041 from vshankar/jewel-15721-backport
Ilya Dryomov [Thu, 12 May 2016 14:50:33 +0000 (16:50 +0200)]
Merge pull request #9041 from vshankar/jewel-15721-backport

jewel: rbd: helpful error message on map failure

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
9 years agoMerge pull request #9081 from yehudasa/wip-rgw-period-commit-jewel
Yehuda Sadeh [Wed, 11 May 2016 19:33:50 +0000 (12:33 -0700)]
Merge pull request #9081 from yehudasa/wip-rgw-period-commit-jewel

rgw: period commit fix

9 years agoMerge pull request #8969 from Abhishekvrshny/wip-15731-jewel
Gregory Farnum [Wed, 11 May 2016 19:24:23 +0000 (12:24 -0700)]
Merge pull request #8969 from Abhishekvrshny/wip-15731-jewel

jewel: MDSAuthCap parse no longer fails on paths with hyphens

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoMerge pull request #8970 from Abhishekvrshny/wip-15732-jewel
Gregory Farnum [Wed, 11 May 2016 19:23:28 +0000 (12:23 -0700)]
Merge pull request #8970 from Abhishekvrshny/wip-15732-jewel

jewel: MDS incarnation no longer gets lost after remove filesystem

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoMerge pull request #8971 from Abhishekvrshny/wip-15738-jewel
Gregory Farnum [Wed, 11 May 2016 19:20:03 +0000 (12:20 -0700)]
Merge pull request #8971 from Abhishekvrshny/wip-15738-jewel

jewel: handle standby-replay nodes properly in upgrades

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoMerge pull request #9054 from yehudasa/wip-rgw-admin-output-jewel
Yehuda Sadeh [Wed, 11 May 2016 17:38:30 +0000 (10:38 -0700)]
Merge pull request #9054 from yehudasa/wip-rgw-admin-output-jewel

jewel: rgw admin output

9 years agoMerge pull request #9053 from yehudasa/wip-15745-jewel
Yehuda Sadeh [Wed, 11 May 2016 17:38:17 +0000 (10:38 -0700)]
Merge pull request #9053 from yehudasa/wip-15745-jewel

jewel: rgw: handle stripe transition when flushing final pending_data_bl

9 years agoMerge pull request #9047 from ceph/wip-rgw-period-delete-jewel
Yehuda Sadeh [Wed, 11 May 2016 17:38:02 +0000 (10:38 -0700)]
Merge pull request #9047 from ceph/wip-rgw-period-delete-jewel

jewel: rgw: period delete fixes

9 years agoMerge pull request #9076 from dillaman/wip-cmake-test-rbd-mirror-jewel
Sage Weil [Wed, 11 May 2016 16:30:18 +0000 (12:30 -0400)]
Merge pull request #9076 from dillaman/wip-cmake-test-rbd-mirror-jewel

jewel: cmake: fix rbd compile errors

9 years agocmake: fix rbd compile errors 9076/head
Jason Dillaman [Wed, 11 May 2016 02:37:01 +0000 (22:37 -0400)]
cmake: fix rbd compile errors

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 8d4c00d1bec431f8c721195c81684c4095079c1d)

9 years agocmake: add library cls_journal for target unittest_librbd
runsisi [Thu, 28 Apr 2016 02:22:07 +0000 (10:22 +0800)]
cmake: add library cls_journal for target unittest_librbd

otherwise if we want to generate target unittest_librbd we need to
(re)generate cls_journal manually

Signed-off-by: runsisi <runsisi@zte.com.cn>
(cherry picked from commit 7efb29416b789fcb7e68aab554d6033e6b5ebb43)

9 years agocls::rbd: mirror_image_status_list returned max 64 items 9069/head
Mykola Golub [Wed, 11 May 2016 11:14:46 +0000 (14:14 +0300)]
cls::rbd: mirror_image_status_list returned max 64 items

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit e925ce86243c91e6d64ff8d7b45166e4e3f2650b)

9 years agoMerge pull request #9063 from dachary/wip-15838-jewel
Kefu Chai [Wed, 11 May 2016 08:50:41 +0000 (16:50 +0800)]
Merge pull request #9063 from dachary/wip-15838-jewel

jewel: tests: make check fails on ext4

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agotests: enable make check on ext4 (part 2) 9063/head
Loic Dachary [Mon, 2 May 2016 08:42:24 +0000 (10:42 +0200)]
tests: enable make check on ext4 (part 2)

Followup of 475cc08c330e639b226f2ab57dedbe4495f63022

Signed-off-by: Loic Dachary <ldachary@redhat.com>
(cherry picked from commit b0b3a068d4fcc7b739c5dd3d68297e2d517c378e)

9 years agoqa/workunits/ceph-helpers.sh: make ceph-osd behave on ext4
Sage Weil [Sat, 30 Apr 2016 21:12:05 +0000 (17:12 -0400)]
qa/workunits/ceph-helpers.sh: make ceph-osd behave on ext4

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 475cc08c330e639b226f2ab57dedbe4495f63022)

9 years agoradosgw-admin: 'period commit' sends to new master zone by default 9081/head
Casey Bodley [Tue, 10 May 2016 19:51:27 +0000 (15:51 -0400)]
radosgw-admin: 'period commit' sends to new master zone by default

if no --remote or --url is given, set --remote = master_zone_id to
override the rest_master_conn (which refers to the old master zone)

Fixes: http://tracker.ceph.com/issues/15828
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit fbe1a05355549dfe0c05750683eeb61e275950c2)

9 years agoradosgw-admin: allow --remote to specify zone or zonegroup id
Casey Bodley [Tue, 10 May 2016 19:48:33 +0000 (15:48 -0400)]
radosgw-admin: allow --remote to specify zone or zonegroup id

--remote was only looking for zonegroup connections. extended to check
for zone connections as well

updated the usage to clarify that it expects zone/zonegroup ids

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9fcff89ee1e60009fa367e33c915a90354c9a9cc)

9 years agoradosgw-admin: 'zonegroup add' prints updated zonegroup 9054/head
Casey Bodley [Thu, 5 May 2016 13:59:49 +0000 (09:59 -0400)]
radosgw-admin: 'zonegroup add' prints updated zonegroup

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit d355208023fe08a7e16f1078c872286048c4bcc6)

9 years agoradosgw-admin: 'zonegroup modify' prints updated zonegroup
Casey Bodley [Thu, 5 May 2016 13:59:32 +0000 (09:59 -0400)]
radosgw-admin: 'zonegroup modify' prints updated zonegroup

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit a033f40caf60083111886aa804fcdbf3ee60aef8)

9 years agoradosgw-admin: 'zone modify' prints updated zone
Casey Bodley [Thu, 5 May 2016 13:56:47 +0000 (09:56 -0400)]
radosgw-admin: 'zone modify' prints updated zone

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 8a639014a6f2dd950062aa405bbee1762ca23e09)

9 years agorgw: handle stripe transition when flushing final pending_data_bl 9053/head
Yehuda Sadeh [Thu, 5 May 2016 21:02:25 +0000 (14:02 -0700)]
rgw: handle stripe transition when flushing final pending_data_bl

Fixes: http://tracker.ceph.com/issues/15745
When complete_writing_data() is called, if pending_data_bl is not empty
we still need to handle stripe transition correctly. If pending_data_bl
has more data that we can allow in current stripe, move to the next one.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit b7a7d41839558b1a8786a66e27d9d80e606f61c7)

9 years agoMerge pull request #9052 from dillaman/wip-cmake-rbd-mirror-replay-status-jewel
Samuel Just [Tue, 10 May 2016 18:14:40 +0000 (11:14 -0700)]
Merge pull request #9052 from dillaman/wip-cmake-rbd-mirror-replay-status-jewel

jewel: cmake: add missing source file to rbd_mirror/image_replayer

Reviewed-by: Samuel Just <sjust@redhat.com>
9 years agocmake: add missing source file to rbd_mirror/image_replayer 9052/head
Casey Bodley [Fri, 29 Apr 2016 21:33:03 +0000 (17:33 -0400)]
cmake: add missing source file to rbd_mirror/image_replayer

fixes an undefined reference when linking librbd_mirror_internal.a

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 2f3f56170ab47fc10d4232101ae2e85398a4c299)

9 years agoMerge pull request #9051 from athanatos/wip-15815-jewel
Sage Weil [Tue, 10 May 2016 18:10:05 +0000 (14:10 -0400)]
Merge pull request #9051 from athanatos/wip-15815-jewel

Wip 15815 jewel

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agoceph_test_keyvaluedb: clean up test dir 9051/head
Sage Weil [Fri, 22 Apr 2016 20:38:14 +0000 (16:38 -0400)]
ceph_test_keyvaluedb: clean up test dir

Just like ceph_test_objectstore

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2b075aa52d4475338c0f3cd3360e1ee4de8befa7)

9 years agoceph_test_keyvaluedb: fixup unit test for keyvaluedb
Allen Samuels [Fri, 22 Apr 2016 18:06:56 +0000 (14:06 -0400)]
ceph_test_keyvaluedb: fixup unit test for keyvaluedb

Fixes: http://tracker.ceph.com/issues/15435
Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>
(cherry picked from commit 85c14de20936ff9ee224f9b6569a73f9bae75f19)

9 years agoMerge pull request #9050 from dillaman/wip-15821
Jason Dillaman [Tue, 10 May 2016 17:52:54 +0000 (13:52 -0400)]
Merge pull request #9050 from dillaman/wip-15821

jewel: rbd-mirror: image sync needs to handle snapshot size and protection status

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agotest: add missing header dependency for MockJournaler 9050/head
Jason Dillaman [Mon, 9 May 2016 22:25:39 +0000 (18:25 -0400)]
test: add missing header dependency for MockJournaler

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit fa91919c856ac8186545bc8f8da31a8f438a9b5d)

9 years agorbd-mirror: image sync object copy was not properly mapping snapshots
Jason Dillaman [Wed, 4 May 2016 14:23:49 +0000 (10:23 -0400)]
rbd-mirror: image sync object copy was not properly mapping snapshots

When the snapshot sequence is out-of-sync between remote and local
clusters (expected), the objects would not be written with the
correct snapshot context.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit dd8f08039bf5354a0413c9da4263d1075243e9c9)

9 years agorbd-mirror: clean up image sync debug messages
Jason Dillaman [Wed, 4 May 2016 14:23:25 +0000 (10:23 -0400)]
rbd-mirror: clean up image sync debug messages

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit acca475fe5c9ff024c7f76397e7f49e4c4558b09)

9 years agolibrbd: readahead should not read past end of image
Jason Dillaman [Wed, 4 May 2016 04:12:05 +0000 (00:12 -0400)]
librbd: readahead should not read past end of image

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit adb14303ccf8a26ed5536bb692ae63d92ac40a9f)

9 years agotest: randomize rbd-mirror test case IO
Jason Dillaman [Wed, 4 May 2016 03:17:12 +0000 (23:17 -0400)]
test: randomize rbd-mirror test case IO

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 0d75f2ce61cee164da4e5b7ffb4e69c286e6036a)

9 years agorbd-mirror: don't set object map to nonexistent during image sync
Jason Dillaman [Wed, 4 May 2016 03:15:58 +0000 (23:15 -0400)]
rbd-mirror: don't set object map to nonexistent during image sync

The object maps are initialized to nonexistent at snapshot creation,
so this operation is unnecessary.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit fe5d4a811f9d9d1160ff7104fe9243cc17ef1bef)

9 years agolibrbd: improve object map debug messages
Jason Dillaman [Wed, 4 May 2016 03:01:30 +0000 (23:01 -0400)]
librbd: improve object map debug messages

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 2c657752a5067e11405dca59461ce9cbdf062602)

9 years agotest: snapshot stress test rbd-mirror image sync
Jason Dillaman [Wed, 4 May 2016 02:53:52 +0000 (22:53 -0400)]
test: snapshot stress test rbd-mirror image sync

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 468287bd182fa0cd02f7551ad6d729ff67ab1a22)

9 years agorbd-mirror: allocate empty object map during snapshot create
Jason Dillaman [Wed, 4 May 2016 01:42:05 +0000 (21:42 -0400)]
rbd-mirror: allocate empty object map during snapshot create

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 57a7fe0f44c5542a72120d0beed8b38e9ccd66db)

9 years agolibrbd: optionally skip object map creation upon snapshot
Jason Dillaman [Fri, 29 Apr 2016 20:43:07 +0000 (16:43 -0400)]
librbd: optionally skip object map creation upon snapshot

This feature is used by rbd-mirror during image bootstrap since
it will directly create an empty object map.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit db16240c79be7e28d65edac2088352b9b146da5f)

9 years agorbd-mirror: refactor snapshot create into its own state machine
Jason Dillaman [Mon, 25 Apr 2016 19:11:28 +0000 (15:11 -0400)]
rbd-mirror: refactor snapshot create into its own state machine

Initial implementation will resize the image (if needed) and create
the snapshot.  It is stubbed out for future state machines for handling
object map and clones.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 8adc47fbf8efa3991bd247be43b786676fe5fff9)

9 years agorbd-mirror: sync snapshot protection status during bootstrap
Jason Dillaman [Fri, 15 Apr 2016 01:47:19 +0000 (21:47 -0400)]
rbd-mirror: sync snapshot protection status during bootstrap

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit e6fba2b2306c8f04ce088fb15ef70e1dac282ff3)

9 years agotest: stub test cases for rbd-mirror image bootstrap
Jason Dillaman [Sat, 9 Apr 2016 17:30:56 +0000 (13:30 -0400)]
test: stub test cases for rbd-mirror image bootstrap

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit d0f732877213ba9eec9d3158b839c5a4c796e7ab)

9 years agotest: share journal::MockJournaler between librbd and rbd-mirror
Jason Dillaman [Tue, 5 Apr 2016 04:03:12 +0000 (00:03 -0400)]
test: share journal::MockJournaler between librbd and rbd-mirror

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 04db7ddec661ef195077c3fab06f248705b17220)

Conflicts:
src/test/librbd/test_mock_Journal.cc: MockJournaler moved to new file

9 years agoMerge pull request #9040 from dillaman/wip-15818
Jason Dillaman [Tue, 10 May 2016 17:40:32 +0000 (13:40 -0400)]
Merge pull request #9040 from dillaman/wip-15818

jewel: librbd: potential concurrent event processing during journal replay

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoMerge pull request #9038 from dillaman/wip-15817
Jason Dillaman [Tue, 10 May 2016 17:39:46 +0000 (13:39 -0400)]
Merge pull request #9038 from dillaman/wip-15817

jewel: journal: incorrectly computed object offset within set

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoMerge pull request #9039 from dillaman/wip-15820
Jason Dillaman [Tue, 10 May 2016 17:39:06 +0000 (13:39 -0400)]
Merge pull request #9039 from dillaman/wip-15820

jewel: librbd: client-side handling for incompatible object map sizes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agolibrbd: guard object map against incompatible image sizes 9039/head
Jason Dillaman [Wed, 4 May 2016 21:00:59 +0000 (17:00 -0400)]
librbd: guard object map against incompatible image sizes

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 42d3d3ac2d33360aae071330cfa34b87c87eadc5)

9 years agolibrbd: properly handle object map open returning error code
Jason Dillaman [Wed, 4 May 2016 19:16:17 +0000 (15:16 -0400)]
librbd: properly handle object map open returning error code

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 570de56bfc7fd2edd5cf1cf5b7b92084cd3352a3)

9 years agolibrbd: add client-side memory constraint when loading object map
Jason Dillaman [Wed, 4 May 2016 19:01:58 +0000 (15:01 -0400)]
librbd: add client-side memory constraint when loading object map

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 2dd34b2c7b8c376817aafe5cfdda7aa9cfb60e1a)

9 years agoMerge pull request #9048 from dillaman/wip-15819
Jason Dillaman [Tue, 10 May 2016 17:30:49 +0000 (13:30 -0400)]
Merge pull request #9048 from dillaman/wip-15819

jewel: librbd: constrain size of AioWriteEvent journal entries

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agolibrbd: split large AioWrite journal events 9048/head
Jason Dillaman [Fri, 6 May 2016 04:08:38 +0000 (00:08 -0400)]
librbd: split large AioWrite journal events

Ensure that AioWrite journal events fit within a single
journal object.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 70b9fbf2745c795fe345f0298a2f30af80a12985)

9 years agojournal: prohibit journal entries larger than the soft object size
Jason Dillaman [Fri, 6 May 2016 01:30:18 +0000 (21:30 -0400)]
journal: prohibit journal entries larger than the soft object size

This avoids complications like a librbd write event of 128MB trying
to fit within a 24MB journal object.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit d5f307dec10429a1ffc042919b71ac25466a1b72)

9 years agoMerge pull request #9036 from dillaman/wip-15814
Jason Dillaman [Tue, 10 May 2016 17:28:11 +0000 (13:28 -0400)]
Merge pull request #9036 from dillaman/wip-15814

jewel: librbd: fix get/list mirror image status API

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agorbd-mirror: fixup to get/list mirror image status API 9036/head
Mykola Golub [Tue, 10 May 2016 09:29:12 +0000 (12:29 +0300)]
rbd-mirror: fixup to get/list mirror image status API

- embed name and rbd_mirror_image_info_t into rbd_mirror_image_status_t;
- index image status list by image id to make 'start' work correctly;
- provide rbd_mirror_image_status_list_cleanup function.

Fixes: #15771
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit e6c709b3a8be489a900178b8b0d962705d5687e9)

9 years agoMerge pull request #9003 from dillaman/wip-15743
Jason Dillaman [Tue, 10 May 2016 17:15:23 +0000 (13:15 -0400)]
Merge pull request #9003 from dillaman/wip-15743

jewel: librbd: reduce log level for image format 1 warning

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoMerge pull request #9010 from dillaman/wip-15736
Jason Dillaman [Tue, 10 May 2016 17:13:27 +0000 (13:13 -0400)]
Merge pull request #9010 from dillaman/wip-15736

jewel: rbd-mirror: admin socket commands to start/stop/restart mirroring

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agorbd-mirror: admin socket commands to start/stop/restart mirroring 9010/head
Mykola Golub [Thu, 28 Apr 2016 06:32:33 +0000 (09:32 +0300)]
rbd-mirror: admin socket commands to start/stop/restart mirroring

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit a22cf518f9cc0872f72a8a850ea01558094ebd00)

9 years agoqa/workunits/rbd: fix rbd-mirror log file name
Mykola Golub [Sun, 1 May 2016 19:04:46 +0000 (22:04 +0300)]
qa/workunits/rbd: fix rbd-mirror log file name

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 4c28fc2aa378c10ce6e78b1a2f98d5e14ac211e9)