]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
9 years agolibrbd: Add a paramter:purge_on_error in ImageCtx::invalidate_cache(). 5767/head
Jianpeng Ma [Mon, 9 Mar 2015 06:23:23 +0000 (14:23 +0800)]
librbd: Add a paramter:purge_on_error in ImageCtx::invalidate_cache().

If bh_write met error, it will try again. For closing image, if met this
issue, it will trigger a assert:
>>2015-02-03 15:22:49.198292 7ff62d537800 -1 osdc/ObjectCacher.cc: In
function 'ObjectCacher::~ObjectCacher()' thread 7ff62d537800 time
>>2015-02-03 15:22:49.195927osdc/ObjectCacher.cc: 551: FAILED
>>assert(i->empty())

Now add purge_on_error, when shutdown_cache it set true.
In ImageCtx::invalidate_cache, if met error and purge_on_error is true,
purge the dirty bh.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 35def5c81f7fc83d55d18320e4860c6a63d4c7f5)

Conflicts:
src/librbd/ImageCtx.cc : trivial resolution

9 years agolibrbd: Remvoe unused func ImageCtx::read_from_cache.
Jianpeng Ma [Thu, 5 Feb 2015 03:28:50 +0000 (11:28 +0800)]
librbd: Remvoe unused func ImageCtx::read_from_cache.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 101440a41253680770f94bc380af7072c7adaebf)

9 years agoosdc: clean up code in ObjectCacher::Object::map_write
Jianpeng Ma [Thu, 5 Feb 2015 03:03:10 +0000 (11:03 +0800)]
osdc: clean up code in ObjectCacher::Object::map_write

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 9f80c2909ace09cd51c24b49c98a093e0e864dca)

9 years agoosdc: Don't pass mutex into ObjectCacher::_wait_for_write.
Jianpeng Ma [Thu, 5 Feb 2015 02:13:06 +0000 (10:13 +0800)]
osdc: Don't pass mutex into ObjectCacher::_wait_for_write.

Because the mutex is the same as ObjectCacher::lock.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit d7cf7aeea5cba1ffa8e51ff1ad2424b1ec161a12)

9 years agoosdc: After write try merge bh.
Jianpeng Ma [Mon, 2 Mar 2015 03:23:44 +0000 (11:23 +0800)]
osdc: After write try merge bh.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 1a48a8a2b222e41236341cb1241f0885a1b0b9d8)

9 years agoosdc: Make last missing bh to wake up the reader.
Jianpeng Ma [Mon, 2 Mar 2015 03:36:24 +0000 (11:36 +0800)]
osdc: Make last missing bh to wake up the reader.

Avoid wakeup early and wait again.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit d582bda090b3339d03e25b0e6d0971ad0267f476)

9 years agoosdc: For trust_enoent is true, there is only one extent.
Jianpeng Ma [Fri, 6 Feb 2015 01:53:36 +0000 (09:53 +0800)]
osdc: For trust_enoent is true, there is only one extent.

Now the judgement only in conditon which will return -ENOENT.
But o->exists don't depend on the extent size. It only depend on
trust_enoent. So move this judgement at the first of _readx().
Make this bug ASAP occur.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 2449fddc13b5ce8bbf1bb4ecaa5d6937f54e54d1)

9 years agoosdc: In _readx() only no error can tidy read result.
Jianpeng Ma [Tue, 3 Feb 2015 06:46:39 +0000 (14:46 +0800)]
osdc: In _readx() only no error can tidy read result.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 540346d4a901d8041c9fd74641c98cdfd2e1ab32)

9 years agoMerge pull request #5755 from dachary/wip-12589-hammer
Loic Dachary [Wed, 2 Sep 2015 21:35:58 +0000 (23:35 +0200)]
Merge pull request #5755 from dachary/wip-12589-hammer

ceph-disk zap should ensure block device

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5732 from ceph/wip-11455-hammer
Loic Dachary [Wed, 2 Sep 2015 21:22:59 +0000 (23:22 +0200)]
Merge pull request #5732 from ceph/wip-11455-hammer

rgw: init some manifest fields when handling explicit objs

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5721 from dachary/wip-12853-hammer
Loic Dachary [Wed, 2 Sep 2015 21:19:02 +0000 (23:19 +0200)]
Merge pull request #5721 from dachary/wip-12853-hammer

RGW Swift API: X-Trans-Id header is wrongly formatted

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9 years agoMerge pull request #5498 from ceph/wip-12432-hammer
Loic Dachary [Wed, 2 Sep 2015 21:08:24 +0000 (23:08 +0200)]
Merge pull request #5498 from ceph/wip-12432-hammer

rgw: HTTP return code is not being logged by CivetWeb

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5527 from SUSE/wip-12585-hammer
Loic Dachary [Wed, 2 Sep 2015 10:00:11 +0000 (12:00 +0200)]
Merge pull request #5527 from SUSE/wip-12585-hammer

OSD crash creating/deleting pools

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agoceph-disk: always check zap is applied on a full device 5755/head
Loic Dachary [Sun, 31 May 2015 17:42:45 +0000 (19:42 +0200)]
ceph-disk: always check zap is applied on a full device

zap only makes sense on a full device and this is verified for

    ceph-disk prepare --zap-disk

but not for

    ceph-disk zap

Unify the two and add a test to check that it fails as expected when
trying to zap a directory.

http://tracker.ceph.com/issues/11272 Fixes: #11272

Signed-off-by: Loic Dachary <ldachary@redhat.com>
(cherry picked from commit 8e1bcf21f090fc98ac9b495d76614e3012f5872a)

Conflicts:
src/test/ceph-disk.sh : trivial resolution

9 years agoMerge pull request #5551 from ceph/wip-corpus-hammer
Loic Dachary [Wed, 2 Sep 2015 00:19:26 +0000 (02:19 +0200)]
Merge pull request #5551 from ceph/wip-corpus-hammer

ceph-object-corpus: add 0.94.2-207-g88e7ee7 hammer objects

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoceph-object-corpus: add 0.94.2-207-g88e7ee7 hammer objects 5551/head
Sage Weil [Tue, 1 Sep 2015 21:44:06 +0000 (17:44 -0400)]
ceph-object-corpus: add 0.94.2-207-g88e7ee7 hammer objects

Signed-off-by: Sage Weil <sage@redhat.com>
9 years agorgw: init some manifest fields when handling explicit objs 5732/head
Yehuda Sadeh [Wed, 26 Aug 2015 21:34:30 +0000 (14:34 -0700)]
rgw: init some manifest fields when handling explicit objs

Fixes: #11455
When dealing with old manifest that has explicit objs, we also
need to set the head size and head object correctly so that
code that relies on this info doesn't break.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit d7bf8cb594e5276d1c80544f5ec954d52b159750)

9 years agoMerge pull request #5365 from dachary/wip-12491-hammer
Gregory Farnum [Mon, 31 Aug 2015 08:41:33 +0000 (09:41 +0100)]
Merge pull request #5365 from dachary/wip-12491-hammer

buffer: critical bufferlist::zero bug

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoMerge pull request #5369 from dachary/wip-12498-hammer
Loic Dachary [Sun, 30 Aug 2015 17:58:25 +0000 (19:58 +0200)]
Merge pull request #5369 from dachary/wip-12498-hammer

get pools health'info have error

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agoMerge pull request #5370 from dachary/wip-12496-hammer
Loic Dachary [Sun, 30 Aug 2015 17:52:52 +0000 (19:52 +0200)]
Merge pull request #5370 from dachary/wip-12496-hammer

pgmonitor: wrong at/near target max“ reporting

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agoMerge pull request #5378 from dachary/wip-12394-hammer
Loic Dachary [Sun, 30 Aug 2015 17:44:56 +0000 (19:44 +0200)]
Merge pull request #5378 from dachary/wip-12394-hammer

Memory leak in Mutex.cc, pthread_mutexattr_init without pthread_mutexattr_destroy

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agoMerge pull request #5372 from dachary/wip-12493-hammer
Loic Dachary [Sun, 30 Aug 2015 17:44:26 +0000 (19:44 +0200)]
Merge pull request #5372 from dachary/wip-12493-hammer

the output is wrong when runing ceph osd reweight

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agorgw: rework X-Trans-Id header to be conform with Swift API. 5721/head
Radoslaw Zarzynski [Thu, 6 Aug 2015 13:52:58 +0000 (15:52 +0200)]
rgw: rework X-Trans-Id header to be conform with Swift API.

Fixes: #12108
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
(cherry picked from commit d1735a4e8ea2056d333a5001a7a410fc03fe1b9e)

9 years agoTransaction Id added in response
Abhishek Dixit [Mon, 8 Jun 2015 17:29:54 +0000 (22:59 +0530)]
Transaction Id added in response

Signed-off-by: Abhishek Dixit dixitabhi@gmail.com
(cherry picked from commit b711e3124f8f73c17ebd19b38807a1b77f201e44)

Conflicts:
src/rgw/rgw_rest.cc
             the prototype of the end_header( function
             in the context of the diff changed

9 years agoMerge pull request #5374 from dachary/wip-12487-hammer
Loic Dachary [Sun, 30 Aug 2015 13:50:03 +0000 (15:50 +0200)]
Merge pull request #5374 from dachary/wip-12487-hammer

ceph osd crush reweight-subtree does not reweight parent node

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agoMerge pull request #5380 from dachary/wip-12390-hammer
Loic Dachary [Sun, 30 Aug 2015 13:49:41 +0000 (15:49 +0200)]
Merge pull request #5380 from dachary/wip-12390-hammer

PGLog::proc_replica_log: correctly handle case where entries between olog.head and log.tail were split out

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agoMerge pull request #5366 from dachary/wip-12303-hammer
Sage Weil [Sun, 30 Aug 2015 12:36:37 +0000 (08:36 -0400)]
Merge pull request #5366 from dachary/wip-12303-hammer

arm: all programs that link to librados2 hang forever on startup

9 years agoMerge pull request #5202 from SUSE/wip-12293-hammer
Loic Dachary [Sun, 30 Aug 2015 11:41:01 +0000 (13:41 +0200)]
Merge pull request #5202 from SUSE/wip-12293-hammer

ceph.spec.in: rpm: cephfs_java not fully conditionalized

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5203 from SUSE/wip-11997-hammer
Loic Dachary [Sun, 30 Aug 2015 11:40:48 +0000 (13:40 +0200)]
Merge pull request #5203 from SUSE/wip-11997-hammer

 ceph.spec.in: rpm: not possible to turn off Java

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5204 from SUSE/wip-11629-hammer
Loic Dachary [Sun, 30 Aug 2015 11:40:30 +0000 (13:40 +0200)]
Merge pull request #5204 from SUSE/wip-11629-hammer

ceph.spec.in: SUSE/openSUSE builds need libbz2-devel

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5207 from SUSE/wip-12267-hammer
Loic Dachary [Sun, 30 Aug 2015 11:40:09 +0000 (13:40 +0200)]
Merge pull request #5207 from SUSE/wip-12267-hammer

ceph.spec.in: 50-rbd.rules conditional is wrong

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5216 from SUSE/wip-12269-hammer
Loic Dachary [Sun, 30 Aug 2015 11:39:57 +0000 (13:39 +0200)]
Merge pull request #5216 from SUSE/wip-12269-hammer

ceph.spec.in: ceph-common needs python-argparse on older distros, but doesn't require it

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5264 from SUSE/wip-12361-hammer
Loic Dachary [Sun, 30 Aug 2015 11:39:31 +0000 (13:39 +0200)]
Merge pull request #5264 from SUSE/wip-12361-hammer

ceph.spec.in: snappy-devel for all supported distros

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5368 from dachary/wip-12331-hammer
Loic Dachary [Sun, 30 Aug 2015 11:39:14 +0000 (13:39 +0200)]
Merge pull request #5368 from dachary/wip-12331-hammer

ceph: cli throws exception on unrecognized errno

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5371 from dachary/wip-12494-hammer
Loic Dachary [Sun, 30 Aug 2015 11:39:00 +0000 (13:39 +0200)]
Merge pull request #5371 from dachary/wip-12494-hammer

ceph tell: broken error message / misleading hinting

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5385 from dachary/wip-12501-hammer
Loic Dachary [Sun, 30 Aug 2015 11:38:43 +0000 (13:38 +0200)]
Merge pull request #5385 from dachary/wip-12501-hammer

error in ext_mime_map_init() when /etc/mime.types is missing

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5411 from SUSE/wip-12446-hammer
Loic Dachary [Sun, 30 Aug 2015 11:38:29 +0000 (13:38 +0200)]
Merge pull request #5411 from SUSE/wip-12446-hammer

ceph.spec.in: radosgw requires apache for SUSE only -- makes no sense

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5412 from SUSE/wip-12448-hammer
Loic Dachary [Sun, 30 Aug 2015 11:38:13 +0000 (13:38 +0200)]
Merge pull request #5412 from SUSE/wip-12448-hammer

ceph.spec.in: useless %py_requires breaks SLE11-SP3 build

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5318 from ceph/wip-12236-hammer
Loic Dachary [Sun, 30 Aug 2015 11:30:18 +0000 (13:30 +0200)]
Merge pull request #5318 from ceph/wip-12236-hammer

Possible crash while concurrently writing and shrinking an image

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5319 from ceph/wip-12235-hammer
Loic Dachary [Sun, 30 Aug 2015 11:30:01 +0000 (13:30 +0200)]
Merge pull request #5319 from ceph/wip-12235-hammer

librbd: deadlock during cooperative exclusive lock transition

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5296 from ceph/wip-12345-hammer
Loic Dachary [Sun, 30 Aug 2015 11:29:26 +0000 (13:29 +0200)]
Merge pull request #5296 from ceph/wip-12345-hammer

librbd: correct issues discovered via lockdep / helgrind

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5559 from ceph/wip-12682-hammer
Loic Dachary [Sun, 30 Aug 2015 10:14:22 +0000 (12:14 +0200)]
Merge pull request #5559 from ceph/wip-12682-hammer

object_map_update fails with -EINVAL return code

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5468 from ceph/wip-12577-hammer
Loic Dachary [Sun, 30 Aug 2015 10:11:10 +0000 (12:11 +0200)]
Merge pull request #5468 from ceph/wip-12577-hammer

osd: fix repair when recorded digest is wrong

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5376 from dachary/wip-12433-hammer
Loic Dachary [Sun, 30 Aug 2015 10:06:59 +0000 (12:06 +0200)]
Merge pull request #5376 from dachary/wip-12433-hammer

Show osd as NONE in ceph osd map <pool> <object>  output

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5359 from ceph/wip-11470.hammer
Loic Dachary [Sun, 30 Aug 2015 09:54:55 +0000 (11:54 +0200)]
Merge pull request #5359 from ceph/wip-11470.hammer

mon: PaxosService: call post_refresh() instead of post_paxos_update()

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agoMerge pull request #5691 from jdurgin/wip-10399-hammer
Josh Durgin [Fri, 28 Aug 2015 18:43:31 +0000 (14:43 -0400)]
Merge pull request #5691 from jdurgin/wip-10399-hammer

is_new_interval() fixes

Reviewed-by: Samuel Just <sjust@redhat.com>
9 years agoObjecter: pg_interval_t::is_new_interval needs pgid from previous pool 5691/head
Jason Dillaman [Fri, 21 Aug 2015 15:32:39 +0000 (11:32 -0400)]
Objecter: pg_interval_t::is_new_interval needs pgid from previous pool

When increasing the pg_num of a pool, an assert would fail since the
calculated pgid seed would be for the pool's new pg_num value instead
of the previous pg_num value.

Fixes: #10399
Backport: infernalis, hammer, firefly
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit f20f7a23e913d09cc7fc22fb3df07f9938ddc144)

Conflicts: (hobject_t sort order not backported, trivial resolution)
src/osdc/Objecter.cc
src/osdc/Objecter.h

9 years agoosd_types::is_new_interval: size change triggers new interval
Samuel Just [Tue, 26 May 2015 19:35:11 +0000 (12:35 -0700)]
osd_types::is_new_interval: size change triggers new interval

Fixes: 11771
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit ff79959c037a7145f7104b06d9e6a64492fdb95f)

9 years agoMerge remote-tracking branch 'gh/wip-12536-hammer' into hammer
Sage Weil [Thu, 27 Aug 2015 17:07:29 +0000 (13:07 -0400)]
Merge remote-tracking branch 'gh/wip-12536-hammer' into hammer

This includes wip-osd-compat-hammer.

9 years ago0.94.3 v0.94.3
Jenkins [Wed, 26 Aug 2015 17:39:37 +0000 (10:39 -0700)]
0.94.3

9 years agoMerge remote-tracking branch 'gh/wip-osd-compat-hammer' into wip-12536-hammer
Sage Weil [Wed, 19 Aug 2015 13:52:02 +0000 (09:52 -0400)]
Merge remote-tracking branch 'gh/wip-osd-compat-hammer' into wip-12536-hammer

9 years agoMerge pull request #5589 from ceph/hammer-12709 5608/head
Gregory Farnum [Tue, 18 Aug 2015 11:43:57 +0000 (12:43 +0100)]
Merge pull request #5589 from ceph/hammer-12709

Workunits : fs/misc/chmod.sh : Include ACL characters in permission check

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoWorkunits : fs/misc/chmod.sh : Include ACL characters in permission check. 5589/head
Yazen Ghannam [Mon, 4 May 2015 16:33:16 +0000 (12:33 -0400)]
Workunits : fs/misc/chmod.sh : Include ACL characters in permission check.

Signed-off-by: Yazen Ghannam <yazen.ghannam@linaro.org>
(cherry picked from commit d3dbfffefb0ae53583350f53258dc902670da659)

9 years agotests: increase test coverage for partial encodes/decodes 5559/head
Jason Dillaman [Mon, 10 Aug 2015 13:39:50 +0000 (09:39 -0400)]
tests: increase test coverage for partial encodes/decodes

Multiple combinations of offsets/lengths are now tested when
performing partial encodes/decodes of the bit vector.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 3e145f714ac9b2d599b45a058c6b93595e38f424)

9 years agocommon: bit_vector extent calculation incorrect for last page
Jason Dillaman [Mon, 10 Aug 2015 13:34:42 +0000 (09:34 -0400)]
common: bit_vector extent calculation incorrect for last page

It's highly probable that the last page in the bit vector will not
be a full page size.  As a result, the computed extents will extend
beyond the data portion of the bit vector, resulting in a end_of_buffer
exception.

Fixes: #12611
Backport: hammer
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit c6d98992691683524d3d96def83a90a6f5fe7f93)

9 years agoosd/OSDMap: handle incrementals that modify+del pool 5527/head
John Spray [Thu, 30 Jul 2015 13:20:56 +0000 (14:20 +0100)]
osd/OSDMap: handle incrementals that modify+del pool

Because new_pools was processed after old_pools, if something
was modified and then deleted in the same incremental
map, then the resulting state would be a pool in the map
that had no entry in pool_name.

Fixes: #12429
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 8d4932e721e32a33c1bada54e11d4ecccd868618)

9 years agorgw: set http status in civetweb 5498/head
Yehuda Sadeh [Wed, 22 Jul 2015 17:01:00 +0000 (10:01 -0700)]
rgw: set http status in civetweb

Need to set the http status in civetweb so that we report it correctly.
Fixes: #12432
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit b8e28ab9f914bf48c9ba4f0def9a0deb9dbb93bc)

9 years agocivetweb: update submodule to support setting of http status
Yehuda Sadeh [Fri, 31 Jul 2015 18:03:29 +0000 (11:03 -0700)]
civetweb: update submodule to support setting of http status

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
9 years agohobject_t: fix get_boundary to work with new sorting regime
Sage Weil [Tue, 23 Dec 2014 19:03:17 +0000 (11:03 -0800)]
hobject_t: fix get_boundary to work with new sorting regime

The hash is no longer the most significant field; set everything that is
more significant, too.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 45281efad1ae6b2b5ddd5549c56dbdd46671e5c5)

9 years agomon: disallow post-hammer OSDs if there are up pre-hammer OSDs 5471/head
Sage Weil [Tue, 4 Aug 2015 17:21:50 +0000 (13:21 -0400)]
mon: disallow post-hammer OSDs if there are up pre-hammer OSDs

Force *all* OSDs to upgrade to hammer before allowing post-hammer
OSDs to join.  This prevents any pre-hammer OSDs from running at
the same time as a post-hammer OSD.

This commit, as well as the definition of the sentinal post-hammer
feature, should get backported to hammer stable series.

Backport: hammer
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e38d60e94503c7e8511a60a8dceceb3cd39c2bd8)

# Conflicts:
# src/mon/OSDMonitor.cc

9 years agoinclude/ceph_features: define MON_METADATA feature
Sage Weil [Tue, 4 Aug 2015 17:16:11 +0000 (13:16 -0400)]
include/ceph_features: define MON_METADATA feature

This was added in master in 40307748b9b8f84c98354a7141da645a3c556ba9.  We
define it but notably do not support it!

Signed-off-by: Sage Weil <sage@redhat.com>
9 years agoosd: include newlines in scrub errors 5468/head
Sage Weil [Fri, 27 Mar 2015 17:17:12 +0000 (10:17 -0700)]
osd: include newlines in scrub errors

We may log more than one of these in a scrubmap; make sure they are
not concatenated.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2b3dd1bb7ab360e8f467a47b7ce3a0e4d3a979b2)

9 years agoosd: fix condition for loggin scrub errors
Sage Weil [Fri, 27 Mar 2015 17:04:00 +0000 (10:04 -0700)]
osd: fix condition for loggin scrub errors

We may have an error to log even though the authoritative map is empty:
when we have a digest that doesn't match all replicas.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit d23766be902080ffb29528acb5a00d70beb97a9f)

9 years agoosd: fix fallback logic; move into be_select_auth_object
Sage Weil [Fri, 27 Mar 2015 17:03:22 +0000 (10:03 -0700)]
osd: fix fallback logic; move into be_select_auth_object

The fallback behavior was printing a promising message but then doing
a 'continue' and not actually scrubbing the object.  Instead, fall back to
a less-bad auth inside be_select_auth_object.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b597db59fedc9a96dbe4b37f03b819dcf8fdb1bb)

9 years agoosd: log a scrub error when we can't pick an auth object
Sage Weil [Fri, 27 Mar 2015 16:34:44 +0000 (09:34 -0700)]
osd: log a scrub error when we can't pick an auth object

If we really can't find a suitable auth, log an error.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit a476d8f3903ca78b5cf36d63059f13cb5268efe5)

9 years agoosd: repair record digest if all replicas match but do not match
Sage Weil [Fri, 27 Mar 2015 17:20:23 +0000 (10:20 -0700)]
osd: repair record digest if all replicas match but do not match

If the recorded digest does not match the replicas, and all replicas
match, then (on repair) fix the recorded digest.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f581fecd8a16b9250fa96beec5aa26074f401028)

9 years agoosd: move recorded vs on disk digest warning into be_compare_scrubmaps
Sage Weil [Thu, 26 Mar 2015 20:52:20 +0000 (13:52 -0700)]
osd: move recorded vs on disk digest warning into be_compare_scrubmaps

This is a better place for it.  While we are here, change the wording to
clearly call out the 'recorded' digest (from object_info_t) vs the 'on
disk' digest (what we observed during scrub).

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit cf349ff35e9111ca52db1b0aad3753d0680b486d)

9 years agoosd: be slightly paranoid about value of okseed
Sage Weil [Thu, 26 Mar 2015 20:46:22 +0000 (13:46 -0700)]
osd: be slightly paranoid about value of okseed

The scrubber.seed value is set based on the peer feature; check for that
too explicitly, and assert the scrubber.seed value matches.

No change in behavior here.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e34d31b7a9a71132a17b95cf5ad60255ece60243)

9 years agoosd: be precise about "known" vs "best guess"
Sage Weil [Thu, 26 Mar 2015 20:44:25 +0000 (13:44 -0700)]
osd: be precise about "known" vs "best guess"

We cannot assume that the auth info has the "known" digest; all replicas
may have a matching digest that does not match the oi, or we may choose
a different auth info for some other reason.  Verify that the digest
matches the oi before calling it "known".

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 546d1c7b8224d96d0cc93dc3c96f52787cd69413)

9 years agoosd: record digest if object is clean (vs entire scrub chunk)
Sage Weil [Thu, 26 Mar 2015 20:24:11 +0000 (13:24 -0700)]
osd: record digest if object is clean (vs entire scrub chunk)

If an individual object is clean, record it in the missing_digest map.
If not, leave it out.  This lets us drop the old condition that only
recorded any digests if the entire scrub chunk was clean.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c39e0e5f126028f552d410ab6924cac6e1f714fb)

9 years agoMerge pull request #5160 from theanalyst/wip-11910-hammer
Loic Dachary [Tue, 4 Aug 2015 11:02:17 +0000 (13:02 +0200)]
Merge pull request #5160 from theanalyst/wip-11910-hammer

mon: pg ls is broken

Reviewed-by: Kefu Chai <kchai@redhat.com>
9 years agoMerge pull request #5384 from dachary/wip-12502-hammer
Loic Dachary [Tue, 4 Aug 2015 10:34:18 +0000 (12:34 +0200)]
Merge pull request #5384 from dachary/wip-12502-hammer

rgw: need conversion tool to handle fixes following #11974

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5405 from ceph/wip-12465-hammer
Loic Dachary [Tue, 4 Aug 2015 09:22:08 +0000 (11:22 +0200)]
Merge pull request #5405 from ceph/wip-12465-hammer

Log::reopen_log_file: take m_flush_mutex

Reviewed-by: Loic Dachary <ldachary@redhat.com>
9 years agohobject_t: decode future hobject_t::get_min() properly
Sage Weil [Mon, 3 Aug 2015 17:05:45 +0000 (13:05 -0400)]
hobject_t: decode future hobject_t::get_min() properly

The post-hammer wip-temp branch changed hobject_t::get_min() so that pool
is INT64_MIN instead of -1 and neglected to deal with the encoding compat
with older versions.  Compensate on hammer by mapping INT64_MIN to -1
locally.  See commit ff99af38df830e215359bfb8837bf310a2023a4d.

Note that this means upgrades from hammer to post-hammer *must* include
this fix prior to the upgrade.  This will need to be well-documented in the
release notes.

Master gets a similar fix so that they map our min value to the new
INT64_MIN one on decode.

Fixes: #12536 (for hammer)
Signed-off-by: Sage Weil <sage@redhat.com>
9 years agoOSDMonitor::preprocess_get_osdmap: send the last map as well
Samuel Just [Wed, 29 Jul 2015 18:49:57 +0000 (11:49 -0700)]
OSDMonitor::preprocess_get_osdmap: send the last map as well

Fixes: #12410
Backport: hammer
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 1320e29dfaee9995409a6d99b9ccaa748dc67b90)

9 years agoMerge pull request #5121 from theanalyst/wip-11983-hammer
Sage Weil [Fri, 31 Jul 2015 19:18:52 +0000 (15:18 -0400)]
Merge pull request #5121 from theanalyst/wip-11983-hammer

FAILED assert(!old_value.deleted()) in upgrade:giant-x-hammer-distro-basic-multi run

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agoMerge pull request #5269 from dachary/wip-12362-hammer
Sage Weil [Fri, 31 Jul 2015 19:17:00 +0000 (15:17 -0400)]
Merge pull request #5269 from dachary/wip-12362-hammer

stuck incomplete

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agoMerge pull request #5117 from theanalyst/wip-12099-hammer
Loic Dachary [Fri, 31 Jul 2015 18:55:48 +0000 (20:55 +0200)]
Merge pull request #5117 from theanalyst/wip-12099-hammer

rgw: rados objects wronly deleted

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5118 from theanalyst/wip-12042-hammer
Loic Dachary [Fri, 31 Jul 2015 18:55:29 +0000 (20:55 +0200)]
Merge pull request #5118 from theanalyst/wip-12042-hammer

DragonDisk fails to create directories via S3: MissingContentLength

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5214 from SUSE/wip-12299-hammer
Loic Dachary [Fri, 31 Jul 2015 18:55:14 +0000 (20:55 +0200)]
Merge pull request #5214 from SUSE/wip-12299-hammer

RGW Swift API: support for 202 Accepted response code on container creation

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5226 from SUSE/wip-12322-hammer
Loic Dachary [Fri, 31 Jul 2015 18:54:57 +0000 (20:54 +0200)]
Merge pull request #5226 from SUSE/wip-12322-hammer

rgw: keystone does not support chunked input

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5227 from SUSE/wip-12323-hammer
Loic Dachary [Fri, 31 Jul 2015 18:54:41 +0000 (20:54 +0200)]
Merge pull request #5227 from SUSE/wip-12323-hammer

RGW Swift API: XML document generated in response for GET on account does not contain account name

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5228 from theanalyst/wip-11872-hammer
Loic Dachary [Fri, 31 Jul 2015 18:54:26 +0000 (20:54 +0200)]
Merge pull request #5228 from theanalyst/wip-11872-hammer

RGW does not send Date HTTP header when civetweb frontend is used

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5229 from theanalyst/wip-12242-hammer
Loic Dachary [Fri, 31 Jul 2015 18:54:02 +0000 (20:54 +0200)]
Merge pull request #5229 from theanalyst/wip-12242-hammer

Fix tool for #11442 does not correctly fix objects created via multipart uploads

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5237 from theanalyst/wip-12245-hammer
Loic Dachary [Fri, 31 Jul 2015 18:53:41 +0000 (20:53 +0200)]
Merge pull request #5237 from theanalyst/wip-12245-hammer

rgw: empty json response when getting user quota

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5284 from SUSE/wip-12398-hammer
Loic Dachary [Fri, 31 Jul 2015 18:53:18 +0000 (20:53 +0200)]
Merge pull request #5284 from SUSE/wip-12398-hammer

rgw: Properly respond to the Connection header with Civetweb

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5285 from SUSE/wip-12399-hammer
Loic Dachary [Fri, 31 Jul 2015 18:53:04 +0000 (20:53 +0200)]
Merge pull request #5285 from SUSE/wip-12399-hammer

rgw: multipart list part response returns incorrect field

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5286 from SUSE/wip-12400-hammer
Loic Dachary [Fri, 31 Jul 2015 18:52:43 +0000 (20:52 +0200)]
Merge pull request #5286 from SUSE/wip-12400-hammer

rgw: radosgw-admin dumps user info twice

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
9 years agoMerge pull request #5427 from dachary/wip-12088-hammer-part-2
Yan, Zheng [Fri, 31 Jul 2015 01:50:22 +0000 (09:50 +0800)]
Merge pull request #5427 from dachary/wip-12088-hammer-part-2

Fh ref count will leak if readahead does not need to do read from osd

9 years agoFh ref count will leak if readahead does not need to do read from osd 5427/head
Zhi Zhang [Wed, 22 Jul 2015 02:54:53 +0000 (10:54 +0800)]
Fh ref count will leak if readahead does not need to do read from osd

The 3c8cdeacf46ae4031189d2ef6948aa3b6ab4ae43 backport introduced a leak.

http://tracker.ceph.com/issues/12319 Fixes: #12319

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
9 years agoMerge pull request #5120 from theanalyst/wip-11999-hammer
Loic Dachary [Thu, 30 Jul 2015 19:43:48 +0000 (21:43 +0200)]
Merge pull request #5120 from theanalyst/wip-11999-hammer

cephfs Dumper tries to load whole journal into memory at once

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoMerge pull request #5119 from theanalyst/wip-12098-hammer
Loic Dachary [Thu, 30 Jul 2015 19:43:21 +0000 (21:43 +0200)]
Merge pull request #5119 from theanalyst/wip-12098-hammer

kernel_untar_build fails on EL7

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
9 years agoMerge pull request #5417 from dachary/wip-11998-hammer
Loic Dachary [Thu, 30 Jul 2015 15:00:14 +0000 (17:00 +0200)]
Merge pull request #5417 from dachary/wip-11998-hammer

debian/control: ceph-common (>> 0.94.2) must be >= 0.94.2-2

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agodebian/control: ceph-common (>> 0.94.2) must be >= 0.94.2-2 5417/head
Loic Dachary [Thu, 30 Jul 2015 07:43:20 +0000 (09:43 +0200)]
debian/control: ceph-common (>> 0.94.2) must be >= 0.94.2-2

The d8733be2ef8874b9a858a7ffddfb81b9b656e9a6 backport introduced a
regression by adding an incorrect Depends / Break combo supposed to
reflect the fact that ceph_argparse moved from ceph to ceph-common after
v0.94.2. It assumed the package is released under the 0.94.2 version
where in reality it is released under the 0.94.2-1xxx version (where xxx
is trusty, jessie etc.).

The Depends / Break combo is changed to use 0.94.2-2 instead.

See also http://tracker.ceph.com/issues/12529 for a larger discussion.

http://tracker.ceph.com/issues/11998 Fixes: #11998

Signed-off-by: Loic Dachary <ldachary@redhat.com>
9 years agoceph.spec.in: drop SUSE-specific %py_requires macro 5412/head
Nathan Cutler [Thu, 9 Jul 2015 09:51:13 +0000 (11:51 +0200)]
ceph.spec.in: drop SUSE-specific %py_requires macro

%py_requires expands to

BuildRequires: /usr/bin/python
PreReq: python = 2.7

The BuildRequires: is already provided, and the PreReq is wrong because
e.g. SLE11-SP3 (a platform we are trying to support) has Python 2.6.

http://tracker.ceph.com/issues/12351 Fixes: #12351

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit cbf6c7b46b42e163950bf7956e5b7565fca961c9)

9 years agoceph.spec.in: remove SUSE-specific apache2-mod_fcgid dependency 5411/head
Nathan Cutler [Thu, 16 Jul 2015 13:16:22 +0000 (15:16 +0200)]
ceph.spec.in: remove SUSE-specific apache2-mod_fcgid dependency

This package is no longer required for RGW to work in SUSE.

http://tracker.ceph.com/issues/12358 Fixes: #12358

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit f3f8d3660d0ece3139e5f3dc7881ccceadcf648d)

Conflicts:
ceph.spec.in
            In master, the "%if %else %endif" has been changed
            into two "%if %endif"s

9 years agotests: verify that image shrink properly handles flush op 5318/head
Jason Dillaman [Tue, 23 Jun 2015 18:20:16 +0000 (14:20 -0400)]
tests: verify that image shrink properly handles flush op

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 8dfcc72071d63c7867a5a59abe871cf5db673a0a)

9 years agolibrbd: invalidate cache outside cache callback context
Jason Dillaman [Tue, 23 Jun 2015 18:18:20 +0000 (14:18 -0400)]
librbd: invalidate cache outside cache callback context

When shrinking an image, it's possible that the op flush callback
will be from within the cache callback context.  This would result
in a deadlock when attempting to re-lock the cache lock in order to
invalidate the cache.

Fixes: #11743
Backport: hammer
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 726d699b7790c7e371279281ab32cd3aeb8ece7b)

9 years agolibrbd: don't cancel request lock early 5319/head
Jason Dillaman [Fri, 15 May 2015 15:18:29 +0000 (11:18 -0400)]
librbd: don't cancel request lock early

It's possible that a stale notice is received and will
be discarded after the request lock has been canceled.
This will stale the client.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit d9dd5c5890029107df40ed438f23fb9865d7de29)

9 years agotests: new test for transitioning exclusive lock
Jason Dillaman [Thu, 14 May 2015 20:13:38 +0000 (16:13 -0400)]
tests: new test for transitioning exclusive lock

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit f97ce46ea4c9c7cdc6e37e3759871d5b41b25769)