]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoRevert "moved to use boost uuid implementation, based on commit 4fe89a7b14c97b2ed7f35... 10913/head
Sage Weil [Mon, 29 Aug 2016 19:29:29 +0000 (15:29 -0400)]
Revert "moved to use boost uuid implementation, based on commit 4fe89a7b14c97b2ed7f357132901beb2bdcec551"

This reverts commit 174de7fce8080df6e02b363e7821e8cca6f8157f.

8 years agoRevert "uuid: use boost::random:random_device"
Sage Weil [Mon, 29 Aug 2016 15:55:24 +0000 (11:55 -0400)]
Revert "uuid: use boost::random:random_device"

This reverts commit 187d308b5b0cb0512b442bbad1bddfda8ef9203f.

This breaks precise builds.

8 years ago0.94.8 v0.94.8
Jenkins Build Slave User [Fri, 26 Aug 2016 00:02:49 +0000 (00:02 +0000)]
0.94.8

8 years agoMerge pull request #10750 from ceph/wip-14799-hammer
Loic Dachary [Wed, 17 Aug 2016 13:26:49 +0000 (15:26 +0200)]
Merge pull request #10750 from ceph/wip-14799-hammer

hammer: rocksdb do not link against tcmalloc if it's disabled

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agorocksdb: disable tcmalloc if disabled 10750/head
Kefu Chai [Wed, 17 Aug 2016 06:45:18 +0000 (23:45 -0700)]
rocksdb: disable tcmalloc if disabled

the rocksdb/configure.ac does not support --with-tcmalloc before,
and the updated rocksdb commit has the change for '--with-tcmalloc'
option, so let's pick it up.

Fixes: http://tracker.ceph.com/issues/14799
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoceph.spec: respect CEPH_EXTRA_CONFIGURE_ARGS
Sage Weil [Sat, 12 Sep 2015 18:12:20 +0000 (14:12 -0400)]
ceph.spec: respect CEPH_EXTRA_CONFIGURE_ARGS

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 51abff11688f0201b8f4076ac515e4515929d4cb)
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
8 years agoMerge pull request #10718 from oritwas/wip-14328-hammer
Orit Wasserman [Sat, 13 Aug 2016 17:19:37 +0000 (19:19 +0200)]
Merge pull request #10718 from oritwas/wip-14328-hammer

hammer: rgw: the swift key remains after removing a subuser

8 years agoMerge pull request #10509 from yehudasa/wip-15557-hammer
Orit Wasserman [Sat, 13 Aug 2016 16:22:19 +0000 (18:22 +0200)]
Merge pull request #10509 from yehudasa/wip-15557-hammer

rgw: Have a flavor of bucket deletion to bypass GC and to trigger

8 years agorgw: fix subuser rm command failure 10718/head
Orit Wasserman [Wed, 20 Jan 2016 16:24:38 +0000 (17:24 +0100)]
rgw: fix subuser rm command failure

Fixes: 14375
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit bbc06e70b49b2917ee63985727cb92724fb99209)

8 years agorgw: add a method to purge all associate keys when removing a subuser
Sangdi Xu [Wed, 16 Dec 2015 01:09:16 +0000 (09:09 +0800)]
rgw: add a method to purge all associate keys when removing a subuser

Fixes: #12890
When removing a subuser, make sure all of its keys, including the swift key and possible s3 keys, are also deleted.

Signed-off-by: Sangdi Xu <xu.sangdi@h3c.com>
(cherry picked from commit e7b7e1afc7a81c3f97976f7442fbdc5118b532b5)

8 years agoMerge pull request #10291 from badone/wip-13829-hammer
Nathan Cutler [Fri, 12 Aug 2016 10:23:41 +0000 (12:23 +0200)]
Merge pull request #10291 from badone/wip-13829-hammer

hammer: config set with negative value results in "error setting 'filestore_merge_threshold' to '-40': (22) Invalid argument"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #10699 from ktdreyer/wip-15867-nroff
Loic Dachary [Fri, 12 Aug 2016 07:46:30 +0000 (09:46 +0200)]
Merge pull request #10699 from ktdreyer/wip-15867-nroff

jewel: doc: fix by-parttypeuuid in ceph-disk(8) nroff

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agodoc: fix by-parttypeuuid in ceph-disk(8) nroff 10699/head
Ken Dreyer [Thu, 11 Aug 2016 23:11:41 +0000 (17:11 -0600)]
doc: fix by-parttypeuuid in ceph-disk(8) nroff

Commit 221efb0b893adbfd7a19df171cf967fee87afcc7 altered the rST source
for the ceph-disk man page. In Hammer, we also have to modify the nroff
sources, because static copies of the generated man pages are stored in
Git.

Fixes: http://tracker.ceph.com/issues/15867
Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
8 years agoMerge pull request #9741 from SUSE/wip-16343-hammer
Nathan Cutler [Thu, 11 Aug 2016 20:58:33 +0000 (22:58 +0200)]
Merge pull request #9741 from SUSE/wip-16343-hammer

hammer: boost uuid makes valgrind complain

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #10554 from Vicente-Cheng/wip-16815-hammer
Orit Wasserman [Thu, 11 Aug 2016 13:58:51 +0000 (15:58 +0200)]
Merge pull request #10554 from Vicente-Cheng/wip-16815-hammer

hammer: radosgw-admin region-map set is not reporting the bucket quota correctly
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #10555 from Vicente-Cheng/wip-16317-hammer
Orit Wasserman [Thu, 11 Aug 2016 13:56:39 +0000 (15:56 +0200)]
Merge pull request #10555 from Vicente-Cheng/wip-16317-hammer

hammer: rgw: bucket listing following object delete is partial
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #10530 from yehudasa/wip-16412-hammer
Orit Wasserman [Thu, 11 Aug 2016 13:55:01 +0000 (15:55 +0200)]
Merge pull request #10530 from yehudasa/wip-16412-hammer

rgw: remove bucket index objects when deleting the bucket
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #8755 from kmroz/wip-hammer-convert-plain-object-to-versioned
Orit Wasserman [Thu, 11 Aug 2016 09:14:53 +0000 (11:14 +0200)]
Merge pull request #8755 from kmroz/wip-hammer-convert-plain-object-to-versioned

hammer: rgw: convert plain object to versioned (with null version) when removing
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #9271 from XinzeChi/wip-fix-digest-hammer
Nathan Cutler [Thu, 4 Aug 2016 19:41:15 +0000 (21:41 +0200)]
Merge pull request #9271 from XinzeChi/wip-fix-digest-hammer

osd: fix omap digest compare when scrub

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8805 from SUSE/wip-15482-hammer
Nathan Cutler [Thu, 4 Aug 2016 19:38:57 +0000 (21:38 +0200)]
Merge pull request #8805 from SUSE/wip-15482-hammer

hammer: is_split crash in handle_pg_create

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #8593 from renhwsky/wip-15478-hammer
Nathan Cutler [Thu, 4 Aug 2016 19:37:24 +0000 (21:37 +0200)]
Merge pull request #8593 from renhwsky/wip-15478-hammer

hammer: Pool quota alarm is not in effect

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #7542 from SUSE/wip-14668-hammer
John Spray [Wed, 3 Aug 2016 12:31:41 +0000 (13:31 +0100)]
Merge pull request #7542 from SUSE/wip-14668-hammer

hammer: Wrong ceph get mdsmap assertion

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #8042 from ukernel/hammer-15050
John Spray [Wed, 3 Aug 2016 12:31:30 +0000 (13:31 +0100)]
Merge pull request #8042 from ukernel/hammer-15050

hammer: mds: fix stray purging in 'stripe_count > 1' case

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #8804 from SUSE/wip-15512-hammer
John Spray [Wed, 3 Aug 2016 12:31:22 +0000 (13:31 +0100)]
Merge pull request #8804 from SUSE/wip-15512-hammer

hammer: Double decreased the count to trim caps which will cause failing to respond to cache pressure

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #9404 from SUSE/wip-16082-hammer
John Spray [Wed, 3 Aug 2016 12:31:09 +0000 (13:31 +0100)]
Merge pull request #9404 from SUSE/wip-16082-hammer

hammer: mds: wrongly treat symlink inode as normal file/dir when symlink inode is stale on kcephfs

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #10198 from SUSE/wip-16626-hammer
John Spray [Wed, 3 Aug 2016 12:30:58 +0000 (13:30 +0100)]
Merge pull request #10198 from SUSE/wip-16626-hammer

hammer: Failing file operations on kernel based cephfs mount point leaves unaccessible file behind on hammer 0.94.7

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agorgw: reset return code in when iterating over the bucket the objects 10555/head
Orit Wasserman [Thu, 25 Feb 2016 15:02:15 +0000 (16:02 +0100)]
rgw: reset return code in when iterating over the bucket the objects

Fixes: #14826
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit e23fdcbbce47aaf041b9f8a0812c8a729aa5014b)

8 years agorgw: fix compilation 10554/head
Yehuda Sadeh [Wed, 14 Oct 2015 00:04:57 +0000 (17:04 -0700)]
rgw: fix compilation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 9dfbae6d65bf6f8ab7cdf8597d556505b81cedd9)

8 years agorgw: add bucket_quota to RGWRegionMap::encode_json
Orit Wasserman [Mon, 12 Oct 2015 09:14:19 +0000 (11:14 +0200)]
rgw: add bucket_quota to RGWRegionMap::encode_json

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit e18b72f7e97a65af681e368d3706a465603df89d)

8 years agorgw: Have a flavor of bucket deletion to bypass GC and to trigger 10509/head
root [Wed, 20 Apr 2016 08:45:55 +0000 (14:15 +0530)]
rgw: Have a flavor of bucket deletion to bypass GC and to trigger
object deletions async.

Fixes: http://tracker.ceph.com/issues/15557
Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>
(cherry picked from commit b7a69fca248afeef1de1278890076693b16cf6d3)

Conflicts:
src/rgw/rgw_admin.cc
src/rgw/rgw_bucket.cc
src/rgw/rgw_bucket.h
src/test/cli/radosgw-admin/help.t

8 years agorgw: remove bucket index objects when deleting the bucket 10530/head
Orit Wasserman [Mon, 4 Jul 2016 13:01:51 +0000 (15:01 +0200)]
rgw: remove bucket index objects when deleting the bucket

Fixes: http://tracker.ceph.com/issues/16412
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit 3ae276390641ad5fc4fef0c03971db95948880b4)

8 years agoMerge pull request #10182 from gaurav36/wip-configure-xfs-issue-hammer
Nathan Cutler [Fri, 29 Jul 2016 21:51:47 +0000 (23:51 +0200)]
Merge pull request #10182 from gaurav36/wip-configure-xfs-issue-hammer

hammer: configure: Add -D_LARGEFILE64_SOURCE to Linux build.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #7961 from dzafman/wip-15002
Nathan Cutler [Fri, 29 Jul 2016 07:40:46 +0000 (09:40 +0200)]
Merge pull request #7961 from dzafman/wip-15002

hammer: objects unfound after repair (fixed by repeering the pg)

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9125 from dzafman/wip-15635
Nathan Cutler [Fri, 29 Jul 2016 07:38:15 +0000 (09:38 +0200)]
Merge pull request #9125 from dzafman/wip-15635

hammer: [MON] Fixed calculation of %USED

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8464 from dzafman/wip-13039-15315
Nathan Cutler [Fri, 29 Jul 2016 07:36:05 +0000 (09:36 +0200)]
Merge pull request #8464 from dzafman/wip-13039-15315

hammer: "FAILED assert(pg->info.history.same_interval_since == p.same_interval_since)" in upgrade:hammer-x-jewel-distro-basic-openstack

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8573 from Vicente-Cheng/wip-15293-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:32:47 +0000 (09:32 +0200)]
Merge pull request #8573 from Vicente-Cheng/wip-15293-hammer

hammer: ECBackend: send write and read sub ops on behalf of client ops at normal priority

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8665 from Vicente-Cheng/wip-15525-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:31:16 +0000 (09:31 +0200)]
Merge pull request #8665 from Vicente-Cheng/wip-15525-hammer

hammer: ReplicatedPG.cc: 430: FAILED assert(!actingbackfill.empty()): old watch timeout tries to queue repop on replica

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8806 from SUSE/wip-15320-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:29:58 +0000 (09:29 +0200)]
Merge pull request #8806 from SUSE/wip-15320-hammer

hammer: LibRadosMiscConnectFailure.ConnectFailure (not so intermittent) failure in upgrade/hammer-x

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9001 from Vicente-Cheng/wip-15730-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:28:32 +0000 (09:28 +0200)]
Merge pull request #9001 from Vicente-Cheng/wip-15730-hammer

hammer: osd: acting_primary not updated on split

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9400 from Vicente-Cheng/wip-15796-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:26:55 +0000 (09:26 +0200)]
Merge pull request #9400 from Vicente-Cheng/wip-15796-hammer

hammer: LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 segv

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9416 from chardan/wip-15770-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:24:42 +0000 (09:24 +0200)]
Merge pull request #9416 from chardan/wip-15770-hammer

hammer: mon/OSDMonistor: improve reweight_by_utilization() logic

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #10189 from dreamhost/wip-16618-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:21:25 +0000 (09:21 +0200)]
Merge pull request #10189 from dreamhost/wip-16618-hammer

rgw: fix multi-delete query param parsing.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8379 from Vicente-Cheng/wip-15283-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:17:57 +0000 (09:17 +0200)]
Merge pull request #8379 from Vicente-Cheng/wip-15283-hammer

hammer: RGW shouldn't send Content-Type nor Content-Length for 304 responses

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8313 from SUSE/wip-15257-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:14:39 +0000 (09:14 +0200)]
Merge pull request #8313 from SUSE/wip-15257-hammer

hammer: rgw: radosgw server abort when user passed bad parameters to set quota

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #8528 from wido/hammer-issue-15348
Nathan Cutler [Fri, 29 Jul 2016 07:13:09 +0000 (09:13 +0200)]
Merge pull request #8528 from wido/hammer-issue-15348

rgw: Set Access-Control-Allow-Origin to a Asterisk if allowed in a rule

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9671 from ceph/hammer-rgw-copy-if-newer
Nathan Cutler [Fri, 29 Jul 2016 07:10:57 +0000 (09:10 +0200)]
Merge pull request #9671 from ceph/hammer-rgw-copy-if-newer

hammer: rgw: backport rgwx-copy-if-newer for radosgw-agent

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9961 from SUSE/wip-16190-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:09:14 +0000 (09:09 +0200)]
Merge pull request #9961 from SUSE/wip-16190-hammer

hammer: subuser rm fails with status 125

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #9402 from SUSE/wip-15966-hammer
Nathan Cutler [Fri, 29 Jul 2016 07:07:10 +0000 (09:07 +0200)]
Merge pull request #9402 from SUSE/wip-15966-hammer

hammer: No Last-Modified, Content-Size and X-Object-Manifest headers if no segments in DLO manifest

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agomon/OSDMonitor: avoid potential expensive grace calculation 9416/head
xie xingguo [Tue, 31 May 2016 22:40:05 +0000 (15:40 -0700)]
mon/OSDMonitor: avoid potential expensive grace calculation

The grace calculation during check_failure() is now very complicated
and time-consuming. Therefore we shall skip this when it is possible.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 3557903d5d57642179b2ae137bedc389974b1956)

 Conflicts:
src/mon/OSDMonitor.cc

Resolved by choosing the move-to-top implementation. Removed unused vars.

8 years agomon/OSDMonitor: improve reweight_by_utilization() logic
xie xingguo [Tue, 26 Apr 2016 03:13:32 +0000 (11:13 +0800)]
mon/OSDMonitor: improve reweight_by_utilization() logic

By calling reweight_by_utilization() method, we are aiming at an evener result
of utilization among all osds. To achieve this, we shall decrease weights of
osds which are currently overloaded, and try to increase weights of osds which
are currently underloaded when it is possible.
However, we can't do this all at a time in order to avoid a massive pg migrations
between osds. Thus we introduce a max_osds limit to smooth the progress.

The problem here is that we have sorted the utilization of all osds in a descending
manner and we always try to decrease the weights of the most overloaded osds
since they are most likely to encounter a nearfull/full transition soon, but
we won't increase the weights from the most underloaded(least utilized by contrast)
at the same time, which I think is not quite reasonable.

Actually, the best thing would probably be to iterate over teh low and high osds
in parallel, and do the ones that are furthest from the average first.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit e7a32534ebc9e27f955ff2d7a8d1db511383301e)

 Conflicts:
src/mon/OSDMonitor.cc

Resolved by picking the lambda implemenation.
NOTE: Because hammer does not support C++11, the lambda functionality from the
current master has been moved into the "Sorter" function object.

8 years agoMerge pull request #10038 from tchaikov/wip-16297-hammer 10464/head
Nathan Cutler [Wed, 27 Jul 2016 06:28:38 +0000 (08:28 +0200)]
Merge pull request #10038 from tchaikov/wip-16297-hammer

mon: Monitor: validate prefix on handle_command()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9090 from tchaikov/wip-13990-hammer
Nathan Cutler [Tue, 26 Jul 2016 17:08:23 +0000 (19:08 +0200)]
Merge pull request #9090 from tchaikov/wip-13990-hammer

hammer: osd: remove all stale osdmaps in handle_osd_map()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #10227 from SUSE/wip-15081-hammer
Nathan Cutler [Mon, 25 Jul 2016 19:44:14 +0000 (21:44 +0200)]
Merge pull request #10227 from SUSE/wip-15081-hammer

hammer: When logging to a file fails, ceph logs excessively to stderr

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoMerge pull request #9893 from Vicente-Cheng/wip-16430-hammer
Nathan Cutler [Mon, 25 Jul 2016 19:43:49 +0000 (21:43 +0200)]
Merge pull request #9893 from Vicente-Cheng/wip-16430-hammer

hammer: OSDMonitor: drop pg temps from not the current primary

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #9238 from SUSE/wip-15962-hammer
Nathan Cutler [Mon, 25 Jul 2016 19:42:54 +0000 (21:42 +0200)]
Merge pull request #9238 from SUSE/wip-15962-hammer

hammer: ceph-osd valgrind invalid reads/writes

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoMerge pull request #8849 from SUSE/wip-14326-hammer
Nathan Cutler [Mon, 25 Jul 2016 19:42:06 +0000 (21:42 +0200)]
Merge pull request #8849 from SUSE/wip-14326-hammer

hammer: osd/PGLog.h: 88: FAILED assert(rollback_info_trimmed_to == head)

Reviewed-by: Samuel Just <sjust@redhat.com>
8 years agoMerge pull request #8845 from SUSE/wip-15647-hammer
Nathan Cutler [Mon, 25 Jul 2016 19:40:57 +0000 (21:40 +0200)]
Merge pull request #8845 from SUSE/wip-15647-hammer

hammer: osd: rados cppool omap to ec pool crashes osd

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8470 from dachary/wip-15403-api-test-timeout-hammer
Loic Dachary [Mon, 25 Jul 2016 13:05:54 +0000 (15:05 +0200)]
Merge pull request #8470 from dachary/wip-15403-api-test-timeout-hammer

hammer: tests: be more generous with test timeout

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #9977 from shun-s/hammer
Nathan Cutler [Mon, 25 Jul 2016 13:05:31 +0000 (15:05 +0200)]
Merge pull request #9977 from shun-s/hammer

replcatedBackend: delete one of the repeated op->mark_started in ReplicatedBackend::sub_op_modify_impl

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #8960 from badone/wip-hammer-rados-bench-units
Nathan Cutler [Mon, 25 Jul 2016 10:51:45 +0000 (12:51 +0200)]
Merge pull request #8960 from badone/wip-hammer-rados-bench-units

hammer: Add units to rados bench output and clean up formatting

Reviewed-by: Nathan Cutler <ncutler@suse.com>
9 years agoOSDMonitor: drop pg temp from sources other than the current primary 9893/head
Samuel Just [Thu, 2 Jun 2016 17:43:17 +0000 (10:43 -0700)]
OSDMonitor: drop pg temp from sources other than the current primary

Fixes: http://tracker.ceph.com/issues/16127
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 1a07123c38e3fecb3fb2e43bbbae962d8411d287)

change:
            use NULL to replace the nullptr because we don't have C++11

9 years agoosd: reset session->osdmap if session is not waiting for a map anymore 9090/head
Kefu Chai [Thu, 12 May 2016 12:28:11 +0000 (20:28 +0800)]
osd: reset session->osdmap if session is not waiting for a map anymore

we should release the osdmap reference once we are done with it,
otherwise we might need to wait very long to update that reference with
a newer osdmap ref. this appears to be an OSDMap leak: it is held by an
quiet OSD::Session forever.

the osdmap is not reset in OSD::session_notify_pg_create(), because its
only caller is wake_pg_waiters(), which will call
dispatch_session_waiting() later. and dispatch_session_waiting() will
check the session->osdmap, and will also reset the osdmap if
session->waiting_for_pg.empty().

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 82b0af7cedc3071cd83ee53479f834c23c62b7d0)

9 years agoqa: Add test for #13829 10291/head
Brad Hubbard [Wed, 27 Jan 2016 01:34:47 +0000 (11:34 +1000)]
qa: Add test for #13829

qa/workunits/cephtool/test.sh: add test for setting negative int options
src/test/daemon_config.cc: remove tests for failed negative values

Fixes: #13829
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 994ac2942d04584d1617e6d4bbd5b880b1ea0448)

9 years agocommon: Allow config set with negative value
Brad Hubbard [Wed, 27 Jan 2016 01:18:16 +0000 (11:18 +1000)]
common: Allow config set with negative value

A recent commit disabled negative values but they are required for variables
such as filestore_merge_threshold.

Modified patch to remove C++11 specific elements so it will build for hammer

Fixes: #13829
Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 8b777a0c346bc70fd10d07e89368b3785b58f10e)

9 years agolog: do not repeat errors to stderr 10227/head
Sage Weil [Thu, 10 Mar 2016 14:50:07 +0000 (09:50 -0500)]
log: do not repeat errors to stderr

If we get an error writing to the log, log it only once to stderr.
This avoids generating, say, 72 GB of ENOSPC errors in
teuthology.log when /var/log fills up.

Fixes: #14616
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit d9ac0474b864afda58a44b9012cca4bbc6aaf509)

Conflicts:
src/log/Log.cc (drop m_uid and m_gid which are not used in hammer;
order of do_stderr, do_syslog, do_fd conditional blocks is reversed in
hammer; drop irrelevant speed optimization code from
5bfe05aebfefdff9022f0eb990805758e0edb1dc)

9 years agomds: disallow 'open truncate' non-regular inode 10198/head
Yan, Zheng [Fri, 15 Apr 2016 12:15:14 +0000 (20:15 +0800)]
mds: disallow 'open truncate' non-regular inode

Signed-off-by: Yan, Zheng <zyan@redhat.com>
(cherry picked from commit 0e4b6f2332bb4822cf324587a94144f1c98e4b97)

Conflicts:
src/mds/Server.cc (hammer has cur->inode.inline_version - in master
this has been changed to cur->inode.inline_data.version)

9 years agomds: only open non-regular inode with mode FILE_MODE_PIN
Yan, Zheng [Fri, 15 Apr 2016 11:45:23 +0000 (19:45 +0800)]
mds: only open non-regular inode with mode FILE_MODE_PIN

ceph_atomic_open() in kernel client does lookup and open at the same
time. So it can open a symlink inode with mode CEPH_FILE_MODE_WR.
Open a symlink inode with mode CEPH_FILE_MODE_WR triggers assertion
in Locker::check_inode_max_size();

Signed-off-by: Yan, Zheng <zyan@redhat.com>
(cherry picked from commit 4d15eb12298e007744486e28924a6f0ae071bd06)

9 years agorgw: fix multi-delete query param parsing. 10189/head
Robin H. Johnson [Thu, 7 Jul 2016 21:14:36 +0000 (14:14 -0700)]
rgw: fix multi-delete query param parsing.

Multi-delete is triggered by a query parameter on POST, but there are
multiple valid ways of representing it, and Ceph should accept ANY way
that has the query parameter set, regardless of what value or absence of
value.

This caused the RubyGem aws-sdk-v1 to break, and has been present since
multi-delete was first added in commit 0a1f4a97da, for the bobtail
release.

Fixes: http://tracker.ceph.com/issues/16618
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
(cherry picked from commit a7016e1b67e82641f0702fda4eae799e953063e6)

9 years agoMerge pull request #9407 from SUSE/wip-15833-hammer
Yehuda Sadeh [Thu, 7 Jul 2016 17:16:31 +0000 (10:16 -0700)]
Merge pull request #9407 from SUSE/wip-15833-hammer

hammer: RGW :: Subset of uploaded objects via radosgw are unretrievable when using erasure coded pool

9 years agoconfigure: Add -D_LARGEFILE64_SOURCE to Linux build. 10179/head 10181/head 10182/head
Ira Cooper [Thu, 31 Mar 2016 16:30:45 +0000 (12:30 -0400)]
configure: Add -D_LARGEFILE64_SOURCE to Linux build.

Fixes: http://tracker.ceph.com/issues/16612
Without -D_LARGEFILE64_SOURCE we can't build against libxfs,
because off64_t must be defined.

Signed-off-by: Ira Cooper <ira@redhat.com>
(cherry picked from commit 602425a)

9 years agoMerge pull request #8475 from Vicente-Cheng/wip-15343-hammer
Orit Wasserman [Wed, 6 Jul 2016 18:25:20 +0000 (20:25 +0200)]
Merge pull request #8475 from Vicente-Cheng/wip-15343-hammer

hammer: Multipart ListPartsResult has missing quotes on ETag
Reviewed-bu: Orit Wasserman <owasserm@redhat.com>

9 years agoreplcatedBackend: delete one useless op->mark_started as there are two in ReplicatedB... 9977/head
shun-s [Tue, 28 Jun 2016 07:30:16 +0000 (15:30 +0800)]
replcatedBackend: delete one useless op->mark_started as there are two in ReplicatedBackend::sub_op_modify_impl
delete one mark_start event as there are two same op->mark_started  in ReplicatedBackend::sub_op_modify_impl
Fixes: http://tracker.ceph.com/issues/16572
Signed-off-by: shun-s <song.shun3@zte.com.cn>
9 years agorgw: Set Access-Control-Allow-Origin to a Asterisk if allowed in a rule 8528/head
Wido den Hollander [Tue, 5 Apr 2016 09:14:16 +0000 (11:14 +0200)]
rgw: Set Access-Control-Allow-Origin to a Asterisk if allowed in a rule

Before this patch the RGW would respond with the Origin send by the client in the request
if a wildcard/asterisk was specified as a valid Origin.

This patch makes sure we respond with a header like this:

  Access-Control-Allow-Origin: *

This way a resource can be used on different Origins by the same browser and that browser
will use the content as the asterisk.

We also keep in mind that when Authorization is send by the client different rules apply.
In the case of Authorization we may not respond with an Asterisk, but we do have to
add the Vary header with 'Origin' as a value to let the browser know that for different
Origins it has to perform a new request.

More information: https://developer.mozilla.org/en-US/docs/Web/HTTP/Access_control_CORS

Fixes: #15348
Signed-off-by: Wido den Hollander <wido@42on.com>
(cherry picked from commit 0021e224480c7164330eaa7cc1078bb8795169bf)

Conflicts:
src/rgw/rgw_rest.cc
hammer still uses s->cio->print() where master uses STREAM_IO(s)->print()

9 years agomon: Monitor: validate prefix on handle_command() 10038/head
Kefu Chai [Thu, 30 Jun 2016 05:24:22 +0000 (13:24 +0800)]
mon: Monitor: validate prefix on handle_command()

Fixes: http://tracker.ceph.com/issues/16297
Signed-off-by: You Ji <youji@ebay.com>
(cherry picked from commit 7cb3434fed03a5497abfd00bcec7276b70df0654)

Conflicts:
    src/mon/Monitor.cc (the signature of Monitor::reply_command()
                        changed a little bit in master, so adapt the
                        commit to work with the old method)

9 years agoMerge pull request #8538 from Vicente-Cheng/wip-15360-hammer
Nathan Cutler [Mon, 27 Jun 2016 15:51:19 +0000 (17:51 +0200)]
Merge pull request #8538 from Vicente-Cheng/wip-15360-hammer

hammer: Linking to -lrbd causes process startup times to balloon

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
9 years agorgw: fix subuser rm command failure 9961/head
Orit Wasserman [Wed, 20 Jan 2016 16:24:38 +0000 (17:24 +0100)]
rgw: fix subuser rm command failure

Fixes: 14375
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit bbc06e70b49b2917ee63985727cb92724fb99209)

Conflicts:
src/rgw/rgw_user.cc The "if (op_state.will_purge_keys())" block was
later changed to "always purge all associated keys" by
e7b7e1afc7a81c3f97976f7442fbdc5118b532b5 - keep the hammer version

9 years agoPipe: take a ref to existing while we are waiting 9238/head
Samuel Just [Thu, 12 May 2016 23:57:49 +0000 (16:57 -0700)]
Pipe: take a ref to existing while we are waiting

Otherwise, if it is reaped while we are waiting, it'll be a
use-after-free.

Fixes: http://tracker.ceph.com/issues/15870
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit b224912d249453d754fc0478d3680f8cfa1a5c22)

Conflicts:
    src/msg/simple/Pipe.cc: nullptr changed to 0 because hammer is not compiled
    with -std=c++11

9 years agorgw: check for -ERR_NOT_MODIFIED in rgw_rest_s3.cc 8379/head
Nathan Cutler [Wed, 15 Jun 2016 14:53:16 +0000 (16:53 +0200)]
rgw: check for -ERR_NOT_MODIFIED in rgw_rest_s3.cc

Fixes: http://tracker.ceph.com/issues/16327
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit fc38346c596d8b0bc156183970d6a327943cb577)

Conflicts:
src/rgw/rgw_rest_s3.cc
  use ret instead of op_ret to check op result

9 years agoerasure-code: s/unreocvery/unfound/ 7961/head
Loic Dachary [Thu, 28 May 2015 20:35:08 +0000 (22:35 +0200)]
erasure-code: s/unreocvery/unfound/

Signed-off-by: Loic Dachary <ldachary@redhat.com>
(cherry picked from commit 28820d1cd630ec466ed1069a437d740a025fb9aa)

9 years agotest: add test-case for repair unrecovery-ec pg.
Jianpeng Ma [Wed, 22 Apr 2015 01:45:04 +0000 (09:45 +0800)]
test: add test-case for repair unrecovery-ec pg.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit 8f30db85219a6c57cb2fc03f4049a3f57446ca55)

9 years agoosd: Remove the duplicated func MissingLoc::get_all_missing.
Jianpeng Ma [Tue, 14 Apr 2015 05:29:54 +0000 (13:29 +0800)]
osd: Remove the duplicated func MissingLoc::get_all_missing.

It is the same as MissingLoc::get_needs_recovery.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
(cherry picked from commit bdd6205408cf20e039496728052a36c1a7d758c6)

9 years agoosd: Fix ec pg repair endless when met unrecover object.
Jianpeng Ma [Tue, 14 Apr 2015 01:11:58 +0000 (09:11 +0800)]
osd: Fix ec pg repair endless when met unrecover object.

In repair_object, if bad_peer is replica, it don't add soid in
MissingLoc for ec pool. If there are more bad replica for ec pool
which cause object can't recover, the later recoverying will endless.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d51806f5b330d5f112281fbb95ea6addf994324e)

9 years agouuid: use boost::random:random_device 9741/head
Sage Weil [Mon, 24 Aug 2015 18:51:47 +0000 (14:51 -0400)]
uuid: use boost::random:random_device

The boost mt code uses uninitialized memory for extra randomness,
which is a bad idea in general but more importantly makes valgrind
unhappy.  Use /dev/urandom instead.

Unfortunately this introduces a link time dependency.. meh!

Fixes: #12736
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit dbcaa544856fcc99ab912a101c4a28e1eb3fb94e)

Conflicts:
ceph.spec.in (trivial resolution)

9 years agomoved to use boost uuid implementation, based on commit 4fe89a7b14c97b2ed7f357132901b...
Rohan Mars [Thu, 13 Aug 2015 04:19:31 +0000 (21:19 -0700)]
moved to use boost uuid implementation, based on commit 4fe89a7b14c97b2ed7f357132901beb2bdcec551

Signed-off-by: Rohan Mars <code@rohanmars.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 62bfc7a1ab1587e81ed3bff0ddfbb1aa69d1c299)

Conflicts:
debian/control (trivial resolution)
src/common/Makefile.am (trivial resolution)
src/common/blkdev.cc (no get_device_by_uuid() function in hammer)

9 years agoMerge pull request #9722 from trociny/wip-16289-hammer
Mykola Golub [Thu, 16 Jun 2016 05:26:00 +0000 (08:26 +0300)]
Merge pull request #9722 from trociny/wip-16289-hammer

hammer: qa/workunits/rbd: respect RBD_CREATE_ARGS environment variable

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
9 years agoqa/workunits/rbd: respect RBD_CREATE_ARGS environment variable 9722/head
Mykola Golub [Tue, 14 Jun 2016 12:28:06 +0000 (15:28 +0300)]
qa/workunits/rbd: respect RBD_CREATE_ARGS environment variable

Fixes: http://tracker.ceph.com/issues/16289
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 3048d3c7ce800a6174c54946b838e4e4079ec609)

9 years agorgw: fix identification of canceled operation 9671/head
Yehuda Sadeh [Sat, 19 Sep 2015 00:34:51 +0000 (17:34 -0700)]
rgw: fix identification of canceled operation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 9f63b15b3a7c4cc633ff90f529934f071aea7c62)

9 years agorgw: identify racing writes when using copy-if-newer
Yehuda Sadeh [Thu, 26 Mar 2015 00:35:40 +0000 (17:35 -0700)]
rgw: identify racing writes when using copy-if-newer

When copying an object from a different zone, and copy-if-newer is
specified, if the final meta write is canceled check whether the
destinatioin that was created is actually newer than our mtime,
otherwise retry.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit fe9c64b75caf3f53ce2dfdea5e39d794528dfc33)

9 years agorgw: translate http error 304 to appropriate status
Yehuda Sadeh [Wed, 25 Mar 2015 05:48:03 +0000 (22:48 -0700)]
rgw: translate http error 304 to appropriate status

So that we can return the appropriate response on a conditioinal multi
zone copy operation.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 20d24e965884af440f94c7e3093587c7b8643cb9)

9 years agorgw: fix if-modified-since boundary
Yehuda Sadeh [Wed, 25 Mar 2015 03:24:55 +0000 (20:24 -0700)]
rgw: fix if-modified-since boundary

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 27946e8ba4bc5dbfec2da319fa23266d5885d655)

9 years agorgw: add rgwx-copy-if-newer http header
Yehuda Sadeh [Wed, 25 Mar 2015 03:16:02 +0000 (20:16 -0700)]
rgw: add rgwx-copy-if-newer http header

Similar to IF_MOD_SINCE, but does not take a time argument, and should
protected against races (not there yet).

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 8813a4401198636e0f4d3a220a0f726625a5c5d4)

9 years agoMerge pull request #8113 from Vicente-Cheng/wip-15023-hammer
Orit Wasserman [Tue, 7 Jun 2016 13:48:00 +0000 (15:48 +0200)]
Merge pull request #8113 from Vicente-Cheng/wip-15023-hammer

hammer: rgw: user quota may not adjust on bucket removal
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
9 years agoMerge pull request #9277 from ceph/wip-split-lfn-hammer
Samuel Just [Mon, 6 Jun 2016 19:42:14 +0000 (12:42 -0700)]
Merge pull request #9277 from ceph/wip-split-lfn-hammer

Hammer LFN collection split fix: backport of http://tracker.ceph.com/issues/14766

Reviewed-by: Sage Weil <sage@redhat.com>
9 years agoMerge pull request #9521 from ceph/revert-9496-wip-16149-hammer
Josh Durgin [Mon, 6 Jun 2016 15:19:23 +0000 (08:19 -0700)]
Merge pull request #9521 from ceph/revert-9496-wip-16149-hammer

Revert "hammer: Scrub error: 0/1 pinned"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
9 years agoRevert "hammer: Scrub error: 0/1 pinned" 9521/head
Sage Weil [Mon, 6 Jun 2016 15:15:54 +0000 (11:15 -0400)]
Revert "hammer: Scrub error: 0/1 pinned"

9 years agoMerge pull request #9496 from Vicente-Cheng/wip-16149-hammer
Sage Weil [Mon, 6 Jun 2016 12:46:45 +0000 (08:46 -0400)]
Merge pull request #9496 from Vicente-Cheng/wip-16149-hammer

hammer: Scrub error: 0/1 pinned

9 years agoMerge pull request #8987 from dreamhost/hammer-wip-pr7712
Orit Wasserman [Mon, 6 Jun 2016 09:39:34 +0000 (11:39 +0200)]
Merge pull request #8987 from dreamhost/hammer-wip-pr7712

hammer: rgw: S3: set EncodingType in ListBucketResult
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
9 years agoReplicatedPG: adjust num_pinned in _delete_oid 9496/head
Samuel Just [Fri, 20 May 2016 20:59:10 +0000 (13:59 -0700)]
ReplicatedPG: adjust num_pinned in _delete_oid

Fixes: http://tracker.ceph.com/issues/15952
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 907d4e25c676fd3e1c2be90ce8ab5b64b362b0bc)

9 years agotest: Fix grouping of mon_cephdf_commands by moving to MON_TESTS 9125/head
David Zafman [Wed, 18 May 2016 00:14:07 +0000 (17:14 -0700)]
test: Fix grouping of mon_cephdf_commands by moving to MON_TESTS

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 2fb0530a5650bcdb9c89d8bdd2504a7dd1642678)

Conflicts:
qa/workunits/cephtool/test.sh (trivial)

9 years agorgw: convert plain object to versioned (with null version) when removing 8755/head
Yehuda Sadeh [Wed, 23 Mar 2016 01:14:57 +0000 (18:14 -0700)]
rgw: convert plain object to versioned (with null version) when removing

Fixes #15243

When removing a plain null versioned object (was created prior to bucket versioning
enabled), need to convert the bucket index representation to a versioned one. This
is needed so that all the versioning mechanics play together.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit c6334d430b17739fed2df2b4481ae395ef6568d9)

Conflicts:
        src/rgw/rgw_rados.cc
          - hammer is missing get_zone() API from which log_data can be
            obtained. Needed to fall back to zone_public_config
            structure in bucket_index_unlink_instance() definition.
          - olh_tag string parameter added to
            bucket_index_unlink_instance() definition.
        src/rgw/rgw_rados.h
          - olh_tag string parameter added to
            bucket_index_unlink_instance() declaration.