]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
10 years agomailmap: Yehuda Sadeh name normalization 2627/head
Abhishek Lekshmanan [Thu, 2 Oct 2014 10:25:06 +0000 (15:55 +0530)]
mailmap: Yehuda Sadeh name normalization

Reported-by: Loic Dachary <loic@dachary.org>
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agoMerge pull request #2625 from ceph/wip-ysw-mailmap
Loic Dachary [Thu, 2 Oct 2014 05:52:43 +0000 (07:52 +0200)]
Merge pull request #2625 from ceph/wip-ysw-mailmap

mailmap: update email address

Reviewed-by: Loic Dachary <loic-201408@dachary.org>
10 years agomailmap: update email address 2625/head
Yehuda Sadeh [Thu, 2 Oct 2014 02:49:33 +0000 (19:49 -0700)]
mailmap: update email address

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
10 years agodoc/release-notes: fix attributions for 8702 fix
Sage Weil [Thu, 2 Oct 2014 01:01:51 +0000 (18:01 -0700)]
doc/release-notes: fix attributions for 8702 fix

Oops!

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agodoc/release-notes: v0.80.6
Sage Weil [Thu, 2 Oct 2014 00:48:12 +0000 (17:48 -0700)]
doc/release-notes: v0.80.6

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2623 from ceph/wip-coverity-20141002
Sage Weil [Wed, 1 Oct 2014 23:20:09 +0000 (16:20 -0700)]
Merge pull request #2623 from ceph/wip-coverity-20141002

build and coverity fixes

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2622 from dachary/wip-osd-pool-ls
Sage Weil [Wed, 1 Oct 2014 23:18:36 +0000 (16:18 -0700)]
Merge pull request #2622 from dachary/wip-osd-pool-ls

qa: fix osd pool ls invalid test

10 years agoMerge pull request #2621 from ceph/wip-objecter-shutdown
Sage Weil [Wed, 1 Oct 2014 23:14:07 +0000 (16:14 -0700)]
Merge pull request #2621 from ceph/wip-objecter-shutdown

Fix Objecter shutdown races with message handling

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoqa: fix osd pool ls invalid test 2622/head
Loic Dachary [Wed, 1 Oct 2014 21:39:39 +0000 (23:39 +0200)]
qa: fix osd pool ls invalid test

expect_false does not extend past the pipe and fails because the command
succeeds

introduced in f05c977bbcd310a83e6df03344a72d4cc06e1cc3

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoBtrfsFileStoreBackend.cc: fix string overflow 2623/head
Danny Al-Gaaf [Wed, 1 Oct 2014 21:08:15 +0000 (23:08 +0200)]
BtrfsFileStoreBackend.cc: fix string overflow

Use strncpy() instead of strcpy and make sure the result
is '\0' terminated.

Fix for:

CID 1063700 (#1 of 1): Copy into fixed size buffer (STRING_OVERFLOW)
 fixed_size_dest: You might overrun the 4088 byte fixed-size string
 vol_args.name by copying the return value of c_str without checking
 the length.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
10 years agotest_librbd.cc: fix compiler warning, cast to size_t
Danny Al-Gaaf [Wed, 1 Oct 2014 21:07:36 +0000 (23:07 +0200)]
test_librbd.cc: fix compiler warning, cast to size_t

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
10 years agoObjecter: check the 'initialized' atomic_t safely 2621/head
Josh Durgin [Tue, 30 Sep 2014 01:17:29 +0000 (18:17 -0700)]
Objecter: check the 'initialized' atomic_t safely

shutdown() resets initialized to 0, but we can still receive messages
after this point, so fix message handlers to skip messages in this
case instead of asserting.

Also read initialized while holding Objecter::rwlock to avoid races
where e.g. handle_osd_map() checks initialized -> 1, continues,
shutdown() is called, sets initialized to 0, then handle_osd_map()
goes about its business and calls op_submit(), which would fail the
assert(initialized.read()) check. Similar races existed in other
message handlers which change Objecter state.

The Objecter is not destroyed until after its Messenger in
the MDS, OSD, and librados, so this should be safe.

Fixes: #9617
Backport: giant
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
10 years agoMerge pull request #2619 from ceph/wip-8187
Josh Durgin [Wed, 1 Oct 2014 19:53:53 +0000 (12:53 -0700)]
Merge pull request #2619 from ceph/wip-8187

librbd: Skip tier pools in list_children and snap_unprotect

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
10 years agolibrbd: Skip tier pools in list_children and snap_unprotect 2619/head
Adam Crume [Tue, 23 Sep 2014 22:41:26 +0000 (15:41 -0700)]
librbd: Skip tier pools in list_children and snap_unprotect

Fixes: #8187
Signed-off-by: Adam Crume <adamcrume@gmail.com>
10 years agoMerge pull request #2552 from ceph/wip-8188
Sage Weil [Wed, 1 Oct 2014 16:52:47 +0000 (09:52 -0700)]
Merge pull request #2552 from ceph/wip-8188

librados: Add rados_pool_get_tiers call

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agolibrados: Add rados_pool_get_base_tier call 2552/head
Adam Crume [Mon, 22 Sep 2014 18:10:48 +0000 (11:10 -0700)]
librados: Add rados_pool_get_base_tier call

Fixes: #8188
Signed-off-by: Adam Crume <adamcrume@gmail.com>
10 years agoMerge pull request #2618 from ceph/wip-coverity-20141001
Sage Weil [Wed, 1 Oct 2014 16:23:01 +0000 (09:23 -0700)]
Merge pull request #2618 from ceph/wip-coverity-20141001

Fixes for Coverity issues

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2452 from ceph/wip-pool-ls
João Eduardo Luís [Wed, 1 Oct 2014 16:22:42 +0000 (16:22 +0000)]
Merge pull request #2452 from ceph/wip-pool-ls

mon: add 'osd pool ls [detail]' command

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
10 years agotest_librbd.cc: fix compiler warning 2618/head
Danny Al-Gaaf [Wed, 1 Oct 2014 15:05:32 +0000 (17:05 +0200)]
test_librbd.cc: fix compiler warning

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
10 years agoclient/SyntheticClient.cc: remove dead code
Danny Al-Gaaf [Wed, 1 Oct 2014 15:01:17 +0000 (17:01 +0200)]
client/SyntheticClient.cc: remove dead code

Fix for:

const: At condition do_sync, the value of do_sync must be equal to 0.
dead_error_condition: The condition do_sync cannot be true.
CID 716893 (#1 of 1): Logically dead code (DEADCODE)
dead_error_begin: Execution cannot reach this statement op.OSDOp()

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
10 years agodoc: A couple of fixes to the CloudStack documentation
Wido den Hollander [Wed, 1 Oct 2014 15:01:07 +0000 (17:01 +0200)]
doc: A couple of fixes to the CloudStack documentation

10 years agoSyntheticClient.cc: remove dead code
Danny Al-Gaaf [Wed, 1 Oct 2014 13:49:17 +0000 (15:49 +0200)]
SyntheticClient.cc: remove dead code

Fix for coverity issue:

const: At condition unsafe > 0, the value of unsafe must be equal to 0.
dead_error_condition: The condition unsafe > 0 cannot be true.

CID 716892 (#1 of 1): Logically dead code (DEADCODE)
dead_error_begin: Execution cannot reach this statement

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
10 years agoLogEntry.h: init LogEntry::prio in constructor
Danny Al-Gaaf [Thu, 25 Sep 2014 11:34:47 +0000 (13:34 +0200)]
LogEntry.h: init LogEntry::prio in constructor

CID 1240202 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
 uninit_member: Non-static class member prio is not initialized
 in this constructor nor in any functions that it calls.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
10 years agoosd: fix need_journal call
Sage Weil [Wed, 1 Oct 2014 13:34:20 +0000 (06:34 -0700)]
osd: fix need_journal call

From 2955b3da4e2c472c18b45e81eba791f8ccd58061

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2607 from yuyuyu101/wip-9580
Sage Weil [Wed, 1 Oct 2014 13:11:10 +0000 (06:11 -0700)]
Merge pull request #2607 from yuyuyu101/wip-9580

ObjectStore: Add "need_journal" interface to make aware of journal devic...

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2608 from yuyuyu101/pipe-iovec
Sage Weil [Wed, 1 Oct 2014 13:10:24 +0000 (06:10 -0700)]
Merge pull request #2608 from yuyuyu101/pipe-iovec

Pipe: avoid redundancy new/delete for struct iovec

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoObjectStore: Add "need_journal" interface to make aware of journal device 2607/head
Haomai Wang [Tue, 30 Sep 2014 05:45:10 +0000 (13:45 +0800)]
ObjectStore: Add "need_journal" interface to make aware of journal device

Impl feature #9580

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
10 years agoPipe: avoid redundancy new/delete for struct iovec 2608/head
Haomai Wang [Tue, 30 Sep 2014 05:44:02 +0000 (13:44 +0800)]
Pipe: avoid redundancy new/delete for struct iovec

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
10 years agoMerge pull request #2605 from ceph/wip-osd-objecter
Gregory Farnum [Tue, 30 Sep 2014 17:14:38 +0000 (10:14 -0700)]
Merge pull request #2605 from ceph/wip-osd-objecter

osd: do not bind ms_objecter messenger

Reviewed-by: Greg Farnum <greg@inktank.com>
10 years agoMerge pull request #2597 from cchengleo/wip-test-shared-cache
Loic Dachary [Tue, 30 Sep 2014 14:59:05 +0000 (16:59 +0200)]
Merge pull request #2597 from cchengleo/wip-test-shared-cache

test shared cache

Reviewed-by: Loic Dachary <loic-201408@dachary.org>
10 years agotest-shared-cache: 2597/head
Cheng Cheng [Mon, 29 Sep 2014 14:41:32 +0000 (10:41 -0400)]
test-shared-cache:
  Add test for "lower_bound" method.
  Add multithread tests for "lookup" and "lower_bound" methods.

Signed-off-by: Cheng Cheng <ccheng.leo@gmail.com>
               Loic Dachary <loic@dachary.org>

10 years agotest-shared-cache:
cchengleo [Mon, 8 Sep 2014 14:37:56 +0000 (10:37 -0400)]
test-shared-cache:
  Initial draft for the unit test of "common/shared_cache.hpp".

Signed-off-by: Cheng Cheng <ccheng.leo@gmail.com>
               Loic Dachary <loic@dachary.org>

10 years agoMerge pull request #2609 from dachary/wip-doc-context
Loic Dachary [Tue, 30 Sep 2014 13:03:15 +0000 (15:03 +0200)]
Merge pull request #2609 from dachary/wip-doc-context

common: document C_GatherBuilder and C_Gather

Reviewed-by: John Spray <john.spray@redhat.com>
10 years agocommon: document C_GatherBuilder and C_Gather 2609/head
Loic Dachary [Tue, 30 Sep 2014 12:10:25 +0000 (14:10 +0200)]
common: document C_GatherBuilder and C_Gather

* Introduction explaining what they are used for
* Commented example to illustrate the abstract description

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoObjecter: init with a constant of the correct type
Josh Durgin [Tue, 30 Sep 2014 01:12:50 +0000 (18:12 -0700)]
Objecter: init with a constant of the correct type

Just a tiny cleanup.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
10 years agoMerge pull request #2502 from yuyuyu101/kvstore-meta-cache
Sage Weil [Mon, 29 Sep 2014 23:43:29 +0000 (16:43 -0700)]
Merge pull request #2502 from yuyuyu101/kvstore-meta-cache

KeyValueStore: performance improvement and docs

10 years agoMerge pull request #2523 from ceph/wip-6926
Josh Durgin [Mon, 29 Sep 2014 23:41:47 +0000 (16:41 -0700)]
Merge pull request #2523 from ceph/wip-6926

rbd: Fix rbd diff for non-existent objects

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
10 years agoMerge remote-tracking branch 'gh/giant'
Sage Weil [Mon, 29 Sep 2014 23:17:15 +0000 (16:17 -0700)]
Merge remote-tracking branch 'gh/giant'

Conflicts:
qa/workunits/cephtool/test.sh
src/test/erasure-code/TestErasureCodeIsa.cc

10 years agoosd: do not bind ms_objecter messenger 2605/head
Sage Weil [Mon, 29 Sep 2014 23:11:06 +0000 (16:11 -0700)]
osd: do not bind ms_objecter messenger

The objecter messenger is only used as a client to initiate client-side
connections to other OSDs.  It doesn't need to bind to a port.

This was added in 558d9fc956204b7a18001b148e171b893cb63d85 to push client
traffic to the cluster interface.  This doesn't actually help/work because
we are still connecting to our peers' client-facing addresses.

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2602 from athanatos/wip-9574
Sage Weil [Mon, 29 Sep 2014 21:14:40 +0000 (14:14 -0700)]
Merge pull request #2602 from athanatos/wip-9574

PG: check full ratio again post-reservation

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2604 from athanatos/wip-9113
Sage Weil [Mon, 29 Sep 2014 21:02:15 +0000 (14:02 -0700)]
Merge pull request #2604 from athanatos/wip-9113

ReplicatedPG: clean out completed trimmed objects as we go

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2549 from ceph/wip-9545
Samuel Just [Mon, 29 Sep 2014 20:54:31 +0000 (13:54 -0700)]
Merge pull request #2549 from ceph/wip-9545

os/FileJournal: do not request sync while shutting down

Reviewed-by: Samuel Just <sam.just@inktank.com>
10 years agoMerge pull request #2550 from ceph/wip-8629
Samuel Just [Mon, 29 Sep 2014 20:52:21 +0000 (13:52 -0700)]
Merge pull request #2550 from ceph/wip-8629

osd: fix cache_evict vs make_writeable/finish_ctx snapdir bug #8629

Reviewed-by: Samuel Just <sam.just@inktank.com>
10 years agoMerge pull request #2510 from somnathr/wip-obj-delete-fix
Samuel Just [Mon, 29 Sep 2014 20:44:37 +0000 (13:44 -0700)]
Merge pull request #2510 from somnathr/wip-obj-delete-fix

FileStore: Race condition during object delete is fixed

Reviewed-by: Samuel Just <sam.just@inktank.com>
10 years agoMerge pull request #2598 from ceph/wip-9582
Sage Weil [Mon, 29 Sep 2014 20:08:10 +0000 (13:08 -0700)]
Merge pull request #2598 from ceph/wip-9582

librados: fix other timeout segfault

Reviewed-by: Greg Farnum <greg@inktank.com>
10 years agoMerge pull request #2458 from ceph/wip-9341
John Spray [Mon, 29 Sep 2014 20:02:58 +0000 (21:02 +0100)]
Merge pull request #2458 from ceph/wip-9341

client: trim unused inodes before reconnecting to recovering MDS

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: John Spray <john.spray@redhat.com>
10 years agoMerge pull request #2555 from theanalyst/wip/mailmap
Loic Dachary [Mon, 29 Sep 2014 18:25:08 +0000 (20:25 +0200)]
Merge pull request #2555 from theanalyst/wip/mailmap

mailmap updates

Reviewed-by: Loic Dachary <loic-201408@dachary.org>
10 years agomailmap: Riccardo Ferretti affiliation 2555/head
Abhishek Lekshmanan [Tue, 23 Sep 2014 13:42:47 +0000 (19:12 +0530)]
mailmap: Riccardo Ferretti affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Casey Marshall affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 12:06:07 +0000 (17:36 +0530)]
mailmap: Casey Marshall affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Feng Wang affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 11:51:23 +0000 (17:21 +0530)]
mailmap: Feng Wang affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Scott A. Brandt affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 11:46:12 +0000 (17:16 +0530)]
mailmap: Scott A. Brandt affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Gerben Meijer affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 07:14:05 +0000 (12:44 +0530)]
mailmap: Gerben Meijer affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Gerben Meijer <gerben@daybyday.nl>
10 years agomailmap: John Wilkins name normalization
Abhishek Lekshmanan [Thu, 25 Sep 2014 10:59:26 +0000 (16:29 +0530)]
mailmap: John Wilkins name normalization

Also adding John Wilkins to .peoplemap to track org change

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: John Spray name normalization
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:51:02 +0000 (12:21 +0530)]
mailmap: John Spray name normalization

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Samuel Just name normalization
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:48:17 +0000 (12:18 +0530)]
mailmap: Samuel Just name normalization

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Pavan Rallabhandi name normalization
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:13:26 +0000 (11:43 +0530)]
mailmap: Pavan Rallabhandi name normalization

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Swami Reddy name normalization
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:18:18 +0000 (11:48 +0530)]
mailmap: Swami Reddy name normalization

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Swami Reddy <swamireddy@gmail.com>
10 years agomailmap: Volker Voigt affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:47:09 +0000 (12:17 +0530)]
mailmap: Volker Voigt affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Laurent Guerby affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:46:39 +0000 (12:16 +0530)]
mailmap: Laurent Guerby affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Johnu George affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 10:01:15 +0000 (15:31 +0530)]
mailmap: Johnu George affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Johnu George <johnugeo@cisco.com>
10 years agomailmap: Janne Grunau affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 10:41:09 +0000 (16:11 +0530)]
mailmap: Janne Grunau affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Daniel Schepler affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:44:45 +0000 (12:14 +0530)]
mailmap: Daniel Schepler affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Cheng Cheng affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:44:20 +0000 (12:14 +0530)]
mailmap: Cheng Cheng affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Sahid Ferdjaoui affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:43:21 +0000 (12:13 +0530)]
mailmap: Sahid Ferdjaoui affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Sahid Orentino Ferdjaoui <sahid.ferdjaoui@redhat.com>
10 years agomailmap: Jiang Heng affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 09:58:39 +0000 (15:28 +0530)]
mailmap: Jiang Heng affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: JuanJose Galvez affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:20:58 +0000 (11:50 +0530)]
mailmap: JuanJose Galvez affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Roman Haritonov affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:19:36 +0000 (11:49 +0530)]
mailmap: Roman Haritonov affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
10 years agomailmap: Yongyue Sun affiliation
Abhishek Lekshmanan [Tue, 23 Sep 2014 06:17:06 +0000 (11:47 +0530)]
mailmap: Yongyue Sun affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Loic Dachary <loic-201408@dachary.org>
10 years agoMerge pull request #2594 from dachary/wip-9620-test-mon-thrash
Sage Weil [Mon, 29 Sep 2014 15:18:36 +0000 (08:18 -0700)]
Merge pull request #2594 from dachary/wip-9620-test-mon-thrash

qa/workunits/cephtool/test.sh: fix thrash (ultimate)

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2582 from ceph/wip-crush-location
Loic Dachary [Mon, 29 Sep 2014 12:27:23 +0000 (14:27 +0200)]
Merge pull request #2582 from ceph/wip-crush-location

crushtool: add --location <id> command

Reviewed-by: Loic Dachary <loic-201408@dachary.org>
10 years agoqa/workunits/cephtool/test.sh: fix thrash (ultimate) 2594/head
Loic Dachary [Mon, 29 Sep 2014 11:47:06 +0000 (13:47 +0200)]
qa/workunits/cephtool/test.sh: fix thrash (ultimate)

Keep the osd trash test to ensure it is a valid command but make it a
noop by giving it a zero argument (meaning thrash 0 OSD maps).

Remove the loops that were added after the command in an attempt to wait
for the cluster to recover and not pollute the rest of the tests. Actual
testing of osd thrash would require a dedicated cluster because it the
side effects are random and it is unnecessarily difficult to ensure they
are finished.

http://tracker.ceph.com/issues/9620 Fixes: #9620

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoMerge pull request #2590 from dachary/wip-9592-librados-large-object
Loic Dachary [Mon, 29 Sep 2014 06:38:34 +0000 (08:38 +0200)]
Merge pull request #2590 from dachary/wip-9592-librados-large-object

librados large object early check

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agolibrados: cap the IoCtxImpl::{aio_}*{write,append} buffer length 2590/head
Loic Dachary [Sun, 28 Sep 2014 22:39:50 +0000 (00:39 +0200)]
librados: cap the IoCtxImpl::{aio_}*{write,append} buffer length

If the value of the len parameter is greater than UINT_MAX/2,
IoCtxImpl::aio_write, IoCtxImpl::aio_write_full, IoCtxImpl::aio_append,
IoCtxImpl::write, IoCtxImpl::append will fail with E2BIG.

IoCtxImpl::write_full is the exception because it does not have a
length argument to check.

For more information see 33501d242661a545211df43bf645398b492398ae

http://tracker.ceph.com/issues/9592 Fixes: #9592

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoMerge pull request #2400 from majianpeng/fix2
Sage Weil [Mon, 29 Sep 2014 00:46:57 +0000 (17:46 -0700)]
Merge pull request #2400 from majianpeng/fix2

osd: Make RPGTransaction::get_bytes_written return the correct size.

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agolibrados: test s/E2BIG/TooBig/
Loic Dachary [Sun, 28 Sep 2014 08:37:21 +0000 (10:37 +0200)]
librados: test s/E2BIG/TooBig/

Because E2BIG does not allow selection

./ceph_test_rados_api_aio --gtest_filter=LibRadosAio.E2BIG
Running main() from gtest_main.cc
Note: Google Test filter = LibRadosAio.E2BIG
[==========] Running 0 tests from 0 test cases.
[==========] 0 tests from 0 test cases ran. (0 ms total)
[  PASSED  ] 0 tests.

probably because it contains a number.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agolibrados: cap the rados_aio_*{write,append} buffer length
Loic Dachary [Sun, 28 Sep 2014 08:26:23 +0000 (10:26 +0200)]
librados: cap the rados_aio_*{write,append} buffer length

If the value of the len parameter is greater than UINT_MAX/2,
rados_aio_write, rados_aio_write_full and rados_aio_append will fail
with E2BIG.

For more information see 33501d242661a545211df43bf645398b492398ae

http://tracker.ceph.com/issues/9592 Fixes: #9592

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoosd: Make RPGTransaction::get_bytes_written return the correct size. 2400/head
Jianpeng Ma [Sun, 28 Sep 2014 07:01:46 +0000 (15:01 +0800)]
osd: Make RPGTransaction::get_bytes_written return the correct size.

It record size larger than clien wrote. It should like
ECTransaction::get_bytes_written only return the size which clien
wrote. It should contain omap data.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
10 years agocrushtool: add --show-location <id> command 2582/head
Sage Weil [Sat, 27 Sep 2014 14:51:24 +0000 (07:51 -0700)]
crushtool: add --show-location <id> command

Include some tests.

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2584 from dachary/wip-9592-librados-large-object
Sage Weil [Sat, 27 Sep 2014 12:58:28 +0000 (05:58 -0700)]
Merge pull request #2584 from dachary/wip-9592-librados-large-object

librados: cap the rados*{write,append} buffer length

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agolibrados: cap the rados*{write,append} buffer length 2584/head
Loic Dachary [Sat, 27 Sep 2014 08:37:07 +0000 (10:37 +0200)]
librados: cap the rados*{write,append} buffer length

When the caller submits a payload that will end up being rejected with

  rados.Error: Ioctx.write(rbd): failed to write hw: errno EMSGSIZE

it is stored in a bufferlist whose length is an unsigned int. If the
value of the len parameter is greater than UINT_MAX/2, rados_write,
rados_write_full and rados_append will fail with E2BIG.

Multiple calls to rados_write or rados_append can fill objects larger
than UINT_MAX/2.

http://tracker.ceph.com/issues/9592 Fixes: #9592

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoMerge pull request #2580 from cernceph/wip-scientific
Sage Weil [Sat, 27 Sep 2014 00:49:59 +0000 (17:49 -0700)]
Merge pull request #2580 from cernceph/wip-scientific

ceph-disk: add Scientific Linux as a Redhat clone

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoceph-disk: add Scientific Linux as a Redhat clone
Dan van der Ster [Fri, 26 Sep 2014 16:00:22 +0000 (18:00 +0200)]
ceph-disk: add Scientific Linux as a Redhat clone

Scientific Linux is a RHEL clone and needs to use partx.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
(cherry picked from commit 5ca7ea5b531f28b3c87161d53aee907d6957cfc2)

10 years agoMerge pull request #2568 from johnugeorge/wip-9492-crush
Loic Dachary [Fri, 26 Sep 2014 22:25:48 +0000 (00:25 +0200)]
Merge pull request #2568 from johnugeorge/wip-9492-crush

Crush: Ensuring at most num-rep osds are selected for any rule

Reviewed-by: Loic Dachary <loic-201408@dachary.org>
10 years agoCrush: Ensuring at most num-rep osds are selected 2568/head
Johnu George [Wed, 24 Sep 2014 16:32:50 +0000 (09:32 -0700)]
Crush: Ensuring at most num-rep osds are selected

Crush temporary buffers are allocated as per replica size configured
by the user.When there are more final osds (to be selected as per
rule) than the replicas, buffer overlaps and it causes crash.Now, it
ensures that at most num-rep osds are selected even if more number of
osds are allowed by the rule.

Fixes: #9492
Signed-off-by: Johnu George <johnugeo@cisco.com>
10 years agoceph-disk: add Scientific Linux as a Redhat clone 2580/head
Dan van der Ster [Fri, 26 Sep 2014 16:00:22 +0000 (18:00 +0200)]
ceph-disk: add Scientific Linux as a Redhat clone

Scientific Linux is a RHEL clone and needs to use partx.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
10 years agoMerge pull request #2572 from ceph/wip-9562
John Spray [Fri, 26 Sep 2014 10:57:53 +0000 (11:57 +0100)]
Merge pull request #2572 from ceph/wip-9562

osdc/Filer: drop probe/purge locks before calling objecter

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Yan, Zheng <ukernel@gmail.com>
10 years agoMerge pull request #2575 from ceph/wip-zafman-cleanup 2566/head
Sage Weil [Fri, 26 Sep 2014 00:02:19 +0000 (17:02 -0700)]
Merge pull request #2575 from ceph/wip-zafman-cleanup

osd: Remove unused PG functions queue_notify(), queue_info(), queue_log(...

Reviewed-by: Loic Dachary <loic@dachary.org>
10 years agoMerge pull request #2524 from ceph/wip-5768
Josh Durgin [Thu, 25 Sep 2014 22:19:43 +0000 (15:19 -0700)]
Merge pull request #2524 from ceph/wip-5768

rbd-fuse: Fix memory leak in enumerate_images

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
10 years agoMerge pull request #2531 from dachary/wip-9536-isa-alignment
Sage Weil [Thu, 25 Sep 2014 21:05:57 +0000 (14:05 -0700)]
Merge pull request #2531 from dachary/wip-9536-isa-alignment

erasure-code: isa plugin alignment fixes

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoosd: improve debug output for do_{notifies,queries,infos}
Sage Weil [Thu, 25 Sep 2014 20:51:46 +0000 (13:51 -0700)]
osd: improve debug output for do_{notifies,queries,infos}

Hunting #9389

Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2540 from ceph/wip-giant-messenger-fixes
Sage Weil [Thu, 25 Sep 2014 20:01:38 +0000 (13:01 -0700)]
Merge pull request #2540 from ceph/wip-giant-messenger-fixes

giant messenger fixes

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoosdc/Objecter: only post_rx_buffer if no op timeout 2598/head
Sage Weil [Thu, 25 Sep 2014 19:34:11 +0000 (12:34 -0700)]
osdc/Objecter: only post_rx_buffer if no op timeout

If we post an rx buffer and there is a timeout, the revocation can happen
while the reader has consumed the buffers but before it has decoded and
constructed the message.  In particular, we calculate a crc32c over the
data portion of the message after we've taken the buffers and dropped the
lock.

Instead of fixing this race (for example, by reverifying rx_buffers under
the lock while calculating the crc.. bleh), just skip the rx buffer
optimization entirely when a timeout is present.

Note that this doesn't cover the op_cancel() paths, but none of those users
provide static buffers to read into.

Fixes: #9582
Backport: firefly, dumpling
Signed-off-by: Sage Weil <sage@redhat.com>
10 years agoMerge pull request #2574 from ceph/wip-msgr-shutdown
Sage Weil [Thu, 25 Sep 2014 16:26:18 +0000 (09:26 -0700)]
Merge pull request #2574 from ceph/wip-msgr-shutdown

msg: allow calling dtor immediately after ctor

Reviewed-by: Sage Weil <sage@redhat.com>
10 years agoerasure-code: test isa encode/decode with various object sizes 2531/head
Loic Dachary [Mon, 22 Sep 2014 12:16:32 +0000 (14:16 +0200)]
erasure-code: test isa encode/decode with various object sizes

Create an encode_decode() helper method to be called from the
encode_decode test function with various object size arguments. The
helper method is a copy/paste of the previous test that was using a
single object of a fixed size. The test is slightly adapted to
accommodate for different object sizes but the logic is not modified.

The object sizes being tested are chosen to be under the size of the
required size alignment or on multiple pages, size aligned or not.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoerasure-code: add test for isa chunk_size method
Loic Dachary [Mon, 22 Sep 2014 12:14:01 +0000 (14:14 +0200)]
erasure-code: add test for isa chunk_size method

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agomsg: allow calling dtor immediately after ctor 2574/head
John Spray [Thu, 25 Sep 2014 16:01:10 +0000 (17:01 +0100)]
msg: allow calling dtor immediately after ctor

Asserting on reaper_stop only made sense if the
messenger had ever been started: as it stood,
one couldn't create and destroy a messenger
without also starting and stopping it.

Signed-off-by: John Spray <john.spray@redhat.com>
10 years agoerasure-code: isa encode tests adapted to per chunk alignment
Loic Dachary [Mon, 22 Sep 2014 12:11:07 +0000 (14:11 +0200)]
erasure-code: isa encode tests adapted to per chunk alignment

The encode tests use the alignment constraints. It has been changed to
be aligned on a per chunk basis instead of computing a more expensive
object alignement constraint. The test function is modified to take the
change into account but the logic is otherwise unmodified.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoerasure-code: isa test compare chunks with memcmp instead of strncmp
Loic Dachary [Mon, 22 Sep 2014 12:09:56 +0000 (14:09 +0200)]
erasure-code: isa test compare chunks with memcmp instead of strncmp

Because they may contain null characters.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoerasure-code: run isa tests via libtool and valgrind
Loic Dachary [Mon, 22 Sep 2014 12:08:48 +0000 (14:08 +0200)]
erasure-code: run isa tests via libtool and valgrind

Because running valgrind with no libtool does not test the binary but
the enclosing shell script.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
10 years agoerasure-code: do not use typed tests for isa
Loic Dachary [Mon, 22 Sep 2014 12:08:07 +0000 (14:08 +0200)]
erasure-code: do not use typed tests for isa

Because there only is one type.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>