]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoMerge pull request #15889 from joscollin/wip-1412614-uninitialized-scalar-field
Jason Dillaman [Mon, 26 Jun 2017 13:08:08 +0000 (09:08 -0400)]
Merge pull request #15889 from joscollin/wip-1412614-uninitialized-scalar-field

tools/rbd_mirror: initialize non-static class member m_do_resync in ImageReplayer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #15445 from wjwithagen/wip-wjw-freebsd-osd-scrub-repair-2
Kefu Chai [Mon, 26 Jun 2017 02:14:10 +0000 (10:14 +0800)]
Merge pull request #15445 from wjwithagen/wip-wjw-freebsd-osd-scrub-repair-2

test/osd/osd-scrub-repair.sh: disable ec_overwrite tests on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15902 from joscollin/wip-1411820-Division-or-modulo-by-zero
Jos Collin [Mon, 26 Jun 2017 01:30:57 +0000 (01:30 +0000)]
Merge pull request #15902 from joscollin/wip-1411820-Division-or-modulo-by-zero

test: Division by zero in Legacy::encode_n()

Reviewed By: Brad Hubbard <bhubbard@redhat.com>

8 years agoMerge pull request #15903 from Adirl/data_path_fixes
Haomai Wang [Sun, 25 Jun 2017 14:52:02 +0000 (22:52 +0800)]
Merge pull request #15903 from Adirl/data_path_fixes

msg/async/rdma: Data path fixes

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agotest: Division by zero in Legacy::encode_n() 15902/head
Jos Collin [Sat, 24 Jun 2017 15:29:43 +0000 (20:59 +0530)]
test: Division by zero in Legacy::encode_n()

Fixes the Coverity Scan Report:
CID 1411820 (#1 of 1): Division or modulo by zero (DIVIDE_BY_ZERO)
9. divide_by_zero: In expression bl.length() * i / sum, division by expression sum which may be zero has undefined behavior.

Signed-off-by: Jos Collin <jcollin@redhat.com>
8 years agoMerge pull request #15826 from xiexingguo/wip-bluestore-20170622
Sage Weil [Sun, 25 Jun 2017 04:21:50 +0000 (23:21 -0500)]
Merge pull request #15826 from xiexingguo/wip-bluestore-20170622

os/bluestore: cleanup min_alloc_size; some formatting nits

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agoMerge pull request #15865 from tchaikov/wip-mgr-pg-command
Sage Weil [Sun, 25 Jun 2017 04:21:27 +0000 (23:21 -0500)]
Merge pull request #15865 from tchaikov/wip-mgr-pg-command

mgr: enable ceph_send_command() to send pg command

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #15875 from xiexingguo/wip-osdmon-20170623
Sage Weil [Sun, 25 Jun 2017 04:21:02 +0000 (23:21 -0500)]
Merge pull request #15875 from xiexingguo/wip-osdmon-20170623

mon/OSDMonitor: "osd crush class rename" support

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15890 from tchaikov/wip-19741
Sage Weil [Sun, 25 Jun 2017 04:20:38 +0000 (23:20 -0500)]
Merge pull request #15890 from tchaikov/wip-19741

osdc/Objecter: release message if it's not handled

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
8 years agoMerge pull request #15891 from minggr/wip-sdata_op_ordering_lock
Sage Weil [Sun, 25 Jun 2017 04:20:19 +0000 (23:20 -0500)]
Merge pull request #15891 from minggr/wip-sdata_op_ordering_lock

osd: unlock sdata_op_ordering_lock with sdata_lock hold to avoid miss…

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #15899 from theanalyst/doc/release-typo
Sage Weil [Sun, 25 Jun 2017 04:16:57 +0000 (23:16 -0500)]
Merge pull request #15899 from theanalyst/doc/release-typo

doc: Luminous release notes typo fixes

8 years agoMerge pull request #15901 from joscollin/wip-CID1412577-Division-or-modulo-by-float...
Jos Collin [Sun, 25 Jun 2017 04:10:32 +0000 (04:10 +0000)]
Merge pull request #15901 from joscollin/wip-CID1412577-Division-or-modulo-by-float-zero

mon: Division by zero in PGMapDigest::dump_pool_stats_full()

Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>

8 years agoMerge pull request #15900 from smithfarm/wip-docdir-fix
Kefu Chai [Sun, 25 Jun 2017 04:05:20 +0000 (12:05 +0800)]
Merge pull request #15900 from smithfarm/wip-docdir-fix

build/ops: rpm: sane packaging of %{_docdir}/ceph directory

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agomsg/async/rdma: allocated reged mem can be greater than requires len 15903/head
Adir lev [Sun, 28 May 2017 07:37:37 +0000 (10:37 +0300)]
msg/async/rdma: allocated reged mem can be greater than requires len

Change-Id: I3ec42afca39c2ad93fc66ed69b3609b68f315e34
Signed-off-by: Adir lev <adirl@mellanox.com>
8 years agomsg/async/rdma: if failed to send push csi to the back
Adir lev [Sun, 28 May 2017 07:36:02 +0000 (10:36 +0300)]
msg/async/rdma: if failed to send push csi to the back

Change-Id: If6c72917b6e3a836279b86a4d5e9e54383d7b4bd
Signed-off-by: Adir lev <adirl@mellanox.com>
8 years agomon: Division by zero in PGMapDigest::dump_pool_stats_full() 15901/head
Jos Collin [Sat, 24 Jun 2017 14:56:51 +0000 (20:26 +0530)]
mon: Division by zero in PGMapDigest::dump_pool_stats_full()

Fixes The Coverity Scan Report:
CID 1412577 (#1 of 1): Division or modulo by float zero (DIVIDE_BY_ZERO)
35. divide_by_zero: In expression (float)mk / k, division by expression k which may be zero has undefined behavior.

Signed-off-by: Jos Collin <jcollin@redhat.com>
8 years agobuild/ops: rpm: sane packaging of %{_docdir}/ceph directory 15900/head
Nathan Cutler [Sat, 24 Jun 2017 10:27:37 +0000 (12:27 +0200)]
build/ops: rpm: sane packaging of %{_docdir}/ceph directory

91648044163 introduced a build error:

ceph-common-12.1.0+git.1498286248.2fcedc7b3d-1.1.x86_64.rpm: directories not
owned by a package:
 - /usr/share/doc/packages/ceph

The %docdir directive is a way of flagging anything in that directory as being
documentation. It does not actually package the directory. And we don't need
it because we're not dumping a large number of files into this directory.
For more information, see the "Directory-related Directives" section of
http://ftp.rpm.org/max-rpm/s1-rpm-inside-files-list-directives.html

Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agodoc: Luminous release notes typo fixes 15899/head
Abhishek Lekshmanan [Sat, 24 Jun 2017 09:29:01 +0000 (11:29 +0200)]
doc: Luminous release notes typo fixes

Suggested-by: Roger Brown <rogerbrown@gmail.com>
Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
8 years agoMerge pull request #15876 from gmayyyha/config-unused-opt 14135/head
Xie Xingguo [Sat, 24 Jun 2017 04:34:12 +0000 (12:34 +0800)]
Merge pull request #15876 from gmayyyha/config-unused-opt

common/config_opts: drop unused opt

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #15108 from guihecheng/rgw_file-fix
Matt Benjamin [Sat, 24 Jun 2017 01:10:13 +0000 (21:10 -0400)]
Merge pull request #15108 from guihecheng/rgw_file-fix

rgw_file: fix misuse of make_key_name before make_fhk

8 years agoMerge pull request #15893 from liewegas/wip-valgrind-everywhere
Sage Weil [Fri, 23 Jun 2017 20:25:54 +0000 (15:25 -0500)]
Merge pull request #15893 from liewegas/wip-valgrind-everywhere

qa: do not restrict valgrind runs to centos

8 years agoqa: do not restrict valgrind runs to centos 15893/head
Greg Farnum [Wed, 31 May 2017 15:37:19 +0000 (08:37 -0700)]
qa: do not restrict valgrind runs to centos

This reverts 693bd238510e69569cc3461f84b04c8667bc11da, which was
added in response to http://tracker.ceph.com/issues/18126. But
we updated the Ubuntu packages in sepia so it should be good to go.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
8 years agoMerge pull request #15572 from rzarzynski/wip-rgw-17779
Casey Bodley [Fri, 23 Jun 2017 18:38:09 +0000 (14:38 -0400)]
Merge pull request #15572 from rzarzynski/wip-rgw-17779

rgw: external auth engines of S3 honor rgw_keystone_implicit_tenants.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
8 years agoMerge pull request #14624 from ceph/wip-s3a-hadoop
Casey Bodley [Fri, 23 Jun 2017 17:46:05 +0000 (13:46 -0400)]
Merge pull request #14624 from ceph/wip-s3a-hadoop

qa/tasks: S3A hadoop task to test s3a with Ceph

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoosd: unlock sdata_op_ordering_lock with sdata_lock hold to avoid missing wakeup signal 15891/head
Ming Lin [Fri, 23 Jun 2017 17:28:19 +0000 (10:28 -0700)]
osd: unlock sdata_op_ordering_lock with sdata_lock hold to avoid missing wakeup signal

We are running mysql on top of rbd. sysbench qps occasionally drops to zero
with the INSERT benchmark.

Debug code captured >2s latency between PG::queue_op() and OSD::dequeue_op().
We finally found out that the latency came from below code in OSD::ShardedOpWQ::_process(),

sdata->sdata_cond.WaitInterval(sdata->sdata_lock,
      utime_t(osd->cct->_conf->threadpool_empty_queue_max_wait, 0));

"threadpool_empty_queue_max_wait" is 2s by default.

Normally, it should not sleep for 2s since the comming IO requests will wakeup it.
But there is a small timing window that it missed the wakeup signal actually.
For example,

     msgr-worker-0 thread                    tp_osd_tp thread
     OSD::ShardedOpWQ::_enqueue              OSD::ShardedOpWQ::_process
     ---------------------------             ---------------------------
T1:                                          sdata_op_ordering_lock.Lock()
T2:  sdata_op_ordering_lock.Lock()
                                             "queue empty"
                                             sdata_op_ordering_lock.Unlock()
     "insert op"
     sdata_op_ordering_lock.Unlock()

T3:  sdata_lock.Lock()
T4:                                          sdata_lock.Lock()
     "send wakeup signal"
     sdata_lock.Unock()
                                             // here the wakeup signal has no effect actually
                                             // becuase it has not slept yet.

                                             // then, it sleeps.
                                             WaitInterval(2s)

This patch unlocks sdata_op_ordering_lock with sdata_lock hold in OSD::ShardedOpWQ::_process(),
then the timeline becomes,

     msgr-worker-0 thread                    tp_osd_tp thread
     OSD::ShardedOpWQ::_enqueue              OSD::ShardedOpWQ::_process
     ---------------------------             ---------------------------
T1:                                          sdata_op_ordering_lock.Lock()
T2:  sdata_op_ordering_lock.Lock()
                                             "queue empty"
                                             sdata_lock.Lock()
T3:                                          sdata_op_ordering_lock.Unlock()
     "insert op"
     sdata_op_ordering_lock.Unlock()
     sdata_lock.Lock()

T4:                                          WaitInterval(2s) -> it actually unlocks sdata_lock
     "send wakeup signal"
     sdata_lock.Unock()
                                             //got signal, wakeup immediately

With this one line change, we can avoid occasional high latency.

Signed-off-by: Ming Lin <ming.lin@alibaba-inc.com>
8 years agoMerge pull request #15665 from oritwas/wip-rgw-reshard-old-bucket
Yehuda Sadeh [Fri, 23 Jun 2017 17:20:42 +0000 (10:20 -0700)]
Merge pull request #15665 from oritwas/wip-rgw-reshard-old-bucket

rgw: auto reshard old buckets

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoosdc/Objecter: release message if it is not handled 15890/head
Kefu Chai [Fri, 23 Jun 2017 16:50:40 +0000 (00:50 +0800)]
osdc/Objecter: release message if it is not handled

Fixes: http://tracker.ceph.com/issues/19741
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15821 from jdurgin/wip-20302
Josh Durgin [Fri, 23 Jun 2017 16:14:44 +0000 (09:14 -0700)]
Merge pull request #15821 from jdurgin/wip-20302

qa/suites/powercycle/osd/tasks/radosbench: consume less space

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15154 from jcsp/wip-multimds-stable
John Spray [Fri, 23 Jun 2017 16:11:16 +0000 (12:11 -0400)]
Merge pull request #15154 from jcsp/wip-multimds-stable

Remove "experimental" warnings from multimds

8 years agotools/rbd_mirror: initialize Non-static class member m_do_resync in ImageReplayer 15889/head
Jos Collin [Fri, 23 Jun 2017 16:09:44 +0000 (21:39 +0530)]
tools/rbd_mirror: initialize Non-static class member m_do_resync in ImageReplayer

Fixes the Coverity Scan Report:
CID 1412614 (#2-1 of 2): Uninitialized scalar field (UNINIT_CTOR)
7. uninit_member: Non-static class member m_do_resync is not initialized in this constructor nor in any functions that it calls.

Signed-off-by: Jos Collin <jcollin@redhat.com>
8 years agodoc: multimds is no longer experimental 15154/head
John Spray [Thu, 18 May 2017 10:54:13 +0000 (06:54 -0400)]
doc: multimds is no longer experimental

Signed-off-by: John Spray <john.spray@redhat.com>
8 years agoqa: update cephtool test for multimds on by default
John Spray [Mon, 22 May 2017 21:42:16 +0000 (17:42 -0400)]
qa: update cephtool test for multimds on by default

Signed-off-by: John Spray <john.spray@redhat.com>
8 years agoqa: no longer need to explicitly enable multimds
John Spray [Tue, 16 May 2017 12:52:59 +0000 (08:52 -0400)]
qa: no longer need to explicitly enable multimds

Signed-off-by: John Spray <john.spray@redhat.com>
8 years agomds: enable multimds by default in new filesystems
John Spray [Tue, 16 May 2017 12:07:04 +0000 (08:07 -0400)]
mds: enable multimds by default in new filesystems

Signed-off-by: John Spray <john.spray@redhat.com>
8 years agomon: remove experimental warning on multimds
John Spray [Tue, 16 May 2017 12:04:45 +0000 (08:04 -0400)]
mon: remove experimental warning on multimds

Signed-off-by: John Spray <john.spray@redhat.com>
8 years agomds: don't call StrayManager::eval_stray() for undefined inode
Yan, Zheng [Wed, 21 Jun 2017 03:42:22 +0000 (11:42 +0800)]
mds: don't call StrayManager::eval_stray() for undefined inode

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: drop locks before waiting for export targets
Yan, Zheng [Wed, 21 Jun 2017 02:33:25 +0000 (10:33 +0800)]
mds: drop locks before waiting for export targets

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: handle MDirUpdate race
Yan, Zheng [Mon, 19 Jun 2017 08:28:41 +0000 (16:28 +0800)]
mds: handle MDirUpdate race

mds may try discover several times for MDirUpdate, rename may kick
in and cause MDCache::path_traverse() to return error.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: don't forge replica dirfrag
Yan, Zheng [Mon, 19 Jun 2017 07:22:08 +0000 (15:22 +0800)]
mds: don't forge replica dirfrag

MDCache::forge_replica_dir() set wrong dir_auth if the forged replica
dirfrag is subtree root.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: avoid submitting log entry while adjusting subtree map
Yan, Zheng [Fri, 9 Jun 2017 07:37:22 +0000 (15:37 +0800)]
mds: avoid submitting log entry while adjusting subtree map

MDCache::eval_subtree_root() may tigger scatter-gather process, which
submits log entry. Submitting log entry while adjusting subtree map is
bad, because subtree map in intermediate state may get used/logged.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: don't mark nestlock dirty on improper inode
Yan, Zheng [Wed, 7 Jun 2017 01:17:42 +0000 (09:17 +0800)]
mds: don't mark nestlock dirty on improper inode

If inode is replica and it has no auth subtree dirfrag, We should
not mark its nestlock dirty.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: create subtree root immediately after directory tree becomes frozen
Yan, Zheng [Tue, 6 Jun 2017 07:43:28 +0000 (15:43 +0800)]
mds: create subtree root immediately after directory tree becomes frozen

When a directory tree become frozen, its WAIT_FROZEN contexts are
executed asynchronously. Before Migrator::export_frozen() set export
bounds, MDCache::try_subtree_merge_at() can merge newly imported
subtree into the frozen directory tree. This causes problem if there
are auth pins in newly imported subtree.

The fix is creating subtree root immediately after directory tree
becomes frozen. The new subtree root has dir_auth 'me, me', so it's
not meregeable.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agomds: fix stray dentry replication in cache rejoin ack
Yan, Zheng [Sat, 3 Jun 2017 06:35:40 +0000 (14:35 +0800)]
mds: fix stray dentry replication in cache rejoin ack

To replicate s stray dentry, we need to replicate all its ancestors.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8 years agoMerge pull request #15795 from myoungwon/wip-print-ignore_redirect
Yuri Weinstein [Fri, 23 Jun 2017 15:52:31 +0000 (08:52 -0700)]
Merge pull request #15795 from myoungwon/wip-print-ignore_redirect

osd/osd_types: add flag name (IGNORE_REDIRECT)

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15656 from aclamk/download_err_with_comp_followup
Casey Bodley [Fri, 23 Jun 2017 15:40:20 +0000 (11:40 -0400)]
Merge pull request #15656 from aclamk/download_err_with_comp_followup

rgw: use 64-bit offsets for compression

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15848 from xiexingguo/wip-fix-rmcc
Sage Weil [Fri, 23 Jun 2017 14:42:57 +0000 (09:42 -0500)]
Merge pull request #15848 from xiexingguo/wip-fix-rmcc

src/vstart.sh: kill dead upmap option

8 years agoMerge pull request #15851 from liewegas/wip-luminous-notes
Sage Weil [Fri, 23 Jun 2017 14:37:04 +0000 (09:37 -0500)]
Merge pull request #15851 from liewegas/wip-luminous-notes

doc/release-notes: update luminous notes

8 years agodoc/release-notes: 'osd crush class rename' is coming 15851/head
Sage Weil [Fri, 23 Jun 2017 13:58:31 +0000 (09:58 -0400)]
doc/release-notes: 'osd crush class rename' is coming

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: ceph tell <foo> help
Sage Weil [Fri, 23 Jun 2017 13:53:25 +0000 (09:53 -0400)]
doc/release-notes: ceph tell <foo> help

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/start/os-recommendations: update
Sage Weil [Thu, 22 Jun 2017 19:26:14 +0000 (15:26 -0400)]
doc/start/os-recommendations: update

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: note debian stretch addition
Sage Weil [Thu, 22 Jun 2017 19:21:31 +0000 (15:21 -0400)]
doc/release-notes: note debian stretch addition

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: sleep settings
Sage Weil [Thu, 22 Jun 2017 19:14:00 +0000 (15:14 -0400)]
doc/release-notes: sleep settings

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: link to EC docs
Sage Weil [Thu, 22 Jun 2017 19:12:03 +0000 (15:12 -0400)]
doc/release-notes: link to EC docs

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: update RGW metadata
Sage Weil [Thu, 22 Jun 2017 19:10:01 +0000 (15:10 -0400)]
doc/release-notes: update RGW metadata

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodev/release-notes: various updates from other PR
Sage Weil [Thu, 22 Jun 2017 19:07:56 +0000 (15:07 -0400)]
dev/release-notes: various updates from other PR

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: notes on new CLI commands
Sage Weil [Thu, 22 Jun 2017 19:04:47 +0000 (15:04 -0400)]
doc/release-notes: notes on new CLI commands

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agomon: 'mon feature list' -> 'mon feature ls'
Sage Weil [Thu, 22 Jun 2017 19:04:36 +0000 (15:04 -0400)]
mon: 'mon feature list' -> 'mon feature ls'

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agodoc/release-notes: update luminous notes
Sage Weil [Thu, 22 Jun 2017 17:28:15 +0000 (13:28 -0400)]
doc/release-notes: update luminous notes

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15764 from tchaikov/wip-20342
Kefu Chai [Fri, 23 Jun 2017 14:26:03 +0000 (22:26 +0800)]
Merge pull request #15764 from tchaikov/wip-20342

qa/suites/upgrade/hammer-jewel-x: add luminous.yaml

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #15877 from wjwithagen/wip-wjw-vstart-ceph-mgr-restfull
Sage Weil [Fri, 23 Jun 2017 13:57:19 +0000 (08:57 -0500)]
Merge pull request #15877 from wjwithagen/wip-wjw-vstart-ceph-mgr-restfull

vstart.sh: Work around mgr restfull not available

8 years agomon/OSDMonitor: slightly nice error output if set-device-class failed 15875/head
xie xingguo [Fri, 23 Jun 2017 07:00:04 +0000 (15:00 +0800)]
mon/OSDMonitor: slightly nice error output if set-device-class failed

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agomon/OSDMonitor: set result code properly if we fail to process "swap-bucket"
xie xingguo [Fri, 23 Jun 2017 10:26:02 +0000 (18:26 +0800)]
mon/OSDMonitor: set result code properly if we fail to process "swap-bucket"

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agomon/OSDMonitor: "osd crush class rename" support
xie xingguo [Fri, 23 Jun 2017 07:41:58 +0000 (15:41 +0800)]
mon/OSDMonitor: "osd crush class rename" support

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years ago./src/vstart.sh: Work around mgr restfull not available 15877/head
Willem Jan Withagen [Fri, 23 Jun 2017 09:33:18 +0000 (11:33 +0200)]
./src/vstart.sh: Work around mgr restfull not available

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agocommon/config_opts: drop unused opt 15876/head
Yanhu Cao [Fri, 23 Jun 2017 09:15:47 +0000 (17:15 +0800)]
common/config_opts: drop unused opt

Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
8 years agotest/osd/osd-scrub-repair.sh: Adjust for FreeBSD 15445/head
Willem Jan Withagen [Sat, 3 Jun 2017 11:52:58 +0000 (13:52 +0200)]
test/osd/osd-scrub-repair.sh: Adjust for FreeBSD

Fixes 2 problems:
 -  Do not test Bluestore on FreeBSD, since that does not work (yet)
    And all erasure code overwrite tests are executed on BlueStore OSDs
    Erasure code overwrites are unsafe on Filestore, see:
    http://docs.ceph.com/docs/master/rados/operations/erasure-code/#erasure-coding-with-overwrites

 -  the JQ expression errors out with:
    (version 1.5-1-g940132e-dirty)
    ====
    jq: error (at :232): Cannot iterate over null (null)
    Traceback (most recent call last):
    File "", line 1, in
    File "/usr/lib64/python2.7/json/init.py", line 338, in loads
    return _default_decoder.decode(s)
    File "/usr/lib64/python2.7/json/decoder.py", line 365, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
    File "/usr/lib64/python2.7/json/decoder.py", line 383, in raw_decode
    raise ValueError("No JSON object could be decoded")
    ValueError: No JSON object could be decoded
    ====
    Adding a ? to the jq expression allows to proceed on null blocks.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agoosdc/Objecter: pass vector by const reference 15865/head
Kefu Chai [Fri, 23 Jun 2017 04:00:58 +0000 (12:00 +0800)]
osdc/Objecter: pass vector by const reference

so we can pass temporary object to it as parameter.

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agomgr: enable ceph_send_command() to send pg command
Kefu Chai [Fri, 23 Jun 2017 04:00:00 +0000 (12:00 +0800)]
mgr: enable ceph_send_command() to send pg command

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agocrypto: allow PK11 module to load even if it's already initialized
Kefu Chai [Wed, 21 Jun 2017 06:25:01 +0000 (14:25 +0800)]
crypto: allow PK11 module to load even if it's already initialized

there is chance that other pieces of application loads PK11 module
already and does not finalize it before calling common_init_finish().

also, upon fork, PK11 module resets its entire status including `nsc_init`,
by which PK11 module tell if it is initialized or not. so the behavior
of NSS_InitContext() could be different before and after fork. that's
another reason to ignore CKR_CRYPTOKI_ALREADY_INITIALIZED error (see
NSS_GetError()).

Fixes: http://tracker.ceph.com/issues/19741
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15832 from Adirl/pd_assert
Haomai Wang [Fri, 23 Jun 2017 01:26:06 +0000 (09:26 +0800)]
Merge pull request #15832 from Adirl/pd_assert

msg/async/rdma: remove assert from ibv_dealloc_pd in ProtectionDomain

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #15283 from donglinpeng/copyPartUpload
Matt Benjamin [Thu, 22 Jun 2017 23:15:00 +0000 (19:15 -0400)]
Merge pull request #15283 from donglinpeng/copyPartUpload

rgw: multipart copy-part remove '/' for s3 java sdk request header.
(make check failures not related)

8 years agoMerge pull request #15857 from theanalyst/doc/v12.1.0/release-notes-3
Sage Weil [Thu, 22 Jun 2017 21:25:06 +0000 (16:25 -0500)]
Merge pull request #15857 from theanalyst/doc/v12.1.0/release-notes-3

doc: v12.1.0 release notes notable changes addition again

8 years agodoc: v12.1.0 release notes notable changes addition again 15857/head
Abhishek Lekshmanan [Thu, 22 Jun 2017 20:57:05 +0000 (22:57 +0200)]
doc: v12.1.0 release notes notable changes addition again

commmits from 9f259cb923e7474229bb2e5e54b59f3b7f068bc5..luminous && sort

Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
8 years agoMerge pull request #15819 from linuxbox2/wip-clru-lockfix
Matt Benjamin [Thu, 22 Jun 2017 19:33:50 +0000 (15:33 -0400)]
Merge pull request #15819 from linuxbox2/wip-clru-lockfix

rgw_file: avoid a recursive lane lock in LRU drain
(failing make check is unrelated)

8 years agorgw_file: avoid a recursive lane lock in LRU drain 15819/head
Matt Benjamin [Wed, 21 Jun 2017 21:20:40 +0000 (17:20 -0400)]
rgw_file: avoid a recursive lane lock in LRU drain

While highly unlikely in normal fs operations, draining an
entire filesystem could induce a recursion on object delete/unref,
when provoked by cohort_lru::drain().

Adjusted to use intrusive slist rather than std:vector<T*>
after review.

Found running librgw_file_nfsns unit test.

Fixes: http://tracker.ceph.com/issues/20374
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
8 years agoradosgw: fixed sizes of integers used to operate on offsets and lengths in compression, 15656/head
Adam Kupczyk [Tue, 13 Jun 2017 07:37:02 +0000 (09:37 +0200)]
radosgw: fixed sizes of integers used to operate on offsets and lengths in compression,
         followup of http://tracker.ceph.com/issues/20231

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
8 years agoMerge pull request #15814 from liewegas/wip-everyone-hates-btrfs
Sage Weil [Thu, 22 Jun 2017 14:50:55 +0000 (09:50 -0500)]
Merge pull request #15814 from liewegas/wip-everyone-hates-btrfs

qa/objectstore/filestore-btrfs: test btrfs on trusty only

8 years agosrc/vstart.sh: kill dead upmap option 15848/head
xie xingguo [Thu, 22 Jun 2017 13:03:43 +0000 (21:03 +0800)]
src/vstart.sh: kill dead upmap option

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #15820 from liewegas/wip-20303
Sage Weil [Thu, 22 Jun 2017 13:38:50 +0000 (08:38 -0500)]
Merge pull request #15820 from liewegas/wip-20303

mon/PGMap: slightly better debugging around pgmap updates

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15846 from xiexingguo/wip-remap-upmap
Sage Weil [Thu, 22 Jun 2017 13:33:35 +0000 (08:33 -0500)]
Merge pull request #15846 from xiexingguo/wip-remap-upmap

mon/OSDMonitor: _apply_remap -> _apply_upmap; less code redundancy

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agomon/OSDMonitor: less code redundancy 15846/head
xie xingguo [Thu, 22 Jun 2017 12:00:04 +0000 (20:00 +0800)]
mon/OSDMonitor: less code redundancy

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #15805 from jcsp/wip-mds-flush-upgrade
John Spray [Thu, 22 Jun 2017 11:08:51 +0000 (07:08 -0400)]
Merge pull request #15805 from jcsp/wip-mds-flush-upgrade

client: check for luminous MDS before sending FLUSH_MDLOG

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15800 from ukernel/wip-20340
John Spray [Thu, 22 Jun 2017 11:07:59 +0000 (07:07 -0400)]
Merge pull request #15800 from ukernel/wip-20340

mds: save  projected path into inode_t::stray_prior_path

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #15776 from ukernel/wip-20338
John Spray [Thu, 22 Jun 2017 11:07:21 +0000 (07:07 -0400)]
Merge pull request #15776 from ukernel/wip-20338

osdc/Journaler: fix memory leak in Journaler::_issue_read()

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #15430 from jcsp/wip-20165
John Spray [Thu, 22 Jun 2017 11:06:41 +0000 (07:06 -0400)]
Merge pull request #15430 from jcsp/wip-20165

mds: fix hangs involving re-entrant calls to journaler

Reviewed-by: Yan, Zheng <zyan@redhat.com>
8 years agoMerge pull request #15548 from ukernel/wip-20196
John Spray [Thu, 22 Jun 2017 10:46:27 +0000 (06:46 -0400)]
Merge pull request #15548 from ukernel/wip-20196

mds: improvements for stray reintegration

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agomon/MonCommand: fix description of "osd pg-upmap"
xie xingguo [Thu, 22 Jun 2017 09:26:47 +0000 (17:26 +0800)]
mon/MonCommand: fix description of "osd pg-upmap"

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoosd/OSDMap: _apply_remap -> _apply_upmap
xie xingguo [Thu, 22 Jun 2017 08:50:27 +0000 (16:50 +0800)]
osd/OSDMap: _apply_remap -> _apply_upmap

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #15796 from lixiaoy1/fio_ceph_objectstore
Igor Fedotov [Thu, 22 Jun 2017 08:01:00 +0000 (12:01 +0400)]
Merge pull request #15796 from lixiaoy1/fio_ceph_objectstore

fio_ceph_objectstore: Print db_statistics when rocksdb_perf is enabled

8 years agoMerge pull request #15753 from pritha-srivastava/wip-rgw-s3tests-conf
Orit Wasserman [Thu, 22 Jun 2017 08:00:26 +0000 (11:00 +0300)]
Merge pull request #15753 from pritha-srivastava/wip-rgw-s3tests-conf

rgw: Changes for s3test config file, to add user under a tenant.
Reviewed-by: Casey Bodely <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agomsg/async/rdma: remove assert from ibv_dealloc_pd in ProtectionDomain 15832/head
Daniel Bar-On [Mon, 15 May 2017 10:44:29 +0000 (10:44 +0000)]
msg/async/rdma: remove assert from ibv_dealloc_pd in ProtectionDomain
destructor

issue: 1044307

Change-Id: I2fe2099c5f4403f14877e0fbe5d4868dd34d4f9b
Signed-off-by: DanielBar-On <danielbo@mellanox.com>
8 years agoos/bluestore: avoid initializing finishers in constructor 15826/head
xie xingguo [Thu, 22 Jun 2017 05:26:27 +0000 (13:26 +0800)]
os/bluestore: avoid initializing finishers in constructor

This is a follow up change of https://github.com/ceph/ceph/pull/15666,
which I forget to update.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoos/bluestore: add "0x" prefix for hex outputs
xie xingguo [Thu, 22 Jun 2017 03:29:49 +0000 (11:29 +0800)]
os/bluestore: add "0x" prefix for hex outputs

Which is the normal case.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoos/bluestore: non-atomic min_alloc_size_order
xie xingguo [Thu, 22 Jun 2017 02:30:55 +0000 (10:30 +0800)]
os/bluestore: non-atomic min_alloc_size_order

This is not necessary because we now write min_alloc_size into disk
during mkfs.

There are two acaccompanying changes too:
(1) don't call _set_alloc_sizes() during mkfs() any more, which is
not necessary.
(2) don't update min_alloc_size during _set_alloc_sizes(), we instead
update min_alloc_size_order each time we successfully read min_alloc_size
from disk.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agorgw: check all users bucket for resharding, this will reshard bucket created in older... 15665/head
Orit Wasserman [Sun, 11 Jun 2017 13:04:52 +0000 (16:04 +0300)]
rgw: check all users bucket for resharding, this will reshard bucket created in older versions

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
8 years agoos/bluestore: drop _open_alloc() from mkfs
xie xingguo [Thu, 22 Jun 2017 02:02:55 +0000 (10:02 +0800)]
os/bluestore: drop _open_alloc() from mkfs

This is useless as the fsck() process will do necessary validations later.
And dropping this can make mkfs slightly faster.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoos/bluestore: prefix open_statfs with "_"
xie xingguo [Thu, 22 Jun 2017 01:45:36 +0000 (09:45 +0800)]
os/bluestore: prefix open_statfs with "_"

As it is an internal method only.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #15317 from liupan1111/wip-fix-list
Mykola Golub [Thu, 22 Jun 2017 04:31:32 +0000 (07:31 +0300)]
Merge pull request #15317 from liupan1111/wip-fix-list

rbd-nbd: display pool/image/snap information in list output

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #15803 from mikulely/cleanup-rgw_rados_doc
Jos Collin [Thu, 22 Jun 2017 04:27:29 +0000 (04:27 +0000)]
Merge pull request #15803 from mikulely/cleanup-rgw_rados_doc

rgw: update function doc in rgw_rados.h  and rgw_rados.cc

Reviewed-by: Jos Collin <jcollin@redhat.com>
8 years agoqa/workunits/rbd: do not test --export-format unless supported 15764/head
Kefu Chai [Thu, 22 Jun 2017 04:16:52 +0000 (12:16 +0800)]
qa/workunits/rbd: do not test --export-format unless supported

in 55edd81, test for `--export-format` was added to exercise this
option. but this option is only supported on luminous, so we need to
check if it's avaialble before using it.

Signed-off-by: Kefu Chai <kchai@redhat.com>