]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 years agodoc: fix typo e.g,. => e.g., 18607/head
Yao Zongyou [Sat, 28 Oct 2017 01:06:24 +0000 (09:06 +0800)]
doc: fix typo e.g,. => e.g.,

Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
7 years agoMerge pull request #18543 from neha-ojha/wip-add-cbt-repo
Josh Durgin [Fri, 27 Oct 2017 03:24:29 +0000 (20:24 -0700)]
Merge pull request #18543 from neha-ojha/wip-add-cbt-repo

qa: add cbt repo parameter

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #18573 from neha-ojha/wip-add-cbt-workloads
Josh Durgin [Fri, 27 Oct 2017 03:13:40 +0000 (20:13 -0700)]
Merge pull request #18573 from neha-ojha/wip-add-cbt-workloads

qa/suites/rados/perf: add workloads

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #18174 into master
Patrick Donnelly [Fri, 27 Oct 2017 02:39:13 +0000 (19:39 -0700)]
Merge PR #18174 into master

* refs/pull/18174/head:
mds: no assertion on inode being purging in find_ino_peers()

Reviewed-by: Zheng Yan <zyan@redhat.com>
7 years agoMerge PR #18537 into master
Patrick Donnelly [Fri, 27 Oct 2017 02:39:04 +0000 (19:39 -0700)]
Merge PR #18537 into master

* refs/pull/18537/head:
mds: set PRIO_USEFUL on num_sessions counter

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoqa/suites/rados/perf: add workloads 18573/head
Neha Ojha [Thu, 26 Oct 2017 22:37:45 +0000 (15:37 -0700)]
qa/suites/rados/perf: add workloads

Signed-off-by: Neha Ojha <nojha@redhat.com>
7 years agoMerge pull request #18524 from liewegas/wip-backfill-rops
Sage Weil [Thu, 26 Oct 2017 22:48:25 +0000 (17:48 -0500)]
Merge pull request #18524 from liewegas/wip-backfill-rops

osd/PG: fix recovery op leak

Reviewed-by: David Zafman <dzafman@redhat.com>
7 years agoMerge pull request #18552 from liewegas/wip-mds-cluster-down
Sage Weil [Thu, 26 Oct 2017 22:47:51 +0000 (17:47 -0500)]
Merge pull request #18552 from liewegas/wip-mds-cluster-down

qa/workunits/rest/test.py: stop trying to test obsolte cluster_up/down

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #18489 from cbodley/wip-21895
Yehuda Sadeh [Thu, 26 Oct 2017 21:16:46 +0000 (14:16 -0700)]
Merge pull request #18489 from cbodley/wip-21895

rgw: fix extra_data_len handling in PutObj filters

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
7 years agoMerge pull request #18451 from zmc/wip-cephmetrics
vasukulkarni [Thu, 26 Oct 2017 18:31:19 +0000 (11:31 -0700)]
Merge pull request #18451 from zmc/wip-cephmetrics

Add cephmetrics suite

7 years agoMerge pull request #18198 from cbodley/wip-21735
Matt Benjamin [Thu, 26 Oct 2017 17:41:19 +0000 (13:41 -0400)]
Merge pull request #18198 from cbodley/wip-21735

rgw: fix error handling in ListBucketIndexesCR

7 years agoAdd cephmetrics suite 18451/head
Zack Cerza [Wed, 18 Oct 2017 20:38:08 +0000 (14:38 -0600)]
Add cephmetrics suite

Signed-off-by: Zack Cerza <zack@redhat.com>
7 years agoqa/workunits/rest/test.py: stop trying to test obsolete 'mds *' commands 18552/head
Sage Weil [Thu, 26 Oct 2017 02:45:11 +0000 (21:45 -0500)]
qa/workunits/rest/test.py: stop trying to test obsolete 'mds *' commands

These were recently removed.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18511 from smithfarm/wip-rpm-recommend-influxdb
John Spray [Thu, 26 Oct 2017 15:23:34 +0000 (17:23 +0200)]
Merge pull request #18511 from smithfarm/wip-rpm-recommend-influxdb

build/ops: rpm: recommend python-influxdb with ceph-mgr

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
7 years agoMerge pull request #18182 from nrdmn/dashboard
John Spray [Thu, 26 Oct 2017 15:17:37 +0000 (17:17 +0200)]
Merge pull request #18182 from nrdmn/dashboard

mgr/dashboard: improve error handling

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18533 from tchaikov/wip-qa-cephtool
Sage Weil [Thu, 26 Oct 2017 14:19:11 +0000 (09:19 -0500)]
Merge pull request #18533 from tchaikov/wip-qa-cephtool

qa: do not "ceph fs get cephfs" w/o a cephfs fs

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
7 years agoosd/PG: handle remote backfill recovation while waiting for other targets 18524/head
Sage Weil [Thu, 26 Oct 2017 13:42:34 +0000 (08:42 -0500)]
osd/PG: handle remote backfill recovation while waiting for other targets

If we have multiple targets, we may still be waiting on them when we get
a revocation.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18545 from batrick/pr18393-revert
Mykola Golub [Thu, 26 Oct 2017 07:28:58 +0000 (10:28 +0300)]
Merge pull request #18545 from batrick/pr18393-revert

Revert "ceph_context: re-expand admin_socket metavariables in child process"

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoMerge pull request #18496 from liewegas/wip-pgmap
Sage Weil [Thu, 26 Oct 2017 02:53:07 +0000 (21:53 -0500)]
Merge pull request #18496 from liewegas/wip-pgmap

build: remove PGMap.cc from libcommon

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoosd/PG: make scan recovery op cancellation match up reliably
Sage Weil [Wed, 25 Oct 2017 03:32:18 +0000 (22:32 -0500)]
osd/PG: make scan recovery op cancellation match up reliably

Previously, there was only one time we would end up in this region of code:
when the backfill was rejected by the peer.  Previously that was apparently
reliably when we had an outstanding SCAN request, because we would
unconditionally cancle the MAX recovery op and clear waiting_on_backfill.

See 624aaf2a4ea9950153a89ff921e2adce683a6f51 for when this code appeared.

Now we have several similar paths, and we don't always have an outstanding
scan call (I don't think!).  Regardless, move most these three cases into
a common helper and make the finish_recovery_op completion conditional
on whether there is an outstanding SCAN.  This fixes a leak of a recovery
op when we defer while a scan is outstanding (this bug was recently
introduced by e708410542b0a52fbb29e14b76f49c94adbc0a59 and then
duplicated by 2463c6463d1ed38a2e15a0960ed1530a47851489).

Note that there is still one other time we register MAX ops: when we are
finishing backfill.  There, we start one per target.  But we will always
get back our reply and process it in the normal way (that old commit
did not change the timing for these).

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoosd/PG: make recovering_oids a multiset
Sage Weil [Wed, 25 Oct 2017 03:16:26 +0000 (22:16 -0500)]
osd/PG: make recovering_oids a multiset

For multiple backfill targets, we start MAX multiple times.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18527 from xiexingguo/wip-hunt-scrub-mismatch
Sage Weil [Thu, 26 Oct 2017 02:49:45 +0000 (21:49 -0500)]
Merge pull request #18527 from xiexingguo/wip-hunt-scrub-mismatch

osd/PrimaryLogPG: several oi.extents fixes

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18531 from majianpeng/msg-async
Sage Weil [Thu, 26 Oct 2017 02:49:27 +0000 (21:49 -0500)]
Merge pull request #18531 from majianpeng/msg-async

msg/async misc cleanup

Reviewed-by: Haomai Wang <haomai@xsky.com>
7 years agomsg/async: record correctly l_msgr_send_bytes if "rc == 0". 18531/head
Jianpeng Ma [Thu, 26 Oct 2017 10:08:54 +0000 (18:08 +0800)]
msg/async: record correctly l_msgr_send_bytes if "rc == 0".

If rc == 0, it mean all data of outcoming_bl whether old or new data.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
7 years agoMerge PR #18192 into master
Patrick Donnelly [Thu, 26 Oct 2017 00:05:38 +0000 (17:05 -0700)]
Merge PR #18192 into master

* refs/pull/18192/head:
qa/cephfs: test ec data pool
qa/suites/fs/basic_functional/clusters: more osds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoRevert "ceph_context: re-expand admin_socket metavariables in child process" 18545/head
Patrick Donnelly [Wed, 25 Oct 2017 20:29:27 +0000 (13:29 -0700)]
Revert "ceph_context: re-expand admin_socket metavariables in child process"

This commit introduces a regression where the admin socket specified in
ceph.conf overrides command line arguments or environment variables.

This reverts commit 1630f4bbef3a3ff6efb56acbaa9b8786b945b1e6.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #18485 from liewegas/wip-remote-res-preemption
Sage Weil [Wed, 25 Oct 2017 19:47:44 +0000 (14:47 -0500)]
Merge pull request #18485 from liewegas/wip-remote-res-preemption

osd: fix recovery reservation bugs, and implement remote reservation preemption

Reviewed-by: David Zafman <dzafman@redhat.com>
7 years agorgw: fix extra_data_len handling in PutObj filters 18489/head
Casey Bodley [Mon, 23 Oct 2017 18:23:32 +0000 (14:23 -0400)]
rgw: fix extra_data_len handling in PutObj filters

the RGWPutObj_Compress filter relies on a starting offset of 0 to ensure
that we only compress entire objects

for RGWRados::fetch_remote_obj(), we also fetch object metadata. the
replies come back with a 'Rgwx-Embedded-Metadata-Len' header, which
specifies how many bytes of object metadata are at the front of the
request body. when this is present, the offsets passed from
RGWRadosPutObj down to the RGWPutObjDataProcessor filters are offsets
into the http response body, rather than logical offsets into the object
data itself

this commit adds a transformation to RGWRadosPutObj so that only that
logical offset is visible to the RGWPutObjDataProcessor

Fixes: http://tracker.ceph.com/issues/21895
Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agoqa: add cbt repo parameter 18543/head
Neha Ojha [Wed, 25 Oct 2017 17:22:43 +0000 (10:22 -0700)]
qa: add cbt repo parameter

Signed-off-by: Neha Ojha <nojha@redhat.com>
7 years agomsg/async: updating l_msgr_running_send_time if write_message failed.
Jianpeng Ma [Wed, 25 Oct 2017 16:50:29 +0000 (00:50 +0800)]
msg/async: updating l_msgr_running_send_time if write_message failed.

Also for the most time write_message return zero. So avoid checking
"r < 0 or r > 0" every time, it should firstly check "r == 0".

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
7 years agoMerge pull request #18528 from tchaikov/wip-osd-misplaced
David Zafman [Wed, 25 Oct 2017 16:36:04 +0000 (09:36 -0700)]
Merge pull request #18528 from tchaikov/wip-osd-misplaced

osd/PG: fix calc of misplaced objects

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agomsg/async: only system can accept more data, continue send.
Jianpeng Ma [Wed, 25 Oct 2017 16:34:45 +0000 (00:34 +0800)]
msg/async: only system can accept more data, continue send.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
7 years agoMerge pull request #18523 from tchaikov/wip-vstart-quoted
Kefu Chai [Wed, 25 Oct 2017 16:18:40 +0000 (00:18 +0800)]
Merge pull request #18523 from tchaikov/wip-vstart-quoted

vstart.sh: should quote the parameters to get them quoted

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agomsg/async: remove redundant condition.
Jianpeng Ma [Wed, 25 Oct 2017 16:16:45 +0000 (00:16 +0800)]
msg/async: remove redundant condition.

From the code, if out_q[r].is_empty, it already remove.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
7 years agomsg/async: batch handle out_seq.
Jianpeng Ma [Wed, 25 Oct 2017 16:03:36 +0000 (00:03 +0800)]
msg/async: batch handle out_seq.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
7 years agoMerge PR #18062 into master
Patrick Donnelly [Wed, 25 Oct 2017 13:51:45 +0000 (06:51 -0700)]
Merge PR #18062 into master

* refs/pull/18062/head:
client: put MetaSession map container
client: simplify release context ref mgmt

Reviewed-by: Zheng Yan <zyan@redhat.com>
7 years agomds: set PRIO_USEFUL on num_sessions counter 18537/head
John Spray [Wed, 25 Oct 2017 13:41:56 +0000 (09:41 -0400)]
mds: set PRIO_USEFUL on num_sessions counter

This is used by dashboard and status modules,
so let's make sure we're sending it to the mgr.

Fixes: http://tracker.ceph.com/issues/21927
Signed-off-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #18381 from cbodley/wip-21832
Matt Benjamin [Wed, 25 Oct 2017 13:37:06 +0000 (09:37 -0400)]
Merge pull request #18381 from cbodley/wip-21832

Revert "radosgw: fix awsv4 header line sort order."

7 years agoMerge pull request #18369 from baixueyu/refcount_bug
Matt Benjamin [Wed, 25 Oct 2017 12:58:07 +0000 (08:58 -0400)]
Merge pull request #18369 from baixueyu/refcount_bug

 rgw: source data in 'default.rgw.buckets.data' may not be deleted after inter-bucket copy

7 years agoMerge pull request #16605 from theanalyst/tools/release-notes-pyfixes
Kefu Chai [Wed, 25 Oct 2017 11:24:53 +0000 (19:24 +0800)]
Merge pull request #16605 from theanalyst/tools/release-notes-pyfixes

script: ceph-release-notes: minor fixes for split_component

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18482 from liewegas/wip-luminous-note-fix
Alfredo Deza [Wed, 25 Oct 2017 11:24:13 +0000 (07:24 -0400)]
Merge pull request #18482 from liewegas/wip-luminous-note-fix

doc/release-notes: add jewel->kraken notes

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #18481 from xiexingguo/wip-choose-acting
Kefu Chai [Wed, 25 Oct 2017 11:21:42 +0000 (19:21 +0800)]
Merge pull request #18481 from xiexingguo/wip-choose-acting

osd/PG: miscellaneous choose acting changes and cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18473 from yuyuyu101/wip-objecter-mono
Kefu Chai [Wed, 25 Oct 2017 11:20:59 +0000 (19:20 +0800)]
Merge pull request #18473 from yuyuyu101/wip-objecter-mono

osdc/Objecter: using coarse_mono instead

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 years agoMerge pull request #18471 from yuyuyu101/wip-omap-stat
Kefu Chai [Wed, 25 Oct 2017 11:20:35 +0000 (19:20 +0800)]
Merge pull request #18471 from yuyuyu101/wip-omap-stat

osd/ReplicatedPG: add omap write bytes to delta_stats

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #16332 from badone/wip-warn-about-objects-with-too-many-omap-entries
Kefu Chai [Wed, 25 Oct 2017 11:20:00 +0000 (19:20 +0800)]
Merge pull request #16332 from badone/wip-warn-about-objects-with-too-many-omap-entries

osd: Warn about objects with too many omap entries

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18506 from majianpeng/osd-scrub
Kefu Chai [Wed, 25 Oct 2017 11:18:50 +0000 (19:18 +0800)]
Merge pull request #18506 from majianpeng/osd-scrub

osd/PrimaryLogPG: add condition "is_chunky_scrub_active" to check object in chunky_scrub

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoqa: do not "ceph fs get cephfs" w/o a cephfs fs 18533/head
Kefu Chai [Wed, 25 Oct 2017 11:12:08 +0000 (19:12 +0800)]
qa: do not "ceph fs get cephfs" w/o a cephfs fs

introduced by 183646c

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoscript: ceph-release-notes: minor fixes for split_component 16605/head
Abhishek Lekshmanan [Wed, 19 Apr 2017 08:40:19 +0000 (10:40 +0200)]
script: ceph-release-notes: minor fixes for split_component

make labels a set as intersection would fail otherwise, also sort the
results of prefixes before creating the title

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
7 years agobuild/ops: rpm: recommend python-influxdb with ceph-mgr 18511/head
Nathan Cutler [Tue, 24 Oct 2017 13:28:33 +0000 (15:28 +0200)]
build/ops: rpm: recommend python-influxdb with ceph-mgr

The influxdb module won't run if python-influxdb is not present (but it will be
graceful about not running). That means python-influxdb is a dependency of
that module, not mgr itself. However, we are not (yet) packaging the modules
separately. (When we do, this could become a Requires: of the module.)

RPM itself does not support "Recommends", and ignores this line. Higher-level
tools may or may not support it, so put this line in a SUSE-only conditional
since we know that zypper supports it.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Tim Serong <tserong@suse.com>
7 years agoMerge pull request #18517 from dillaman/wip-iscsi-docs
Mykola Golub [Wed, 25 Oct 2017 07:41:41 +0000 (10:41 +0300)]
Merge pull request #18517 from dillaman/wip-iscsi-docs

doc/rbd: specify additional ESX prerequisites

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoOSD/PG: fix calc of misplaced objects 18528/head
Kefu Chai [Wed, 25 Oct 2017 06:29:18 +0000 (14:29 +0800)]
OSD/PG: fix calc of misplaced objects

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18466 from zealoussnow/wip-wrong-parameter
Kefu Chai [Wed, 25 Oct 2017 05:31:19 +0000 (13:31 +0800)]
Merge pull request #18466 from zealoussnow/wip-wrong-parameter

OSD: drop unsed parameter passed to check_osdmap_features

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Liu-Chunmei <chunmei.liu@intel.com>
7 years agoMerge pull request #18425 from ZVampirEM77/wip-options-cleanup
Kefu Chai [Wed, 25 Oct 2017 05:27:52 +0000 (13:27 +0800)]
Merge pull request #18425 from ZVampirEM77/wip-options-cleanup

common/options.cc: cleanup readable literals for default sizes

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #17894 from chenliuzhong/change-aio-max-nr
Kefu Chai [Wed, 25 Oct 2017 05:25:24 +0000 (13:25 +0800)]
Merge pull request #17894 from chenliuzhong/change-aio-max-nr

ceph.spec.in,debian/rules: change aio-max-nr to 1048576

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agovstart.sh: should quote the parameters to get them quoted 18523/head
Kefu Chai [Wed, 25 Oct 2017 02:19:14 +0000 (10:19 +0800)]
vstart.sh: should quote the parameters to get them quoted

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18505 from badone/wip-unittest-crypto-getentropy-limit
Brad Hubbard [Wed, 25 Oct 2017 00:27:38 +0000 (10:27 +1000)]
Merge pull request #18505 from badone/wip-unittest-crypto-getentropy-limit

unittest_crypto: Don't exceed limit for getentropy

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #18181 from tchaikov/wip-vstart-quoted-print
Josh Durgin [Tue, 24 Oct 2017 23:43:38 +0000 (16:43 -0700)]
Merge pull request #18181 from tchaikov/wip-vstart-quoted-print

vstart.sh: quote command only when necessary

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #17266 into master
Patrick Donnelly [Tue, 24 Oct 2017 23:37:14 +0000 (16:37 -0700)]
Merge PR #17266 into master

* refs/pull/17266/head:
qa: update test_ceph_argparse to test fs cmds
qa: use fs rm_data_pool
qa: fix mdsmap lookup
qa: remove usage of mds dump
PendingReleaseNotes: add obsoleted mds commands
qa: remove use of obsolete mds commands
ceph_volume_client: remove use of obsolete mds cmd
doc: update on obsolete mds commands
cephfs: obsolete deprecated mds commands

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
7 years agoMerge pull request #17909 from tchaikov/wip-coverity
Josh Durgin [Tue, 24 Oct 2017 23:34:02 +0000 (16:34 -0700)]
Merge pull request #17909 from tchaikov/wip-coverity

test/objectstore/test_bluefs: cleanups

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoqa: update test_ceph_argparse to test fs cmds 17266/head
Patrick Donnelly [Tue, 24 Oct 2017 19:05:15 +0000 (12:05 -0700)]
qa: update test_ceph_argparse to test fs cmds

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #18475 from yuyuyu101/wip-fix-alignment
Sage Weil [Tue, 24 Oct 2017 20:39:11 +0000 (15:39 -0500)]
Merge pull request #18475 from yuyuyu101/wip-fix-alignment

os/ObjectStore: fix get_data_alignment return -1 causing problem in msg header

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
7 years agoMerge pull request #18297 from dzafman/wip-21803
Yuri Weinstein [Tue, 24 Oct 2017 20:31:40 +0000 (13:31 -0700)]
Merge pull request #18297 from dzafman/wip-21803

osd/PG: fix objects degraded higher than 100%

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years agoMerge pull request #18479 from wzliao/wip-correct-scrub-cost
Yuri Weinstein [Tue, 24 Oct 2017 20:30:01 +0000 (13:30 -0700)]
Merge pull request #18479 from wzliao/wip-correct-scrub-cost

osd/OSD.cc: use option 'osd_scrub_cost' instead

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agodoc/rbd: specify additional ESX prerequisites 18517/head
Jason Dillaman [Tue, 24 Oct 2017 19:49:42 +0000 (15:49 -0400)]
doc/rbd: specify additional ESX prerequisites

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge PR #18109 into master
Patrick Donnelly [Tue, 24 Oct 2017 19:17:25 +0000 (12:17 -0700)]
Merge PR #18109 into master

* refs/pull/18109/head:
mds: clean up non-existent data pools in MDSMap
mds: reduce variable scope

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoMerge PR #18366 into master
Patrick Donnelly [Tue, 24 Oct 2017 19:17:19 +0000 (12:17 -0700)]
Merge PR #18366 into master

* refs/pull/18366/head:
mon: s/mds_blacklist_interval/mon_mds_blacklist_interval/
mon: tidy up mds_blacklist_interval

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #18384 into master
Patrick Donnelly [Tue, 24 Oct 2017 19:17:14 +0000 (12:17 -0700)]
Merge PR #18384 into master

* refs/pull/18384/head:
mds: disable early reply for dir layout and quota related requests
mds: make mksnap/setlayout wait for unsafe requests on other mds
mds: don't rdlock locks in replica object while auth mds is recovering
mds: move ScatterLock::state_flags into SimpleLock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #18393 into master
Patrick Donnelly [Tue, 24 Oct 2017 19:17:08 +0000 (12:17 -0700)]
Merge PR #18393 into master

* refs/pull/18393/head:
ceph_context: re-expand admin_socket metavariables in child process

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #18490 from dillaman/wip-21894
Mykola Golub [Tue, 24 Oct 2017 19:14:13 +0000 (22:14 +0300)]
Merge pull request #18490 from dillaman/wip-21894

rbd-mirror: strip environment/CLI overrides for remote cluster

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agoqa: use fs rm_data_pool
Patrick Donnelly [Tue, 24 Oct 2017 18:51:02 +0000 (11:51 -0700)]
qa: use fs rm_data_pool

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoqa: fix mdsmap lookup
Patrick Donnelly [Tue, 24 Oct 2017 18:36:06 +0000 (11:36 -0700)]
qa: fix mdsmap lookup

We were returning the file system structure and not the mdsmap.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoqa: remove usage of mds dump
Patrick Donnelly [Tue, 24 Oct 2017 18:32:43 +0000 (11:32 -0700)]
qa: remove usage of mds dump

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #18514 from ceph/wip-fix-cv-create-path
Andrew Schoen [Tue, 24 Oct 2017 17:40:01 +0000 (12:40 -0500)]
Merge pull request #18514 from ceph/wip-fix-cv-create-path

ceph-volume lvm.prepare update to use create_osd_path

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agoceph-volume lvm.prepare update to use create_osd_path 18514/head
Alfredo Deza [Tue, 24 Oct 2017 17:29:18 +0000 (13:29 -0400)]
ceph-volume lvm.prepare update to use create_osd_path

Signed-off-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #18500 from scienceluo/wip-luo-fix-doc-log-level-branch
Kefu Chai [Tue, 24 Oct 2017 15:03:09 +0000 (23:03 +0800)]
Merge pull request #18500 from scienceluo/wip-luo-fix-doc-log-level-branch

doc: complete and update the subsystem logging level info table

Reviewed-By: Kefu Chai <kchai@redhat.com>
7 years agoosd/PrimaryLogPG: add condition "is_chunky_scrub_active" to check object in chunky_scrub. 18506/head
Jianpeng Ma [Tue, 24 Oct 2017 14:07:18 +0000 (22:07 +0800)]
osd/PrimaryLogPG: add condition "is_chunky_scrub_active" to check object in chunky_scrub.

Avoid every time call scrubber.write_block_by_scrub. Most time scrubber
is inactive. And compare to write_block_by_scrub, is_chunky_scrub_active
is light.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
7 years agoosd/PrimaryLogPG: clear DEGRADED at recovery completion even if more backfill 18485/head
Sage Weil [Mon, 23 Oct 2017 22:11:59 +0000 (17:11 -0500)]
osd/PrimaryLogPG: clear DEGRADED at recovery completion even if more backfill

We may have log recovery *and* backfill to do, but cease to be degraded
as soon as the log recovery portion is done.  If that's the case, clear
the DEGRADED bit so that the PG state is not misleading.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoosd/PG: simplify Recovering state change
Sage Weil [Mon, 23 Oct 2017 03:49:19 +0000 (22:49 -0500)]
osd/PG: simplify Recovering state change

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agodoc/release-notes: fix backticks 18482/head
Sage Weil [Tue, 24 Oct 2017 12:30:05 +0000 (07:30 -0500)]
doc/release-notes: fix backticks

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18467 from yuyuyu101/wip-21883
Kefu Chai [Tue, 24 Oct 2017 13:19:43 +0000 (21:19 +0800)]
Merge pull request #18467 from yuyuyu101/wip-21883

msg/async/AsyncConnection: state will be NONE if replacing by another one

Reviewed-By: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18469 from yuyuyu101/wip-remove-legacy
Kefu Chai [Tue, 24 Oct 2017 13:18:15 +0000 (21:18 +0800)]
Merge pull request #18469 from yuyuyu101/wip-remove-legacy

msg/async/AsyncConnection: remove legacy feature case handle

Reviewed-By: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18415 from majianpeng/msg-cleanup
Kefu Chai [Tue, 24 Oct 2017 13:17:25 +0000 (21:17 +0800)]
Merge pull request #18415 from majianpeng/msg-cleanup

msg/async: batch handle msg_iovlen

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-By: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18397 from tchaikov/wip-mon-opts
Kefu Chai [Tue, 24 Oct 2017 13:16:30 +0000 (21:16 +0800)]
Merge pull request #18397 from tchaikov/wip-mon-opts

common/options: set max_background_jobs instead of max_background_compactions

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #18382 from ceph/wip-vstart-mgr-dashboard
Kefu Chai [Tue, 24 Oct 2017 13:15:10 +0000 (21:15 +0800)]
Merge pull request #18382 from ceph/wip-vstart-mgr-dashboard

cmake: add cython_rbd as a dependency to vstart target

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18480 from tchaikov/wip-doc-cleanup
Alfredo Deza [Tue, 24 Oct 2017 11:03:29 +0000 (07:03 -0400)]
Merge pull request #18480 from tchaikov/wip-doc-cleanup

doc: various cleanups

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoOSD: drop unsed parameter passed to check_osdmap_features 18466/head
Leo Zhang [Sun, 22 Oct 2017 16:11:33 +0000 (00:11 +0800)]
OSD: drop unsed parameter passed to check_osdmap_features

Signed-off-by: Leo Zhang <nguzcf@gmail.com>
7 years agoMerge pull request #18405 from dillaman/wip-21849
Mykola Golub [Tue, 24 Oct 2017 08:02:49 +0000 (11:02 +0300)]
Merge pull request #18405 from dillaman/wip-21849

librbd: default to sparse-reads for any IO operation over 64K

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
7 years agorpm,debian: use download.ceph.com/tarballs instead of ceph.com/download 18480/head
Kefu Chai [Tue, 24 Oct 2017 08:00:09 +0000 (16:00 +0800)]
rpm,debian: use download.ceph.com/tarballs instead of ceph.com/download

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agodoc: fix warning reported by "build-doc linkcheck"
Kefu Chai [Mon, 23 Oct 2017 11:26:28 +0000 (19:26 +0800)]
doc: fix warning reported by "build-doc linkcheck"

all the HTTP 301 (moved permanently) should be killed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoosd/PrimaryLogPG: update modified_ranges correctly on truncating 18527/head
xie xingguo [Tue, 24 Oct 2017 07:40:12 +0000 (15:40 +0800)]
osd/PrimaryLogPG: update modified_ranges correctly on truncating

This is necessary since we are modifying the object contents.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoosd: Add a flag to ScrubMap to signal check needed 16332/head
Brad Hubbard [Fri, 13 Oct 2017 05:46:47 +0000 (15:46 +1000)]
osd: Add a flag to ScrubMap to signal check needed

If we know none of the scrub maps have errors early in
be_large_omap_check() we can return without doing a lot of unnecessary
work.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoosd: Warn about objects with too many omap entries
Brad Hubbard [Tue, 27 Jun 2017 01:40:47 +0000 (11:40 +1000)]
osd: Warn about objects with too many omap entries

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoosd: Move creation of 'master_set' to scrub_compare_maps
Brad Hubbard [Mon, 9 Oct 2017 07:24:17 +0000 (17:24 +1000)]
osd: Move creation of 'master_set' to scrub_compare_maps

Moving it to scrub_compare_maps allows us to pass it to multiple
subsequently called functions.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
7 years agomon/OSDMonitor: more options in new-style 18397/head
Kefu Chai [Thu, 19 Oct 2017 11:28:49 +0000 (19:28 +0800)]
mon/OSDMonitor: more options in new-style

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agocommon/options: set max_background_jobs instead of max_background_compactions
Kefu Chai [Thu, 19 Oct 2017 10:46:23 +0000 (18:46 +0800)]
common/options: set max_background_jobs instead of max_background_compactions

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #18409 from liu-chunmei/fix_dpdk_assert
Haomai Wang [Tue, 24 Oct 2017 06:06:53 +0000 (01:06 -0500)]
Merge pull request #18409 from liu-chunmei/fix_dpdk_assert

Fix two dpdk assert happened in dpdk library.

Reviewed-by: Haomai Wang <haomai@xsky.com>
7 years agodoc: complete and update the subsystem logging level info table 18500/head
Luo Kexue [Tue, 24 Oct 2017 02:21:06 +0000 (10:21 +0800)]
doc: complete and update the subsystem logging level info table

Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>
7 years agoceph.spec.in,debian/rules: change aio-max-nr to 1048576 17894/head
chenliuzhong [Tue, 24 Oct 2017 02:54:33 +0000 (10:54 +0800)]
ceph.spec.in,debian/rules: change aio-max-nr to 1048576

when osd is more than 14 in one host,it report error that aio is not enough.
As the default aio-max-nr is 65536, one OSD needs 4096 aios and other programs may use aios.
This patch change aio-max-nr to 1048576 when install ceph-osd rpm package and debian package

Signed-off-by: chenliuzhong <liuzhong.chen@easystack.cn>
7 years agounittest_crypto: Don't exceed limit for getentropy 18505/head
Brad Hubbard [Tue, 24 Oct 2017 04:34:26 +0000 (14:34 +1000)]
unittest_crypto: Don't exceed limit for getentropy

CryptoRandom::get_bytes calls getentropy directly if available and it
enforces a limit of 256 bytes.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
7 years agoMerge pull request #18460 from liewegas/wip-straw2-command
Kefu Chai [Tue, 24 Oct 2017 04:27:15 +0000 (12:27 +0800)]
Merge pull request #18460 from liewegas/wip-straw2-command

mon/OSDMonitor: add 'osd crush set-all-straw-buckets-to-straw2'

Reviewed-by: Kefu Chai <kchai@redhat.com>