]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 years agocrush: fix preservation of shadow bucket ids
Sage Weil [Thu, 3 Aug 2017 22:05:08 +0000 (18:05 -0400)]
crush: fix preservation of shadow bucket ids

1- a decompiled and recompiled was parsing the class bucket ids but it
wasn't actually using them.
2- rebuild_roots_with_classes() was throwing out the old ids and assigning
new ids when the tree was rebuilt.

Fix by passing in a (potentially partial) class_bucket map into
populate_classes().  Take care to allocate new bucket ids that don't
collide with previously used ids.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/workunits/mon/crush_ops.sh: remove existing dev class before setting it
Kefu Chai [Sun, 30 Jul 2017 07:05:05 +0000 (15:05 +0800)]
qa/workunits/mon/crush_ops.sh: remove existing dev class before setting it

we cannot overwrite existing dev class, and "osd_class_update_on_start"
is true by default (see 0c885d6). so we should remove all device classes before
setting them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomon/OSDMonitor: kill unused variable 'ts'
xie xingguo [Mon, 31 Jul 2017 00:53:45 +0000 (08:53 +0800)]
mon/OSDMonitor: kill unused variable 'ts'

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agotest/osd-fast-mark-down: enable 'osd-class-update-on-start' by default
xie xingguo [Mon, 31 Jul 2017 03:36:34 +0000 (11:36 +0800)]
test/osd-fast-mark-down: enable 'osd-class-update-on-start' by default

https://github.com/ceph/ceph/pull/16016/commits/116cf759c86ca9ca7d80769b2096953516f357cb
will now hide all shadow trees(roots), so this is not applicable anymore
(actually it is misleading).

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agocrush: make 'remove_root' idempotent
xie xingguo [Mon, 31 Jul 2017 09:24:55 +0000 (17:24 +0800)]
crush: make 'remove_root' idempotent

We might use 'crush link' to link same host into
different roots, which as a result can cause different
shadow trees reference same hosts too.

This means we may need to destory the same buckets(hosts, racks, etc.)
multiple times during rebuilding all shadow trees and hence 'remove_root'
shall be idempotent.

Fixes: http://tracker.ceph.com/issues/20845
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoMerge pull request #16740 from liewegas/wip-crush-tree
Sage Weil [Thu, 3 Aug 2017 21:16:17 +0000 (16:16 -0500)]
Merge pull request #16740 from liewegas/wip-crush-tree

mon: show class in 'osd crush tree' output; sort output

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoMerge PR #16772 into master
Patrick Donnelly [Thu, 3 Aug 2017 21:07:32 +0000 (14:07 -0700)]
Merge PR #16772 into master

* refs/remotes/upstream/pull/16772/head:
qa: add health whitelist for all fs sub-suites

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoqa: add health whitelist for all fs sub-suites 16772/head
Patrick Donnelly [Thu, 3 Aug 2017 04:06:02 +0000 (21:06 -0700)]
qa: add health whitelist for all fs sub-suites

Fixes: http://tracker.ceph.com/issues/20892
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #16768 into master
Patrick Donnelly [Thu, 3 Aug 2017 20:55:42 +0000 (13:55 -0700)]
Merge PR #16768 into master

* refs/remotes/upstream/pull/16768/head:
qa: fix log whitelist string

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge PR #16743 into master
Patrick Donnelly [Thu, 3 Aug 2017 20:55:39 +0000 (13:55 -0700)]
Merge PR #16743 into master

* refs/remotes/upstream/pull/16743/head:
mds: add inter-mds operations to PerfCounter

7 years agoMerge PR #16654 into master
Patrick Donnelly [Thu, 3 Aug 2017 20:55:36 +0000 (13:55 -0700)]
Merge PR #16654 into master

* refs/remotes/upstream/pull/16654/head:
mds: fix race in "open inode by inode number"
mds: cleanup {do_open,_do_find}_ino_peer()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #16631 into master
Patrick Donnelly [Thu, 3 Aug 2017 20:55:33 +0000 (13:55 -0700)]
Merge PR #16631 into master

* refs/remotes/upstream/pull/16631/head:
cephfs: Resend discover when joining from starting state
cephfs: Wait for MDCache to be ready before starting log segment

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #16363 into master
Patrick Donnelly [Thu, 3 Aug 2017 20:55:29 +0000 (13:55 -0700)]
Merge PR #16363 into master

* refs/remotes/upstream/pull/16363/head:
mds: fix health checks for multiple filesystems
mon: fix log message on mds rank stop
mon: uniform way of referring to MDS daemons
mds: revise health checks for _FAILED/_DEGRADED
mon/MDSMonitor: log messages on MDS rank changes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #16292 into master
Patrick Donnelly [Thu, 3 Aug 2017 20:55:21 +0000 (13:55 -0700)]
Merge PR #16292 into master

* refs/remotes/upstream/pull/16292/head:
qa: use new hex rep of inode
qa: fix whitelist error message
mds: refine "Scrub error" cluster log message
mds: polish clog messages
doc: developer logging guidance

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #16749 from tchaikov/wip-restful-delete-key
Sage Weil [Thu, 3 Aug 2017 20:53:27 +0000 (15:53 -0500)]
Merge pull request #16749 from tchaikov/wip-restful-delete-key

mgr: handle "module.set_config(.., None)" correctly

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #16756 from liewegas/wip-20113
Sage Weil [Thu, 3 Aug 2017 20:52:56 +0000 (15:52 -0500)]
Merge pull request #16756 from liewegas/wip-20113

ceph: wait for maps before doing 'ceph tell ... help'

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #16760 from cbodley/wip-rgw-disable-lifecycle-s3tests
Yuri Weinstein [Thu, 3 Aug 2017 20:25:39 +0000 (13:25 -0700)]
Merge pull request #16760 from cbodley/wip-rgw-disable-lifecycle-s3tests

qa/rgw: disable lifecycle tests because of expiration failures

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
7 years agoMerge pull request #16491 from cbodley/wip-20308
Yuri Weinstein [Thu, 3 Aug 2017 20:24:59 +0000 (13:24 -0700)]
Merge pull request #16491 from cbodley/wip-20308

rgw: match wildcards in StringLike policy conditions

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
7 years agoMerge pull request #16738 from liewegas/wip-20810
Sage Weil [Thu, 3 Aug 2017 18:22:46 +0000 (13:22 -0500)]
Merge pull request #16738 from liewegas/wip-20810

os/bluestore: fix dirty_range on _do_clone_range

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoMerge pull request #16789 from liewegas/wip-ec-m-2
Josh Durgin [Thu, 3 Aug 2017 18:20:13 +0000 (11:20 -0700)]
Merge pull request #16789 from liewegas/wip-ec-m-2

qa: avoid map-gap tests for k=2 m=1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #16795 from liewegas/wip-mgr-whitelist
Sage Weil [Thu, 3 Aug 2017 18:14:20 +0000 (13:14 -0500)]
Merge pull request #16795 from liewegas/wip-mgr-whitelist

qa/suites/rados/mgr/tasks/failover: whitelist

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoqa/suites/rados/thrash-erasure-code: do not test map gap with m=1 16789/head
Sage Weil [Thu, 3 Aug 2017 18:13:02 +0000 (14:13 -0400)]
qa/suites/rados/thrash-erasure-code: do not test map gap with m=1

We test EC profiles with m=1 here, and mapgap can lead to incomplete pgs
because it takes an osd down and waits for healthy.

Fixes: http://tracker.ceph.com/issues/20844
Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/suites/rados/thrash-erasure-coe-big/clsuter: 12 osds on 3 nodes not 4
Sage Weil [Thu, 3 Aug 2017 18:11:43 +0000 (14:11 -0400)]
qa/suites/rados/thrash-erasure-coe-big/clsuter: 12 osds on 3 nodes not 4

smithi have 4 nvme partitions available, not 3.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16797 from jdurgin/wip-upgrade-jewel-x
Josh Durgin [Thu, 3 Aug 2017 18:11:41 +0000 (11:11 -0700)]
Merge pull request #16797 from jdurgin/wip-upgrade-jewel-x

qa: timeout when waiting for mgr to be available in healthy()

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoqa/suites/rados/thrash-erasure-code-big: add k=4 m=2
Sage Weil [Thu, 3 Aug 2017 18:10:36 +0000 (14:10 -0400)]
qa/suites/rados/thrash-erasure-code-big: add k=4 m=2

Get better coverage for larger codes.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/suites/rados/monthrash/worklaods/rados_api_tests: whitelist SMALLER_PGP_NUM 16795/head
Sage Weil [Thu, 3 Aug 2017 17:31:39 +0000 (13:31 -0400)]
qa/suites/rados/monthrash/worklaods/rados_api_tests: whitelist SMALLER_PGP_NUM

The rados/test.sh fiddles with pg_num.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/suites/rados/mgr/tasks/failover: whitelist
Sage Weil [Thu, 3 Aug 2017 16:40:01 +0000 (12:40 -0400)]
qa/suites/rados/mgr/tasks/failover: whitelist

remote/smithi025/log/ceph.log.gz:2017-08-03 07:02:15.049074 mon.b mon.0 172.21.15.25:6789/0 197 : cluster [INF] Manager daemon x is unresponsive, replacing it with standby daemon y
remote/smithi025/log/ceph.log.gz:2017-08-03 07:03:10.078032 mon.b mon.0 172.21.15.25:6789/0 226 : cluster [WRN] Manager daemon x is unresponsive.  No standby daemons available.

x and y may be swapped, so whitelist the rest of the string.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16764 from liewegas/wip-release-notes
Sage Weil [Thu, 3 Aug 2017 13:28:20 +0000 (08:28 -0500)]
Merge pull request #16764 from liewegas/wip-release-notes

doc/release-notes: sort release note changes into the right section

7 years agoMerge pull request #16765 from liewegas/wip-bluestore-docs
Sage Weil [Thu, 3 Aug 2017 13:27:41 +0000 (08:27 -0500)]
Merge pull request #16765 from liewegas/wip-bluestore-docs

doc/rados/configuration: document bluestore

7 years agodoc/rados/configuration/bluestore-config-ref: devices, checksumming, cache 16765/head
Sage Weil [Thu, 3 Aug 2017 13:21:18 +0000 (09:21 -0400)]
doc/rados/configuration/bluestore-config-ref: devices, checksumming, cache

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16773 from dmick/wip-make-check-cleanup
Sage Weil [Thu, 3 Aug 2017 13:19:48 +0000 (08:19 -0500)]
Merge pull request #16773 from dmick/wip-make-check-cleanup

Clean up make check for persistent test nodes (like arm64)

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16683 from Liuchang0812/clear-result-in-getchildren
Kefu Chai [Thu, 3 Aug 2017 13:17:06 +0000 (21:17 +0800)]
Merge pull request #16683 from Liuchang0812/clear-result-in-getchildren

os/bluestore: clear result in BlueRocksEnv::getChildren

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16717 from gmayyyha/osd-objectstore-20865
Kefu Chai [Thu, 3 Aug 2017 13:14:34 +0000 (21:14 +0800)]
Merge pull request #16717 from gmayyyha/osd-objectstore-20865

ceph-osd: fix auto detect which objectstore is currently running

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
7 years agoMerge pull request #16777 from SUSE/wip-20894
Kefu Chai [Thu, 3 Aug 2017 12:22:03 +0000 (20:22 +0800)]
Merge pull request #16777 from SUSE/wip-20894

doc: document "rados cleanup" in rados manpage

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #16775 from ovh/bp-fr-pendingnotes-update
Abhishek L [Thu, 3 Aug 2017 09:30:01 +0000 (11:30 +0200)]
Merge pull request #16775 from ovh/bp-fr-pendingnotes-update

PendingReleaseNotes: mention forced recovery

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
7 years agodoc: document "rados cleanup" in rados manpage 16777/head
Nathan Cutler [Thu, 3 Aug 2017 09:08:48 +0000 (11:08 +0200)]
doc: document "rados cleanup" in rados manpage

Fixes: http://tracker.ceph.com/issues/20894
Signed-off-by: Nathan Cutler <ncutler@suse.com>
7 years agoPendingReleaseNotes: mention forced recovery 16775/head
Piotr Dałek [Thu, 3 Aug 2017 07:45:28 +0000 (09:45 +0200)]
PendingReleaseNotes: mention forced recovery

Mention forced recovery in release notes.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
7 years agoqa: use new hex rep of inode 16292/head
Patrick Donnelly [Thu, 3 Aug 2017 04:39:48 +0000 (21:39 -0700)]
qa: use new hex rep of inode

Resolves a failure from QA:

    2017-08-02T19:23:27.489 INFO:tasks.cephfs_test_runner:======================================================================
    2017-08-02T19:23:27.489 INFO:tasks.cephfs_test_runner:FAIL: test_oversize (tasks.cephfs.test_fragment.TestFragmentation)
    2017-08-02T19:23:27.489 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
    2017-08-02T19:23:27.490 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
    2017-08-02T19:23:27.490 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20170802/qa/tasks/cephfs/test_fragment.py", line 71, in test_oversize
    2017-08-02T19:23:27.490 INFO:tasks.cephfs_test_runner:    self.assertEqual(frags[0]['dirfrag'], "10000000000.0*")
    2017-08-02T19:23:27.490 INFO:tasks.cephfs_test_runner:AssertionError: u'0x10000000000.0*' != '10000000000.0*'
    2017-08-02T19:23:27.490 INFO:tasks.cephfs_test_runner:

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agotest/encoding/readable.sh: clean up all tmpfiles/dirs 16773/head
Dan Mick [Thu, 3 Aug 2017 04:11:09 +0000 (21:11 -0700)]
test/encoding/readable.sh: clean up all tmpfiles/dirs

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 years agorun-make-check.sh: set ulimit -n (because no one else does)
Dan Mick [Thu, 3 Aug 2017 03:00:07 +0000 (20:00 -0700)]
run-make-check.sh: set ulimit -n (because no one else does)

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 years agoMerge pull request #16678 from mychoxin/yuanxin_make_print_informative
Gregory Farnum [Thu, 3 Aug 2017 02:59:50 +0000 (19:59 -0700)]
Merge pull request #16678 from mychoxin/yuanxin_make_print_informative

print more information when run ceph-osd cmd with 'check options'

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years agoMerge PR #16713 into master
Patrick Donnelly [Thu, 3 Aug 2017 02:41:42 +0000 (19:41 -0700)]
Merge PR #16713 into master

* refs/remotes/upstream/pull/16713/head:
qa: ignore failed MDS message during upgrade

7 years agoMerge PR #16691 into master
Patrick Donnelly [Thu, 3 Aug 2017 01:42:37 +0000 (18:42 -0700)]
Merge PR #16691 into master

* refs/remotes/upstream/pull/16691/head:
doc: update client.admin key refs to "mds 'allow'"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge PR #16714 into master
Patrick Donnelly [Thu, 3 Aug 2017 01:41:12 +0000 (18:41 -0700)]
Merge PR #16714 into master

* refs/remotes/upstream/pull/16714/head:
qa: test export_pin is correct in dumped subtree
mds: print export_pin for dumped subtree

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
Reviewed-by: huanwen ren <ren.huanwen@zte.com.cn>
7 years agoqa: fix whitelist error message
Patrick Donnelly [Wed, 2 Aug 2017 23:52:30 +0000 (16:52 -0700)]
qa: fix whitelist error message

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoqa: fix log whitelist string 16768/head
Patrick Donnelly [Wed, 2 Aug 2017 23:32:19 +0000 (16:32 -0700)]
qa: fix log whitelist string

Fixes: http://tracker.ceph.com/issues/20889
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #16732 from Abhishekvrshny/fix-rgw-mp-races
Matt Benjamin [Wed, 2 Aug 2017 20:06:08 +0000 (16:06 -0400)]
Merge pull request #16732 from Abhishekvrshny/fix-rgw-mp-races

rgw : fix race in RGWCompleteMultipart

7 years agodoc/rados/configuration: document bluestore
Sage Weil [Wed, 2 Aug 2017 19:48:36 +0000 (15:48 -0400)]
doc/rados/configuration: document bluestore

Initial pass here.  Not yet complete.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agodoc/release-notes: cleanup 16764/head
Sage Weil [Wed, 2 Aug 2017 19:16:54 +0000 (15:16 -0400)]
doc/release-notes: cleanup

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agorgw : fix race in RGWCompleteMultipart 16732/head
Abhishek Varshney [Tue, 1 Aug 2017 14:46:52 +0000 (14:46 +0000)]
rgw : fix race in RGWCompleteMultipart

Fixes : http://tracker.ceph.com/issues/20861

Signed-off-by: Abhishek Varshney <abhishek.varshney@flipkart.com>
7 years agoMerge pull request #16377 from theanalyst/doc/release-notes/12.1.1
Sage Weil [Wed, 2 Aug 2017 16:02:59 +0000 (11:02 -0500)]
Merge pull request #16377 from theanalyst/doc/release-notes/12.1.1

doc: 12.1.1 & 12.1.2 release notes

7 years agoMerge pull request #16308 from joscollin/wip-rbd-nbd-return-values
Yuri Weinstein [Wed, 2 Aug 2017 16:01:27 +0000 (09:01 -0700)]
Merge pull request #16308 from joscollin/wip-rbd-nbd-return-values

tools/rbd, rgw: Removed unreachable returns

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #16370 from rzarzynski/wip-rgw-swift-prefixed-tempurls
Yuri Weinstein [Wed, 2 Aug 2017 16:00:42 +0000 (09:00 -0700)]
Merge pull request #16370 from rzarzynski/wip-rgw-swift-prefixed-tempurls

rgw: add support for Swift's TempURLs with prefix-based scope

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #16442 from theanalyst/rgw-admin-tenant-validate
Yuri Weinstein [Wed, 2 Aug 2017 15:59:54 +0000 (08:59 -0700)]
Merge pull request #16442 from theanalyst/rgw-admin-tenant-validate

rgw: validate tenant names during user create.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
7 years agoMerge pull request #16485 from rzarzynski/wip-rgw-s3anonauthengine
Yuri Weinstein [Wed, 2 Aug 2017 15:58:15 +0000 (08:58 -0700)]
Merge pull request #16485 from rzarzynski/wip-rgw-s3anonauthengine

rgw: move the S3 anonymous auth handling to a dedicated engine.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #16690 from scienceluo/wip-luo-unused-var-branch
Yuri Weinstein [Wed, 2 Aug 2017 15:57:33 +0000 (08:57 -0700)]
Merge pull request #16690 from scienceluo/wip-luo-unused-var-branch

common/rgw/rbd: remove some unused variables

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #16692 from oritwas/wip-rgw-dir-suggest
Yuri Weinstein [Wed, 2 Aug 2017 15:56:52 +0000 (08:56 -0700)]
Merge pull request #16692 from oritwas/wip-rgw-dir-suggest

rgw: Fix up to 1000 entries at a time in check_bad_index_multipart

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agodoc: release notes for v12.1.2 16377/head
Abhishek Lekshmanan [Tue, 25 Jul 2017 18:56:56 +0000 (20:56 +0200)]
doc: release notes for v12.1.2

Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
7 years agodoc: 12.1.1 release notes add major changes
Abhishek Lekshmanan [Wed, 2 Aug 2017 15:41:13 +0000 (17:41 +0200)]
doc: 12.1.1 release notes add major changes

Also cleanup PendingReleasenotes to an empty file so that only newer
changes are tracked, adding the relevant section back to
RC1 where relevant. Moving all the RC1 announcements back to RC2, when
we go to 12.2.0 we'll collapse all of these back to the release
announcments

Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
7 years agodoc: 12.1.1 release notes
Abhishek Lekshmanan [Mon, 17 Jul 2017 20:08:54 +0000 (22:08 +0200)]
doc: 12.1.1 release notes

Adding the changelog from 12.1.0 -> 12.1.1

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
7 years agoMerge pull request #16759 from liewegas/wip-powercycle-health
Sage Weil [Wed, 2 Aug 2017 15:07:06 +0000 (10:07 -0500)]
Merge pull request #16759 from liewegas/wip-powercycle-health

qa/suites/powercycle: whitelist health for thrashing

7 years agoqa/suites/powercycle: whitelist health for thrashing 16759/head
Sage Weil [Wed, 2 Aug 2017 15:06:43 +0000 (11:06 -0400)]
qa/suites/powercycle: whitelist health for thrashing

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/rgw: disable lifecycle tests because of expiration failures 16760/head
Casey Bodley [Wed, 2 Aug 2017 15:06:32 +0000 (11:06 -0400)]
qa/rgw: disable lifecycle tests because of expiration failures

lifecycle expiration tests are too reliant on timing, and have been
failing consistently for a long time

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agomds: add inter-mds operations to PerfCounter 16743/head
Patrick Donnelly [Mon, 24 Jul 2017 19:55:28 +0000 (12:55 -0700)]
mds: add inter-mds operations to PerfCounter

Fixes: http://tracker.ceph.com/issues/20760
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #16758 from ceph/luminous
Sage Weil [Wed, 2 Aug 2017 14:46:37 +0000 (09:46 -0500)]
Merge pull request #16758 from ceph/luminous

sync luminous tag back to master

7 years agoMerge pull request #16535 from liewegas/wip-osd-shard-init
Sage Weil [Wed, 2 Aug 2017 14:10:54 +0000 (09:10 -0500)]
Merge pull request #16535 from liewegas/wip-osd-shard-init

osd: initialize waiting_for_pg_osdmap on startup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years agoMerge pull request #16684 from tchaikov/wip-pybind-replace-deprecated-apis
Sage Weil [Wed, 2 Aug 2017 14:10:26 +0000 (09:10 -0500)]
Merge pull request #16684 from tchaikov/wip-pybind-replace-deprecated-apis

pybind/rados: use new APIs instead of deprecated ones

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #16735 from dillaman/wip-20869
Sage Weil [Wed, 2 Aug 2017 14:08:40 +0000 (09:08 -0500)]
Merge pull request #16735 from dillaman/wip-20869

common: avoid statically allocating configuration options

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoceph: wait for maps before doing 'ceph tell ... help' 16756/head
Sage Weil [Wed, 2 Aug 2017 13:33:55 +0000 (09:33 -0400)]
ceph: wait for maps before doing 'ceph tell ... help'

If we don't have a mgrmap yet (usually we do, but it's racy) MgrClient
will assume EACCES if we try to send a command.  This can lead to
EACCES from 'ceph tell mgr help'.

The mon sends maps in alphanumeric order, so waiting for osdmap will
include mgrmap and fsmap.  That's everything (current) except servicemap,
but we can't 'tell' those anyway.

Fixes: http://tracker.ceph.com/issues/20113
Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16747 from tchaikov/wip-doc-fixes
Sage Weil [Wed, 2 Aug 2017 13:11:41 +0000 (08:11 -0500)]
Merge pull request #16747 from tchaikov/wip-doc-fixes

doc: document bluestore compression settings

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoqa: refactor suites/rados/rest/mgr-restful 16749/head
Kefu Chai [Wed, 2 Aug 2017 10:19:17 +0000 (18:19 +0800)]
qa: refactor suites/rados/rest/mgr-restful

- use "ceph restful restart" to restart the restful API server instead
of restarting the ceph-mgr
- test "ceph restful delete-key"
- test "ceph restful list-keys"

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agomgr: handle "module.set_config(.., None)" correctly
Kefu Chai [Wed, 2 Aug 2017 10:18:02 +0000 (18:18 +0800)]
mgr: handle "module.set_config(.., None)" correctly

otherwise "ceph restful delete-key foo" would fail:

TypeError: ceph_config_set() argument 3 must be string, not None

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agodoc: document bluestore compression settings 16747/head
Kefu Chai [Wed, 2 Aug 2017 07:35:29 +0000 (15:35 +0800)]
doc: document bluestore compression settings

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agodoc/man/8/radosgw-admin: document --compression option
Kefu Chai [Wed, 2 Aug 2017 08:21:40 +0000 (16:21 +0800)]
doc/man/8/radosgw-admin: document --compression option

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agoqa: timeout when waiting for mgr to be available 16797/head
Josh Durgin [Wed, 2 Aug 2017 00:47:08 +0000 (20:47 -0400)]
qa: timeout when waiting for mgr to be available

Otherwise during upgrades we wait forever.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #16741 from liewegas/wip-more-doc-links
Kefu Chai [Wed, 2 Aug 2017 05:52:38 +0000 (13:52 +0800)]
Merge pull request #16741 from liewegas/wip-more-doc-links

doc/release-notes: fix links, formatting; add crush device class docs

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #16722 from tchaikov/wip-qa-fixes
Kefu Chai [Wed, 2 Aug 2017 05:00:01 +0000 (13:00 +0800)]
Merge pull request #16722 from tchaikov/wip-qa-fixes

qa/suites: escape the parenthesis of the whitelist text

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16474 from shun-s/wip-fix-deactive
Kefu Chai [Wed, 2 Aug 2017 04:58:34 +0000 (12:58 +0800)]
Merge pull request #16474 from shun-s/wip-fix-deactive

ceph-disk: do not remove mount point if deactive --once

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoqa/suites: more whitelisting 16722/head
Kefu Chai [Wed, 2 Aug 2017 02:00:23 +0000 (10:00 +0800)]
qa/suites: more whitelisting

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 years agodoc/release-notes: clean up links 16741/head
Sage Weil [Tue, 1 Aug 2017 16:00:32 +0000 (12:00 -0400)]
doc/release-notes: clean up links

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agodoc/rados/operations/crush-map: more device class docs
Sage Weil [Tue, 1 Aug 2017 16:14:51 +0000 (12:14 -0400)]
doc/rados/operations/crush-map: more device class docs

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agocrush/CrushTreeDumper: sort tree items by (class, name) 16740/head
Sage Weil [Tue, 1 Aug 2017 20:39:12 +0000 (16:39 -0400)]
crush/CrushTreeDumper: sort tree items by (class, name)

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoosd/crush/CrushWrapper: include CLASS column in 'osd crush tree'
Sage Weil [Tue, 1 Aug 2017 20:05:03 +0000 (16:05 -0400)]
osd/crush/CrushWrapper: include CLASS column in 'osd crush tree'

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoos/bluestore: fix dirty_range on _do_clone_range 16738/head
Sage Weil [Tue, 1 Aug 2017 19:47:28 +0000 (15:47 -0400)]
os/bluestore: fix dirty_range on _do_clone_range

If we are cloning several extents that start from logical offset 0, we may
need to dirty those extents on the source object if they are being made
shared.  However, if there are two or more such extents, and the first
starts at 0, the current code will adjust dirty_range_start to the
second extent because the second time around the loop dirty_range_begin
is still 0.

Fix by adjusting the condition to be dirty_range_begin and dirty_range_end
== 0 so that it only triggers on the first pass.

Fixes: http://tracker.ceph.com/issues/20810
Signed-off-by: Sage Weil <sage@redhat.com>
7 years agorgw: policy uses ceph::not_fn instead of std::not2 16491/head
Casey Bodley [Tue, 25 Jul 2017 20:34:32 +0000 (16:34 -0400)]
rgw: policy uses ceph::not_fn instead of std::not2

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agocommon: add std::not_fn to backport14.h and unit tests
Casey Bodley [Tue, 25 Jul 2017 20:10:51 +0000 (16:10 -0400)]
common: add std::not_fn to backport14.h and unit tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agotest/rgw: add missing object tagging actions to policy tests
Casey Bodley [Mon, 24 Jul 2017 20:14:47 +0000 (16:14 -0400)]
test/rgw: add missing object tagging actions to policy tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agotest/rgw: add tests for match_wildcards, match_policy
Casey Bodley [Fri, 21 Jul 2017 17:08:28 +0000 (13:08 -0400)]
test/rgw: add tests for match_wildcards, match_policy

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agotest/rgw: rename ceph_test_rgw_iam_policy to unittest_
Casey Bodley [Fri, 21 Jul 2017 17:06:19 +0000 (13:06 -0400)]
test/rgw: rename ceph_test_rgw_iam_policy to unittest_

tagging this as a unittest will make it run during 'make check'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agorgw: match wildcards in StringLike policy conditions
Casey Bodley [Fri, 21 Jul 2017 14:14:11 +0000 (10:14 -0400)]
rgw: match wildcards in StringLike policy conditions

Fixes: http://tracker.ceph.com/issues/20308
Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agorgw: split match into match_policy, match_wildcards
Casey Bodley [Fri, 21 Jul 2017 15:33:03 +0000 (11:33 -0400)]
rgw: split match into match_policy, match_wildcards

Signed-off-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #16700 from jcsp/wip-20803
Sage Weil [Tue, 1 Aug 2017 19:13:00 +0000 (14:13 -0500)]
Merge pull request #16700 from jcsp/wip-20803

osd/mon/mds: fix `config set` tell command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16701 from jcsp/wip-health-format
Sage Weil [Tue, 1 Aug 2017 19:12:28 +0000 (14:12 -0500)]
Merge pull request #16701 from jcsp/wip-health-format

mon: extensible output format for health checks

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #16706 from jdurgin/wip-20850
Sage Weil [Tue, 1 Aug 2017 19:12:01 +0000 (14:12 -0500)]
Merge pull request #16706 from jdurgin/wip-20850

osd: do not try to set device class before luminous

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #16712 from gregsfortytwo/wip-20808
Sage Weil [Tue, 1 Aug 2017 19:11:29 +0000 (14:11 -0500)]
Merge pull request #16712 from gregsfortytwo/wip-20808

osd: pg: be more careful with locking around forced pg recovery

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #16688 from amitkumar50/cov-1395347-1
Gregory Farnum [Tue, 1 Aug 2017 18:25:20 +0000 (11:25 -0700)]
Merge pull request #16688 from amitkumar50/cov-1395347-1

os: Argument cannot be negative

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years ago12.1.2 16758/head v12.1.2
Jenkins Build Slave User [Tue, 1 Aug 2017 17:55:40 +0000 (17:55 +0000)]
12.1.2

7 years agoMerge pull request #15801 from zhangsw/feature-bucket-sync
Casey Bodley [Tue, 1 Aug 2017 17:13:18 +0000 (13:13 -0400)]
Merge pull request #15801 from zhangsw/feature-bucket-sync

rgw multisite: feature of bucket sync enable/disable

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agocommon: avoid statically allocating configuration options 16735/head
Jason Dillaman [Tue, 1 Aug 2017 16:02:06 +0000 (12:02 -0400)]
common: avoid statically allocating configuration options

This was resulting in seg faults within rbd-fuse during shutdown. This also
fixes the "variable tracking size limit exceeded with -fvar-tracking-assignments,
retrying without" compiler warning".

Fixes: http://tracker.ceph.com/issues/20869
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #16616 from tchaikov/wip-doc-cleanup
Sage Weil [Tue, 1 Aug 2017 16:01:09 +0000 (11:01 -0500)]
Merge pull request #16616 from tchaikov/wip-doc-cleanup

doc: remove docs on non-existant command