]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 years agoceph-volume tests verify proper formatting of RuntimeError on vg/lv error 19527/head
Alfredo Deza [Fri, 1 Dec 2017 18:53:39 +0000 (13:53 -0500)]
ceph-volume tests verify proper formatting of RuntimeError on vg/lv error

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d7320313a15ad8bb948e501382269c8f33a8cb70)

7 years agoceph-volume lvm.prepare correctly format argument for vg/lv error
Alfredo Deza [Fri, 1 Dec 2017 18:53:06 +0000 (13:53 -0500)]
ceph-volume lvm.prepare correctly format argument for vg/lv error

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7c0b00615d46a9451cb3a7731594cd7864eabc07)

7 years agoMerge pull request #19042 from liewegas/wip-22128
Sage Weil [Tue, 12 Dec 2017 15:04:20 +0000 (09:04 -0600)]
Merge pull request #19042 from liewegas/wip-22128

mon/OSDMonitor: fix ruleset-* to crush-* fixup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoMerge pull request #19355 from tchaikov/wip-18589-luminous
Kefu Chai [Fri, 8 Dec 2017 02:54:12 +0000 (10:54 +0800)]
Merge pull request #19355 from tchaikov/wip-18589-luminous

luminous: build/ops: move ceph-*-tool binaries out of ceph-test subpackage

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
7 years agodebian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move 19355/head
Kefu Chai [Wed, 6 Dec 2017 02:19:09 +0000 (10:19 +0800)]
debian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move

this is a follow-up of #19328. we need to get this change into 12.2.3.
so better off do the switch somewhere after 12.2.2 which has been
tagged, and before 12.2.3, which is not tagged yet.

please note, this is not targetting master, because i want to make
sure the change number (the <num> in << 12.2.2-<num>) is correct. it
does not hurt if it's not, as long as it is ">> 12.2.2", so the replace
machinery in 12.2.3 works, and it covers the releases where the
ceph-{osdomap,kvstore,monstore}-tool are not move yet. but why don't
make it more right?

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 57bb57f76d733d6e6dea4fc0682058e4e6abe7df)

7 years agodebian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move
Sage Weil [Tue, 5 Dec 2017 03:25:16 +0000 (21:25 -0600)]
debian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move

The backport didn't make 12.2.2, but it will be in 12.2.3.

Fixes: http://tracker.ceph.com/issues/22319
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e0c814266fe653311673e07bd7c7dbb51d866f82)

7 years agodoc: add ceph-kvstore-tool's man
liuchang0812 [Fri, 18 Aug 2017 13:52:52 +0000 (21:52 +0800)]
doc: add ceph-kvstore-tool's man

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
(cherry picked from commit 0667db4eb61338887743d17c93a61c0e89868b08)

7 years agodebian: fix package relationships after d3ac8d18
Kefu Chai [Mon, 23 Oct 2017 12:15:16 +0000 (20:15 +0800)]
debian: fix package relationships after d3ac8d18

d3ac8d18 moves ceph-client-debug from ceph-test to ceph-base without
updating the package relationships between the two involved packages.
which results in:

dpkg: error processing archive /var/cache/apt/archives/ceph-test_12.2.1-241-g43e027b-1trusty_amd64.deb (--unpack):
 trying to overwrite '/usr/bin/ceph-client-debug', which is also in package ceph-base 10.2.10-14-gcbaddae-1trusty
dpkg-deb: error: subprocess paste was killed by signal (Broken pipe)

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit ed988fc660c5da3cb97e48e82ac5b7ad8f3bcd41)

7 years agodebian: fix package relationships after 40caf6a6
Kefu Chai [Mon, 23 Oct 2017 07:26:35 +0000 (15:26 +0800)]
debian: fix package relationships after 40caf6a6

we have issues when running upgrade tests:

dpkg: error processing archive /var/cache/apt/archives/ceph-osd_13.0.0-2201-g6cc0b41-1trusty_amd64.deb (--unpack):
trying to overwrite '/usr/bin/ceph-osdomap-tool', which is also in package ceph-test 10.2.10-14-gcbaddae-1trusty

in 40caf6a6, we moves some tools from ceph-test out into ceph-osd,
ceph-mon and ceph-base respectively. but didn't update the relationships
between these packages accordingly. this causes the upgrade failure.

see https://www.debian.org/doc/debian-policy/#document-ch-relationships
for more details on "Breaks" and "Conflicts".

the reason why the package version to be replaced/conflicted is 12.2.2
is that: i assume that this change will be backported to luminous, and
the next release of it will be 12.2.2 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 50dad805d9f635f2d8085237e94ee8fd0948dd3c)

7 years agobuild/ops: deb: move ceph-*-tool binaries out of ceph-test subpackage
Nathan Cutler [Fri, 13 Oct 2017 08:34:52 +0000 (10:34 +0200)]
build/ops: deb: move ceph-*-tool binaries out of ceph-test subpackage

ceph-osdomap-tool into ceph-osd subpackage
ceph-monstore-tool into ceph-mon subpackage
ceph-kvstore-tool into the ceph-base subpackage

Fixes: http://tracker.ceph.com/issues/21762
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 40caf6a6d85fbde930b74df57a62381f6225c3fd)

7 years agobuild/ops: rpm: move ceph-*-tool binaries out of ceph-test subpackage
Nathan Cutler [Fri, 13 Oct 2017 08:34:52 +0000 (10:34 +0200)]
build/ops: rpm: move ceph-*-tool binaries out of ceph-test subpackage

ceph-osdomap-tool into ceph-osd subpackage
ceph-monstore-tool into ceph-mon subpackage
ceph-kvstore-tool into the ceph-base subpackage

Fixes: http://tracker.ceph.com/issues/21762
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit d7b493a7108a68302bc0f48337bf3c253a720266)

7 years agoMerge pull request #19299 from tchaikov/wip-pr-19196-luminous 19359/head
Alfredo Deza [Tue, 5 Dec 2017 12:01:35 +0000 (07:01 -0500)]
Merge pull request #19299 from tchaikov/wip-pr-19196-luminous

luminous: ceph-disk: fix signed integer is greater than maximum when call major

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-disk: fix signed integer is greater than maximum when call major 19299/head
Song Shun [Tue, 28 Nov 2017 03:28:43 +0000 (11:28 +0800)]
ceph-disk: fix signed integer is greater than maximum when call major
  fix signed integer is greater than maximum when call os.major
  using python 2.7.5 in Centos 7

Signed-off-by: Song Shun <song.shun3@zte.com.cn>
(cherry picked from commit f77934b19939796d7ab52daf4dac44846a2ad162)

7 years agoMerge remote-tracking branch 'gh/luminous' into luminous
Alfredo Deza [Fri, 1 Dec 2017 14:57:44 +0000 (09:57 -0500)]
Merge remote-tracking branch 'gh/luminous' into luminous

7 years agoMerge pull request #19001 from tchaikov/wip-pr-18848-luminous
Kefu Chai [Fri, 1 Dec 2017 05:48:29 +0000 (13:48 +0800)]
Merge pull request #19001 from tchaikov/wip-pr-18848-luminous

luminous: mgr/dashboard: fix audit log loading

Reviewed-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #19270 from tchaikov/wip-pr-19225-luminous
Kefu Chai [Fri, 1 Dec 2017 05:47:17 +0000 (13:47 +0800)]
Merge pull request #19270 from tchaikov/wip-pr-19225-luminous

luminous: qa/suites/rados/singleton: more whitelist

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoqa/suites/rados/singleton: more whitelist 19270/head
Kefu Chai [Wed, 29 Nov 2017 05:51:49 +0000 (13:51 +0800)]
qa/suites/rados/singleton: more whitelist

* SLOW_OPS is normal in a cluster with flattering OSDs
* so is OBJECT_MISPLACED.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 0e987665fe480530a0d1664392604713828bfa5c)

7 years ago12.2.2 v12.2.2
Jenkins Build Slave User [Thu, 30 Nov 2017 14:59:27 +0000 (14:59 +0000)]
12.2.2

7 years agoMerge pull request #19240 from tchaikov/wip-22266-luminous
Kefu Chai [Thu, 30 Nov 2017 14:26:46 +0000 (22:26 +0800)]
Merge pull request #19240 from tchaikov/wip-22266-luminous

luminous: tools/ceph_monstore_tool: rebuild initial mgrmap also

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
7 years agoMerge pull request #19230 from tchaikov/wip-22247-luminous
Gregory Farnum [Wed, 29 Nov 2017 21:25:14 +0000 (16:25 -0500)]
Merge pull request #19230 from tchaikov/wip-22247-luminous

luminous: mon/PGMap: Fix %USED calculation

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7 years agoMerge pull request #19239 from ceph/luminous-bz1518264
Andrew Schoen [Wed, 29 Nov 2017 16:33:34 +0000 (10:33 -0600)]
Merge pull request #19239 from ceph/luminous-bz1518264

luminous: ceph-volume correctly fallback to bluestore when no objectstore is specified

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agotools/ceph_monstore_tool: rebuild initial mgrmap also 19240/head
Kefu Chai [Wed, 29 Nov 2017 12:21:33 +0000 (20:21 +0800)]
tools/ceph_monstore_tool: rebuild initial mgrmap also

Fixes: http://tracker.ceph.com/issues/22266
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit f63d1da4afa3463730ecbc0be29df6375b79fa8f)

7 years agoceph-volume lvm.activate correct detection and fallback of objectstore flags 19239/head
Alfredo Deza [Tue, 28 Nov 2017 14:22:19 +0000 (09:22 -0500)]
ceph-volume lvm.activate correct detection and fallback of objectstore flags

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f0ac2dfdbc0a05cff0a5edbedca91274885b7870)

7 years agoceph-volume tests.devices.lvm verify objectstore flags in activate
Alfredo Deza [Tue, 28 Nov 2017 14:21:34 +0000 (09:21 -0500)]
ceph-volume tests.devices.lvm verify objectstore flags in activate

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 8d22856d6c95ac3b45918765b382cae507a8d1a4)

7 years agoMerge pull request #19217 from liewegas/wip-p2p-app-warning-luminous
Sage Weil [Wed, 29 Nov 2017 14:43:07 +0000 (08:43 -0600)]
Merge pull request #19217 from liewegas/wip-p2p-app-warning-luminous

upgrade/jewel-x/parallel: debug fuse

7 years agomon/PGMap: Fix %USED calculation bug. 19230/head
Xiaoxi Chen [Mon, 27 Nov 2017 05:51:58 +0000 (22:51 -0700)]
mon/PGMap: Fix %USED calculation bug.

Previous code forgot to multiple raw_used_ratio to calculate
used byte.

Fixes: http://tracker.ceph.com/issues/22247
Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
(cherry picked from commit d10c6c26f9ef7372e2c95da79d23b07ce5f4e0e5)

7 years agoqa/suites/upgrade/jewel-x/point-to-point: whitelist more stuff 19217/head
Sage Weil [Tue, 28 Nov 2017 22:48:36 +0000 (16:48 -0600)]
qa/suites/upgrade/jewel-x/point-to-point: whitelist more stuff

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/suites/upgrade/jewel-x/parallel: only mount ceph-fuse once
Sage Weil [Tue, 28 Nov 2017 21:02:18 +0000 (15:02 -0600)]
qa/suites/upgrade/jewel-x/parallel: only mount ceph-fuse once

Otherwise we do 4 mounts for no good reason.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoupgrade/jewel-x/parallel: debug fuse
Sage Weil [Tue, 28 Nov 2017 21:00:05 +0000 (15:00 -0600)]
upgrade/jewel-x/parallel: debug fuse

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #19216 from liewegas/wip-p2p-app-warning-luminous
Sage Weil [Tue, 28 Nov 2017 20:48:08 +0000 (14:48 -0600)]
Merge pull request #19216 from liewegas/wip-p2p-app-warning-luminous

qa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning

7 years agoqa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning 19216/head
Sage Weil [Tue, 28 Nov 2017 20:46:02 +0000 (14:46 -0600)]
qa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning

It's generated on the mgr.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #19205 from tchaikov/wip-22136-luminous
Kefu Chai [Tue, 28 Nov 2017 15:47:17 +0000 (23:47 +0800)]
Merge pull request #19205 from tchaikov/wip-22136-luminous

luminous: qa/ceph-disk: enlarge the simulated SCSI disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #19152 from smithfarm/wip-22235-luminous
Nathan Cutler [Tue, 28 Nov 2017 13:03:01 +0000 (14:03 +0100)]
Merge pull request #19152 from smithfarm/wip-22235-luminous

luminous: ceph-disk flake8 test fails on very old, and very new, versions of flake8

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoqa/ceph-disk: enlarge the simulated SCSI disk 19205/head
Kefu Chai [Tue, 28 Nov 2017 06:42:31 +0000 (14:42 +0800)]
qa/ceph-disk: enlarge the simulated SCSI disk

100MB will be allocated for journal, and the remaining 100MB is for data
device. taking the inode into consideration, there will be approximately
87988 kB available for the activated OSD. and it will complain with a
"nearfull" state.

Fixes: http://tracker.ceph.com/issues/22136
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit b3c159e9fb8c31d0acd75f0702080f18959f672e)

7 years agoMerge pull request #19173 from smithfarm/wip-22251-luminous
Nathan Cutler [Tue, 28 Nov 2017 02:23:09 +0000 (03:23 +0100)]
Merge pull request #19173 from smithfarm/wip-22251-luminous

luminous: build/ops: macros expanding in spec file comment

Reviewed-by: David Disseldorp <ddiss@suse.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
7 years agoMerge pull request #19179 from ceph/wip-yuriw-BP-19175-luminous
Yuri Weinstein [Mon, 27 Nov 2017 18:23:57 +0000 (10:23 -0800)]
Merge pull request #19179 from ceph/wip-yuriw-BP-19175-luminous

qa/suites/rados/rest: move rest_test from qa/suites/rest/

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
7 years agoqa/suites/rados/rest: move rest_test from qa/suites/rest/ 19179/head
Sage Weil [Mon, 27 Nov 2017 16:11:51 +0000 (10:11 -0600)]
qa/suites/rados/rest: move rest_test from qa/suites/rest/

...and add more health whitelists.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit ddb274669ca16b95c452b256e58a2830af10c73d)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7 years agoMerge pull request #19177 from liewegas/wip-jewel-x-p2p
Yuri Weinstein [Mon, 27 Nov 2017 17:20:18 +0000 (09:20 -0800)]
Merge pull request #19177 from liewegas/wip-jewel-x-p2p

qa/suites/upgrade/jewel-x/point-to-point: skip ec tests when mons may be old

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
7 years agoqa/suites/upgrade/jewel-x/point-to-point: skip ec tests when mons may be old 19177/head
Sage Weil [Mon, 27 Nov 2017 16:28:16 +0000 (10:28 -0600)]
qa/suites/upgrade/jewel-x/point-to-point: skip ec tests when mons may be old

Early point release mons don't handle legacy ruleset-* ec profiles, new
ones do.  Skip the ec tests that may trigger this when we are doing a
workload that races with mon upgrades.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agorpm: rm macros in comments 19173/head
Ken Dreyer [Thu, 17 Aug 2017 15:19:38 +0000 (09:19 -0600)]
rpm: rm macros in comments

rpm expands all macros in a .spec file, even those in comments. Drop the
percent signs so rpm will not expand these.

This change silences rpmlint's warning about macros in comments.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
(cherry picked from commit 5c1e9f55d3a144c93c9c18b031db3cdc320561ef)

7 years agotests: ceph-disk: ignore E722 in flake8 test 19152/head
Nathan Cutler [Tue, 21 Nov 2017 10:36:02 +0000 (11:36 +0100)]
tests: ceph-disk: ignore E722 in flake8 test

Very old, and very new, versions of flake8 treat E722 as an error:

flake8 runtests: commands[0] | flake8 --ignore=H105,H405,E127 ceph_disk tests
ceph_disk/main.py:1575:9: E722 do not use bare except'
ceph_disk/main.py:1582:9: E722 do not use bare except'
ceph_disk/main.py:3252:5: E722 do not use bare except'
ceph_disk/main.py:3288:21: E722 do not use bare except'
ceph_disk/main.py:3296:17: E722 do not use bare except'
ceph_disk/main.py:4358:5: E722 do not use bare except'
tests/test_main.py:26:1: E722 do not use bare except'
ERROR: InvocationError: '/opt/j/ws/mkck/src/ceph-disk/.tox/flake8/bin/flake8 --ignore=H105,H405,E127 ceph_disk tests'

Fixes: http://tracker.ceph.com/issues/22207
References: https://gitlab.com/pycqa/flake8/issues/361

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 3600cd7bfdca76485d2998c5da1a0dd25816d1ce)

7 years agoMerge pull request #19080 from smithfarm/wip-22212-luminous
Kefu Chai [Wed, 22 Nov 2017 05:36:58 +0000 (13:36 +0800)]
Merge pull request #19080 from smithfarm/wip-22212-luminous

luminous: tests: ceph-disk: silence deprecation warnings

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoqa/workunits: silence py warnings for ceph-disk tests 19080/head
Kefu Chai [Tue, 21 Nov 2017 13:47:30 +0000 (21:47 +0800)]
qa/workunits: silence py warnings for ceph-disk tests

ceph-disk now prints "depreacted" warning message when it starts. but
the tests parses its stdout and stderr for a json string. so we need to
silence the warnings for the tests.

Fixes: http://tracker.ceph.com/issues/22154
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d44334f31704487ec3574738e75145872d9932cf)

7 years agoqa/suites/upgrade/jewel-x: move mon_warn_on_pool_no_app to global 19042/head
Sage Weil [Mon, 20 Nov 2017 20:35:48 +0000 (14:35 -0600)]
qa/suites/upgrade/jewel-x: move mon_warn_on_pool_no_app to global

Check runs on mgr.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18989 from ceph/wip-luminous-rm22154
Andrew Schoen [Mon, 20 Nov 2017 15:24:41 +0000 (09:24 -0600)]
Merge pull request #18989 from ceph/wip-luminous-rm22154

luminous: ceph-disk create deprecation warnings

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agomon/OSDMonitor: fix mon_fixup_legacy_erasure_code_profiles
Sage Weil [Mon, 20 Nov 2017 14:55:59 +0000 (08:55 -0600)]
mon/OSDMonitor: fix mon_fixup_legacy_erasure_code_profiles

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #19025 from tchaikov/wip-pr-19024-luminous
Kefu Chai [Mon, 20 Nov 2017 14:55:06 +0000 (22:55 +0800)]
Merge pull request #19025 from tchaikov/wip-pr-19024-luminous

luminous: qa/tasks: prolong revive_osd() timeout to 6 min

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18945 from liewegas/wip-22128
Sage Weil [Mon, 20 Nov 2017 13:23:30 +0000 (07:23 -0600)]
Merge pull request #18945 from liewegas/wip-22128

mon/OSDMonitor: add option to fix up ruleset-* to crush-* for ec profiles

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
7 years agoqa/tasks: prolong revive_osd() timeout to 6 min 19025/head
Kefu Chai [Mon, 20 Nov 2017 05:40:56 +0000 (13:40 +0800)]
qa/tasks: prolong revive_osd() timeout to 6 min

see also #17902

Fixes: http://tracker.ceph.com/issues/21474
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 749bbda07522114b99b17a4a01cfcf019520285d)

7 years agoMerge pull request #18983 from pdvian/wip-22150-luminous
Sage Weil [Sun, 19 Nov 2017 02:34:50 +0000 (20:34 -0600)]
Merge pull request #18983 from pdvian/wip-22150-luminous

luminous: os/bluestore: fix SharedBlob unregistration

7 years agomon/OSDMonitor: add option to fix up ruleset-* to crush-* for ec profiles 18945/head
Sage Weil [Wed, 15 Nov 2017 14:55:33 +0000 (08:55 -0600)]
mon/OSDMonitor: add option to fix up ruleset-* to crush-* for ec profiles

The jewel->luminous upgrade test will fail if we finish the upgrade while
a workload setting old-style ec profiles is running.  Add option to
automatically fix them up.  Warn to the cluster log when this happens.

For now, enable this option to ease upgrades and whitelist the warning.

Only include this option in luminous so that we implicitly sunset this
compatibility kludge immediately.

Fixes: http://tracker.ceph.com/issues/22128
Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #18751 from shinobu-x/wip-21701-luminous
Sage Weil [Sat, 18 Nov 2017 15:44:46 +0000 (09:44 -0600)]
Merge pull request #18751 from shinobu-x/wip-21701-luminous

luminous: ceph-kvstore-tool does not call bluestore's umount when exit

7 years agoMerge pull request #18750 from shinobu-x/wip-21702-luminous
Sage Weil [Sat, 18 Nov 2017 15:44:19 +0000 (09:44 -0600)]
Merge pull request #18750 from shinobu-x/wip-21702-luminous

luminous: BlueStore::umount will crash when the BlueStore is opened by start_kv_only()

7 years agoMerge pull request #18860 from liewegas/wip-filestore-rocksdb-compression-luminous
Sage Weil [Sat, 18 Nov 2017 15:41:37 +0000 (09:41 -0600)]
Merge pull request #18860 from liewegas/wip-filestore-rocksdb-compression-luminous

luminous: os/filestore: disable rocksdb compression

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
7 years agomgr/dashboard: fix audit log loading 19001/head
John Spray [Thu, 9 Nov 2017 12:33:10 +0000 (07:33 -0500)]
mgr/dashboard: fix audit log loading

Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 85e1dadb287ee5216985b16b4a144dfe148d6a60)

7 years agodoc/ceph-volume create a migration section to help users coming from ceph-disk 18989/head
Alfredo Deza [Fri, 17 Nov 2017 18:10:29 +0000 (13:10 -0500)]
doc/ceph-volume create a migration section to help users coming from ceph-disk

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit e433efe51481ec63bc9753a0f446fe2b12b5bb6a)

7 years agoceph-disk add deprecation warnings in favor of ceph-volume
Alfredo Deza [Fri, 17 Nov 2017 18:01:14 +0000 (13:01 -0500)]
ceph-disk add deprecation warnings in favor of ceph-volume

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Fixes: http://tracker.ceph.com/issues/22154
(cherry picked from commit c9da92e1ec8d60dc40d86630dab95e4fec4d0d30)

7 years agoMerge pull request #18973 from ceph/backport-18924
Alfredo Deza [Fri, 17 Nov 2017 17:19:36 +0000 (12:19 -0500)]
Merge pull request #18973 from ceph/backport-18924

luminous: ceph-volume: allow using a device or partition for `lvm --data`

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume tests.devices.lvm prepare isn't bluestore specific anymore 18973/head
Alfredo Deza [Fri, 17 Nov 2017 13:41:24 +0000 (08:41 -0500)]
ceph-volume tests.devices.lvm prepare isn't bluestore specific anymore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 2f40dbac386be631ac97e2450117c218d9bf02f9)

7 years agoos/bluestore: fix SharedBlob unregistration 18983/head
Sage Weil [Wed, 8 Nov 2017 04:05:10 +0000 (22:05 -0600)]
os/bluestore: fix SharedBlob unregistration

We use the SharedBlobSet remove() in three cases:

- from SharedBlob::put(), we try to remove ourselves from the set, but
  have to deal with a racing lookup, so the removal is conditional on
  nref still being 0.
- from split_cache(), we move the SharedBlob to another collection
- from make_blob_unshared(), we remove the entry when we clear the sbid.

The problem is that the condtiional remove() (for the first case) was being
used for all three cases, and in the second two cases nref is always != 0,
so it doesn't actually happen.  This can lead to a crash during cache
shutdown.

Fix by making two variants: remove() that is unconditional, and
try_remove() that is conditional.

Set the sb->coll pointer after because remove() asserts the parent matches
where we are unregistering.

Fixes: http://tracker.ceph.com/issues/22039
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 78a465b90b1c5187cfec9f25eb58b3bf617ca39b)

7 years agoMerge pull request #18957 from tchaikov/wip-pr-18808-luminous
Josh Durgin [Thu, 16 Nov 2017 21:40:32 +0000 (13:40 -0800)]
Merge pull request #18957 from tchaikov/wip-pr-18808-luminous

luminous: qa: do not wait for down/out osd for pg convergence

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoceph-volume tests.functional create a common playbook directory for setups
Alfredo Deza [Thu, 16 Nov 2017 13:50:34 +0000 (08:50 -0500)]
ceph-volume tests.functional create a common playbook directory for setups

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit def89a411f2f4bdb23c4bbd3b71c1310a564f07d)

7 years agodoc/ceph-volume lvm prepare can accept devices for --data
Alfredo Deza [Tue, 14 Nov 2017 16:01:48 +0000 (11:01 -0500)]
doc/ceph-volume lvm prepare can accept devices for --data

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9bfab348b2ff59c0b939a19c22d4a06bc5236b96)

Conflicts:
doc/ceph-volume/lvm/prepare.rst

7 years agoceph-volume tests.functional add setup playbook for xenial filestore
Alfredo Deza [Tue, 14 Nov 2017 13:42:27 +0000 (08:42 -0500)]
ceph-volume tests.functional add setup playbook for xenial filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 210c1e1d4770dde47f0008cadaaec35deb729272)

7 years agoceph-volume tests.functional add data device and journal to xenial filestore
Alfredo Deza [Tue, 14 Nov 2017 13:42:02 +0000 (08:42 -0500)]
ceph-volume tests.functional add data device and journal to xenial filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d0754e25177b9bf3bce695b7991e99f49312d91c)

7 years agoceph-volume tests.functional add setup playbook for xenial bluestore
Alfredo Deza [Tue, 14 Nov 2017 13:40:37 +0000 (08:40 -0500)]
ceph-volume tests.functional add setup playbook for xenial bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d0f5623963f58fc4d5727a79d8377b2191b0f9dc)

7 years agoceph-volume tests.functional add raw data device to xenial bluestore
Alfredo Deza [Tue, 14 Nov 2017 13:40:18 +0000 (08:40 -0500)]
ceph-volume tests.functional add raw data device to xenial bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit fbcfb522981cd4039cfe617609c5f160f0b05c52)

7 years agoceph-volume tests.functional tox.ini addition of setup playbook for partitions
Alfredo Deza [Tue, 14 Nov 2017 13:38:23 +0000 (08:38 -0500)]
ceph-volume tests.functional tox.ini addition of setup playbook for partitions

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d074b534643dde37d732b34c36c5089e41848d6d)

7 years agoceph-volume tests.functional add raw data device to centos7 bluestore
Alfredo Deza [Tue, 14 Nov 2017 13:37:17 +0000 (08:37 -0500)]
ceph-volume tests.functional add raw data device to centos7 bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 2d416a849ad7b33dde1386da09c81249e6c2299d)

7 years agoceph-volume tests.functional add setup playbook for centos7 bluestore
Alfredo Deza [Tue, 14 Nov 2017 13:36:36 +0000 (08:36 -0500)]
ceph-volume tests.functional add setup playbook for centos7 bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 161fd373d2f11f64466927e5d615d039822e2ab5)

7 years agoceph-volume tests.functional add setup playbook for centos7 filestore
Alfredo Deza [Tue, 14 Nov 2017 13:35:59 +0000 (08:35 -0500)]
ceph-volume tests.functional add setup playbook for centos7 filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit b3bb147298f8816651f231f77bc91a3a1b50d96f)

7 years agoceph-volume tests.functional add raw device to centos7 filestore
Alfredo Deza [Tue, 14 Nov 2017 13:35:42 +0000 (08:35 -0500)]
ceph-volume tests.functional add raw device to centos7 filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit c5b8d72570b24dfd0d2f8c1cc8f13812c6c11a69)

7 years agoceph-volume lvm.common update --data flag to reflect device acceptance
Alfredo Deza [Mon, 13 Nov 2017 19:29:32 +0000 (14:29 -0500)]
ceph-volume lvm.common update --data flag to reflect device acceptance

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 4df7ea8d83cfa02c8864d043b5d5fb2f5409dc96)

7 years agoceph-volume lvm.prepare add example of raw device or partition in help menu
Alfredo Deza [Mon, 13 Nov 2017 19:28:32 +0000 (14:28 -0500)]
ceph-volume lvm.prepare add example of raw device or partition in help menu

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 6fb8d566aac0e0fa081e6500852855ad177f784f)

7 years agoceph-volume lvm.prepare allow partition or raw device as input for --data in filestore
Alfredo Deza [Mon, 13 Nov 2017 19:26:44 +0000 (14:26 -0500)]
ceph-volume lvm.prepare allow partition or raw device as input for --data in filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 89236ee3f81e50b9b059c10f6d6e7ce048c06474)

7 years agoqa: do not wait for down/out osd for pg convergence 18957/head
Kefu Chai [Wed, 8 Nov 2017 06:13:54 +0000 (14:13 +0800)]
qa: do not wait for down/out osd for pg convergence

that osd is not invovlved in the PG state changes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 7f549af459b40c5bb51a24a3a443ed7a7116915e)

7 years agoMerge pull request #18908 from smithfarm/wip-luminous-fixup
Yuri Weinstein [Tue, 14 Nov 2017 16:38:35 +0000 (08:38 -0800)]
Merge pull request #18908 from smithfarm/wip-luminous-fixup

qa/suites/fs/basic_functional/clusters: more osds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
7 years agoMerge pull request #18910 from ceph/backport-18882
Alfredo Deza [Tue, 14 Nov 2017 16:06:00 +0000 (11:06 -0500)]
Merge pull request #18910 from ceph/backport-18882

luminous: ceph-volume: add functional tests for simple, rearrange lvm tests

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume tests.functional update lvm/tox.ini paths after moving it 18910/head
Alfredo Deza [Fri, 10 Nov 2017 18:18:07 +0000 (13:18 -0500)]
ceph-volume tests.functional update lvm/tox.ini paths after moving it

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7d787849556788961155534039886aedfcdb2a88)

7 years agoceph-volume tests.functional move top level tox.ini to lvm/tox.ini
Alfredo Deza [Fri, 10 Nov 2017 18:14:55 +0000 (13:14 -0500)]
ceph-volume tests.functional move top level tox.ini to lvm/tox.ini

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9b14b96d3bf6c8326cfc91e657161ffab3b8c2b4)

7 years agoceph-volume tests.functional move xenial to lvm/xenial
Alfredo Deza [Fri, 10 Nov 2017 18:12:51 +0000 (13:12 -0500)]
ceph-volume tests.functional move xenial to lvm/xenial

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 00d576d266b63080129e58482bd6fba62534ee97)

7 years agoceph-volume tests.functional lvm move xenial/bluestore to xenial/bluestore/create
Alfredo Deza [Fri, 10 Nov 2017 18:11:58 +0000 (13:11 -0500)]
ceph-volume tests.functional lvm move xenial/bluestore to xenial/bluestore/create

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d5ec7d1c58141f4593ed9d1e4501c9f3be6d9755)

7 years agoceph-volume tests.functional lvm move xenial/create to xenial/filestore/create
Alfredo Deza [Fri, 10 Nov 2017 18:09:48 +0000 (13:09 -0500)]
ceph-volume tests.functional lvm move xenial/create to xenial/filestore/create

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit c504b8781b3a31475280a032cd75c9e1eaa6d8c9)

7 years agoceph-volume tests.functional move centos7 to lvm/centos7
Alfredo Deza [Fri, 10 Nov 2017 18:02:05 +0000 (13:02 -0500)]
ceph-volume tests.functional move centos7 to lvm/centos7

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit dc1da3fd0aeafe59a82343fb16fe1fcea66ae3eb)

7 years agoceph-volume tests.functional lvm move bluestore to bluestore/create
Alfredo Deza [Fri, 10 Nov 2017 17:58:27 +0000 (12:58 -0500)]
ceph-volume tests.functional lvm move bluestore to bluestore/create

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit aec1a80a3e1e61720f494980711808bfee783a03)

7 years agoceph-volume tests.functional lvm move create to filestore/create
Alfredo Deza [Fri, 10 Nov 2017 17:54:01 +0000 (12:54 -0500)]
ceph-volume tests.functional lvm move create to filestore/create

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d6905f3f620d4c733835e21a275d4127cdcb769b)

7 years agoceph-volume tests.functional simple xenial bluestore scenario
Alfredo Deza [Fri, 10 Nov 2017 17:42:19 +0000 (12:42 -0500)]
ceph-volume tests.functional simple xenial bluestore scenario

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 8f0fdc975951a2a8af31bbaa3abd2b5d807a0add)

7 years agoceph-volume tests.functional simple xenial filestore scenario
Alfredo Deza [Fri, 10 Nov 2017 17:40:18 +0000 (12:40 -0500)]
ceph-volume tests.functional simple xenial filestore scenario

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7452e1b6f9b82c2ef62bae19c632e81039638ba5)

7 years agoceph-volume tests.functional simple tox.ini update for xenial scnearios
Alfredo Deza [Fri, 10 Nov 2017 17:30:05 +0000 (12:30 -0500)]
ceph-volume tests.functional simple tox.ini update for xenial scnearios

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 76ed6a8f2ecab7c58def0453ffed9d8a997e0d5b)

7 years agoceph-volume tests.functional simple tox.ini addition for bluestore
Alfredo Deza [Fri, 10 Nov 2017 14:12:09 +0000 (09:12 -0500)]
ceph-volume tests.functional simple tox.ini addition for bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 02154e445b87a8fdcabbd699a2532833764140b5)

7 years agoceph-volume tests.functional add initial files for simple bluestore activate
Alfredo Deza [Fri, 10 Nov 2017 14:11:39 +0000 (09:11 -0500)]
ceph-volume tests.functional add initial files for simple bluestore activate

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 3320f28e799e1d77d1ea69be9ced603bb69cc5fa)

7 years agoceph-volume tests.functional add initial files for simple filestore activate
Alfredo Deza [Thu, 9 Nov 2017 21:55:30 +0000 (16:55 -0500)]
ceph-volume tests.functional add initial files for simple filestore activate

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9d18bae52ad77be0e64ef105c33a019446b6f1cf)

7 years agoceph-volume tests.functional create a specific test.yml for simple activate
Alfredo Deza [Thu, 9 Nov 2017 21:07:53 +0000 (16:07 -0500)]
ceph-volume tests.functional create a specific test.yml for simple activate

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 37bde0d3b37a87c456438b0edc0cb9e2dcd39120)

7 years agoceph-volume tests.functional create a separate tox.ini environ for
Alfredo Deza [Thu, 9 Nov 2017 20:40:51 +0000 (15:40 -0500)]
ceph-volume tests.functional create a separate tox.ini environ for
`simple`

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 89757ad12e6938fe2bf997e0f21a5ffac082e30b)

7 years agoMerge pull request #18907 from ceph/luminous-wip-bz1498200
Andrew Schoen [Mon, 13 Nov 2017 16:55:24 +0000 (10:55 -0600)]
Merge pull request #18907 from ceph/luminous-wip-bz1498200

luminous: ceph-volume: support GPT and other deployed OSDs

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
7 years agoqa/suites/fs/basic_functional/clusters: more osds 18908/head
Sage Weil [Mon, 9 Oct 2017 18:44:51 +0000 (13:44 -0500)]
qa/suites/fs/basic_functional/clusters: more osds

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 998122c324047c96c16d60d7fbb3a21f4dd63c56)

7 years agodoc/ceph-volume include the top level systemd.rst in the toctree 18907/head
Alfredo Deza [Thu, 9 Nov 2017 15:50:43 +0000 (10:50 -0500)]
doc/ceph-volume include the top level systemd.rst in the toctree

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit e2f281c115c15e820588b478214c3600ff97470f)

7 years agoceph-volume simple.activate add --file in help docstring as an example
Alfredo Deza [Thu, 9 Nov 2017 11:49:49 +0000 (06:49 -0500)]
ceph-volume simple.activate add --file in help docstring as an example

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit ff60592897b63581ebce372b3f6ffa0f10d2fe5a)

7 years agodoc/ceph-volume activate has a --file option for json files
Alfredo Deza [Thu, 9 Nov 2017 11:46:59 +0000 (06:46 -0500)]
doc/ceph-volume activate has a --file option for json files

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 29913951b71d68b3f3f9b9fa076f309c0252da36)

7 years agoceph-volume simple.activate enable the osd when activating
Alfredo Deza [Wed, 8 Nov 2017 22:23:41 +0000 (17:23 -0500)]
ceph-volume simple.activate enable the osd when activating

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 366fb8c43af54e9c92f4e95d9a0582c1fc378dbc)