]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agorgw: use rgw_zone_root_pool for region_map like is done in hammer 14144/head
Orit Wasserman [Sun, 12 Mar 2017 10:11:28 +0000 (12:11 +0200)]
rgw: use rgw_zone_root_pool for region_map like is done in hammer

Fixes: http://tracker.ceph.com/issues/19195
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit c91dd6d9efd148e0fe0f027dde537e977de9aa26)

8 years agoMerge pull request #13501 from shinobu-x/wip-18371-kraken
Sage Weil [Sat, 4 Mar 2017 17:22:44 +0000 (11:22 -0600)]
Merge pull request #13501 from shinobu-x/wip-18371-kraken

 kraken: ceph-disk: error on _bytes2str

8 years agoMerge pull request #13757 from liewegas/wip-pgp-kraken
Kefu Chai [Fri, 3 Mar 2017 03:14:48 +0000 (11:14 +0800)]
Merge pull request #13757 from liewegas/wip-pgp-kraken

qa/tasks: set pgp = pg num on thrashing finish

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agotest: Thrasher: do not update pools_to_fix_pgp_num if nothing happens 13757/head
Kefu Chai [Sun, 19 Feb 2017 05:10:44 +0000 (13:10 +0800)]
test: Thrasher: do not update pools_to_fix_pgp_num if nothing happens

we should not update pools_to_fix_pgp_num if the pool is not expanded or
the pg_num is not increased due to pgs being created. this prevent us
from fixing the pgp_num after done with thrashing if we actually did
nothing when fixing the pgp_num when thrashing, but we removed the pool
from pools_to_fix_pgp_num after set_pool_pgpnum() returns.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit c0f0cde399a80cea617c115417e5390a63ec674e)

8 years agotest: Thrasher: update pgp_num of all expanded pools if not yet
Kefu Chai [Sun, 12 Feb 2017 05:16:57 +0000 (13:16 +0800)]
test: Thrasher: update pgp_num of all expanded pools if not yet

otherwise wait_until_healthy will fail after timeout as seeing warning
like:

HEALTH_WARN pool cephfs_data pg_num 182 > pgp_num 172

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 136483a8f940710cbe40804afa7af2eac6728d50)

8 years agoMerge pull request #13707 from zmc/wip-openstack-volumes-kraken
Zack Cerza [Wed, 1 Mar 2017 22:16:17 +0000 (15:16 -0700)]
Merge pull request #13707 from zmc/wip-openstack-volumes-kraken

qa/suites/ceph-deploy: Drop OpenStack volume count

8 years agoqa/suites/ceph-deploy: Drop OpenStack volume count 13707/head
Zack Cerza [Tue, 28 Feb 2017 20:07:15 +0000 (13:07 -0700)]
qa/suites/ceph-deploy: Drop OpenStack volume count

Looks like we only need two per node, since there is only one OSD per
node, and ceph-deploy wants two disks per OSD to account for the
journal.

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 87072e277c9ef259c9ee2ae1f761e252aa216713)

8 years agoMerge pull request #13673 from zmc/wip-openstack-volumes-kraken
Zack Cerza [Mon, 27 Feb 2017 19:23:10 +0000 (12:23 -0700)]
Merge pull request #13673 from zmc/wip-openstack-volumes-kraken

qa/suites/{ceph-ansible,rest}: OpenStack volumes

8 years agoqa/suites/rest: Openstack volumes 13673/head
Zack Cerza [Mon, 27 Feb 2017 16:14:41 +0000 (09:14 -0700)]
qa/suites/rest: Openstack volumes

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 99d942145f4206c00aca30c0bb74f0edc4bac798)

8 years agoqa/suites/ceph-ansible: Openstack volumes
Zack Cerza [Mon, 27 Feb 2017 16:06:26 +0000 (09:06 -0700)]
qa/suites/ceph-ansible: Openstack volumes

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 964b983bdbd412311bce56184d12d1b6d43c7f28)

8 years agoMerge pull request #13485 from shinobu-x/wip-18644-kraken
Brad Hubbard [Sat, 25 Feb 2017 23:23:43 +0000 (09:23 +1000)]
Merge pull request #13485 from shinobu-x/wip-18644-kraken

kraken: osd: condition object_info_t encoding on required (not up) features

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #13641 from zmc/wip-fs-openstack-kraken
Zack Cerza [Sat, 25 Feb 2017 00:22:11 +0000 (17:22 -0700)]
Merge pull request #13641 from zmc/wip-fs-openstack-kraken

qa/suites/fs: Add openstack volume configuration

8 years agoqa/suites/fs: Add openstack volume configuration 13641/head
Zack Cerza [Fri, 24 Feb 2017 22:25:19 +0000 (15:25 -0700)]
qa/suites/fs: Add openstack volume configuration

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit b076d89a3f1fbad7d477913812b2e17529abeacf)

8 years agoMerge pull request #13638 from zmc/wip-openstack-volumes-kraken
Zack Cerza [Fri, 24 Feb 2017 21:44:04 +0000 (14:44 -0700)]
Merge pull request #13638 from zmc/wip-openstack-volumes-kraken

qa/suites/{knfs,hadoop,samba}: OpenStack volume configuration

8 years agoMerge pull request #13635 from zmc/wip-kcephfs-openstack-kraken
Zack Cerza [Fri, 24 Feb 2017 21:43:34 +0000 (14:43 -0700)]
Merge pull request #13635 from zmc/wip-kcephfs-openstack-kraken

qa/suites/kcephfs: Openstack volume configuration

8 years agoqa/suites/samba: Openstack volume configuration 13638/head
Zack Cerza [Fri, 24 Feb 2017 20:46:54 +0000 (13:46 -0700)]
qa/suites/samba: Openstack volume configuration

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit e0296d706422ea4dc01d84f8786f6f7104c3d996)

8 years agoqa/suites/hadoop: Openstack volume configuration
Zack Cerza [Fri, 24 Feb 2017 20:45:18 +0000 (13:45 -0700)]
qa/suites/hadoop: Openstack volume configuration

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 3fef0a49da2ccfdceba7b98e9096be8305da1111)

8 years agoqa/suites/knfs: Add openstack volume configuration
Zack Cerza [Fri, 24 Feb 2017 20:44:33 +0000 (13:44 -0700)]
qa/suites/knfs: Add openstack volume configuration

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 62c6fd3371adf0f420c12d9c7e2b3a2a0c69256b)

8 years agoqa/suites/kcephfs: Openstack volume configuration 13635/head
Zack Cerza [Fri, 24 Feb 2017 20:37:23 +0000 (13:37 -0700)]
qa/suites/kcephfs: Openstack volume configuration

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit ec6fb28eaf8e2db327e4afc115879a40c7664e07)

8 years agoMerge pull request #13633 from zmc/wip-krbd-openstack-kraken
Zack Cerza [Fri, 24 Feb 2017 19:16:02 +0000 (12:16 -0700)]
Merge pull request #13633 from zmc/wip-krbd-openstack-kraken

qa/suites/krbd: Add openstack volume configuration

8 years agoMerge pull request #13613 from ceph/wip-rgw-openstack-kraken
Zack Cerza [Fri, 24 Feb 2017 19:15:29 +0000 (12:15 -0700)]
Merge pull request #13613 from ceph/wip-rgw-openstack-kraken

qa/suites/rgw: Add openstack volume configuration

8 years agoMerge pull request #13618 from tmuthamizhan/wip-rm-trusty-kraken
Yuri Weinstein [Fri, 24 Feb 2017 18:37:12 +0000 (10:37 -0800)]
Merge pull request #13618 from tmuthamizhan/wip-rm-trusty-kraken

qa: drop ubuntu trusty support

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
8 years agoqa/suites/krbd: Add openstack volume configuration 13633/head
Zack Cerza [Fri, 24 Feb 2017 18:17:45 +0000 (11:17 -0700)]
qa/suites/krbd: Add openstack volume configuration

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 201b4d0d1e92bf95ac6a8f2951b664763030f12d)

8 years agoqa/suites/rgw: Add openstack volume configuration 13613/head
Zack Cerza [Thu, 23 Feb 2017 17:14:05 +0000 (10:14 -0700)]
qa/suites/rgw: Add openstack volume configuration

Without this, OSDs will fail to create on instances whose root fs isn't
xfs.

(cherry picked from commit 8af4c35f9577ef5a88307ea5cbbe2561a473926c)
Signed-off-by: Zack Cerza <zack@redhat.com>
8 years agoosd/OSDMap: require OSD features only of OSDs 13485/head
Ilya Dryomov [Mon, 6 Feb 2017 11:51:05 +0000 (12:51 +0100)]
osd/OSDMap: require OSD features only of OSDs

Fix up commit 1a5cc32f0a3b ("osd/OSDMap: reflect REQUIRE_*_OSDS flag in
required features") -- require_*_osds shouldn't affect older clients.

Fixes: http://tracker.ceph.com/issues/18831
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit ab558bbf2956157cbde59c155a5180a62ae73d07)

Conflicts:
src/osd/OSDMap.cc

8 years agoqa: drop ubuntu trusty support 13618/head
Tamil Muthamizhan [Fri, 17 Feb 2017 21:06:43 +0000 (21:06 +0000)]
qa: drop ubuntu trusty support

ceph-ansible dropped support for OS that doesnt support systemd

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
(cherry picked from commit 4d4b38eca81f7b57e3d3b31e1c13e7ab0ba5b30f)
Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
8 years agoMerge pull request #13283 from zmc/wip-smoke-openstack-kraken
Yuri Weinstein [Thu, 23 Feb 2017 22:55:56 +0000 (14:55 -0800)]
Merge pull request #13283 from zmc/wip-smoke-openstack-kraken

qa/suites/smoke: add openstack requirements

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
8 years agoMerge pull request #13201 from dillaman/wip-18703-kraken
Mykola Golub [Tue, 21 Feb 2017 14:16:26 +0000 (16:16 +0200)]
Merge pull request #13201 from dillaman/wip-18703-kraken

kraken: librbd: prevent self-blacklisting during break lock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #13102 from dillaman/wip-18668
Mykola Golub [Tue, 21 Feb 2017 14:15:35 +0000 (16:15 +0200)]
Merge pull request #13102 from dillaman/wip-18668

kraken: test: use librados API to retrieve config params

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoceph-disk: convert none str to str before printing it 13501/head
Kefu Chai [Tue, 3 Jan 2017 12:40:00 +0000 (20:40 +0800)]
ceph-disk: convert none str to str before printing it

Error('somethings goes wrong', e) is thrown if exception `e` is caught
in ceph-disk, where e is not a string. so we can not just concat it in
Error's __str__(). so cast it to str before doing so.

introduced by d0e29c7

Fixes: http://tracker.ceph.com/issues/18371
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 5e0dd1e7df43a3be589d17878714756a22052d8e)

8 years agoMerge pull request #13330 from smithfarm/wip-18870-kraken
Loic Dachary [Mon, 13 Feb 2017 07:19:36 +0000 (08:19 +0100)]
Merge pull request #13330 from smithfarm/wip-18870-kraken

kraken: tests: SUSE yaml facets in qa/distros/all are out of date

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #12984 from ceph/wip-cherry-pick-4tamil
Yuri Weinstein [Fri, 10 Feb 2017 23:41:06 +0000 (15:41 -0800)]
Merge pull request #12984 from ceph/wip-cherry-pick-4tamil

qa: Wip cherry pick 4tamil ceph-ansible

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
8 years agoMerge pull request #13239 from smithfarm/wip-18805-kraken
Kefu Chai [Thu, 9 Feb 2017 14:48:01 +0000 (22:48 +0800)]
Merge pull request #13239 from smithfarm/wip-18805-kraken

kraken: tests: ignore bogus ceph-objectstore-tool error in ceph_manager

Reviewed-by: Kefu Chai <kefu@redhat.com>
8 years agotests: drop buildpackages.py 13330/head
Nathan Cutler [Wed, 8 Feb 2017 20:23:54 +0000 (21:23 +0100)]
tests: drop buildpackages.py

The buildpackages suite has been moved to teuthology. This cleans up a file
that was left behind by https://github.com/ceph/ceph/pull/13297

Fixes: http://tracker.ceph.com/issues/18846
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 6b7443fb50c117ee7f20d53bbc7530bb0eb7ebd5)

8 years agotests: update SUSE yaml facets in qa/distros/all
Nathan Cutler [Wed, 8 Feb 2017 14:27:00 +0000 (15:27 +0100)]
tests: update SUSE yaml facets in qa/distros/all

Fixes: http://tracker.ceph.com/issues/18856
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 0bd56e871a8549d4b0b1211f09dad2d1120fb606)

8 years agoMerge pull request #13298 from dachary/wip-18849-kraken
Loic Dachary [Wed, 8 Feb 2017 17:50:52 +0000 (18:50 +0100)]
Merge pull request #13298 from dachary/wip-18849-kraken

kraken: tests: remove qa/suites/buildpackages

Reviewed-by: Nathan Cutler <ncutler@suse.cz>
8 years agobuildpackages: remove because it does not belong 13298/head
Loic Dachary [Tue, 7 Feb 2017 17:33:29 +0000 (18:33 +0100)]
buildpackages: remove because it does not belong

It should live in teuthology, not in Ceph. And it is currently broken:
there is no need to keep it around.

Fixes: http://tracker.ceph.com/issues/18846
Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 5a43f8d57925da227c95480501ceec10a29395d8)

8 years agotests: fix regression in qa/tasks/ceph_master.py 13239/head
Nathan Cutler [Mon, 6 Feb 2017 17:43:49 +0000 (18:43 +0100)]
tests: fix regression in qa/tasks/ceph_master.py

https://github.com/ceph/ceph/pull/13194 introduced a regression:

2017-02-06T16:14:23.162 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/ceph_manager.py", line 722, in wrapper
    return func(self)
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/ceph_manager.py", line 839, in do_thrash
    self.choose_action()()
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/ceph_manager.py", line 305, in kill_osd
    output = proc.stderr.getvalue()
AttributeError: 'NoneType' object has no attribute 'getvalue'

This is because the original patch failed to pass "stderr=StringIO()" to run().

Fixes: http://tracker.ceph.com/issues/16263
Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit db2582e25e390fcaf75952eb59a73dcff643f49c)

8 years agoAdd openstack requirements to smoke suite 13283/head
Zack Cerza [Thu, 12 Jan 2017 21:55:26 +0000 (14:55 -0700)]
Add openstack requirements to smoke suite

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit fe9b7552d116b150f178c4cc778fa27cd8d956d1)

8 years agotests: ignore bogus ceph-objectstore-tool error in ceph_manager
Nathan Cutler [Mon, 30 Jan 2017 23:46:22 +0000 (00:46 +0100)]
tests: ignore bogus ceph-objectstore-tool error in ceph_manager

Fixes: http://tracker.ceph.com/issues/16263
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 046e873026c59e733f1844b28ffdc030cbe57b36)

8 years agolibrbd: prevent self-blacklisting during break lock 13201/head
Jason Dillaman [Wed, 25 Jan 2017 19:45:56 +0000 (14:45 -0500)]
librbd: prevent self-blacklisting during break lock

Fixes: http://tracker.ceph.com/issues/18666
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 5c590acaec4dd66a9a8c3aa0ec8ab904dd350216)

Conflicts:
src/librbd/exclusive_lock/BreakRequest.cc: managed lock refactor
src/test/librbd/exclusive_lock/test_mock_BreakRequest.cc: managed lock refactor

8 years agoMerge pull request #13024 from SUSE/wip-18604-kraken 13486/head 13499/head
John Spray [Wed, 25 Jan 2017 23:33:46 +0000 (00:33 +0100)]
Merge pull request #13024 from SUSE/wip-18604-kraken

kraken: cephfs test failures (ceph.com/qa is broken, should be download.ceph.com/qa)

8 years agoMerge pull request #12813 from SUSE/wip-18439-kraken
John Spray [Wed, 25 Jan 2017 23:31:53 +0000 (00:31 +0100)]
Merge pull request #12813 from SUSE/wip-18439-kraken

kraken: fuse: TestVolumeClient.test_evict_client failure creating pidfile

8 years agoMerge pull request #12951 from jcsp/wip-18361-kraken
John Spray [Wed, 25 Jan 2017 23:29:55 +0000 (00:29 +0100)]
Merge pull request #12951 from jcsp/wip-18361-kraken

kraken: client: populate metadata during mount

8 years agoMerge pull request #13030 from SUSE/wip-18612-kraken
John Spray [Wed, 25 Jan 2017 23:29:00 +0000 (00:29 +0100)]
Merge pull request #13030 from SUSE/wip-18612-kraken

kraken: client: segfault on ceph_rmdir path /

8 years agoMerge pull request #13028 from SUSE/wip-18531-kraken
John Spray [Wed, 25 Jan 2017 23:27:57 +0000 (00:27 +0100)]
Merge pull request #13028 from SUSE/wip-18531-kraken

kraken: speed up readdir by skipping unwanted dn

8 years agoMerge pull request #12835 from SUSE/wip-18463-kraken
John Spray [Wed, 25 Jan 2017 23:25:34 +0000 (00:25 +0100)]
Merge pull request #12835 from SUSE/wip-18463-kraken

kraken: Decode errors on backtrace will crash MDS

8 years agolibrbd: improve debug logging for lock / watch state machines 13102/head
Jason Dillaman [Tue, 24 Jan 2017 14:24:52 +0000 (09:24 -0500)]
librbd: improve debug logging for lock / watch state machines

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
8 years agotest: use librados API to retrieve config params
Jason Dillaman [Tue, 24 Jan 2017 02:24:41 +0000 (21:24 -0500)]
test: use librados API to retrieve config params

The CephContext object is not ABI-stable, so it is necessary to
use the "conf_get" librados methods to safely retrieve a setting.

Fixes: http://tracker.ceph.com/issues/18617
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 8ad40645ac3948f8341e9a80ce8aff8ac5b9ad11)

Conflicts:
src/test/librbd/test_librbd.cc: trivial resolution

8 years agoMerge pull request #13006 from rzarzynski/wip-rgw-18476-kraken
Radoslaw Zarzynski [Mon, 23 Jan 2017 19:46:55 +0000 (20:46 +0100)]
Merge pull request #13006 from rzarzynski/wip-rgw-18476-kraken

kraken: rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agorgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT. 13006/head
Radoslaw Zarzynski [Tue, 10 Jan 2017 11:09:50 +0000 (12:09 +0100)]
rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT.

Before this patch the flag was wrongly handled in the Swift API
implementation. In rare conditions this might result in setting
req_state::system_request.

This may happen only if both of those conditions are fulfilled:
 * RadosGW is running in a multi-site configuration (at least
   one user with the system flag turned on is present),
 * the "rgw_swift_account_in_url" configurable has been switched
   to true. The value is false by default and our documentation
   doesn't actually mention about the option.

The issue doesn't affect Jewel nor any previous release.

Fixes: http://tracker.ceph.com/issues/18476
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
(cherry picked from commit 8dac93392b6679c3ad9bb28ea66f6bb8c7be511d)

8 years agoMerge pull request #13044 from SUSE/wip-18571-kraken
Nathan Cutler [Mon, 23 Jan 2017 18:29:57 +0000 (19:29 +0100)]
Merge pull request #13044 from SUSE/wip-18571-kraken

kraken: Python Swift client commands in Quick Developer Guide don't match configuration in vstart.sh

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoqa: update remaining ceph.com to download.ceph.com 13024/head
John Spray [Tue, 17 Jan 2017 16:12:46 +0000 (17:12 +0100)]
qa: update remaining ceph.com to download.ceph.com

Fixes: http://tracker.ceph.com/issues/18574
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 549d993d3fd8ffffa280ed4a64aca41d1c6f2da1)

8 years agoDoc: Fixes Python Swift client commands 13044/head
Ronak Jain [Fri, 13 Jan 2017 11:27:45 +0000 (16:57 +0530)]
Doc: Fixes Python Swift client commands

Fixes: http://tracker.ceph.com/issues/17746
Signed-off-by: Ronak Jain <ronakjain@outlook.in>
(cherry picked from commit 8c79959557d60f619adf1a3ed1b5bd1112ceaabb)

8 years agoclient/Client.cc: prevent segfaulting 13030/head
Michal Jarzabek [Thu, 12 Jan 2017 21:22:20 +0000 (21:22 +0000)]
client/Client.cc: prevent segfaulting

The segfaulting in the rmdir function is caused by calling
filepath::last_dentry() function.
last_dentry() function assumes that the bits vector has always at
least one element, which is not the case for the the filepath object
created with "/" input.
This commit also fixes other functions affected by this bug:
link, unlink, rename, mkdir, mknod and symlink.

Fixes: http://tracker.ceph.com/issues/9935
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
(cherry picked from commit 6ed7f2364ae5507bab14c60b582929aa7b0ba400)

8 years agoMerge pull request #13011 from liewegas/wip-18595-kraken
Sage Weil [Fri, 20 Jan 2017 17:14:24 +0000 (11:14 -0600)]
Merge pull request #13011 from liewegas/wip-18595-kraken

os/bluestore: fix Allocator::allocate() int truncation

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agomds/server: skip unwanted dn in handle_client_readdir 13028/head
Xiaoxi Chen [Wed, 11 Jan 2017 02:11:08 +0000 (19:11 -0700)]
mds/server: skip unwanted dn in handle_client_readdir

We can skip unwanted dn which  < (offset_key, snap) via map.lower_bound, rather than
iterate across them.

Previously we iterate and skip dn which < (offset_key, dn->last), as dn->last >= snap
 means (offset_key, dn->last) >= (offset_key, snap), and such iterate_and_skip logic
still keep, so this commit doesnt change code logic but an optimization.

Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
(cherry picked from commit 52fe52baf920c672ac7f63a3087dcd31137891b6)

8 years agoos/bluestore: fix Allocator::allocate() int truncation 13011/head
Sage Weil [Fri, 20 Jan 2017 01:51:45 +0000 (19:51 -0600)]
os/bluestore: fix Allocator::allocate() int truncation

An allocation of size 0x80000000 gets truncated to 0.  Larger values can
break things in similar ways.

Introduced in 5ab034345d7320fbc86a2133c0c29ec1aca4b71a.

Fixes: http://tracker.ceph.com/issues/18595
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e19aa8484632ac7d83aa5dc868a1fe4dc167d9b9)

8 years ago11.2.0 v11.2.0
Jenkins Build Slave User [Thu, 19 Jan 2017 13:08:38 +0000 (13:08 +0000)]
11.2.0

8 years agoMerge pull request #13000 from liewegas/wip-bluestore-extents-kraken
Sage Weil [Thu, 19 Jan 2017 12:29:48 +0000 (06:29 -0600)]
Merge pull request #13000 from liewegas/wip-bluestore-extents-kraken

os/bluestore: fix reclaim_blocks (kraken)

8 years agoremoving fs workunit 12984/head
Tamil Muthamizhan [Fri, 13 Jan 2017 23:25:32 +0000 (15:25 -0800)]
removing fs workunit

removing fs workunit for now until tracker issue 18528 is resolved.

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
(cherry picked from commit 728411f5aee053c8258e7e642816c5d5605da8ef)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
8 years agoMerge pull request #12989 from yuriw/wip-fix-distro-kraken
Sage Weil [Wed, 18 Jan 2017 22:47:29 +0000 (16:47 -0600)]
Merge pull request #12989 from yuriw/wip-fix-distro-kraken

qa: Switched to centos 7.3 and as runs on smithi and vps are supported now

8 years agoSwitched to centos 7.3 and as runs on smithi and vps are supported now 12989/head
Yuri Weinstein [Wed, 18 Jan 2017 22:44:02 +0000 (22:44 +0000)]
Switched to centos 7.3 and as runs on smithi and vps are supported now

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
8 years agoqa: specify client for fs workunit
Tamil Muthamizhan [Thu, 12 Jan 2017 23:29:56 +0000 (15:29 -0800)]
qa: specify client for fs workunit
s/all/client.0

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
(cherry picked from commit 8f6fd3a76695904f8e8674372866867bca44b464)

8 years agoAdded a smoke suite for ceph-ansible
Tamil Muthamizhan [Thu, 22 Dec 2016 00:03:31 +0000 (16:03 -0800)]
Added a smoke suite for ceph-ansible

Smoke suite with basic tests for ceph ansible deployment

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
(cherry picked from commit ad9b75f8d0ccca1aa2dfc8679196643433634687)

8 years agoos/bluestore/BlueFS: dump allocator freelist on failure in reclaim_blocks 13000/head
Sage Weil [Wed, 18 Jan 2017 12:35:59 +0000 (07:35 -0500)]
os/bluestore/BlueFS: dump allocator freelist on failure in reclaim_blocks

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 15ff48518a65e0a3add97c5b7f650d329abf1dd1)

8 years agoos/bluestore/BlueFS: handle failure to reclaim blocks without crashing
Sage Weil [Wed, 18 Jan 2017 12:24:06 +0000 (06:24 -0600)]
os/bluestore/BlueFS: handle failure to reclaim blocks without crashing

We shouldn't fail to reclaim space in general, but if we do, do not treat
it as a fatal error.  Log loudly.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6dc1bcd9e72b01c3fbf09c7eb91cd7cf4e01f94a)

8 years agoMerge pull request #12969 from ceph/wip-cd-bp
Yuri Weinstein [Tue, 17 Jan 2017 22:50:28 +0000 (14:50 -0800)]
Merge pull request #12969 from ceph/wip-cd-bp

qa/task/ceph-deploy backports for kraken

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
8 years agouse the create option during instantiation 12969/head
Vasu Kulkarni [Tue, 10 Jan 2017 23:43:12 +0000 (15:43 -0800)]
use the create option during instantiation

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8 years agoRemove debug overrides
Vasu Kulkarni [Tue, 10 Jan 2017 01:59:20 +0000 (17:59 -0800)]
Remove debug overrides

the high level of debug for mon/osd is causing remoto to hang during get key

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8 years agoAdd ceph-create-keys to explicitly create admin/bootstrap keys
Vasu Kulkarni [Tue, 10 Jan 2017 00:45:01 +0000 (16:45 -0800)]
Add ceph-create-keys to explicitly create admin/bootstrap keys

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8 years agounitest_bit_alloc, unittest_alloc: fixes
Sage Weil [Tue, 17 Jan 2017 21:23:07 +0000 (16:23 -0500)]
unitest_bit_alloc, unittest_alloc: fixes

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7492aef0f717f1fb5c09d55c99ded2adce7997d6)

8 years agoos/bluestore: prealloc/reserve extent vector for common alloc path
Sage Weil [Tue, 17 Jan 2017 16:17:38 +0000 (11:17 -0500)]
os/bluestore: prealloc/reserve extent vector for common alloc path

No need to worry about the gift/reclaim path--those are very rare.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b0c243875fe963e2958828bef62f3ba55e123434)

8 years agoos/bluestore/Allocator: drop unused and goofy release_extents
Sage Weil [Tue, 17 Jan 2017 15:26:50 +0000 (10:26 -0500)]
os/bluestore/Allocator: drop unused and goofy release_extents

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 14676ac8cd69a1b4c06c728b0c00b00dd6a71a7a)

8 years agoos/bluestore: drop useless count arg to allocate
Sage Weil [Tue, 17 Jan 2017 15:25:34 +0000 (10:25 -0500)]
os/bluestore: drop useless count arg to allocate

The vector<> has a size.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 0aa402fba19f5c83806304b2ecef6902c481eff4)

8 years agoos/bluestore: return blocks allocated from allocate()
Sage Weil [Tue, 17 Jan 2017 15:20:07 +0000 (10:20 -0500)]
os/bluestore: return blocks allocated from allocate()

Instead of having a separate output argument with the number of
blocks allocated, just return it via the return value.  Simplifies
the calling convention.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 95c78706317f2fe61b8f48de5e8539ed49221d64)

8 years agoos/bluestore: manage vector from ExtentList
Sage Weil [Tue, 17 Jan 2017 15:56:13 +0000 (10:56 -0500)]
os/bluestore: manage vector from ExtentList

ExtentList was previous relying the caller to preallocate/size the
vector to be large enough for the worst case allocation of extents,
and keeping it's own manual count of the extent list size.  Instead,
manage that from ExtentList, and remove the preallocation from the
callers.

Fixes: http://tracker.ceph.com/issues/18573
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 65502891dd66569c8d99384e63b68decdab1c8e2)

8 years agoMerge tag 'v11.1.1' into kraken
Sage Weil [Tue, 17 Jan 2017 20:32:47 +0000 (15:32 -0500)]
Merge tag 'v11.1.1' into kraken

v11.1.1

8 years agoMerge pull request #12960 from SUSE/wip-18546-kraken
Jason Dillaman [Tue, 17 Jan 2017 13:40:38 +0000 (08:40 -0500)]
Merge pull request #12960 from SUSE/wip-18546-kraken

kraken: [teuthology] update Ubuntu image url after ceph.com refactor

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoqa/tasks/qemu: update default image url after ceph.com redesign 12960/head
Jason Dillaman [Tue, 17 Jan 2017 03:12:51 +0000 (22:12 -0500)]
qa/tasks/qemu: update default image url after ceph.com redesign

Fixes: http://tracker.ceph.com/issues/18542
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 6d17befb3bbc3d83c9d23d763ad95e1e7b2e4be0)

8 years agoclient: populate metadata during mount 12951/head
John Spray [Fri, 13 Jan 2017 00:30:28 +0000 (00:30 +0000)]
client: populate metadata during mount

This way we avoid having to over-write the "root"
metadata during mount, and any user-set overrides (such
as bad values injected by tests) will survive.

Because Client instances may also open sessions without
mounting to send commands, add a call into populate_metadata
from mds_command as well.

Fixes: http://tracker.ceph.com/issues/18361
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 1dbff09ad553f9ff07f4f4217ba7ece6c2cdc5d2)

8 years agoMerge pull request #12949 from cbodley/wip-rgw-kraken
Sage Weil [Mon, 16 Jan 2017 20:04:55 +0000 (14:04 -0600)]
Merge pull request #12949 from cbodley/wip-rgw-kraken

rgw: valgrind fixes for kraken

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agorgw: RGWCloneMetaLogCoroutine uses RGWMetadataLogInfoCompletion 12949/head
Casey Bodley [Thu, 5 Jan 2017 18:10:50 +0000 (13:10 -0500)]
rgw: RGWCloneMetaLogCoroutine uses RGWMetadataLogInfoCompletion

Fixes: http://tracker.ceph.com/issues/18412
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 34a2edbf53f26a21e3206027dc61efc70d9c6aad)

8 years agorgw: expose completion for RGWMetadataLog::get_info_async()
Casey Bodley [Thu, 5 Jan 2017 18:10:18 +0000 (13:10 -0500)]
rgw: expose completion for RGWMetadataLog::get_info_async()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7b3532e2ad0f478a1670ceb61fd68209df87aa8b)

8 years agorgw: RGWMetaSyncShardCR drops stack refs on destruction
Casey Bodley [Wed, 21 Dec 2016 19:32:04 +0000 (14:32 -0500)]
rgw: RGWMetaSyncShardCR drops stack refs on destruction

if the coroutine is canceled before collect_children() can clean up
all of its child stacks, those stack refs will leak. store these
stacks as boost::intrusive_ptr so the ref is dropped automatically on
destruction

Fixes: http://tracker.ceph.com/issues/18300
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 060fe72faf6a483a36d481207c6624c46a414231)

8 years agorgw: RGWAsyncRadosRequest drops notifier ref on cancel
Casey Bodley [Thu, 5 Jan 2017 21:06:45 +0000 (16:06 -0500)]
rgw: RGWAsyncRadosRequest drops notifier ref on cancel

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1d586f76a11fed937fc7bb0f7cf6a44ca0506881)

8 years agorgw: release RGWAioCompletionNotifier refs on destruction
Casey Bodley [Wed, 4 Jan 2017 16:36:00 +0000 (11:36 -0500)]
rgw: release RGWAioCompletionNotifier refs on destruction

Fixes: http://tracker.ceph.com/issues/18407
Fixes: http://tracker.ceph.com/issues/18414
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7a4975adba8b890e211d47662896e445a9822970)

8 years agoMerge pull request #12889 from dillaman/wip-18452-kraken
Jason Dillaman [Sat, 14 Jan 2017 14:57:38 +0000 (09:57 -0500)]
Merge pull request #12889 from dillaman/wip-18452-kraken

kraken: librbd: new API method to force break a peer's exclusive lock

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agorgw_rados: sanitize dout print in GWRados::get_obj_iterate_cb(...)
Matt Benjamin [Fri, 6 Jan 2017 20:16:32 +0000 (15:16 -0500)]
rgw_rados: sanitize dout print in GWRados::get_obj_iterate_cb(...)

We cannot assume pbl may be deferenced.  Per review, move the dout
print into the r < 0 condition--since it's now an error, make it's
trace level 0.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit c0233c4abb9f99304e3d82272bbb4385086bbfc0)

8 years agorgw_rados: add guard assert in add_io()
Matt Benjamin [Fri, 6 Jan 2017 17:30:42 +0000 (12:30 -0500)]
rgw_rados: add guard assert in add_io()

Use the iterator-returning insert operation in std::map, check
assert the insert case.  As a side effect, this makes use of the
inserted object record more clear.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit d10c37adf925d8b34daa81b419463ea376ec27aa)

8 years agoMerge pull request #12911 from athanatos/wip-18165
Sage Weil [Thu, 12 Jan 2017 21:48:27 +0000 (15:48 -0600)]
Merge pull request #12911 from athanatos/wip-18165

osd/PrimaryLogPG::failed_push: update missing as well

8 years agoMerge pull request #12910 from athanatos/wip-18358
Sage Weil [Thu, 12 Jan 2017 21:48:08 +0000 (15:48 -0600)]
Merge pull request #12910 from athanatos/wip-18358

osdc/Objecter: resend pg commands on interval change

8 years agoObjecter: resend pg commands on interval change 12869/head 12910/head
Samuel Just [Thu, 12 Jan 2017 20:44:44 +0000 (12:44 -0800)]
Objecter: resend pg commands on interval change

mark_lost_unfound* are now async since the rework, so we need
the Objecter to be able to resend on interval change.  This
is preferable to somehow requeueing the Command because they
don't use the normal op queue.

Fixes: http://tracker.ceph.com/issues/18358
Signed-off-by: Samuel Just <sjust@redhat.com>
8 years agoObjecter: fold last_force_resend into op_target_t
Samuel Just [Tue, 10 Jan 2017 02:08:53 +0000 (18:08 -0800)]
Objecter: fold last_force_resend into op_target_t

It's always passed along with op_target_t, this seems simpler.

Signed-off-by: Samuel Just <sjust@redhat.com>
8 years agolibrados: blacklist_add should wait for latest OSD map 12889/head
Jason Dillaman [Fri, 6 Jan 2017 16:17:10 +0000 (11:17 -0500)]
librados: blacklist_add should wait for latest OSD map

This ensures that future operations against the OSDs force
a OSD map update to notice the blacklisted client.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 9242a2e4e1a5a9fcea48d8135b1589493fc28242)

8 years agolibrbd: prevent assertion failure when journal IO is blacklisted
Jason Dillaman [Thu, 5 Jan 2017 18:31:57 +0000 (13:31 -0500)]
librbd: prevent assertion failure when journal IO is blacklisted

Fixes: http://tracker.ceph.com/issues/18429
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit c720f6e3704ed7e8cf41dffdb931dbb05d59a003)

8 years agolibrbd: ignore blacklist error when releasing exclusive lock
Jason Dillaman [Wed, 4 Jan 2017 17:12:27 +0000 (12:12 -0500)]
librbd: ignore blacklist error when releasing exclusive lock

This ensures the journal and object map are properly closed so that the
image can be properly closed w/o failing any assertions.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 418dcf29cb8c450049047e09a4dad2941af87018)

8 years agolibrbd: fail immediately if the exclusive lock cannot be acquired
Jason Dillaman [Tue, 3 Jan 2017 20:29:17 +0000 (15:29 -0500)]
librbd: fail immediately if the exclusive lock cannot be acquired

Fixes: http://tracker.ceph.com/issues/16988
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 47b89f4d48a0b99876462167389df28893a8d418)

8 years agolibrbd: add new lock_get_owners / lock_break_lock API methods
Jason Dillaman [Tue, 3 Jan 2017 19:51:14 +0000 (14:51 -0500)]
librbd: add new lock_get_owners / lock_break_lock API methods

If the client application supports failover, let the application
force break the current lock and blacklist the owner. This is
required in case the current lock owner is alive from the point-of-view
of librbd but failover was required due to a higher level reason.

Fixes: http://tracker.ceph.com/issues/18327
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 9a5a8c75a025143cee6f92f3dbc3a12f2b6a9ad7)

8 years agolibrbd: separate break lock logic into standalone state machine
Jason Dillaman [Thu, 22 Dec 2016 20:00:23 +0000 (15:00 -0500)]
librbd: separate break lock logic into standalone state machine

The current lockers are now queried before the lock is attempted to
prevent any possible race conditions when one or more clients attempt
to break the lock of a dead client.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 23f60fee86d1ff9b261fbb6411746a2a9479cf19)