]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoMerge pull request #13533 from smithfarm/wip-stress-split-ec
Sage Weil [Mon, 20 Feb 2017 16:20:58 +0000 (10:20 -0600)]
Merge pull request #13533 from smithfarm/wip-stress-split-ec

jewel: qa/suites/upgrade/hammer-x: break stress split ec symlinks

8 years agoMerge pull request #13222 from liewegas/wip-hammer-x-jewel
Sage Weil [Mon, 20 Feb 2017 16:20:51 +0000 (10:20 -0600)]
Merge pull request #13222 from liewegas/wip-hammer-x-jewel

jewel: tests: qa/suites/upgrade/hammer-x/stress-split: finish thrashing before final upgrade

8 years agoMerge pull request #13273 from asheplyakov/jewel-bp-18773
Loic Dachary [Mon, 20 Feb 2017 15:42:59 +0000 (16:42 +0100)]
Merge pull request #13273 from asheplyakov/jewel-bp-18773

jewel: rgw: fix period update crash

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #13341 from dreamhost/wip-17550-jewel
Loic Dachary [Mon, 20 Feb 2017 15:41:56 +0000 (16:41 +0100)]
Merge pull request #13341 from dreamhost/wip-17550-jewel

jewel: rgw: bucket resharding

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
8 years agoMerge pull request #13004 from asheplyakov/jewel-bp-18563
Loic Dachary [Mon, 20 Feb 2017 15:41:29 +0000 (16:41 +0100)]
Merge pull request #13004 from asheplyakov/jewel-bp-18563

jewel: rgw: leak from RGWMetaSyncShardCR::incremental_sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agotests: reduce stress-split-erasure-code-x86_64 dependency on stress-split 13533/head
Nathan Cutler [Mon, 20 Feb 2017 10:44:49 +0000 (11:44 +0100)]
tests: reduce stress-split-erasure-code-x86_64 dependency on stress-split

This patch breaks the symlinks for two files from stress-split that
are being changed by https://github.com/ceph/ceph/pull/13222 in a way
that would break this test otherwise.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12754 from Abhishekvrshny/wip-18285-jewel
Loic Dachary [Mon, 20 Feb 2017 10:48:26 +0000 (11:48 +0100)]
Merge pull request #12754 from Abhishekvrshny/wip-18285-jewel

jewel: rbd: partition func should be enabled When load nbd.ko for rbd-nbd

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #13183 from smithfarm/wip-17313-jewel
Loic Dachary [Mon, 20 Feb 2017 10:45:29 +0000 (11:45 +0100)]
Merge pull request #13183 from smithfarm/wip-17313-jewel

jewel: build/ops: add ldap lib to rgw lib deps based on build config

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agotests: reduce stress-split-erasure-code dependency on stress-split
Nathan Cutler [Mon, 20 Feb 2017 10:44:49 +0000 (11:44 +0100)]
tests: reduce stress-split-erasure-code dependency on stress-split

This patch breaks the symlinks for two files from stress-split that
are being changed by https://github.com/ceph/ceph/pull/13222 in a way
that would break this test otherwise.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #13502 from tmuthamizhan/wip-ansible-rm-trusty
Yuri Weinstein [Fri, 17 Feb 2017 22:43:00 +0000 (14:43 -0800)]
Merge pull request #13502 from tmuthamizhan/wip-ansible-rm-trusty

qa: drop ubuntu trusty support

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
8 years agoqa: drop ubuntu trusty support 13502/head
Tamil Muthamizhan [Fri, 17 Feb 2017 21:06:43 +0000 (21:06 +0000)]
qa: drop ubuntu trusty support

ceph-ansible dropped support for OS that doesnt support systemd

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
8 years agoMerge pull request #13276 from rzarzynski/wip-rgw-18364-2-jewel
Loic Dachary [Thu, 16 Feb 2017 21:27:53 +0000 (22:27 +0100)]
Merge pull request #13276 from rzarzynski/wip-rgw-18364-2-jewel

jewel: rgw: be aware abount tenants on cls_user_bucket -> rgw_bucket conversion

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #12729 from liupan1111/wip-fix-disable-rgw-compile-error
Loic Dachary [Thu, 16 Feb 2017 15:30:56 +0000 (16:30 +0100)]
Merge pull request #12729 from liupan1111/wip-fix-disable-rgw-compile-error

jewel: build/ops: fixed compilation error when --with-radowsgw=no

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #12239 from liupan1111/wip-fix-makefile-bug
Loic Dachary [Thu, 16 Feb 2017 14:43:32 +0000 (15:43 +0100)]
Merge pull request #12239 from liupan1111/wip-fix-makefile-bug

jewel: build/ops: fixed the issue when --disable-server, compilation fails.

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #12380 from dachary/wip-18183-jewel
Loic Dachary [Wed, 15 Feb 2017 22:39:11 +0000 (23:39 +0100)]
Merge pull request #12380 from dachary/wip-18183-jewel

jewel: cephfs metadata pool: deep-scrub error omap_digest != best guess omap_digest

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #13130 from rjfd/wip-18608-jewel
Loic Dachary [Wed, 15 Feb 2017 16:08:26 +0000 (17:08 +0100)]
Merge pull request #13130 from rjfd/wip-18608-jewel

jewel: librbd: allow to open an image without opening parent image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #13233 from smithfarm/wip-18556-jewel
Loic Dachary [Wed, 15 Feb 2017 16:06:53 +0000 (17:06 +0100)]
Merge pull request #13233 from smithfarm/wip-18556-jewel

jewel: rbd: Potential race when removing two-way mirroring image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
8 years agoMerge pull request #13113 from jcsp/wip-18679
Loic Dachary [Wed, 15 Feb 2017 09:48:21 +0000 (10:48 +0100)]
Merge pull request #13113 from jcsp/wip-18679

jewel: mds: finish clientreplay requests before requesting active state

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #13139 from jcsp/wip-18100
Loic Dachary [Wed, 15 Feb 2017 09:47:59 +0000 (10:47 +0100)]
Merge pull request #13139 from jcsp/wip-18100

jewel: mds: fix MDSMap upgrade decoding

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #12490 from linuxbox2/jewel-rgw-header
Loic Dachary [Wed, 15 Feb 2017 09:18:04 +0000 (10:18 +0100)]
Merge pull request #12490 from linuxbox2/jewel-rgw-header

jewel: rgw: add option to log custom HTTP headers (rgw_log_http_headers)

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #12079 from rzarzynski/wip-rgw-17961
Loic Dachary [Wed, 15 Feb 2017 09:14:23 +0000 (10:14 +0100)]
Merge pull request #12079 from rzarzynski/wip-rgw-17961

jewel: rgw: TempURL properly handles accounts created with the implicit tenant

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #12044 from Abhishekvrshny/wip-17886-jewel
Loic Dachary [Wed, 15 Feb 2017 09:13:32 +0000 (10:13 +0100)]
Merge pull request #12044 from Abhishekvrshny/wip-17886-jewel

jewel: rgw: multisite: ECANCELED & 500 error on bucket delete

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
8 years agoMerge pull request #13422 from smithfarm/wip-fix-hammer-x-fix
Nathan Cutler [Tue, 14 Feb 2017 23:39:48 +0000 (00:39 +0100)]
Merge pull request #13422 from smithfarm/wip-fix-hammer-x-fix

tests: remove extra indentation in exec block

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
8 years agoMerge pull request #13364 from tmuthamizhan/wip-ansible-jewel
Tamilarasi Muthamizhan [Tue, 14 Feb 2017 21:59:58 +0000 (13:59 -0800)]
Merge pull request #13364 from tmuthamizhan/wip-ansible-jewel

qa: ceph-ansible smoke suite modified for jewel

8 years agotests: remove extra indentation in exec block 13422/head
Nathan Cutler [Tue, 14 Feb 2017 21:13:37 +0000 (22:13 +0100)]
tests: remove extra indentation in exec block

The exec block was indented by an extra space, causing

line 439, in parse_block_mapping_key
    "expected <block end>, but found %r" % token.id, token.start_mark)
yaml.parser.ParserError: while parsing a block mapping
  in "<string>", line 111, column 3:
      sequential:
      ^
expected <block end>, but found '<block sequence start>'
  in "<string>", line 126, column 4:
       - exec:
       ^

when trying to run upgrade/hammer-x

Reported-by: Yuri Weinstein <yweins@redhat.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #13404 from smithfarm/wip-fix-hammer-x
Sage Weil [Tue, 14 Feb 2017 00:44:37 +0000 (18:44 -0600)]
Merge pull request #13404 from smithfarm/wip-fix-hammer-x

tests: add require_jewel_osds to upgrade/hammer-x/tiering

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
8 years agotests: add require_jewel_osds to upgrade/hammer-x/tiering 13404/head
Nathan Cutler [Mon, 13 Feb 2017 21:04:17 +0000 (22:04 +0100)]
tests: add require_jewel_osds to upgrade/hammer-x/tiering

Without this, the test tends to fail, but sometimes passes (apparently because
the "wait-for-healthy: true" in the last ceph.restart is racy - HEALTH_OK is
received before the MONs notice that all OSDs are running jewel without
require_jewel_osds.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
8 years agolibrbd: async method to check journal tag owner 13233/head
Mykola Golub [Wed, 31 Aug 2016 19:49:36 +0000 (22:49 +0300)]
librbd: async method to check journal tag owner

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 953561f84140efcc870ec4a8f1ecb732b8e99409)

Conflicts:
src/librbd/Journal.cc - trivial context difference (master does not
                                have "class SafeTimerSingleton"),
                                added "typedef ::journal::Journaler Journaler;" in
                                C_IsTagOwner template to fix build failure

8 years agorbd-mirror: check image mirroring state when bootstrapping
Mykola Golub [Mon, 9 Jan 2017 09:40:46 +0000 (10:40 +0100)]
rbd-mirror: check image mirroring state when bootstrapping

Fixes: http://tracker.ceph.com/issues/18447
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 5fc5a8ac895524f05eed6e7db20b0dda3a8cb60f)

8 years agorbd-mirror: async request to test if image is primary
Mykola Golub [Mon, 9 Jan 2017 08:23:19 +0000 (09:23 +0100)]
rbd-mirror: async request to test if image is primary

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 0a1cb35caacdf85029f31a0364dc07a5d7462f5f)

Conflicts:
src/tools/rbd_mirror/CMakeLists.txt - file doesn't exist in jewel
            (ported the patch to src/tools/Makefile-client.am)
src/tools/rbd_mirror/image_replayer/BootstrapRequest.cc - Journal is
             implemented by a typedef in jewel
src/tools/rbd_mirror/image_replayer/OpenLocalImageRequest.cc -
             no compat.h include in jewel, Journal is implemented by a typedef
             in jewel

8 years agoMerge pull request #13331 from smithfarm/wip-18869-jewel
Loic Dachary [Mon, 13 Feb 2017 07:20:53 +0000 (08:20 +0100)]
Merge pull request #13331 from smithfarm/wip-18869-jewel

jewel: tests: SUSE yaml facets in qa/distros/all are out of date

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #11410 from dachary/wip-17334-jewel
Kefu Chai [Mon, 13 Feb 2017 06:52:59 +0000 (14:52 +0800)]
Merge pull request #11410 from dachary/wip-17334-jewel

jewel: crushtool --compile is create output despite of missing item

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agotest/cli/crushtool: fix the test of compile-decompile-recompile.t 11410/head
Kefu Chai [Wed, 21 Sep 2016 14:58:49 +0000 (22:58 +0800)]
test/cli/crushtool: fix the test of compile-decompile-recompile.t

should read the map from $TESTDIR,
it's a regression introduced by b2c0a07

Fixes: http://tracker.ceph.com/issues/17306
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 404043980d7882f320f48fbaed4b18f31bb15eb7)

8 years agocrush/CrushCompiler: error out as long as parse fails
Kefu Chai [Tue, 20 Sep 2016 06:10:16 +0000 (14:10 +0800)]
crush/CrushCompiler: error out as long as parse fails

do not output compiled crush map if anything goes wrong when parsing
crush map.

Fixes: http://tracker.ceph.com/issues/17306
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit b2c0a079dc074c907e1bc429861230096534f597)

8 years agoqa: ceph-ansible smoke suite modified for jewel 13364/head
Tamil Muthamizhan [Fri, 10 Feb 2017 20:37:51 +0000 (12:37 -0800)]
qa: ceph-ansible smoke suite modified for jewel

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
8 years agoMerge pull request #13358 from linuxbox2/wip-jewel-marker
Matt Benjamin [Fri, 10 Feb 2017 20:04:02 +0000 (15:04 -0500)]
Merge pull request #13358 from linuxbox2/wip-jewel-marker

jewel: rgw: fix use of marker in List::list_objects()

8 years agorgw: fix use of marker in List::list_objects() 13358/head
Yehuda Sadeh [Fri, 27 Jan 2017 00:26:42 +0000 (16:26 -0800)]
rgw: fix use of marker in List::list_objects()

Fixes: http://tracker.ceph.com/issues/18331
List marker is an index key, so treat it as such. This
fixes infinite loop in orphans find command.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit a5d1fa0587184f43c69d8e03114b58d43f320781)

8 years agoBackport bucket reshard to jewel. 13341/head
Robin H. Johnson [Thu, 9 Feb 2017 22:38:02 +0000 (14:38 -0800)]
Backport bucket reshard to jewel.

Fixes: http://tracker.ceph.com/issues/17756
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: add a few admin commands to the usage
Yehuda Sadeh [Tue, 4 Oct 2016 00:00:41 +0000 (17:00 -0700)]
rgw_admin: add a few admin commands to the usage

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 91ed1216d7465a42d11546cb967c70997ea5b1d8)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: add bi purge command
Yehuda Sadeh [Mon, 3 Oct 2016 23:43:44 +0000 (16:43 -0700)]
rgw_admin: add bi purge command

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit aaf0d213eb39192ceb252c9c7db68c1a48ba1272)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw: bucket resharding, adjust logging
Yehuda Sadeh [Wed, 28 Sep 2016 19:54:47 +0000 (12:54 -0700)]
rgw: bucket resharding, adjust logging

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit e2b8dc6113e2625bdf65ea6f2c42510229d04c87)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agocls/rgw: bi_list() fix is_truncated returned param
Yehuda Sadeh [Wed, 28 Sep 2016 17:41:45 +0000 (10:41 -0700)]
cls/rgw: bi_list() fix is_truncated returned param

is_truncated was never set. Also, make sure that we don't return
more entries than requested.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 47f422a4e0382d53023af6f651433011606b8625)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: require --yes-i-really-mean-it for bucket reshard
Yehuda Sadeh [Tue, 27 Sep 2016 22:13:37 +0000 (15:13 -0700)]
rgw_admin: require --yes-i-really-mean-it for bucket reshard

in the case where num shards are less or equal to current bucket

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 75da4375ee0e36c58f96cbf2920c3b9aadf12733)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: better bucket reshard logging
Yehuda Sadeh [Tue, 27 Sep 2016 21:35:31 +0000 (14:35 -0700)]
rgw_admin: better bucket reshard logging

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit ac88b5d9e6bc3c8b59c500bf79a0e3daa923a47c)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw: limit bucket reshard num shards to max possible
Yehuda Sadeh [Tue, 27 Sep 2016 21:11:41 +0000 (14:11 -0700)]
rgw: limit bucket reshard num shards to max possible

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit d9c88afec4b52848f9ad8957bab5a86fdafecded)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: fix bi list command
Yehuda Sadeh [Tue, 27 Sep 2016 18:55:32 +0000 (11:55 -0700)]
rgw_admin: fix bi list command

Changes scoping of json section, and push the --object param in so that
an object can be specified as a filter.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 716d096bbb8e836aefa6a451b799389d3bd85620)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: use aio operations for bucket resharding
Yehuda Sadeh [Mon, 26 Sep 2016 22:49:37 +0000 (15:49 -0700)]
rgw_admin: use aio operations for bucket resharding

also created shards manager to make things slightly cleaner

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 97e7ee9ca213ccf4b8f537e02125bd0c4ef24103)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw: bucket reshard updates stats
Yehuda Sadeh [Mon, 26 Sep 2016 17:45:17 +0000 (10:45 -0700)]
rgw: bucket reshard updates stats

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit dd712384ffe72ee23cbe0a20d7400aff7fb779a8)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agocls/rgw: add bucket_update_stats method
Yehuda Sadeh [Mon, 26 Sep 2016 16:52:29 +0000 (09:52 -0700)]
cls/rgw: add bucket_update_stats method

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 4cc7d3a33a28602b45ec04ff5384e6bc62b376cb)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: reshard also links to new bucket instance
Yehuda Sadeh [Sat, 24 Sep 2016 17:46:36 +0000 (10:46 -0700)]
rgw_admin: reshard also links to new bucket instance

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 094fe3f0cfeb27b32abfc93b07054b60de363a20)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw: rgw_link_bucket, use correct bucket structure for entry point
Yehuda Sadeh [Sat, 24 Sep 2016 17:33:57 +0000 (10:33 -0700)]
rgw: rgw_link_bucket, use correct bucket structure for entry point

The bucket structure might be different than the one that we were using
before.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit f2d9fc015556d6d70e596f75c382cc7157add411)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agoradosgw-admin: bucket reshard needs --num-shards to be specified
Yehuda Sadeh [Sat, 24 Sep 2016 17:01:00 +0000 (10:01 -0700)]
radosgw-admin: bucket reshard needs --num-shards to be specified

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit d0569f913340cb251c1a49f1e470b176d8b34346)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agocls/rgw: fix bi_list objclass command
Yehuda Sadeh [Sat, 24 Sep 2016 12:49:37 +0000 (05:49 -0700)]
cls/rgw: fix bi_list objclass command

was filtering entries, even if filter was not specified, and need to
set boundary for plain entries. Also, list_instance_entries() was not
working correctly, and added list_olh_entries().

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit f87c4b2c2a6ecadaf9f0e0cfef4b6061878a023b)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agorgw_admin: bucket rehsrading, initial work
Yehuda Sadeh [Mon, 26 Sep 2016 23:09:34 +0000 (16:09 -0700)]
rgw_admin: bucket rehsrading, initial work

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit d8c5931bceaa42ad47ae5ad9b2c32bb6c321484a)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
Conflicts:
src/rgw/rgw_admin.cc

8 years agorgw: utilities to support raw bucket index operations
Yehuda Sadeh [Mon, 26 Sep 2016 23:09:15 +0000 (16:09 -0700)]
rgw: utilities to support raw bucket index operations

and other related changes.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit b01e732f3d597670f4f781be3db81786e63d5053)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
Conflicts:
src/rgw/rgw_rados.cc

8 years agorgw: use bucket_info.bucket_id instead of marker where needed
Yehuda Sadeh [Mon, 26 Sep 2016 23:06:17 +0000 (16:06 -0700)]
rgw: use bucket_info.bucket_id instead of marker where needed

We used to use these interchangeably, but they actually have diffent meaning.
The marker is the prefix we assign to the objects in this bucket, whereas
the bucket_id is the bucket instance's id. These used to hold the same
value, but with bucket resharding it's not going to be true anymore.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 94afaf722fc8289af6e75025ba7d783f11c4b7d0)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agocls/rgw: utilities to support raw bucket index operations
Yehuda Sadeh [Mon, 26 Sep 2016 23:01:39 +0000 (16:01 -0700)]
cls/rgw: utilities to support raw bucket index operations

New flavour of bi_put() call, and a function to extract key off
a raw bi entry.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 9b3a2a40a5732689be98a940f7e6c3c4a6e73c53)
See: http://tracker.ceph.com/issues/17556
See: https://github.com/ceph/ceph/pull/11368
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
8 years agotests: drop buildpackages.py 13331/head
Nathan Cutler [Wed, 8 Feb 2017 20:23:54 +0000 (21:23 +0100)]
tests: drop buildpackages.py

The buildpackages suite has been moved to teuthology. This cleans up a file
that was left behind by https://github.com/ceph/ceph/pull/13297

Fixes: http://tracker.ceph.com/issues/18846
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 6b7443fb50c117ee7f20d53bbc7530bb0eb7ebd5)

8 years agotests: update SUSE yaml facets in qa/distros/all
Nathan Cutler [Wed, 8 Feb 2017 14:27:00 +0000 (15:27 +0100)]
tests: update SUSE yaml facets in qa/distros/all

Fixes: http://tracker.ceph.com/issues/18856
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 0bd56e871a8549d4b0b1211f09dad2d1120fb606)

8 years agoMerge pull request #13299 from dachary/wip-18848-jewel
Loic Dachary [Wed, 8 Feb 2017 12:16:25 +0000 (13:16 +0100)]
Merge pull request #13299 from dachary/wip-18848-jewel

jewel: tests: remove qa/suites/buildpackages

Reviewed-by: Nathan Cutler <ncutler@suse.cz>
8 years agorbd-nbd: support partition for rbd-nbd mapped raw block device. 12754/head
Pan Liu [Tue, 6 Dec 2016 13:04:03 +0000 (21:04 +0800)]
rbd-nbd: support partition for rbd-nbd mapped raw block device.

Fixes: http://tracker.ceph.com/issues/18115
Signed-off-by: Pan Liu pan.liu@istuary.com
(cherry picked from commit 42645a301869b08b4be860fcac491ae4189b313a)

Conflicts:
src/tools/rbd_nbd/rbd-nbd.cc
Removed exclusive option

8 years agobuildpackages: remove because it does not belong 13299/head
Loic Dachary [Tue, 7 Feb 2017 17:33:29 +0000 (18:33 +0100)]
buildpackages: remove because it does not belong

It should live in teuthology, not in Ceph. And it is currently broken:
there is no need to keep it around.

Fixes: http://tracker.ceph.com/issues/18846
Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 5a43f8d57925da227c95480501ceec10a29395d8)

Conflicts:
qa/tasks/buildpackages/common.sh (remove)
qa/tasks/buildpackages/make-rpm.sh (remove)

8 years agoMerge pull request #13280 from athanatos/wip-revert-jewel-18581
Samuel Just [Tue, 7 Feb 2017 00:31:06 +0000 (16:31 -0800)]
Merge pull request #13280 from athanatos/wip-revert-jewel-18581

Revert "Merge pull request #12978 from asheplyakov/jewel-18581"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
8 years agoRevert "Merge pull request #12978 from asheplyakov/jewel-18581" 13280/head
Samuel Just [Mon, 6 Feb 2017 18:20:55 +0000 (10:20 -0800)]
Revert "Merge pull request #12978 from asheplyakov/jewel-18581"

See: http://tracker.ceph.com/issues/18809

This reverts commit 8e69580c97622abfcbda73f92d9b6b6780be031f, reversing
changes made to c05730ceb3387fb43c35937f0506297a34a44452.

Signed-off-by: Samuel Just <sjust@redhat.com>
8 years agorgw: be aware abount tenants on cls_user_bucket -> rgw_bucket conversion. 13276/head
Radoslaw Zarzynski [Wed, 1 Feb 2017 18:05:50 +0000 (19:05 +0100)]
rgw: be aware abount tenants on cls_user_bucket -> rgw_bucket conversion.

Fixes: http://tracker.ceph.com/issues/18364
Fixes: http://tracker.ceph.com/issues/16355
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
(cherry picked from commit 871e1f51afe9d6c8b88debc07460b4316121f999)

8 years agorgw: add check for update return value 13273/head
Orit Wasserman [Sun, 22 Jan 2017 13:05:30 +0000 (15:05 +0200)]
rgw: add check for update return value

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit 125955e0625461065dc4755b900e51c3598cadb4)

8 years agorgw: we need to reinit the zonegroup after assignment to avoid invalid cct and store
Orit Wasserman [Sun, 22 Jan 2017 12:42:14 +0000 (14:42 +0200)]
rgw: we need to reinit the zonegroup after assignment to avoid invalid cct and store

Fixes: http://tracker.ceph.com/issues/18631
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit ac9a7565ddf801121f22476cf3f66668f311833e)

8 years agorgw: fix init_zg_from_period when default zone is not set as default
Orit Wasserman [Sun, 22 Jan 2017 12:40:16 +0000 (14:40 +0200)]
rgw: fix init_zg_from_period when default zone is not set as default

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
(cherry picked from commit 5393077e07bed45b9fc007591d365f1229d3e815)

8 years agolibrbd: allow to open an image without opening parent image 13130/head
Ricardo Dias [Tue, 10 Jan 2017 15:11:19 +0000 (15:11 +0000)]
librbd: allow to open an image without opening parent image

Fixes: http://tracker.ceph.com/issues/18325
Signed-off-by: Ricardo Dias <rdias@suse.com>
(cherry picked from commit 61af1c25015de087a2423811548d975dd7d430b4)

Conflicts:
  src/librbd/ImageState.cc - added missing arg to RefreshRequest::create
  src/librbd/exclusive_lock/PostAcquireRequest.cc -
                                        deleted, does not exist in jewel
  src/librbd/image/OpenRequest.cc - added missing arg to
                                    RefreshRequest::create
  src/librbd/internal.cc - added missing arg to ImageState::open
  src/librbd/librbd.cc - added missing arg to ImageState::open
  src/test/librbd/exclusive_lock/test_mock_PostAcquireRequest.cc -
                                        deleted, does not exist in jewel
  src/test/rbd_mirror/image_replayer/test_mock_CreateImageRequest.cc -
                                        added missing arg to ImageState::open
  src/test/rbd_mirror/test_PoolWatcher.cc - added missing arg to
                                            ImageState::open

8 years agorbd-mirror: hold owner lock when testing if lock owner
Mykola Golub [Mon, 9 Jan 2017 14:02:02 +0000 (15:02 +0100)]
rbd-mirror: hold owner lock when testing if lock owner

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
(cherry picked from commit 82aa89668d666f434cd19ff444223017b5512c6a)

8 years agorgw: RGWCloneMetaLogCoroutine uses RGWMetadataLogInfoCompletion 13004/head
Casey Bodley [Thu, 5 Jan 2017 18:10:50 +0000 (13:10 -0500)]
rgw: RGWCloneMetaLogCoroutine uses RGWMetadataLogInfoCompletion

Fixes: http://tracker.ceph.com/issues/18412
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 34a2edbf53f26a21e3206027dc61efc70d9c6aad)

Minor changes:
RGWCloneMetaLogCoroutine::state_read_shard_status(): use
boost::intrusive_ptr ctor instead of reset() to be compatible
with older boost versions (there's no bundled boost in jewel)

8 years agorgw: expose completion for RGWMetadataLog::get_info_async()
Casey Bodley [Thu, 5 Jan 2017 18:10:18 +0000 (13:10 -0500)]
rgw: expose completion for RGWMetadataLog::get_info_async()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7b3532e2ad0f478a1670ceb61fd68209df87aa8b)

8 years agorgw: RGWMetaSyncShardCR drops stack refs on destruction
Casey Bodley [Wed, 21 Dec 2016 19:32:04 +0000 (14:32 -0500)]
rgw: RGWMetaSyncShardCR drops stack refs on destruction

if the coroutine is canceled before collect_children() can clean up
all of its child stacks, those stack refs will leak. store these
stacks as boost::intrusive_ptr so the ref is dropped automatically on
destruction

Fixes: http://tracker.ceph.com/issues/18300
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 060fe72faf6a483a36d481207c6624c46a414231)

8 years agorgw: librados aio wait_for_safe, not wait_for_complete
Sage Weil [Mon, 26 Sep 2016 15:19:50 +0000 (11:19 -0400)]
rgw: librados aio wait_for_safe, not wait_for_complete

We want to wait for the op to be durable, not ordered.

Note that wait_for_safe works for read ops as well, despite a
name that implies an update.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2e447eafb34a7019ca15189d73a3ad3341640dc5)

8 years agoMerge pull request #11872 from dachary/wip-17838-jewel
Nathan Cutler [Wed, 1 Feb 2017 23:08:29 +0000 (00:08 +0100)]
Merge pull request #11872 from dachary/wip-17838-jewel

jewel: leak in RGWFetchAllMetaCR

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #13182 from smithfarm/wip-18498-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:58:29 +0000 (23:58 +0100)]
Merge pull request #13182 from smithfarm/wip-18498-jewel

jewel: rgw: Realm set does not create a new period

8 years agoMerge pull request #13180 from smithfarm/wip-18547-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:57:40 +0000 (23:57 +0100)]
Merge pull request #13180 from smithfarm/wip-18547-jewel

jewel: rgw: multisite: segfault after changing value of rgw_data_log_num_shards

8 years agoMerge pull request #13177 from smithfarm/wip-18676-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:56:21 +0000 (23:56 +0100)]
Merge pull request #13177 from smithfarm/wip-18676-jewel

jewel: rgw: librgw: objects created from s3 apis are not visible from nfs mount point

8 years agoMerge pull request #13175 from smithfarm/wip-18684-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:55:25 +0000 (23:55 +0100)]
Merge pull request #13175 from smithfarm/wip-18684-jewel

jewel: rgw: multisite: sync status reports master is on a different period

8 years agoMerge pull request #13173 from smithfarm/wip-18710-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:54:33 +0000 (23:54 +0100)]
Merge pull request #13173 from smithfarm/wip-18710-jewel

jewel: rgw: slave zonegroup cannot enable the bucket versioning

8 years agoMerge pull request #13171 from smithfarm/wip-18712-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:53:39 +0000 (23:53 +0100)]
Merge pull request #13171 from smithfarm/wip-18712-jewel

jewel: rgw: radosgw-admin period update reverts deleted zonegroup

8 years agoMerge pull request #13001 from asheplyakov/jewel-bp/18559
Nathan Cutler [Wed, 1 Feb 2017 22:13:11 +0000 (23:13 +0100)]
Merge pull request #13001 from asheplyakov/jewel-bp/18559

jewel: rgw multisite: fix ref counting of completions

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12997 from asheplyakov/jewel-bp-18569
Nathan Cutler [Wed, 1 Feb 2017 22:10:37 +0000 (23:10 +0100)]
Merge pull request #12997 from asheplyakov/jewel-bp-18569

jewel: radosgw valgrind "invalid read size 4" RGWGetObj

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12764 from SUSE/wip-17342-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:02:14 +0000 (23:02 +0100)]
Merge pull request #12764 from SUSE/wip-17342-jewel

jewel: tests: assertion failure in a radosgw-admin related task

8 years agoMerge pull request #12738 from SUSE/wip-18286-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:01:02 +0000 (23:01 +0100)]
Merge pull request #12738 from SUSE/wip-18286-jewel

jewel: rgw: multisite: coroutine deadlock in RGWMetaSyncCR after ECANCELED errors

8 years agoMerge pull request #12678 from Abhishekvrshny/wip-18348-jewel
Nathan Cutler [Wed, 1 Feb 2017 22:00:12 +0000 (23:00 +0100)]
Merge pull request #12678 from Abhishekvrshny/wip-18348-jewel

jewel: rgw ldap: enforce simple_bind w/LDAPv3 redux

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12622 from wido/jewel-15776
Nathan Cutler [Wed, 1 Feb 2017 21:45:54 +0000 (22:45 +0100)]
Merge pull request #12622 from wido/jewel-15776

jewel: rgw: log name instead of id for SystemMetaObj on failure

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
8 years agoMerge pull request #12542 from dreamhost/wip-17076-jewel
Nathan Cutler [Wed, 1 Feb 2017 21:39:52 +0000 (22:39 +0100)]
Merge pull request #12542 from dreamhost/wip-17076-jewel

jewel: rgw: Replacing '+' with "%20" in canonical uri for s3 v4 auth.

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12428 from SUSE/wip-18216-jewel
Nathan Cutler [Wed, 1 Feb 2017 21:38:17 +0000 (22:38 +0100)]
Merge pull request #12428 from SUSE/wip-18216-jewel

jewel: rgw-admin: missing command to modify placement targets

8 years agoMerge pull request #12426 from SUSE/wip-18214-jewel
Nathan Cutler [Wed, 1 Feb 2017 21:36:19 +0000 (22:36 +0100)]
Merge pull request #12426 from SUSE/wip-18214-jewel

jewel: add max_part and nbds_max options in rbd nbd map, in order to keep consistent with

http://tracker.ceph.com/issues/17851#note-59

8 years agoMerge pull request #12419 from SUSE/wip-18217-jewel
Nathan Cutler [Wed, 1 Feb 2017 21:34:15 +0000 (22:34 +0100)]
Merge pull request #12419 from SUSE/wip-18217-jewel

jewel: rgw sends omap_getvals with (u64)-1 limit

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12405 from jan--f/wip-18199-jewel
Nathan Cutler [Wed, 1 Feb 2017 21:32:24 +0000 (22:32 +0100)]
Merge pull request #12405 from jan--f/wip-18199-jewel

jewel: build/ops: install-deps.sh based on /etc/os-release

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12397 from linuxbox2/jewel-next
Nathan Cutler [Wed, 1 Feb 2017 21:29:24 +0000 (22:29 +0100)]
Merge pull request #12397 from linuxbox2/jewel-next

jewel: rgw: do not abort when accept a CORS request with short origin

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12316 from dachary/wip-18101-jewel
Nathan Cutler [Wed, 1 Feb 2017 21:15:35 +0000 (22:15 +0100)]
Merge pull request #12316 from dachary/wip-18101-jewel

jewel: Add workaround for upgrade issues for older jewel versions

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12890 from dillaman/wip-18453-jewel
Nathan Cutler [Wed, 1 Feb 2017 20:37:45 +0000 (21:37 +0100)]
Merge pull request #12890 from dillaman/wip-18453-jewel

jewel: librbd: new API method to force break a peer's exclusive lock

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoqa/suites/upgrade/hammer-x: wrap thrash and workloads 13222/head
Sage Weil [Wed, 1 Feb 2017 20:24:50 +0000 (15:24 -0500)]
qa/suites/upgrade/hammer-x: wrap thrash and workloads

We need the thrashing to stop before we do the final upgrade step.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #12302 from SUSE/wip-18135-jewel
Loic Dachary [Wed, 1 Feb 2017 19:23:36 +0000 (20:23 +0100)]
Merge pull request #12302 from SUSE/wip-18135-jewel

jewel: build/ops: add hostname sanity check to run-{c}make-check.sh

Reviewed-by: Loic Dachary <ldachary@redhat.com>
8 years agoMerge pull request #12315 from dachary/wip-18102-jewel
Nathan Cutler [Wed, 1 Feb 2017 15:18:04 +0000 (16:18 +0100)]
Merge pull request #12315 from dachary/wip-18102-jewel

jewel: rgw: Unable to commit period zonegroup change

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12314 from dachary/wip-18107-jewel
Nathan Cutler [Wed, 1 Feb 2017 15:14:15 +0000 (16:14 +0100)]
Merge pull request #12314 from dachary/wip-18107-jewel

jewel: multisite: failed assertion in 'radosgw-admin bucket sync status'

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #12313 from dachary/wip-18112-jewel
Nathan Cutler [Wed, 1 Feb 2017 15:12:40 +0000 (16:12 +0100)]
Merge pull request #12313 from dachary/wip-18112-jewel

jewel: rgw: multisite requests failing with '400 Bad Request' with civetweb 1.8

Reviewed-by: Nathan Cutler <ncutler@suse.com>