]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoceph-backport.sh: add deprecation warning 30748/head
Nathan Cutler [Mon, 7 Oct 2019 10:49:33 +0000 (12:49 +0200)]
ceph-backport.sh: add deprecation warning

The script is not maintained in the stable versions of Ceph.

This commit is not a cherry-pick from master, because the script is maintained
in master. It is unmaintained only in the stable versions, like "nautilus".

Also add a --version option which, in this case, will also indicate to the
user that this is an outdated, deprecated version of the script.

Fixes: https://tracker.ceph.com/issues/42194
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #30325 from theanalyst/wip-41498-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:07:01 +0000 (13:07 -0700)]
Merge pull request #30325 from theanalyst/wip-41498-nautilus

nautilus: rgw: fix the bug of rgw not doing necessary checking to website configuration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30437 from smithfarm/wip-41846-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:06:38 +0000 (13:06 -0700)]
Merge pull request #30437 from smithfarm/wip-41846-nautilus

nautilus: rgw: increase beast parse buffer size to 64k

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30604 from vumrao/wip-vumrao-41976
Yuri Weinstein [Thu, 3 Oct 2019 20:06:15 +0000 (13:06 -0700)]
Merge pull request #30604 from vumrao/wip-vumrao-41976

nautilus: radosgw-admin: add --uid check in bucket list command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30651 from pdvian/wip-41970-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:52 +0000 (13:05 -0700)]
Merge pull request #30651 from pdvian/wip-41970-nautilus

nautilus: rgw: ldap auth: S3 auth failure should return InvalidAccessKeyId

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30680 from pdvian/wip-41974-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:28 +0000 (13:05 -0700)]
Merge pull request #30680 from pdvian/wip-41974-nautilus

nautilus: rgw: add minssing admin property when sync user info.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30247 from pdvian/wip-41631-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:58:18 +0000 (12:58 -0700)]
Merge pull request #30247 from pdvian/wip-41631-nautilus

nautilus: rgw: fixed "unrecognized arg" error when using "radosgw-admin zone rm".

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30248 from pdvian/wip-41627-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:57:45 +0000 (12:57 -0700)]
Merge pull request #30248 from pdvian/wip-41627-nautilus

nautilus: rgw: RGWCoroutine::call(nullptr) sets retcode=0

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30252 from smithfarm/wip-41707-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:56:57 +0000 (12:56 -0700)]
Merge pull request #30252 from smithfarm/wip-41707-nautilus

nautilus: rgw: fix cls_bucket_list_unordered() partial results

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge pull request #30509 from pdvian/wip-41898-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:55:32 +0000 (12:55 -0700)]
Merge pull request #30509 from pdvian/wip-41898-nautilus

nautilus: rgw: fix data sync start delay if remote haven't init data_log

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30472 from pdvian/wip-41858-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:54:58 +0000 (12:54 -0700)]
Merge pull request #30472 from pdvian/wip-41858-nautilus

nautilus: rgw: fix memory growth while deleteing objects with

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29716 from xiexingguo/wip-build-push-segv-for-n
Yuri Weinstein [Thu, 3 Oct 2019 19:53:24 +0000 (12:53 -0700)]
Merge pull request #29716 from xiexingguo/wip-build-push-segv-for-n

nautilus: core: osd/ReplicatedBackend: check against empty data_included before enabling crc

5 years agoMerge pull request #29928 from smithfarm/wip-41534-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:52:42 +0000 (12:52 -0700)]
Merge pull request #29928 from smithfarm/wip-41534-nautilus

nautilus: tests: valgrind: UninitCondition in ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authenticated_decrypt_update_final()

5 years agoMerge pull request #29946 from smithfarm/wip-39412-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:51:50 +0000 (12:51 -0700)]
Merge pull request #29946 from smithfarm/wip-39412-nautilus

nautilus: core: pool_stat.dump() - value of num_store_stats is wrong

5 years agoMerge pull request #30278 from pdvian/wip-41703-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:51:12 +0000 (12:51 -0700)]
Merge pull request #30278 from pdvian/wip-41703-nautilus

nautilus: osd/PrimaryLogPG: update oi.size on write op implicitly truncating ob…

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30605 from vumrao/wip-vumrao-41963
Yuri Weinstein [Thu, 3 Oct 2019 19:50:20 +0000 (12:50 -0700)]
Merge pull request #30605 from vumrao/wip-vumrao-41963

nautilus: tools/rados: call pool_lookup() after rados is connected

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30607 from vumrao/wip-vumrao-41960
Yuri Weinstein [Thu, 3 Oct 2019 19:49:15 +0000 (12:49 -0700)]
Merge pull request #30607 from vumrao/wip-vumrao-41960

nautilus: tools/rados: add --pgid in help

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30708 from smithfarm/wip-epel-release-snafu-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:31:35 +0000 (12:31 -0700)]
Merge pull request #30708 from smithfarm/wip-epel-release-snafu-nautilus

nautilus: build/ops: install-deps: do not install if rpm already installed and ceph.spec.in: s/pkgversion/version_nodots/

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoceph.spec.in: fix Cython package dependency for Fedora 30708/head
Jeff Layton [Thu, 26 Sep 2019 11:50:28 +0000 (07:50 -0400)]
ceph.spec.in: fix Cython package dependency for Fedora

Fedora distros do not have python3?-Cython packages, but they do have
python3-Cython ones. Fix the BuildRequires so that we only use the
python3_version_nodots based version string for RHEL.

Fixes: https://tracker.ceph.com/issues/42032
Signed-off-by: Jeff Layton <jlayton@redhat.com>
(cherry picked from commit 40c5a18f81c67c96f6a35e592ac3141b87c19701)

5 years agoceph.spec.in: s/pkgversion/version_nodots/
Kefu Chai [Fri, 30 Aug 2019 11:49:28 +0000 (19:49 +0800)]
ceph.spec.in: s/pkgversion/version_nodots/

`python3_pkgversion` is now defined as 3, while we don't have packages
like python3-Cython yet in EPEL7. but we do have `python36-Cython`. so
let's use `python3_version_nodots` instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 6d2f66846d1b84595cfdf8ac13a7ed4e1ae608ce)

5 years agoinstall-deps: do not install if rpm already installed
Kefu Chai [Fri, 27 Sep 2019 02:26:54 +0000 (10:26 +0800)]
install-deps: do not install if rpm already installed

there is chance that the system already have epel-release-latest-7.noarch.rpm
installed, in that case, install-deps.sh should not fail.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 45a4173bcfe15a9bf56f6aeb6e6c35386a00d1c5)

5 years agoMerge pull request #30579 from yuvalif/wip-yuval-backport-notif-nautilus
Yuval Lifshitz [Wed, 2 Oct 2019 13:21:35 +0000 (16:21 +0300)]
Merge pull request #30579 from yuvalif/wip-yuval-backport-notif-nautilus

nautilus: rgw/pubsub: backport notifications and pubsub

5 years agoMerge pull request #30601 from smithfarm/wip-42070-nautilus
Nathan Cutler [Wed, 2 Oct 2019 12:00:27 +0000 (14:00 +0200)]
Merge pull request #30601 from smithfarm/wip-42070-nautilus

nautilus: build/ops: install-deps.sh: add EPEL repo for non-x86_64 archs as well

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge branch 'nautilus' into wip-yuval-backport-notif-nautilus 30579/head
Yuval Lifshitz [Wed, 2 Oct 2019 11:50:13 +0000 (14:50 +0300)]
Merge branch 'nautilus' into wip-yuval-backport-notif-nautilus

5 years agoMerge pull request #30686 from smithfarm/wip-40131-nautilus-follow-on
Nathan Cutler [Wed, 2 Oct 2019 11:26:26 +0000 (13:26 +0200)]
Merge pull request #30686 from smithfarm/wip-40131-nautilus-follow-on

nautilus: doc: fix urls in posix.rst

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoinstall-deps.sh: add EPEL repo for non-x86_64 archs as well 30601/head
Nathan Cutler [Tue, 24 Sep 2019 19:48:27 +0000 (21:48 +0200)]
install-deps.sh: add EPEL repo for non-x86_64 archs as well

Fixes: https://tracker.ceph.com/issues/42023
Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 49d740118f9a0ee6b6bb82954630c654946f1751)

5 years agoMerge pull request #30322 from theanalyst/wip-41700-nautilus
Nathan Cutler [Wed, 2 Oct 2019 10:22:04 +0000 (12:22 +0200)]
Merge pull request #30322 from theanalyst/wip-41700-nautilus

nautilus: build/ops: install-deps.sh: install `python*-devel` for python*rpm-macros

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #30245 from smithfarm/wip-41711-nautilus
Nathan Cutler [Wed, 2 Oct 2019 10:00:34 +0000 (12:00 +0200)]
Merge pull request #30245 from smithfarm/wip-41711-nautilus

nautilus: doc/ceph-kvstore-tool: add description for 'stats' command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agodoc: fix urls in posix.rst 30686/head
Jos Collin [Thu, 25 Jul 2019 04:33:12 +0000 (10:03 +0530)]
doc: fix urls in posix.rst

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit c5c5f031f77f778af73f8659b01695b88f158807)

5 years agoMerge pull request #30664 from smithfarm/wip-42105-nautilus
Nathan Cutler [Wed, 2 Oct 2019 09:35:29 +0000 (11:35 +0200)]
Merge pull request #30664 from smithfarm/wip-42105-nautilus

nautilus: build/ops: admin/build-doc: use python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30004 from smithfarm/wip-41568-nautilus
Nathan Cutler [Wed, 2 Oct 2019 09:08:54 +0000 (11:08 +0200)]
Merge pull request #30004 from smithfarm/wip-41568-nautilus

nautilus: doc: pg_num should always be a power of two

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30003 from smithfarm/wip-41529-nautilus
Nathan Cutler [Wed, 2 Oct 2019 09:06:51 +0000 (11:06 +0200)]
Merge pull request #30003 from smithfarm/wip-41529-nautilus

nautilus: doc: default values for mon_health_to_clog_* were flipped

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agorgw: add minssing admin property when sync user info. 30680/head
zhang Shaowen [Wed, 4 Sep 2019 06:46:13 +0000 (14:46 +0800)]
rgw: add minssing admin property when sync user info.

Fixes: https://tracker.ceph.com/issues/41643
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
(cherry picked from commit 9ad975d422aba67c0bf7bc1b114079331e2f7fd5)

5 years agoMerge pull request #29731 from pdvian/wip-41081-nautilus
Nathan Cutler [Tue, 1 Oct 2019 16:14:49 +0000 (18:14 +0200)]
Merge pull request #29731 from pdvian/wip-41081-nautilus

nautilus: doc: Fix rbd namespace documentation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
5 years agoadmin/build-doc: use python3 30664/head
Kefu Chai [Wed, 7 Aug 2019 09:46:13 +0000 (17:46 +0800)]
admin/build-doc: use python3

to address https://github.com/sphinx-doc/sphinx/issues/3620, we need to
use sphinx with its fix at
https://github.com/sphinx-doc/sphinx/commit/e049f86b2de1cfdf8a74c88dc9593d047c85d5cb
in other words, we need to use sphinx v2.0.0 and up. but sphinx 2.0
requires python >= 3.5, so we have to use python3 for building the
documents.

in this change:

* doc-requirements.txt: install python3 packages on debian derivatives
* build-doc: install python3.6 packages from EPEL7, and use python3
  venv for using sphinx2
* doc-requirements.txt: bump up all python packages to latest
  stable.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit ace8cb15a600daf5261c0ab349b43010a238a1d9)

5 years agoMerge PR #30025 into nautilus
Patrick Donnelly [Tue, 1 Oct 2019 02:30:19 +0000 (19:30 -0700)]
Merge PR #30025 into nautilus

* refs/pull/30025/head:
doc: cephfs: add section on fsync error reporting to posix.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agorgw: ldap auth: S3 auth failure should return InvalidAccessKeyId 30651/head
Matt Benjamin [Wed, 11 Sep 2019 17:22:26 +0000 (13:22 -0400)]
rgw: ldap auth: S3 auth failure should return InvalidAccessKeyId

LDAP was out of sync with the other auth modules, and the default
error code is not correct for S3.

Fixes: https://tracker.ceph.com/issues/41760
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 226227cf2d825b3414b7522a9f738180142f3956)

5 years agoMerge pull request #30649 from lordcirth/wip-doc-misplaced-ratio
Xie Xingguo [Mon, 30 Sep 2019 23:47:11 +0000 (07:47 +0800)]
Merge pull request #30649 from lordcirth/wip-doc-misplaced-ratio

doc: max_misplaced option was renamed in Nautilus

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agodoc: max_misplaced was renamed in Nautilus 30649/head
Nathan Fish [Mon, 30 Sep 2019 18:31:55 +0000 (14:31 -0400)]
doc: max_misplaced was renamed in Nautilus

mgr/balancer/max_misplaced was changed to target_max_misplaced_ratio
in 14.2.0.

Signed-off-by: Nathan Fish <lordcirth@gmail.com>
5 years agoMerge pull request #30554 from alfredodeza/nautilus-guits-41392
Alfredo Deza [Mon, 30 Sep 2019 12:29:28 +0000 (08:29 -0400)]
Merge pull request #30554 from alfredodeza/nautilus-guits-41392

nautilus ceph-volume: do not fail when trying to remove crypt mapper

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@redhat.com>
5 years agotools/rados: add --pgid in help 30607/head
Vikhyat Umrao [Fri, 13 Sep 2019 23:53:58 +0000 (16:53 -0700)]
tools/rados: add --pgid in help

This commit 825c7b9729b2410a116e123d4b21210c646704d4 brought
the support for --pgid in rados ls but was not in help.
Fixes: https://tracker.ceph.com/issues/41876
Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>
(cherry picked from commit ae9a24eaba330fd3f6946063c2bc926f58c93772)

5 years agotools/rados: call pool_lookup() after rados is connected 30605/head
Vikhyat Umrao [Mon, 16 Sep 2019 19:59:56 +0000 (12:59 -0700)]
tools/rados: call pool_lookup() after rados is connected
This commit fixes a segmentation fault when using --pgid
option in rados ls command in combination with --pool/-p option.
The reason for the crash was that we can not use the rados object
before connecting it with the cluster using rados.init_with_context().

Fixes: https://tracker.ceph.com/issues/41875
Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>
(cherry picked from commit 56b6dd9bd7a50371062128122e6a899f2c79c5f5)

5 years agoradosgw-admin: add --uid check in bucket list command 30604/head
Vikhyat Umrao [Thu, 5 Sep 2019 23:39:51 +0000 (16:39 -0700)]
radosgw-admin: add --uid check in bucket list command
Fixes: https://tracker.ceph.com/issues/41589
Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>
(cherry picked from commit c53597b561837340314f0a169f6881c1814ce0b9)

 Conflicts:
src/rgw/rgw_admin.cc
        - no --new-uid

5 years agoMerge pull request #30049 from smithfarm/wip-41333-nautilus
Nathan Cutler [Thu, 26 Sep 2019 11:13:15 +0000 (13:13 +0200)]
Merge pull request #30049 from smithfarm/wip-41333-nautilus

nautilus: rpm: always build ceph-test package

Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.de>
5 years agobuild-doc: allow building docs on fedora 30
Yuval Lifshitz [Wed, 4 Sep 2019 10:47:00 +0000 (13:47 +0300)]
build-doc: allow building docs on fedora 30

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit e17e4bfcc048abd1757c3efd12c7443169d67477)

5 years agorgw/pubsub: backporting pubsub/notifications to nautilus
Yuval Lifshitz [Wed, 25 Sep 2019 08:00:50 +0000 (11:00 +0300)]
rgw/pubsub: backporting pubsub/notifications to nautilus

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agorgw/pubsub: add notification filtering
Yuval Lifshitz [Tue, 10 Sep 2019 15:53:21 +0000 (18:53 +0300)]
rgw/pubsub: add notification filtering

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 543f8f7a2729ab8bd2e1a14d98a3fd2c2e19f9bd)

5 years agorgw/pubsub: support deletion markers and multipart upload
Yuval Lifshitz [Mon, 2 Sep 2019 16:24:46 +0000 (19:24 +0300)]
rgw/pubsub: support deletion markers and multipart upload

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 923799fd960f97b8ddbbe0e106139069d640588b)

5 years agorgw/pubsub: push notifications documentation
Yuval Lifshitz [Thu, 22 Aug 2019 13:31:01 +0000 (16:31 +0300)]
rgw/pubsub: push notifications documentation

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit c345566831c72446c8250f630337825e526847a8)

5 years agorgw/pubsub: push notifications from ops
Yuval Lifshitz [Mon, 12 Aug 2019 16:48:15 +0000 (19:48 +0300)]
rgw/pubsub: push notifications from ops

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit dc31b030ea30f3b7bfdeb9fa92e303892d17138a)

5 years agorgw/pubsub: allow pubsub REST API on master
Yuval Lifshitz [Mon, 8 Jul 2019 20:00:06 +0000 (23:00 +0300)]
rgw/pubsub: allow pubsub REST API on master

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit a14353496d1f75a303495f538141a1a54ff28c60)

5 years agorgw/pubsub: service reordering issue
Yuval Lifshitz [Sun, 25 Aug 2019 14:12:53 +0000 (17:12 +0300)]
rgw/pubsub: service reordering issue

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit e91489f443b5b086ef96b51051d2726728412ff5)

5 years agorgw/pubsub: fix amqp topic bug. add disabled end2end push tests
Yuval Lifshitz [Tue, 25 Jun 2019 04:44:40 +0000 (07:44 +0300)]
rgw/pubsub: fix amqp topic bug. add disabled end2end push tests

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit abfd6f72db3b6e1a797a660a4a601a33605e5f25)

5 years agorgw/pubsub: fix duplicates due to multiple zone synching
Yuval Lifshitz [Mon, 24 Jun 2019 19:24:17 +0000 (22:24 +0300)]
rgw/pubsub: fix duplicates due to multiple zone synching

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 38c23833b35279cb6e1a9b575b5a463959fed348)

5 years agorgw/pubsub: run pubsub tests even if multisite fails
Yuval Lifshitz [Sun, 23 Jun 2019 14:37:49 +0000 (17:37 +0300)]
rgw/pubsub: run pubsub tests even if multisite fails

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 1df809144c2ed96a715c8bd3df6ed5ef48399dd3)

5 years agorgw/pubsub: make new PSZone parameters optional in test
Yuval Lifshitz [Mon, 10 Jun 2019 06:41:19 +0000 (09:41 +0300)]
rgw/pubsub: make new PSZone parameters optional in test

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 0b6909c1e9832d7a6f375f38f32bed58d1e161c2)

5 years agorgw/pubsub: add conf parameter for full/incremental sync
Yuval Lifshitz [Fri, 7 Jun 2019 07:47:45 +0000 (10:47 +0300)]
rgw/pubsub: add conf parameter for full/incremental sync

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit af4c2d5dbb42170ade4ad78088b80b0b5a357c5a)

5 years agorgw: add tenant as parameter to User in multisite tests
Yuval Lifshitz [Sun, 5 May 2019 17:54:31 +0000 (20:54 +0300)]
rgw: add tenant as parameter to User in multisite tests

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 4def929395bce39e9a130d0e8740790815a6a503)

5 years agorgw/pubsub: revert the RGWSysObjectCtx change
Yuval Lifshitz [Mon, 6 May 2019 20:08:48 +0000 (23:08 +0300)]
rgw/pubsub: revert the RGWSysObjectCtx change

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 10b8b57d723971604cbabf984291232c194a55ec)

5 years agorgw/pubsub: cleanup tests for multiple notifications
Yuval Lifshitz [Sun, 5 May 2019 08:31:20 +0000 (11:31 +0300)]
rgw/pubsub: cleanup tests for multiple notifications

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit b4005db82da1627a03d96baa45081fbb329070b1)

5 years agorgw/pubsub: fix doc on updates. attempt to fix multi-notifications
Yuval Lifshitz [Thu, 2 May 2019 17:33:34 +0000 (20:33 +0300)]
rgw/pubsub: fix doc on updates. attempt to fix multi-notifications

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 3279a786ba0abc9d1955f03eaa5f94da0d12ed22)

5 years agorgw/pubsub: fix more test issues with teuthology failures
Yuval Lifshitz [Thu, 2 May 2019 15:51:59 +0000 (18:51 +0300)]
rgw/pubsub: fix more test issues with teuthology failures

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 51fc8a40e3484bcc16244723b091ba7f3157abfb)

5 years agorgw/pubsub: fix test issue with 3 zones
Yuval Lifshitz [Thu, 2 May 2019 07:15:00 +0000 (10:15 +0300)]
rgw/pubsub: fix test issue with 3 zones

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 83e5571c873a6f459aaf9a7c42a532339ed2a1b3)

5 years agorgw/pubsub: add another zone for pubsub
Yuval Lifshitz [Tue, 30 Apr 2019 08:51:16 +0000 (11:51 +0300)]
rgw/pubsub: add another zone for pubsub

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit d8d817a6006e38b52f922b714870c32b9a76a169)

5 years agorgw/pubsub: make sure bucket is empty before deletion
Yuval Lifshitz [Mon, 29 Apr 2019 07:33:06 +0000 (10:33 +0300)]
rgw/pubsub: make sure bucket is empty before deletion

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 588e0c0e23f66eb35a056ad110404a97fa219a15)

5 years agorgw/pubsub: fix "no module named rgw_multi.zone_ps"
Yuval Lifshitz [Wed, 17 Apr 2019 08:02:51 +0000 (11:02 +0300)]
rgw/pubsub: fix "no module named rgw_multi.zone_ps"

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit dfa501cfb77e72fe3e4cb2454aea99916705b812)

5 years agorgw/pubsub: fix "no module named rgw_multi.tests"
Yuval Lifshitz [Tue, 16 Apr 2019 11:44:57 +0000 (14:44 +0300)]
rgw/pubsub: fix "no module named rgw_multi.tests"

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit b03a56fe930be0ff7bad4e375e22a8e2ca0fed76)

5 years agorgw/pubsub: actually adding the ps tests
Yuval Lifshitz [Mon, 15 Apr 2019 11:19:45 +0000 (14:19 +0300)]
rgw/pubsub: actually adding the ps tests

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 8362ecc7dfd8056567b74fdaaa52809082f15421)

5 years agorgw/pubsub: fix popping the wrong key
Yuval Lifshitz [Mon, 15 Apr 2019 06:01:03 +0000 (09:01 +0300)]
rgw/pubsub: fix popping the wrong key

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 2d7c07bbeb9887d76b89eded7458ac7af8068026)

5 years agorgw/pubsub: fix topic arn. tenant support to multisite tests
Yuval Lifshitz [Thu, 18 Apr 2019 08:21:26 +0000 (11:21 +0300)]
rgw/pubsub: fix topic arn. tenant support to multisite tests

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit be64adf916e0f318b22b57cedd02c2b0b2a503f2)

5 years agorgw/pubsub: handle subscription conf errors better
Yuval Lifshitz [Thu, 11 Apr 2019 17:16:52 +0000 (20:16 +0300)]
rgw/pubsub: handle subscription conf errors better

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit f4e3745bcb9f75814b4052e2b651c25a39c2f17b)

5 years agorgw/pubsub: more info on notification deletion compatibility
Yuval Lifshitz [Thu, 11 Apr 2019 09:23:17 +0000 (12:23 +0300)]
rgw/pubsub: more info on notification deletion compatibility

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit 2cf1872bdf63e9093884b6d3bbc20b9a42963d53)

5 years agorgw/pubsub: fix comments from PR #27493
Yuval Lifshitz [Wed, 10 Apr 2019 16:32:02 +0000 (19:32 +0300)]
rgw/pubsub: fix comments from PR #27493

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit cb256dd92ac39baddce252acb634b587653da4f3)

5 years agorgw/pubsub: clarify pubsub zone configuration
Yuval Lifshitz [Wed, 10 Apr 2019 12:38:35 +0000 (15:38 +0300)]
rgw/pubsub: clarify pubsub zone configuration

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit 89ddc407b48959831450638f14929f553511d240)

5 years agorgw/pubsub: wrong link in S3 doc
Yuval Lifshitz [Wed, 3 Apr 2019 11:27:49 +0000 (14:27 +0300)]
rgw/pubsub: wrong link in S3 doc

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 98e6a0434609d7b29d61166276419eca1d552ad0)

5 years agorgw/pubsub: fix documentation link errors
Yuval Lifshitz [Wed, 3 Apr 2019 10:29:47 +0000 (13:29 +0300)]
rgw/pubsub: fix documentation link errors

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit dc904249a00aacecf9a06a26223b5b2d5c46ace2)

5 years agorgw/pubsub: fix comments from PR #27091
Yuval Lifshitz [Tue, 2 Apr 2019 16:27:21 +0000 (19:27 +0300)]
rgw/pubsub: fix comments from PR #27091

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit a0b43fa26c9ba1bebe6553c84fd98fad3a3d28ad)

5 years agorgw/pubsub: add more S3 compatibility documentation
Yuval Lifshitz [Tue, 2 Apr 2019 11:46:27 +0000 (14:46 +0300)]
rgw/pubsub: add more S3 compatibility documentation

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit e1e39d627ec9a044f9f7428400dd379350fc4bbb)

5 years agorgw/pubsub: test and doc bucket deletion impact on notifications
Yuval Lifshitz [Mon, 1 Apr 2019 09:28:11 +0000 (12:28 +0300)]
rgw/pubsub: test and doc bucket deletion impact on notifications

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit cb6e894937098999e4eb7d2c13c2f180329f2432)

5 years agorgw/pubsub: avoid static creation of amqp manager
Yuval Lifshitz [Sun, 31 Mar 2019 19:52:27 +0000 (22:52 +0300)]
rgw/pubsub: avoid static creation of amqp manager

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 376a3df0d12b544a0378a1467fcf4b2c32fd8afa)

5 years agorgw/pubsub: add s3-compatible API documentation
Yuval Lifshitz [Sun, 31 Mar 2019 08:34:05 +0000 (11:34 +0300)]
rgw/pubsub: add s3-compatible API documentation

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 9fd0f873188532c7552f087f65c5b279eb1fc3ca)

5 years agorgw/pubsub: allow for endpoint definition via topics
Yuval Lifshitz [Wed, 27 Mar 2019 15:47:18 +0000 (17:47 +0200)]
rgw/pubsub: allow for endpoint definition via topics

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 8ac119fdd50b6306e4b338e3f0b4731818c6e6c8)

5 years agorgw/pubsub: implement S3 compatible get/delete APIs
Yuval Lifshitz [Wed, 20 Mar 2019 16:43:36 +0000 (18:43 +0200)]
rgw/pubsub: implement S3 compatible get/delete APIs

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 0f8671b3a13af2713fed51f15c83cca8ef19dd19)

5 years agorgw: pubsub support s3 records. refactor ARN
Yuval Lifshitz [Wed, 13 Mar 2019 17:54:16 +0000 (19:54 +0200)]
rgw: pubsub support s3 records. refactor ARN

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 2bd353233112ead32181b94a2af1b04e3fa9e1de)

5 years agoceph-volume: do not fail when trying to remove crypt mapper 30554/head
Guillaume Abrioux [Fri, 20 Sep 2019 12:57:58 +0000 (14:57 +0200)]
ceph-volume: do not fail when trying to remove crypt mapper

In a containerized context, at some point, need to run `simple scan` on a device
from a separate container (not the existing and running corresponding container
to that device), but this can't work because when it tries to remove the
mapper which is still in use by the corresponding running osd container,
it fails.
This can be a bit more permissive and simply throw a warning.

Closes: https://tracker.ceph.com/issues/41392
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
(cherry picked from commit 80d3e4ca054b4d1334c2fb99fede46ab54ca4305)

5 years agorgw/pubsub: initial version of S3 compliant API
Yuval Lifshitz [Wed, 27 Feb 2019 17:13:08 +0000 (19:13 +0200)]
rgw/pubsub: initial version of S3 compliant API

(cherry picked from commit 2e94f4d1cecb5164bc646fb6b088dd197f878263)
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoMerge pull request #30304 from alfredodeza/nautilus-ceph-volume-zap-fix
Alfredo Deza [Mon, 23 Sep 2019 19:02:21 +0000 (15:02 -0400)]
Merge pull request #30304 from alfredodeza/nautilus-ceph-volume-zap-fix

nautilus ceph-volume lvm.zap fix cleanup for db partitions

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoMerge pull request #30520 from smithfarm/wip-41956-nautilus
Alfredo Deza [Mon, 23 Sep 2019 18:50:33 +0000 (14:50 -0400)]
Merge pull request #30520 from smithfarm/wip-41956-nautilus

nautilus: ceph-volume: systemd fix typo in log message

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoceph-volume: systemd fix typo in log message 30520/head
Manu Zurmühl [Fri, 20 Sep 2019 14:47:22 +0000 (16:47 +0200)]
ceph-volume: systemd fix typo in log message

Fixes: https://tracker.ceph.com/issues/41942
Signed-off-by: Manu Zurmühl <m.zurmuehl@heinlein-support.de>
(cherry picked from commit 8d9780ce50ef5d986c4994ed6ba5629be0bbfb74)

5 years agoMerge PR #29926 into nautilus
Patrick Donnelly [Mon, 23 Sep 2019 12:15:19 +0000 (05:15 -0700)]
Merge PR #29926 into nautilus

* refs/pull/29926/head:
mgr/volumes: return string type to ceph-manager
qa/tasks: test for prevent negative subvolume size
mgr/volumes: prevent negative subvolume size
mgr/volumes: drop unnecessary size
mgr/volumes: cleanup FS subvolume or subvolume group path
mgr/volumes: give useful error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agorgw: fix data sync start delay if remote haven't init data_log 30509/head
Tianshan Qu [Mon, 16 Sep 2019 05:59:31 +0000 (13:59 +0800)]
rgw: fix data sync start delay if remote haven't init data_log

Fixes: https://tracker.ceph.com/issues/41839
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
(cherry picked from commit 339344ab1928ea805f55368b854ade35efcecf08)

5 years agomgr/volumes: return string type to ceph-manager 29926/head
Venky Shankar [Tue, 17 Sep 2019 19:01:59 +0000 (15:01 -0400)]
mgr/volumes: return string type to ceph-manager

The 'volumes' ceph-mgr module returns a byte type instead of a string
type as the stdout result of commands, `fs subvolume getpath` and
`fs subvolumegroup getpath` to the ceph-mgr. This causes the commands
to hang and the ceph-mgr to utilize 100% CPU. Fix the 'volumes'
ceph-mgr module to return string type to ceph-mgr as the stdout
result of the commands.

Introduced-by: 3d63cd947f55a8508f972ee249ea6a04836429ae
Fixes: https://tracker.ceph.com/issues/41903
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 88aa0576a63c5b2e8d4478951b4f594fb5047b52)

5 years agoqa/tasks: test for prevent negative subvolume size
Jos Collin [Fri, 6 Sep 2019 06:10:17 +0000 (11:40 +0530)]
qa/tasks: test for prevent negative subvolume size

Fixes: https://tracker.ceph.com/issues/41617
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 9c6be9586166c3092aabefbfcd3f48e81e3d32af)

5 years agomgr/volumes: prevent negative subvolume size
Jos Collin [Sun, 1 Sep 2019 16:07:21 +0000 (21:37 +0530)]
mgr/volumes: prevent negative subvolume size

Fixes: https://tracker.ceph.com/issues/41617
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 8a1249626b56f345e20f1a7058aa70da9fb82576)

5 years agomgr/volumes: drop unnecessary size
Jos Collin [Thu, 5 Sep 2019 13:48:23 +0000 (19:18 +0530)]
mgr/volumes: drop unnecessary size

Fixes: https://tracker.ceph.com/issues/41752
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 6c4154b1bbdb9deeb0420a604def43e9f52aa4a0)

5 years agomgr/volumes: cleanup FS subvolume or subvolume group path
Ramana Raja [Wed, 21 Aug 2019 09:41:47 +0000 (15:11 +0530)]
mgr/volumes: cleanup FS subvolume or subvolume group path

... on best effort basis when FS subvolume or subvolumegroup create
command fails.

Fixes: https://tracker.ceph.com/issues/41371
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit ecf53a3527ed7561ddceeed75ed4aef1daf8230d)

5 years agomgr/volumes: give useful error message
Ramana Raja [Tue, 20 Aug 2019 10:55:11 +0000 (16:25 +0530)]
mgr/volumes: give useful error message

... when creating FS subvolume or subvolume group with invalid
data pool layout.

Fixes: https://tracker.ceph.com/issues/41337
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit cbe48308e9e6b7e1b673e11101fd7e1403f52019)

5 years agorgw: fix memory growth while deleteing objects with 30472/head
Mark Kogan [Thu, 5 Sep 2019 09:32:50 +0000 (12:32 +0300)]
rgw: fix memory growth while deleteing objects with
radosgw-admin bucket rm --bucket=$BIG_BUCKET --bypass-gc --purge-objects
by freeing <rgw_obj, RGWObjState> map elements allocated at
https://github.com/ceph/ceph/blob/master/src/rgw/rgw_rados.cc#L236
  result = &objs_state[obj];

Fixes: https://tracker.ceph.com/issues/40700
Signed-off-by: Mark Kogan <mkogan@redhat.com>
(cherry picked from commit 21560ed2e141137bbcb4d871eb3908d293a83948)

5 years agoMerge pull request #29487 from rhcs-dashboard/nautilus-run-dashboard-api-tests
Nathan Cutler [Wed, 18 Sep 2019 12:51:25 +0000 (14:51 +0200)]
Merge pull request #29487 from rhcs-dashboard/nautilus-run-dashboard-api-tests

nautilus: mgr/dashboard: run-backend-api-tests.sh improvements

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agorgw: increase beast parse buffer size to 64k 30437/head
Casey Bodley [Tue, 20 Aug 2019 17:18:45 +0000 (13:18 -0400)]
rgw: increase beast parse buffer size to 64k

the flat_buffer starts very small and rarely grew above 512 bytes when
reading headers. this buffer's capacity() is what determines the size of
reads when when recv_body() calls boost::beast::http::async_read_some().
raising this buffer size to a static 64k greatly reduces the number of
socket reads

Reported-by: Marcus Watts <mwatts@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f13c6914eba9ad05c7bcff6eda81bb858f0f2349)

Conflicts:
src/rgw/rgw_asio_frontend.cc