]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agodoc: releases/luminous: release notes for 12.2.12
Abhishek Lekshmanan [Fri, 12 Apr 2019 13:21:46 +0000 (15:21 +0200)]
doc: releases/luminous: release notes for 12.2.12

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge PR #27473 into master
Sage Weil [Fri, 12 Apr 2019 11:57:03 +0000 (06:57 -0500)]
Merge PR #27473 into master

* refs/pull/27473/head:
mgr/DaemonServer: prevent pgp_num reductions from outpacing pg_num merges

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #27477 into master
Sage Weil [Fri, 12 Apr 2019 11:56:45 +0000 (06:56 -0500)]
Merge PR #27477 into master

* refs/pull/27477/head:
os/bluestore: check return value of func _open_db_and_around.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge PR #27499 into master
Sage Weil [Fri, 12 Apr 2019 11:54:58 +0000 (06:54 -0500)]
Merge PR #27499 into master

* refs/pull/27499/head:
qa/standalone/osd/osd-markdown: fix dup command disabling

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #27516 into master
Sage Weil [Fri, 12 Apr 2019 11:54:35 +0000 (06:54 -0500)]
Merge PR #27516 into master

* refs/pull/27516/head:
mgr/rook: Fix Python 2 regression

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Gabriel Brascher <gabriel@apache.org>
6 years agoMerge pull request #26816 from iotcg/doc
Kefu Chai [Fri, 12 Apr 2019 09:59:07 +0000 (17:59 +0800)]
Merge pull request #26816 from iotcg/doc

doc: correct example to use vstart to run up cluster

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27535 from yuriw/wip-yuriw-wip-yuriw-crontab-master
Yuri Weinstein [Fri, 12 Apr 2019 02:17:36 +0000 (19:17 -0700)]
Merge pull request #27535 from yuriw/wip-yuriw-wip-yuriw-crontab-master

qa/tests: added rados on master, reduced fs, rbd, multimds

6 years agoMerge pull request #27428 from cyx1231st/wip-seastar-msgr-write
Kefu Chai [Fri, 12 Apr 2019 01:07:53 +0000 (09:07 +0800)]
Merge pull request #27428 from cyx1231st/wip-seastar-msgr-write

crimson/net: extract do_write_dispatch_sweep()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoqa/tests: added rados on master, reduced fs, rbd, multimds 27535/head
Yuri Weinstein [Fri, 12 Apr 2019 00:46:44 +0000 (17:46 -0700)]
qa/tests: added rados on master, reduced fs, rbd, multimds

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #27515 from tchaikov/wip-seastar-fix-monc
Kefu Chai [Fri, 12 Apr 2019 00:31:12 +0000 (08:31 +0800)]
Merge pull request #27515 from tchaikov/wip-seastar-fix-monc

test/crimson: fix build of unittest_seastar_monc

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #27524 from tchaikov/wip-39164
Kefu Chai [Fri, 12 Apr 2019 00:16:51 +0000 (08:16 +0800)]
Merge pull request #27524 from tchaikov/wip-39164

install-deps.sh: install '*rpm-macros'

Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #27443 from Polynomial-C/tinfo
Jason Dillaman [Thu, 11 Apr 2019 18:32:15 +0000 (14:32 -0400)]
Merge pull request #27443 from Polynomial-C/tinfo

cmake: Fix build against ncurses with separate libtinfo

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27527 into master
Sage Weil [Thu, 11 Apr 2019 18:30:33 +0000 (13:30 -0500)]
Merge PR #27527 into master

* refs/pull/27527/head:
qa/tests: run luminous-x and mimic-x 2 times a week but with high priority

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoqa/tests: run luminous-x and mimic-x 2 times a week but with high priority 27527/head
Yuri Weinstein [Thu, 11 Apr 2019 16:25:23 +0000 (09:25 -0700)]
qa/tests: run luminous-x and mimic-x 2 times a week but with high priority
hope is it will help with locking 5 nodes for tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge PR #27345 into master
Patrick Donnelly [Thu, 11 Apr 2019 16:18:15 +0000 (09:18 -0700)]
Merge PR #27345 into master

* refs/pull/27345/head:
cephfs-shell: Change type of d_name to bytes array
cephfs-shell: Revert "cephfs.pyx: add py3 compatibility"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoinstall-deps.sh: install '*rpm-macros' 27524/head
Kefu Chai [Thu, 11 Apr 2019 16:11:42 +0000 (00:11 +0800)]
install-deps.sh: install '*rpm-macros'

so `yum-builddep` can have access to the latest macros for preparing the
build dependencies

Fixes: http://tracker.ceph.com/issues/39164
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27504 from tchaikov/wip-qa-use-python36-for-py3-tests
Kefu Chai [Thu, 11 Apr 2019 15:16:58 +0000 (23:16 +0800)]
Merge pull request #27504 from tchaikov/wip-qa-use-python36-for-py3-tests

qa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agomgr/rook: Fix Python 2 regression 27516/head
Sebastian Wagner [Thu, 11 Apr 2019 13:32:13 +0000 (15:32 +0200)]
mgr/rook: Fix Python 2 regression

Fixes: http://tracker.ceph.com/issues/39250
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge PR #27323 into master
Sage Weil [Thu, 11 Apr 2019 13:36:00 +0000 (08:36 -0500)]
Merge PR #27323 into master

* refs/pull/27323/head:
msg/async: avoid creating unnecessary AsyncConnectionRef

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27444 from ifed01/wip-ifed-fix-21312
Kefu Chai [Thu, 11 Apr 2019 13:33:36 +0000 (21:33 +0800)]
Merge pull request #27444 from ifed01/wip-ifed-fix-21312

os/bluestore: call fault_range prior to looking for blob to reuse

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27445 from ifed01/wip-ifed-fix-39143
Kefu Chai [Thu, 11 Apr 2019 13:24:20 +0000 (21:24 +0800)]
Merge pull request #27445 from ifed01/wip-ifed-fix-39143

os/ceph-bluestore-tool: bluefs-bdev-expand asserts if no WAL

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agocrimson: add move ctor for CephContext and mon::Client 27515/head
Kefu Chai [Thu, 11 Apr 2019 13:03:54 +0000 (21:03 +0800)]
crimson: add move ctor for CephContext and mon::Client

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agotest/crimson: add dummy_auth_handler to test_monc
Yingxin Cheng [Wed, 10 Apr 2019 09:42:31 +0000 (17:42 +0800)]
test/crimson: add dummy_auth_handler to test_monc

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agoMerge pull request #27438 from Devp00l/wip-issue-37701
Lenz Grimmer [Thu, 11 Apr 2019 10:58:47 +0000 (12:58 +0200)]
Merge pull request #27438 from Devp00l/wip-issue-37701

mgr/dashboard: Removes distracting search behavior

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #27348 from Devp00l/wip-issue-39086
Lenz Grimmer [Thu, 11 Apr 2019 09:04:33 +0000 (11:04 +0200)]
Merge pull request #27348 from Devp00l/wip-issue-39086

mgr/dashboard: Enable read only users to read again

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agocmake: Fix build against ncurses with separate libtinfo 27443/head
Lars Wendler [Mon, 8 Apr 2019 14:34:53 +0000 (16:34 +0200)]
cmake: Fix build against ncurses with separate libtinfo

Signed-off-by: Lars Wendler <polynomial-c@gentoo.org>
6 years agocephfs-shell: Change type of d_name to bytes array 27345/head
Varsha Rao [Thu, 11 Apr 2019 07:07:46 +0000 (12:37 +0530)]
cephfs-shell: Change type of d_name to bytes array

By reverting commit 5106582 'd_name' is always a bytes array. This produces
type error wherever 'd_name' is used with 'str' type. In such cases decode it.

Fixes: https://tracker.ceph.com/issues/39060
Signed-off-by: Varsha Rao <varao@redhat.com>
6 years agocephfs-shell: Revert "cephfs.pyx: add py3 compatibility"
Varsha Rao [Thu, 11 Apr 2019 07:03:12 +0000 (12:33 +0530)]
cephfs-shell: Revert "cephfs.pyx: add py3 compatibility"

This reverts commit 5106582fc7edae7f39161cf89e566c020fcfa0ce.

Signed-off-by: Varsha Rao <varao@redhat.com>
6 years agoqa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests 27504/head
Kefu Chai [Thu, 11 Apr 2019 02:02:32 +0000 (10:02 +0800)]
qa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests

EPEL7 has switched over to python3.6 as the main python3. and we started
packaging python bindings for python3.6 since
https://github.com/ceph/ceph-build/pull/1283

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27495 into master
Sage Weil [Wed, 10 Apr 2019 22:41:49 +0000 (17:41 -0500)]
Merge PR #27495 into master

* refs/pull/27495/head:
doc/releases/nautilus: fix config update step

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa/standalone/osd/osd-markdown: fix dup command disabling 27499/head
Sage Weil [Wed, 10 Apr 2019 21:44:38 +0000 (16:44 -0500)]
qa/standalone/osd/osd-markdown: fix dup command disabling

The ceph cli tool checks for the presence of the variable, not its value.

Fixes: http://tracker.ceph.com/issues/38359
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agodoc/releases/nautilus: fix config update step 27495/head
Sage Weil [Wed, 10 Apr 2019 16:25:11 +0000 (11:25 -0500)]
doc/releases/nautilus: fix config update step

'ceph ... > /etc/ceph/ceph.conf' fails because bash truncates ceph.conf
before the ceph cli invocation is able to use it to connect to the cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27290 from sebastian-philipp/rook-system-namespace
Sebastian Wagner [Wed, 10 Apr 2019 13:20:40 +0000 (15:20 +0200)]
Merge pull request #27290 from sebastian-philipp/rook-system-namespace

mgr/rook: Support other system namespaces

Reviewed-by: Blaine Gardner <blaine.gardner@suse.com>
Reviewed-by: Rohan Gupta <rohanrgupta1996@gmail.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
6 years agoMerge pull request #27408 from nathan-weinberg/reformat
Lenz Grimmer [Wed, 10 Apr 2019 12:56:08 +0000 (14:56 +0200)]
Merge pull request #27408 from nathan-weinberg/reformat

mgr/dashboard: Updated existing E2E tests to match new format

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge PR #27490 into master
Sage Weil [Wed, 10 Apr 2019 12:27:27 +0000 (07:27 -0500)]
Merge PR #27490 into master

* refs/pull/27490/head:
PendingReleaseNotes: note on python3.6 changes

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoPendingReleaseNotes: note on python3.6 changes 27490/head
Kefu Chai [Wed, 10 Apr 2019 10:08:04 +0000 (18:08 +0800)]
PendingReleaseNotes: note on python3.6 changes

Fixes: http://tracker.ceph.com/issues/39164
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27406 from rhcs-dashboard/fix-39125-master
Ricardo Marques [Wed, 10 Apr 2019 09:53:27 +0000 (10:53 +0100)]
Merge pull request #27406 from rhcs-dashboard/fix-39125-master

mgr/dashboard: Add whitelist to guard

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #27289 from sebastian-philipp/rook-fix-osd-create
Sebastian Wagner [Wed, 10 Apr 2019 08:50:22 +0000 (10:50 +0200)]
Merge pull request #27289 from sebastian-philipp/rook-fix-osd-create

mgr/rook: Fix creation of bluestore OSDs

Reviewed-by: Blaine Gardner <blaine.gardner@suse.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
6 years agoos/bluestore: check return value of func _open_db_and_around. 27477/head
Jianpeng Ma [Wed, 10 Apr 2019 03:17:03 +0000 (11:17 +0800)]
os/bluestore: check return value of func _open_db_and_around.

In develop, met the following error messages:

2019-04-08 10:24:54.259 7faa25114d80  1 bdev create path /var/lib/ceph/mnt/osd-device-6-data/block.db type kernel
2019-04-08 10:24:54.259 7faa25114d80  1 bdev(0x55ef0840ce00 /var/lib/ceph/mnt/osd-device-6-data/block.db) open path /var/lib/ceph/mnt/osd-device-6-data/block.db
2019-04-08 10:24:54.259 7faa25114d80 -1 bdev(0x55ef0840ce00 /var/lib/ceph/mnt/osd-device-6-data/block.db) _lock flock failed on /var/lib/ceph/mnt/osd-device-6-data/block.db
2019-04-08 10:24:54.259 7faa25114d80 -1 bdev(0x55ef0840ce00 /var/lib/ceph/mnt/osd-device-6-data/block.db) open failed to lock /var/lib/ceph/mnt/osd-device-6-data/block.db: (11) Resource temporarily unavailable
2019-04-08 10:24:54.259 7faa25114d80 -1 bluestore(/var/lib/ceph/mnt/osd-device-6-data) _minimal_open_bluefs add block device(/var/lib/ceph/mnt/osd-device-6-data/block.db) returned: (11) Resource temporarily unavailable
2019-04-08 10:24:54.259 7faa25114d80  1 fbmap_alloc 0x55ef0754ef00 shutdown
2019-04-08 10:24:54.259 7faa25114d80  1 freelist shutdown
2019-04-08 10:24:54.259 7faa25114d80  1 bluestore(/var/lib/ceph/mnt/osd-device-6-data) _upgrade_super from 2, latest 2
2019-04-08 10:24:54.259 7faa25114d80  1 bluestore(/var/lib/ceph/mnt/osd-device-6-data) _upgrade_super done
2019-04-08 10:24:54.264 7faa25114d80 -1 *** Caught signal (Segmentation fault) **
 in thread 7faa25114d80 thread_name:ceph-osd

 ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable)
 1: (()+0xf5d0) [0x7faa21d655d0]
 2: (BlueStore::_open_collections(int*)+0x5b) [0x55eefd1f511b]
 3: (BlueStore::_mount(bool, bool)+0x6c6) [0x55eefd22d1c6]
 4: (OSD::init()+0x3aa) [0x55eefcda4e4a]
 5: (main()+0x14fa) [0x55eefcc4137a]
 6: (__libc_start_main()+0xf5) [0x7faa20b483d5]
 7: (()+0x5646c5) [0x55eefcd356c5]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
6 years agomgr/DaemonServer: prevent pgp_num reductions from outpacing pg_num merges 27473/head
Sage Weil [Tue, 9 Apr 2019 22:12:37 +0000 (17:12 -0500)]
mgr/DaemonServer: prevent pgp_num reductions from outpacing pg_num merges

If we are merging lots of pgs down to a much smaller number of pgs, and
the pgs are able to move quickly (faster than the merges happen), we can
end up with too many pgs on a small number of osds, triggering the max
pgs per osd limits.

Avoid this by preventing the pgp_num reductions from getting too far
out in front of the merges themselves.  Basically, cap the delta between
pgp_num and pg_num to the max_misplaced ratio.  We are already limiting
the movement caused by pgp_num by max_misplaced; this effectively just
makes sure that the actual merging (and pg_num reductions) are keeping
up.

Fixes: http://tracker.ceph.com/issues/38786
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27464 into master
Sage Weil [Tue, 9 Apr 2019 18:49:42 +0000 (13:49 -0500)]
Merge PR #27464 into master

* refs/pull/27464/head:
msg/async/frames_v2.h: fix warning

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #27357 from dillaman/wip-39021
Mykola Golub [Tue, 9 Apr 2019 17:34:16 +0000 (20:34 +0300)]
Merge pull request #27357 from dillaman/wip-39021

librbd: fixed several race conditions related to copyup

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #27466 from wjwithagen/wjw-fix-/src/test/rgw/CMakeLists.txt
Casey Bodley [Tue, 9 Apr 2019 17:03:15 +0000 (13:03 -0400)]
Merge pull request #27466 from wjwithagen/wjw-fix-/src/test/rgw/CMakeLists.txt

build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27468 from tchaikov/wip-rpm-python3
Boris Ranto [Tue, 9 Apr 2019 16:53:07 +0000 (18:53 +0200)]
Merge pull request #27468 from tchaikov/wip-rpm-python3

rpm: add "Provides: python3-*" for python packages and cleanup

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agorpm: add "Provides: python3-*" for python packages 27468/head
Kefu Chai [Tue, 9 Apr 2019 15:22:57 +0000 (23:22 +0800)]
rpm: add "Provides: python3-*" for python packages

so user can install python3-rados, instead of python36-rados, without
specifying the minor version of python. also, we should not break our
teuthology tests with this naming scheme change. for instance, our
cephfs qa suite installs `python3-cephfs` for testing the `cephfs-shell`

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27309 from pritha-srivastava/wip-rgw-non-existent-object
Casey Bodley [Tue, 9 Apr 2019 16:02:36 +0000 (12:02 -0400)]
Merge pull request #27309 from pritha-srivastava/wip-rgw-non-existent-object

rgw: Evaluating bucket policies also while reading permissions for an…

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
6 years agorpm: always use 3 as the default python3_{pkgversion,version}
Kefu Chai [Tue, 9 Apr 2019 15:15:16 +0000 (23:15 +0800)]
rpm: always use 3 as the default python3_{pkgversion,version}

as we have the rpm macros installed in
https://github.com/ceph/ceph-build/pull/1283 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agobuild/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES 27466/head
Willem Jan Withagen [Tue, 9 Apr 2019 14:49:09 +0000 (16:49 +0200)]
build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES

Redo fix, also see #26799

Otherwise linking could error like:
```
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyUnicodeUCS4_FromEncodedObject'
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyNumber_InPlaceDivide'
........
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyStaticMethod_Type'
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyTuple_Size'
c++: error: linker command failed with exit code 1 (use -v to see invocation)
gmake[2]: *** [src/test/rgw/CMakeFiles/unittest_rgw_dmclock_scheduler.dir/build.make:147: bin/unittest_rgw_dmclock_scheduler] Error 1
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agocrimson/net: extract do_write_dispatch_sweep() 27428/head
Yingxin Cheng [Mon, 8 Apr 2019 11:51:04 +0000 (19:51 +0800)]
crimson/net: extract do_write_dispatch_sweep()

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agomsg/async/frames_v2.h: fix warning 27464/head
Sage Weil [Tue, 9 Apr 2019 14:31:24 +0000 (09:31 -0500)]
msg/async/frames_v2.h: fix warning

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27455 from wjwithagen/wjw-fix-test_weighted_shuffle.cc
Kefu Chai [Tue, 9 Apr 2019 14:29:55 +0000 (22:29 +0800)]
Merge pull request #27455 from wjwithagen/wjw-fix-test_weighted_shuffle.cc

test: Add `#include <array>`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27431 from sebastian-philipp/rook-doc-update-mon
Sebastian Wagner [Tue, 9 Apr 2019 14:19:53 +0000 (16:19 +0200)]
Merge pull request #27431 from sebastian-philipp/rook-doc-update-mon

doc/mgr/orchestrator_cli: Rook orch supports mon update

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
6 years agoMerge pull request #25985 from l-vo/update_php_doc
Casey Bodley [Tue, 9 Apr 2019 13:40:42 +0000 (09:40 -0400)]
Merge pull request #25985 from l-vo/update_php_doc

doc/radosgw: update documentation examples with the current S3 PHP client

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
6 years agoMerge PR #27051 into master
Patrick Donnelly [Tue, 9 Apr 2019 13:18:26 +0000 (06:18 -0700)]
Merge PR #27051 into master

* refs/pull/27051/head:
mds: open import bounding dirfrags in batch
mds: remove superfluous error in StrayManager::advance_delayed()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27412 into master
Patrick Donnelly [Tue, 9 Apr 2019 13:17:26 +0000 (06:17 -0700)]
Merge PR #27412 into master

* refs/pull/27412/head:
doc: add doc for blacklisting older CephFS clients

Reviewed-by: Barbora Ančincová <bara@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge pull request #27194 from trociny/wip-38661
Jason Dillaman [Tue, 9 Apr 2019 12:58:50 +0000 (08:58 -0400)]
Merge pull request #27194 from trociny/wip-38661

librbd: do not allow to deep copy migrating image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27268 from trociny/wip-38364
Jason Dillaman [Tue, 9 Apr 2019 12:57:53 +0000 (08:57 -0400)]
Merge pull request #27268 from trociny/wip-38364

librbd: support EC data pool images sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/dashboard: Enable read only users to read again 27348/head
Stephan Müller [Wed, 3 Apr 2019 14:13:54 +0000 (16:13 +0200)]
mgr/dashboard: Enable read only users to read again

The dashboards Prometheus receiver API needed to receive a POST from the
frontend, but POSTs aren't allowed by default by any read only
users. As a result the receiver API call had thrown a 403 error which
redirected the user to the 403 error page. Now you can get the last
notifications via GET. This prevents the redirection for read only
users, as a result they can get the last notifications and also
see all other allowed pages again.

Fixes: https://tracker.ceph.com/issues/39086
Signed-off-by: Stephan Müller <smueller@suse.com>
6 years agoMerge pull request #27452 from tchaikov/wip-crimson-auth-server
Kefu Chai [Tue, 9 Apr 2019 11:16:50 +0000 (19:16 +0800)]
Merge pull request #27452 from tchaikov/wip-crimson-auth-server

crimson: move dummy impl of AuthServer to DummyAuth

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agomgr/dashboard: Add whitelist to guard 27406/head
Ernesto Puerta [Fri, 5 Apr 2019 16:22:30 +0000 (18:22 +0200)]
mgr/dashboard: Add whitelist to guard

After PR https://github.com/ceph/ceph/pull/26572, when RGW is not
  configured, accessing /rgw drop-down (daemons, users or buckets)
  results in nothing apparently happening (not even an error).

  Under the curtains, what is happening is that the ModuleStatusGuard
  has redirected the route to the rgw/501, but as this route is now
  under parent rgw route handler, which sets CanActivateChild guards,
  this results in a new ModuleStatusGuard invokation, a subsequent
  failure and a new redirection to rgw/501.

  Several approaches could be taken here:
  - Remove error pages from lazy-loaded modules. Probably it does not
  make sense to have a 501 page per component.
  - Add some whitelist to avoid this kind of loop (e.g.: 501, or any
      error page).
  - Set a max number of redirections (cautionary measure).

Fixes: https://tracker.ceph.com/issues/39125
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
6 years agomgr/rook: Support other system namespaces 27290/head
Sebastian Wagner [Mon, 1 Apr 2019 13:25:33 +0000 (15:25 +0200)]
mgr/rook: Support other system namespaces

Fixes http://tracker.ceph.com/issues/38799

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agotest: Add includefile for arrays 27455/head
Willem Jan Withagen [Tue, 9 Apr 2019 09:24:49 +0000 (11:24 +0200)]
test: Add includefile for arrays

Otherwise Clang will complain on FreeBSD:
```
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:9:23: error: implicit instantiation of undefined template 'std::__1::array<char, 5>'
  std::array<char, 5> choices{'a', 'b', 'c', 'd', 'e'};
                      ^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
                                                               ^
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:10:22: error: implicit instantiation of undefined template 'std::__1::array<int, 5>'
  std::array<int, 5> weights{100, 50, 25, 10, 1};
                     ^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agocrimson/mon: implement AuthServer methods 27452/head
Kefu Chai [Tue, 9 Apr 2019 06:36:45 +0000 (14:36 +0800)]
crimson/mon: implement AuthServer methods

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/auth: move dummy impl of AuthServer to DummyAuth
Kefu Chai [Tue, 9 Apr 2019 06:35:24 +0000 (14:35 +0800)]
crimson/auth: move dummy impl of AuthServer to DummyAuth

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27416 from tchaikov/wip-crimson-auth
Kefu Chai [Tue, 9 Apr 2019 03:39:28 +0000 (11:39 +0800)]
Merge pull request #27416 from tchaikov/wip-crimson-auth

crimson: update osd when peer gets authenticated

Reviewed-by: Samuel Just <sjust@redhat.com>
6 years agocrimson: update osd when peer gets authenticated 27416/head
Kefu Chai [Sat, 6 Apr 2019 13:00:59 +0000 (21:00 +0800)]
crimson: update osd when peer gets authenticated

* common/auth_handler.h: add an abstract class of AuthHandler, the one who is interested in
  an authenticated peer should implement this class
* mon/MonClient: let mon::Client implement AuthServer, as it has access the keyring. it
  will update the registered AuthHandler if the client (peer) is
  authenticated.
* osd: implement AuthHandler class. we will keep track of the connected
  sessions along their caps in a follow-up change.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27426 from tchaikov/wip-crimson-setup-msgr
Kefu Chai [Tue, 9 Apr 2019 03:31:19 +0000 (11:31 +0800)]
Merge pull request #27426 from tchaikov/wip-crimson-setup-msgr

crimson/osd: consolidate the code to initialize msgrs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #27286 from tchaikov/wip-strncpy-with-nul
Kefu Chai [Tue, 9 Apr 2019 03:30:05 +0000 (11:30 +0800)]
Merge pull request #27286 from tchaikov/wip-strncpy-with-nul

osdc/Objecter: always add `\0' after strncpy()

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #27429 from cyx1231st/wip-seastar-msgr-perf2
Kefu Chai [Tue, 9 Apr 2019 03:27:52 +0000 (11:27 +0800)]
Merge pull request #27429 from cyx1231st/wip-seastar-msgr-perf2

test/crimson: include writes in perf_crimson/async_server

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agotest/crimson: wrap perf parameters as structured data 27429/head
Yingxin Cheng [Mon, 8 Apr 2019 08:49:46 +0000 (16:49 +0800)]
test/crimson: wrap perf parameters as structured data

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agotest/crimson: perf_crimson/async_server write test support
Yingxin Cheng [Thu, 4 Apr 2019 13:18:00 +0000 (21:18 +0800)]
test/crimson: perf_crimson/async_server write test support

Allow server to have write/send workload with specified block size.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agoMerge pull request #27422 from iotcg/doc_pg
Xie Xingguo [Tue, 9 Apr 2019 00:58:41 +0000 (08:58 +0800)]
Merge pull request #27422 from iotcg/doc_pg

doc: fix parameter to set pg autoscale mode

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27427 into master
Patrick Donnelly [Tue, 9 Apr 2019 00:09:45 +0000 (17:09 -0700)]
Merge PR #27427 into master

* refs/pull/27427/head:
cephfs-shell: Use colorama module instead of colorize

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27369 into master
Patrick Donnelly [Mon, 8 Apr 2019 23:16:06 +0000 (16:16 -0700)]
Merge PR #27369 into master

* refs/pull/27369/head:
docs: Add note to execute cephfs-shell

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27256 into master
Patrick Donnelly [Mon, 8 Apr 2019 23:13:00 +0000 (16:13 -0700)]
Merge PR #27256 into master

* refs/pull/27256/head:
mds: drop reconnect message from non-existent session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agoMerge PR #27214 into master
Patrick Donnelly [Mon, 8 Apr 2019 23:11:51 +0000 (16:11 -0700)]
Merge PR #27214 into master

* refs/pull/27214/head:
mds/server: check directory split after rename.

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agomsg/async: avoid creating unnecessary AsyncConnectionRef 27323/head
Patrick Donnelly [Wed, 20 Mar 2019 19:03:14 +0000 (12:03 -0700)]
msg/async: avoid creating unnecessary AsyncConnectionRef

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27415 into master
Patrick Donnelly [Mon, 8 Apr 2019 22:41:48 +0000 (15:41 -0700)]
Merge PR #27415 into master

* refs/pull/27415/head:
qa: decouple session map test from simple msgr
msg/async: move connection ref
msg/async: dec active connections when marked down

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27414 into master
Patrick Donnelly [Mon, 8 Apr 2019 22:21:42 +0000 (15:21 -0700)]
Merge PR #27414 into master

* refs/pull/27414/head:
msg/async: resolve gcc warning

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoqa: decouple session map test from simple msgr 27415/head
Patrick Donnelly [Fri, 5 Apr 2019 23:06:22 +0000 (16:06 -0700)]
qa: decouple session map test from simple msgr

Instead of looking at the number of threads (used by the simple messenger) to
judge the coming and going of connections, use the (async) messenger perf
counters.

Plus some other minor improvements.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomsg/async: move connection ref
Patrick Donnelly [Fri, 5 Apr 2019 23:05:42 +0000 (16:05 -0700)]
msg/async: move connection ref

Trivial optimization.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomsg/async: dec active connections when marked down
Patrick Donnelly [Fri, 5 Apr 2019 23:04:14 +0000 (16:04 -0700)]
msg/async: dec active connections when marked down

Otherwise, tests can't tell when a connection is stopped until it's eventually
"lazily" deleted. This should be safe since the perf counter is manipulating an
atomic value.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoos/ceph-bluestore-tool: bluefs-bdev-expand asserts if no WAL 27445/head
Igor Fedotov [Mon, 8 Apr 2019 18:24:31 +0000 (21:24 +0300)]
os/ceph-bluestore-tool: bluefs-bdev-expand asserts if no WAL

Fixes: https://tracker.ceph.com/issues/39143
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
6 years agodoc: add doc for blacklisting older CephFS clients 27412/head
Patrick Donnelly [Fri, 5 Apr 2019 21:11:11 +0000 (14:11 -0700)]
doc: add doc for blacklisting older CephFS clients

Fixes: http://tracker.ceph.com/issues/39130
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agolibrbd: force a copyup object map update if migration completes 27357/head
Jason Dillaman [Mon, 8 Apr 2019 17:42:16 +0000 (13:42 -0400)]
librbd: force a copyup object map update if migration completes

If a live-migration copyup was in-progress when the copyup completes,
force the object map to be updated.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: cleaned up snap/parent lock release in read-from-parent path
Jason Dillaman [Thu, 4 Apr 2019 15:23:58 +0000 (11:23 -0400)]
librbd: cleaned up snap/parent lock release in read-from-parent path

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agotest/librbd: initial unit test for copyup state machine
Jason Dillaman [Tue, 2 Apr 2019 18:10:42 +0000 (14:10 -0400)]
test/librbd: initial unit test for copyup state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: copyup should restart delayed ops against the same object
Jason Dillaman [Thu, 4 Apr 2019 01:35:40 +0000 (21:35 -0400)]
librbd: copyup should restart delayed ops against the same object

This avoids the potential for a race condition where an in-flight
copyup is removed from the in-flight copyup list and a subsequent
IO against the same object causes a second in-flight copyup.

Fixes: http://tracker.ceph.com/issues/39021
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: merge copyup object map update states
Jason Dillaman [Tue, 2 Apr 2019 15:51:36 +0000 (11:51 -0400)]
librbd: merge copyup object map update states

The object map HEAD and HEAD/snapshot update states have been
simplified and merged into a single state. This also fixes
several potential race conditions and an issue where CoR might
incorrectly mark the HEAD object has exists+dirty.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: refactor copyup state machine to match current code style
Jason Dillaman [Fri, 29 Mar 2019 18:17:15 +0000 (14:17 -0400)]
librbd: refactor copyup state machine to match current code style

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: properly hold snap/parent locks during IO
Jason Dillaman [Fri, 29 Mar 2019 17:23:37 +0000 (13:23 -0400)]
librbd: properly hold snap/parent locks during IO

The ImageCtx::parent pointer was dereferenced without holding the lock
which could lead to a crash. The ImageCtx::migration_info structure
was also dereferenced without holding a lock.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: empty IO requests should complete in new context
Jason Dillaman [Tue, 2 Apr 2019 19:33:00 +0000 (15:33 -0400)]
librbd: empty IO requests should complete in new context

This will avoid the possibility of a lock being held by the caller
and having the IO immediately complete back to the calling state
machine.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: deep-copy object copy should register an in-flight op
Jason Dillaman [Mon, 1 Apr 2019 18:48:47 +0000 (14:48 -0400)]
librbd: deep-copy object copy should register an in-flight op

When handling live migrations, the source image is the parent
image of the destination image. To prevent the parent image from
being closed while a request is in-flight, the object copy
state machine now registers an async operation with the source
image.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: deep-copy object copy should delay computing object existence
Jason Dillaman [Fri, 29 Mar 2019 20:33:21 +0000 (16:33 -0400)]
librbd: deep-copy object copy should delay computing object existence

This prevent a potential recursive lock on the destination image's
snap_lock.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoos/bluestore: call fault_range properly prior to looking for blob to reuse 27444/head
Igor Fedotov [Mon, 8 Apr 2019 16:41:55 +0000 (19:41 +0300)]
os/bluestore: call fault_range properly prior to looking for blob to reuse

Fixes: https://tracker.ceph.com/issues/21312
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge PR #27281 into master
Patrick Donnelly [Mon, 8 Apr 2019 16:35:43 +0000 (09:35 -0700)]
Merge PR #27281 into master

* refs/pull/27281/head:
script/ceph-release-notes: alternate merge commit format

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #26782 from iotcg/master
Kefu Chai [Mon, 8 Apr 2019 16:32:46 +0000 (00:32 +0800)]
Merge pull request #26782 from iotcg/master

vstart.sh: fix CEPH_PORT check and cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27437 into master
Patrick Donnelly [Mon, 8 Apr 2019 16:26:01 +0000 (09:26 -0700)]
Merge PR #27437 into master

* refs/pull/27437/head:
vstart: add an alias for cephfs-shell to vstart_environment.sh

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27419 into master
Sage Weil [Mon, 8 Apr 2019 15:17:50 +0000 (10:17 -0500)]
Merge PR #27419 into master

* refs/pull/27419/head:
common: add --log-early command line option

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27091 from yuvalif/s2_pubsub_api_new
Yuval Lifshitz [Mon, 8 Apr 2019 14:31:40 +0000 (17:31 +0300)]
Merge pull request #27091 from yuvalif/s2_pubsub_api_new

S3 compatible pubsub API