]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Abhishek Lekshmanan [Fri, 12 Apr 2019 13:21:46 +0000 (15:21 +0200)]
doc: releases/luminous: release notes for 12.2.12
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Sage Weil [Fri, 12 Apr 2019 11:57:03 +0000 (06:57 -0500)]
Merge PR #27473 into master
* refs/pull/27473/head:
mgr/DaemonServer: prevent pgp_num reductions from outpacing pg_num merges
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Sage Weil [Fri, 12 Apr 2019 11:56:45 +0000 (06:56 -0500)]
Merge PR #27477 into master
* refs/pull/27477/head:
os/bluestore: check return value of func _open_db_and_around.
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Sage Weil [Fri, 12 Apr 2019 11:54:58 +0000 (06:54 -0500)]
Merge PR #27499 into master
* refs/pull/27499/head:
qa/standalone/osd/osd-markdown: fix dup command disabling
Reviewed-by: Neha Ojha <nojha@redhat.com>
Sage Weil [Fri, 12 Apr 2019 11:54:35 +0000 (06:54 -0500)]
Merge PR #27516 into master
* refs/pull/27516/head:
mgr/rook: Fix Python 2 regression
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Gabriel Brascher <gabriel@apache.org>
Kefu Chai [Fri, 12 Apr 2019 09:59:07 +0000 (17:59 +0800)]
Merge pull request #26816 from iotcg/doc
doc: correct example to use vstart to run up cluster
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuri Weinstein [Fri, 12 Apr 2019 02:17:36 +0000 (19:17 -0700)]
Merge pull request #27535 from yuriw/wip-yuriw-wip-yuriw-crontab-master
qa/tests: added rados on master, reduced fs, rbd, multimds
Kefu Chai [Fri, 12 Apr 2019 01:07:53 +0000 (09:07 +0800)]
Merge pull request #27428 from cyx1231st/wip-seastar-msgr-write
crimson/net: extract do_write_dispatch_sweep()
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Yuri Weinstein [Fri, 12 Apr 2019 00:46:44 +0000 (17:46 -0700)]
qa/tests: added rados on master, reduced fs, rbd, multimds
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
Kefu Chai [Fri, 12 Apr 2019 00:31:12 +0000 (08:31 +0800)]
Merge pull request #27515 from tchaikov/wip-seastar-fix-monc
test/crimson: fix build of unittest_seastar_monc
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Fri, 12 Apr 2019 00:16:51 +0000 (08:16 +0800)]
Merge pull request #27524 from tchaikov/wip-39164
install-deps.sh: install '*rpm-macros'
Reviewed-by: Boris Ranto <branto@redhat.com>
Jason Dillaman [Thu, 11 Apr 2019 18:32:15 +0000 (14:32 -0400)]
Merge pull request #27443 from Polynomial-C/tinfo
cmake: Fix build against ncurses with separate libtinfo
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Sage Weil [Thu, 11 Apr 2019 18:30:33 +0000 (13:30 -0500)]
Merge PR #27527 into master
* refs/pull/27527/head:
qa/tests: run luminous-x and mimic-x 2 times a week but with high priority
Reviewed-by: Sage Weil <sage@redhat.com>
Yuri Weinstein [Thu, 11 Apr 2019 16:25:23 +0000 (09:25 -0700)]
qa/tests: run luminous-x and mimic-x 2 times a week but with high priority
hope is it will help with locking 5 nodes for tests
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
Patrick Donnelly [Thu, 11 Apr 2019 16:18:15 +0000 (09:18 -0700)]
Merge PR #27345 into master
* refs/pull/27345/head:
cephfs-shell: Change type of d_name to bytes array
cephfs-shell: Revert "cephfs.pyx: add py3 compatibility"
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Kefu Chai [Thu, 11 Apr 2019 16:11:42 +0000 (00:11 +0800)]
install-deps.sh: install '*rpm-macros'
so `yum-builddep` can have access to the latest macros for preparing the
build dependencies
Fixes: http://tracker.ceph.com/issues/39164
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Thu, 11 Apr 2019 15:16:58 +0000 (23:16 +0800)]
Merge pull request #27504 from tchaikov/wip-qa-use-python36-for-py3-tests
qa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Sebastian Wagner [Thu, 11 Apr 2019 13:32:13 +0000 (15:32 +0200)]
mgr/rook: Fix Python 2 regression
Fixes: http://tracker.ceph.com/issues/39250
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
Sage Weil [Thu, 11 Apr 2019 13:36:00 +0000 (08:36 -0500)]
Merge PR #27323 into master
* refs/pull/27323/head:
msg/async: avoid creating unnecessary AsyncConnectionRef
Reviewed-by: Sage Weil <sage@redhat.com>
Kefu Chai [Thu, 11 Apr 2019 13:33:36 +0000 (21:33 +0800)]
Merge pull request #27444 from ifed01/wip-ifed-fix-21312
os/bluestore: call fault_range prior to looking for blob to reuse
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Kefu Chai [Thu, 11 Apr 2019 13:24:20 +0000 (21:24 +0800)]
Merge pull request #27445 from ifed01/wip-ifed-fix-39143
os/ceph-bluestore-tool: bluefs-bdev-expand asserts if no WAL
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
Kefu Chai [Thu, 11 Apr 2019 13:03:54 +0000 (21:03 +0800)]
crimson: add move ctor for CephContext and mon::Client
Signed-off-by: Kefu Chai <kchai@redhat.com>
Yingxin Cheng [Wed, 10 Apr 2019 09:42:31 +0000 (17:42 +0800)]
test/crimson: add dummy_auth_handler to test_monc
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
Lenz Grimmer [Thu, 11 Apr 2019 10:58:47 +0000 (12:58 +0200)]
Merge pull request #27438 from Devp00l/wip-issue-37701
mgr/dashboard: Removes distracting search behavior
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Lenz Grimmer [Thu, 11 Apr 2019 09:04:33 +0000 (11:04 +0200)]
Merge pull request #27348 from Devp00l/wip-issue-39086
mgr/dashboard: Enable read only users to read again
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Lars Wendler [Mon, 8 Apr 2019 14:34:53 +0000 (16:34 +0200)]
cmake: Fix build against ncurses with separate libtinfo
Signed-off-by: Lars Wendler <polynomial-c@gentoo.org>
Varsha Rao [Thu, 11 Apr 2019 07:07:46 +0000 (12:37 +0530)]
cephfs-shell: Change type of d_name to bytes array
By reverting commit
5106582 'd_name' is always a bytes array. This produces
type error wherever 'd_name' is used with 'str' type. In such cases decode it.
Fixes: https://tracker.ceph.com/issues/39060
Signed-off-by: Varsha Rao <varao@redhat.com>
Varsha Rao [Thu, 11 Apr 2019 07:03:12 +0000 (12:33 +0530)]
cephfs-shell: Revert "cephfs.pyx: add py3 compatibility"
This reverts commit
5106582fc7edae7f39161cf89e566c020fcfa0ce .
Signed-off-by: Varsha Rao <varao@redhat.com>
Kefu Chai [Thu, 11 Apr 2019 02:02:32 +0000 (10:02 +0800)]
qa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests
EPEL7 has switched over to python3.6 as the main python3. and we started
packaging python bindings for python3.6 since
https://github.com/ceph/ceph-build/pull/1283
Signed-off-by: Kefu Chai <kchai@redhat.com>
Sage Weil [Wed, 10 Apr 2019 22:41:49 +0000 (17:41 -0500)]
Merge PR #27495 into master
* refs/pull/27495/head:
doc/releases/nautilus: fix config update step
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Sage Weil [Wed, 10 Apr 2019 21:44:38 +0000 (16:44 -0500)]
qa/standalone/osd/osd-markdown: fix dup command disabling
The ceph cli tool checks for the presence of the variable, not its value.
Fixes: http://tracker.ceph.com/issues/38359
Signed-off-by: Sage Weil <sage@redhat.com>
Sage Weil [Wed, 10 Apr 2019 16:25:11 +0000 (11:25 -0500)]
doc/releases/nautilus: fix config update step
'ceph ... > /etc/ceph/ceph.conf' fails because bash truncates ceph.conf
before the ceph cli invocation is able to use it to connect to the cluster.
Signed-off-by: Sage Weil <sage@redhat.com>
Sebastian Wagner [Wed, 10 Apr 2019 13:20:40 +0000 (15:20 +0200)]
Merge pull request #27290 from sebastian-philipp/rook-system-namespace
mgr/rook: Support other system namespaces
Reviewed-by: Blaine Gardner <blaine.gardner@suse.com>
Reviewed-by: Rohan Gupta <rohanrgupta1996@gmail.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
Lenz Grimmer [Wed, 10 Apr 2019 12:56:08 +0000 (14:56 +0200)]
Merge pull request #27408 from nathan-weinberg/reformat
mgr/dashboard: Updated existing E2E tests to match new format
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Sage Weil [Wed, 10 Apr 2019 12:27:27 +0000 (07:27 -0500)]
Merge PR #27490 into master
* refs/pull/27490/head:
PendingReleaseNotes: note on python3.6 changes
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Kefu Chai [Wed, 10 Apr 2019 10:08:04 +0000 (18:08 +0800)]
PendingReleaseNotes: note on python3.6 changes
Fixes: http://tracker.ceph.com/issues/39164
Signed-off-by: Kefu Chai <kchai@redhat.com>
Ricardo Marques [Wed, 10 Apr 2019 09:53:27 +0000 (10:53 +0100)]
Merge pull request #27406 from rhcs-dashboard/fix-39125-master
mgr/dashboard: Add whitelist to guard
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Sebastian Wagner [Wed, 10 Apr 2019 08:50:22 +0000 (10:50 +0200)]
Merge pull request #27289 from sebastian-philipp/rook-fix-osd-create
mgr/rook: Fix creation of bluestore OSDs
Reviewed-by: Blaine Gardner <blaine.gardner@suse.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
Jianpeng Ma [Wed, 10 Apr 2019 03:17:03 +0000 (11:17 +0800)]
os/bluestore: check return value of func _open_db_and_around.
In develop, met the following error messages:
2019-04-08 10:24:54.259
7faa25114d80 1 bdev create path /var/lib/ceph/mnt/osd-device-6-data/block.db type kernel
2019-04-08 10:24:54.259
7faa25114d80 1 bdev(0x55ef0840ce00 /var/lib/ceph/mnt/osd-device-6-data/block.db) open path /var/lib/ceph/mnt/osd-device-6-data/block.db
2019-04-08 10:24:54.259
7faa25114d80 -1 bdev(0x55ef0840ce00 /var/lib/ceph/mnt/osd-device-6-data/block.db) _lock flock failed on /var/lib/ceph/mnt/osd-device-6-data/block.db
2019-04-08 10:24:54.259
7faa25114d80 -1 bdev(0x55ef0840ce00 /var/lib/ceph/mnt/osd-device-6-data/block.db) open failed to lock /var/lib/ceph/mnt/osd-device-6-data/block.db: (11) Resource temporarily unavailable
2019-04-08 10:24:54.259
7faa25114d80 -1 bluestore(/var/lib/ceph/mnt/osd-device-6-data) _minimal_open_bluefs add block device(/var/lib/ceph/mnt/osd-device-6-data/block.db) returned: (11) Resource temporarily unavailable
2019-04-08 10:24:54.259
7faa25114d80 1 fbmap_alloc 0x55ef0754ef00 shutdown
2019-04-08 10:24:54.259
7faa25114d80 1 freelist shutdown
2019-04-08 10:24:54.259
7faa25114d80 1 bluestore(/var/lib/ceph/mnt/osd-device-6-data) _upgrade_super from 2, latest 2
2019-04-08 10:24:54.259
7faa25114d80 1 bluestore(/var/lib/ceph/mnt/osd-device-6-data) _upgrade_super done
2019-04-08 10:24:54.264
7faa25114d80 -1 *** Caught signal (Segmentation fault) **
in thread
7faa25114d80 thread_name:ceph-osd
ceph version 14.2.0 (
3a54b2b6d167d4a2a19e003a705696d4fe619afc ) nautilus (stable)
1: (()+0xf5d0) [0x7faa21d655d0]
2: (BlueStore::_open_collections(int*)+0x5b) [0x55eefd1f511b]
3: (BlueStore::_mount(bool, bool)+0x6c6) [0x55eefd22d1c6]
4: (OSD::init()+0x3aa) [0x55eefcda4e4a]
5: (main()+0x14fa) [0x55eefcc4137a]
6: (__libc_start_main()+0xf5) [0x7faa20b483d5]
7: (()+0x5646c5) [0x55eefcd356c5]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
Sage Weil [Tue, 9 Apr 2019 22:12:37 +0000 (17:12 -0500)]
mgr/DaemonServer: prevent pgp_num reductions from outpacing pg_num merges
If we are merging lots of pgs down to a much smaller number of pgs, and
the pgs are able to move quickly (faster than the merges happen), we can
end up with too many pgs on a small number of osds, triggering the max
pgs per osd limits.
Avoid this by preventing the pgp_num reductions from getting too far
out in front of the merges themselves. Basically, cap the delta between
pgp_num and pg_num to the max_misplaced ratio. We are already limiting
the movement caused by pgp_num by max_misplaced; this effectively just
makes sure that the actual merging (and pg_num reductions) are keeping
up.
Fixes: http://tracker.ceph.com/issues/38786
Signed-off-by: Sage Weil <sage@redhat.com>
Sage Weil [Tue, 9 Apr 2019 18:49:42 +0000 (13:49 -0500)]
Merge PR #27464 into master
* refs/pull/27464/head:
msg/async/frames_v2.h: fix warning
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Mykola Golub [Tue, 9 Apr 2019 17:34:16 +0000 (20:34 +0300)]
Merge pull request #27357 from dillaman/wip-39021
librbd: fixed several race conditions related to copyup
Reviewed-by: Mykola Golub <mgolub@suse.com>
Casey Bodley [Tue, 9 Apr 2019 17:03:15 +0000 (13:03 -0400)]
Merge pull request #27466 from wjwithagen/wjw-fix-/src/test/rgw/CMakeLists.txt
build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Boris Ranto [Tue, 9 Apr 2019 16:53:07 +0000 (18:53 +0200)]
Merge pull request #27468 from tchaikov/wip-rpm-python3
rpm: add "Provides: python3-*" for python packages and cleanup
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 15:22:57 +0000 (23:22 +0800)]
rpm: add "Provides: python3-*" for python packages
so user can install python3-rados, instead of python36-rados, without
specifying the minor version of python. also, we should not break our
teuthology tests with this naming scheme change. for instance, our
cephfs qa suite installs `python3-cephfs` for testing the `cephfs-shell`
Signed-off-by: Kefu Chai <kchai@redhat.com>
Casey Bodley [Tue, 9 Apr 2019 16:02:36 +0000 (12:02 -0400)]
Merge pull request #27309 from pritha-srivastava/wip-rgw-non-existent-object
rgw: Evaluating bucket policies also while reading permissions for an…
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 15:15:16 +0000 (23:15 +0800)]
rpm: always use 3 as the default python3_{pkgversion,version}
as we have the rpm macros installed in
https://github.com/ceph/ceph-build/pull/1283 .
Signed-off-by: Kefu Chai <kchai@redhat.com>
Willem Jan Withagen [Tue, 9 Apr 2019 14:49:09 +0000 (16:49 +0200)]
build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES
Redo fix, also see #26799
Otherwise linking could error like:
```
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyUnicodeUCS4_FromEncodedObject'
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyNumber_InPlaceDivide'
........
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyStaticMethod_Type'
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyTuple_Size'
c++: error: linker command failed with exit code 1 (use -v to see invocation)
gmake[2]: *** [src/test/rgw/CMakeFiles/unittest_rgw_dmclock_scheduler.dir/build.make:147: bin/unittest_rgw_dmclock_scheduler] Error 1
```
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
Yingxin Cheng [Mon, 8 Apr 2019 11:51:04 +0000 (19:51 +0800)]
crimson/net: extract do_write_dispatch_sweep()
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
Sage Weil [Tue, 9 Apr 2019 14:31:24 +0000 (09:31 -0500)]
msg/async/frames_v2.h: fix warning
Signed-off-by: Sage Weil <sage@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 14:29:55 +0000 (22:29 +0800)]
Merge pull request #27455 from wjwithagen/wjw-fix-test_weighted_shuffle.cc
test: Add `#include <array>`
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Sebastian Wagner [Tue, 9 Apr 2019 14:19:53 +0000 (16:19 +0200)]
Merge pull request #27431 from sebastian-philipp/rook-doc-update-mon
doc/mgr/orchestrator_cli: Rook orch supports mon update
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Casey Bodley [Tue, 9 Apr 2019 13:40:42 +0000 (09:40 -0400)]
Merge pull request #25985 from l-vo/update_php_doc
doc/radosgw: update documentation examples with the current S3 PHP client
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Patrick Donnelly [Tue, 9 Apr 2019 13:18:26 +0000 (06:18 -0700)]
Merge PR #27051 into master
* refs/pull/27051/head:
mds: open import bounding dirfrags in batch
mds: remove superfluous error in StrayManager::advance_delayed()
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 9 Apr 2019 13:17:26 +0000 (06:17 -0700)]
Merge PR #27412 into master
* refs/pull/27412/head:
doc: add doc for blacklisting older CephFS clients
Reviewed-by: Barbora Ančincová <bara@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Jason Dillaman [Tue, 9 Apr 2019 12:58:50 +0000 (08:58 -0400)]
Merge pull request #27194 from trociny/wip-38661
librbd: do not allow to deep copy migrating image
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Tue, 9 Apr 2019 12:57:53 +0000 (08:57 -0400)]
Merge pull request #27268 from trociny/wip-38364
librbd: support EC data pool images sparsify
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Stephan Müller [Wed, 3 Apr 2019 14:13:54 +0000 (16:13 +0200)]
mgr/dashboard: Enable read only users to read again
The dashboards Prometheus receiver API needed to receive a POST from the
frontend, but POSTs aren't allowed by default by any read only
users. As a result the receiver API call had thrown a 403 error which
redirected the user to the 403 error page. Now you can get the last
notifications via GET. This prevents the redirection for read only
users, as a result they can get the last notifications and also
see all other allowed pages again.
Fixes: https://tracker.ceph.com/issues/39086
Signed-off-by: Stephan Müller <smueller@suse.com>
Kefu Chai [Tue, 9 Apr 2019 11:16:50 +0000 (19:16 +0800)]
Merge pull request #27452 from tchaikov/wip-crimson-auth-server
crimson: move dummy impl of AuthServer to DummyAuth
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Ernesto Puerta [Fri, 5 Apr 2019 16:22:30 +0000 (18:22 +0200)]
mgr/dashboard: Add whitelist to guard
After PR https://github.com/ceph/ceph/pull/26572, when RGW is not
configured, accessing /rgw drop-down (daemons, users or buckets)
results in nothing apparently happening (not even an error).
Under the curtains, what is happening is that the ModuleStatusGuard
has redirected the route to the rgw/501, but as this route is now
under parent rgw route handler, which sets CanActivateChild guards,
this results in a new ModuleStatusGuard invokation, a subsequent
failure and a new redirection to rgw/501.
Several approaches could be taken here:
- Remove error pages from lazy-loaded modules. Probably it does not
make sense to have a 501 page per component.
- Add some whitelist to avoid this kind of loop (e.g.: 501, or any
error page).
- Set a max number of redirections (cautionary measure).
Fixes: https://tracker.ceph.com/issues/39125
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
Sebastian Wagner [Mon, 1 Apr 2019 13:25:33 +0000 (15:25 +0200)]
mgr/rook: Support other system namespaces
Fixes http://tracker.ceph.com/issues/38799
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
Willem Jan Withagen [Tue, 9 Apr 2019 09:24:49 +0000 (11:24 +0200)]
test: Add includefile for arrays
Otherwise Clang will complain on FreeBSD:
```
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:9:23: error: implicit instantiation of undefined template 'std::__1::array<char, 5>'
std::array<char, 5> choices{'a', 'b', 'c', 'd', 'e'};
^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
^
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:10:22: error: implicit instantiation of undefined template 'std::__1::array<int, 5>'
std::array<int, 5> weights{100, 50, 25, 10, 1};
^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
```
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
Kefu Chai [Tue, 9 Apr 2019 06:36:45 +0000 (14:36 +0800)]
crimson/mon: implement AuthServer methods
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 06:35:24 +0000 (14:35 +0800)]
crimson/auth: move dummy impl of AuthServer to DummyAuth
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 03:39:28 +0000 (11:39 +0800)]
Merge pull request #27416 from tchaikov/wip-crimson-auth
crimson: update osd when peer gets authenticated
Reviewed-by: Samuel Just <sjust@redhat.com>
Kefu Chai [Sat, 6 Apr 2019 13:00:59 +0000 (21:00 +0800)]
crimson: update osd when peer gets authenticated
* common/auth_handler.h: add an abstract class of AuthHandler, the one who is interested in
an authenticated peer should implement this class
* mon/MonClient: let mon::Client implement AuthServer, as it has access the keyring. it
will update the registered AuthHandler if the client (peer) is
authenticated.
* osd: implement AuthHandler class. we will keep track of the connected
sessions along their caps in a follow-up change.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 03:31:19 +0000 (11:31 +0800)]
Merge pull request #27426 from tchaikov/wip-crimson-setup-msgr
crimson/osd: consolidate the code to initialize msgrs
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 03:30:05 +0000 (11:30 +0800)]
Merge pull request #27286 from tchaikov/wip-strncpy-with-nul
osdc/Objecter: always add `\0' after strncpy()
Reviewed-by: David Zafman <dzafman@redhat.com>
Kefu Chai [Tue, 9 Apr 2019 03:27:52 +0000 (11:27 +0800)]
Merge pull request #27429 from cyx1231st/wip-seastar-msgr-perf2
test/crimson: include writes in perf_crimson/async_server
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yingxin Cheng [Mon, 8 Apr 2019 08:49:46 +0000 (16:49 +0800)]
test/crimson: wrap perf parameters as structured data
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
Yingxin Cheng [Thu, 4 Apr 2019 13:18:00 +0000 (21:18 +0800)]
test/crimson: perf_crimson/async_server write test support
Allow server to have write/send workload with specified block size.
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
Xie Xingguo [Tue, 9 Apr 2019 00:58:41 +0000 (08:58 +0800)]
Merge pull request #27422 from iotcg/doc_pg
doc: fix parameter to set pg autoscale mode
Reviewed-by: Sage Weil <sage@redhat.com>
Patrick Donnelly [Tue, 9 Apr 2019 00:09:45 +0000 (17:09 -0700)]
Merge PR #27427 into master
* refs/pull/27427/head:
cephfs-shell: Use colorama module instead of colorize
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 8 Apr 2019 23:16:06 +0000 (16:16 -0700)]
Merge PR #27369 into master
* refs/pull/27369/head:
docs: Add note to execute cephfs-shell
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 8 Apr 2019 23:13:00 +0000 (16:13 -0700)]
Merge PR #27256 into master
* refs/pull/27256/head:
mds: drop reconnect message from non-existent session
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Patrick Donnelly [Mon, 8 Apr 2019 23:11:51 +0000 (16:11 -0700)]
Merge PR #27214 into master
* refs/pull/27214/head:
mds/server: check directory split after rename.
Reviewed-by: Zheng Yan <zyan@redhat.com>
Patrick Donnelly [Wed, 20 Mar 2019 19:03:14 +0000 (12:03 -0700)]
msg/async: avoid creating unnecessary AsyncConnectionRef
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 8 Apr 2019 22:41:48 +0000 (15:41 -0700)]
Merge PR #27415 into master
* refs/pull/27415/head:
qa: decouple session map test from simple msgr
msg/async: move connection ref
msg/async: dec active connections when marked down
Reviewed-by: Sage Weil <sage@redhat.com>
Patrick Donnelly [Mon, 8 Apr 2019 22:21:42 +0000 (15:21 -0700)]
Merge PR #27414 into master
* refs/pull/27414/head:
msg/async: resolve gcc warning
Reviewed-by: Ricardo Dias <rdias@suse.com>
Patrick Donnelly [Fri, 5 Apr 2019 23:06:22 +0000 (16:06 -0700)]
qa: decouple session map test from simple msgr
Instead of looking at the number of threads (used by the simple messenger) to
judge the coming and going of connections, use the (async) messenger perf
counters.
Plus some other minor improvements.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Fri, 5 Apr 2019 23:05:42 +0000 (16:05 -0700)]
msg/async: move connection ref
Trivial optimization.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Fri, 5 Apr 2019 23:04:14 +0000 (16:04 -0700)]
msg/async: dec active connections when marked down
Otherwise, tests can't tell when a connection is stopped until it's eventually
"lazily" deleted. This should be safe since the perf counter is manipulating an
atomic value.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Igor Fedotov [Mon, 8 Apr 2019 18:24:31 +0000 (21:24 +0300)]
os/ceph-bluestore-tool: bluefs-bdev-expand asserts if no WAL
Fixes: https://tracker.ceph.com/issues/39143
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
Patrick Donnelly [Fri, 5 Apr 2019 21:11:11 +0000 (14:11 -0700)]
doc: add doc for blacklisting older CephFS clients
Fixes: http://tracker.ceph.com/issues/39130
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Jason Dillaman [Mon, 8 Apr 2019 17:42:16 +0000 (13:42 -0400)]
librbd: force a copyup object map update if migration completes
If a live-migration copyup was in-progress when the copyup completes,
force the object map to be updated.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Thu, 4 Apr 2019 15:23:58 +0000 (11:23 -0400)]
librbd: cleaned up snap/parent lock release in read-from-parent path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Tue, 2 Apr 2019 18:10:42 +0000 (14:10 -0400)]
test/librbd: initial unit test for copyup state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Thu, 4 Apr 2019 01:35:40 +0000 (21:35 -0400)]
librbd: copyup should restart delayed ops against the same object
This avoids the potential for a race condition where an in-flight
copyup is removed from the in-flight copyup list and a subsequent
IO against the same object causes a second in-flight copyup.
Fixes: http://tracker.ceph.com/issues/39021
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Tue, 2 Apr 2019 15:51:36 +0000 (11:51 -0400)]
librbd: merge copyup object map update states
The object map HEAD and HEAD/snapshot update states have been
simplified and merged into a single state. This also fixes
several potential race conditions and an issue where CoR might
incorrectly mark the HEAD object has exists+dirty.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Fri, 29 Mar 2019 18:17:15 +0000 (14:17 -0400)]
librbd: refactor copyup state machine to match current code style
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Fri, 29 Mar 2019 17:23:37 +0000 (13:23 -0400)]
librbd: properly hold snap/parent locks during IO
The ImageCtx::parent pointer was dereferenced without holding the lock
which could lead to a crash. The ImageCtx::migration_info structure
was also dereferenced without holding a lock.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Tue, 2 Apr 2019 19:33:00 +0000 (15:33 -0400)]
librbd: empty IO requests should complete in new context
This will avoid the possibility of a lock being held by the caller
and having the IO immediately complete back to the calling state
machine.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Mon, 1 Apr 2019 18:48:47 +0000 (14:48 -0400)]
librbd: deep-copy object copy should register an in-flight op
When handling live migrations, the source image is the parent
image of the destination image. To prevent the parent image from
being closed while a request is in-flight, the object copy
state machine now registers an async operation with the source
image.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Fri, 29 Mar 2019 20:33:21 +0000 (16:33 -0400)]
librbd: deep-copy object copy should delay computing object existence
This prevent a potential recursive lock on the destination image's
snap_lock.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Igor Fedotov [Mon, 8 Apr 2019 16:41:55 +0000 (19:41 +0300)]
os/bluestore: call fault_range properly prior to looking for blob to reuse
Fixes: https://tracker.ceph.com/issues/21312
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
Patrick Donnelly [Mon, 8 Apr 2019 16:35:43 +0000 (09:35 -0700)]
Merge PR #27281 into master
* refs/pull/27281/head:
script/ceph-release-notes: alternate merge commit format
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Kefu Chai [Mon, 8 Apr 2019 16:32:46 +0000 (00:32 +0800)]
Merge pull request #26782 from iotcg/master
vstart.sh: fix CEPH_PORT check and cleanups
Reviewed-by: Kefu Chai <kchai@redhat.com>
Patrick Donnelly [Mon, 8 Apr 2019 16:26:01 +0000 (09:26 -0700)]
Merge PR #27437 into master
* refs/pull/27437/head:
vstart: add an alias for cephfs-shell to vstart_environment.sh
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Sage Weil [Mon, 8 Apr 2019 15:17:50 +0000 (10:17 -0500)]
Merge PR #27419 into master
* refs/pull/27419/head:
common: add --log-early command line option
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuval Lifshitz [Mon, 8 Apr 2019 14:31:40 +0000 (17:31 +0300)]
Merge pull request #27091 from yuvalif/s2_pubsub_api_new
S3 compatible pubsub API