]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to... 24399/head
Alfredo Deza [Wed, 3 Oct 2018 12:31:20 +0000 (08:31 -0400)]
ceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to find device

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24348 from trociny/wip-config-pool-mirror
Jason Dillaman [Wed, 3 Oct 2018 11:31:52 +0000 (07:31 -0400)]
Merge pull request #24348 from trociny/wip-config-pool-mirror

 rbd-mirror: use pool level config overrides

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge PR #24367 into master
Patrick Donnelly [Wed, 3 Oct 2018 00:47:45 +0000 (17:47 -0700)]
Merge PR #24367 into master

* refs/pull/24367/head:
doc: Fix typo error on cephfs/fuse/

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #24362 into master
Patrick Donnelly [Wed, 3 Oct 2018 00:46:05 +0000 (17:46 -0700)]
Merge PR #24362 into master

* refs/pull/24362/head:
doc: fix broken fstab url in cephfs/fuse

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24276 from dillaman/wip-36183
Yuri Weinstein [Tue, 2 Oct 2018 22:45:04 +0000 (15:45 -0700)]
Merge pull request #24276 from dillaman/wip-36183

osdc/Objecter: possible race condition with connection reset

Reviewed-by: Greg Farnum gfarnum@redhat.com
6 years agoMerge pull request #24262 from cernceph/dvanders_creating
Yuri Weinstein [Tue, 2 Oct 2018 22:44:04 +0000 (15:44 -0700)]
Merge pull request #24262 from cernceph/dvanders_creating

osd: add creating to pg_string_state

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #24304 from tchaikov/wip-monclient-remove-unused-label
Yuri Weinstein [Tue, 2 Oct 2018 22:41:44 +0000 (15:41 -0700)]
Merge pull request #24304 from tchaikov/wip-monclient-remove-unused-label

mon/MonClient: use scoped_guard instead of goto

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #24372 from alfredodeza/wip-rm36247
Andrew Schoen [Tue, 2 Oct 2018 20:46:36 +0000 (15:46 -0500)]
Merge pull request #24372 from alfredodeza/wip-rm36247

ceph-volume: skip processing devices that don't exist when scanning system disks

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #24180 from colletj/wip-35914-mmgrconfigure-osd-query
Jason Dillaman [Tue, 2 Oct 2018 19:01:12 +0000 (15:01 -0400)]
Merge pull request #24180 from colletj/wip-35914-mmgrconfigure-osd-query

mgr: update MMgrConfigure message to include optional OSD perf queries

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr: add optional OSD perf queries to MMgrConfigure message 24180/head
Julien Collet [Mon, 17 Sep 2018 15:23:17 +0000 (17:23 +0200)]
mgr: add optional OSD perf queries to MMgrConfigure message

Fixes: https://tracker.ceph.com/issues/35914
Signed-off-by: Julien Collet <julien.collet@cern.ch>
6 years agoceph-volume util.disk when there are no devices mapped, skip to the next one 24372/head
Alfredo Deza [Tue, 2 Oct 2018 15:18:44 +0000 (11:18 -0400)]
ceph-volume util.disk when there are no devices mapped, skip to the next one

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.util verify devices that don't exist don't break get_devices
Alfredo Deza [Tue, 2 Oct 2018 15:18:22 +0000 (11:18 -0400)]
ceph-volume tests.util verify devices that don't exist don't break get_devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24349 from ricardoasmarques/wip-ex-message-py3
Lenz Grimmer [Tue, 2 Oct 2018 12:32:05 +0000 (14:32 +0200)]
Merge pull request #24349 from ricardoasmarques/wip-ex-message-py3

mgr/dashboard: Exception.message doesn't exist on Python 3

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agodoc: Fix typo error on cephfs/fuse/ 24367/head
Karun Josy [Tue, 2 Oct 2018 11:53:25 +0000 (17:23 +0530)]
doc: Fix typo error on cephfs/fuse/

Fixes: http://tracker.ceph.com/issues/36180
Signed-off-by: Karun Josy <kjosy@redhat.com>
6 years agoMerge pull request #24266 from theanalyst/doc/releases/13.2.2
Abhishek L [Tue, 2 Oct 2018 08:00:57 +0000 (10:00 +0200)]
Merge pull request #24266 from theanalyst/doc/releases/13.2.2

doc: release notes for 13.2.2 mimic

Reviewed-By: Nathan Cutler <nculter@suse.com>
6 years agoMerge pull request #24354 from idryomov/wip-krbd-kfsx-fancy-striping
Ilya Dryomov [Tue, 2 Oct 2018 07:32:57 +0000 (09:32 +0200)]
Merge pull request #24354 from idryomov/wip-krbd-kfsx-fancy-striping

qa/suites/krbd: more fsx tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agodoc: fix broken fstab url in cephfs/fuse 24362/head
Jos Collin [Tue, 2 Oct 2018 05:06:26 +0000 (10:36 +0530)]
doc: fix broken fstab url in cephfs/fuse

Fixes: http://tracker.ceph.com/issues/36286
Signed-off-by: Jos Collin <jcollin@redhat.com>
6 years agoMerge pull request #24291 from tchaikov/wip-23964
Kefu Chai [Tue, 2 Oct 2018 02:48:21 +0000 (10:48 +0800)]
Merge pull request #24291 from tchaikov/wip-23964

erasure-code: add clay codes

Reviewed-by: Myna Vajha <mynaramana@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #24256 from dzafman/wip-36170
Neha Ojha [Mon, 1 Oct 2018 22:50:45 +0000 (15:50 -0700)]
Merge pull request #24256 from dzafman/wip-36170

osd: Remove old bft= which has been superceded by backfill=

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #24147 from sebastian-philipp/orchestrator-debuggability
John Spray [Mon, 1 Oct 2018 20:48:28 +0000 (21:48 +0100)]
Merge pull request #24147 from sebastian-philipp/orchestrator-debuggability

mgr/orchestrator: Improve debuggability

Reviewed-by: John Spray <john.spray@redhat.com>
6 years agoMerge PR #24346 into master
Patrick Donnelly [Mon, 1 Oct 2018 20:25:43 +0000 (13:25 -0700)]
Merge PR #24346 into master

* refs/pull/24346/head:
doc: misc fixes cephfs-shell

Reviewed-by: Pavani Rajula <rpavani1998@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24340 from tchaikov/wip-36260
Dan Mick [Mon, 1 Oct 2018 20:04:58 +0000 (13:04 -0700)]
Merge pull request #24340 from tchaikov/wip-36260

qa/workunits/mon/test_mon_config_key.py: bump up the size limit

6 years agoMerge PR #21566 into master
Patrick Donnelly [Mon, 1 Oct 2018 19:47:40 +0000 (12:47 -0700)]
Merge PR #21566 into master

* refs/pull/21566/head:
test: add test for mds drop cache command
mds: command to trim mds cache and client caps
mds: implement journal flush as asynchronous context execution
mds: cleanup some asok commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24355 from alfredodeza/wip-rm36249
Andrew Schoen [Mon, 1 Oct 2018 19:02:46 +0000 (14:02 -0500)]
Merge pull request #24355 from alfredodeza/wip-rm36249

ceph-volume:  activate option --auto-detect-objectstore respects --no-systemd

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge PR #24044 into master
Patrick Donnelly [Mon, 1 Oct 2018 17:43:35 +0000 (10:43 -0700)]
Merge PR #24044 into master

* refs/pull/24044/head:
qa: tolerate failed rank while waiting for state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #23674 from wjwithagen/wjw-wip-ceph-volume-zfs
Alfredo Deza [Mon, 1 Oct 2018 17:42:43 +0000 (13:42 -0400)]
Merge pull request #23674 from wjwithagen/wjw-wip-ceph-volume-zfs

ceph-volume: zfs, the initial first submit.

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #24275 into master
Patrick Donnelly [Mon, 1 Oct 2018 17:41:00 +0000 (10:41 -0700)]
Merge PR #24275 into master

* refs/pull/24275/head:
qa: add timeout to cleaning up workunit sandbox
qa: add timeout to kclient umount
qa: do not cleanup sandbox on error
qa: use default timeout in fs workunits

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoceph-volume lvm.activate pass no_systemd args when detecting objectstore 24355/head
Alfredo Deza [Mon, 1 Oct 2018 15:54:19 +0000 (11:54 -0400)]
ceph-volume lvm.activate pass no_systemd args when detecting objectstore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.lvm verify activate works with --auto-detect-objectstore
Alfredo Deza [Mon, 1 Oct 2018 15:53:37 +0000 (11:53 -0400)]
ceph-volume tests.lvm verify activate works with --auto-detect-objectstore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume: zfs, the inital first submit. 23674/head
Willem Jan Withagen [Tue, 21 Aug 2018 18:56:21 +0000 (20:56 +0200)]
ceph-volume: zfs, the inital first submit.

Does nothing other than invoce the ceph-volume-zfs modules when
called with 'ceph-volume zfs

Like:
> ceph-volume zfs list

Use ZFS as the underlying technology for OSDs

--verbose   Increase the verbosity level

['list']
-->  TypeError: main() takes exactly 2 arguments (1 given)
Exit 1

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoqa/suites/krbd: more fsx tests 24354/head
Ilya Dryomov [Thu, 20 Sep 2018 08:18:20 +0000 (10:18 +0200)]
qa/suites/krbd: more fsx tests

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agotest/librbd/fsx: don't use time() for seeding
Ilya Dryomov [Wed, 19 Sep 2018 14:37:36 +0000 (16:37 +0200)]
test/librbd/fsx: don't use time() for seeding

When starting multiple concurrent jobs with rbd_fsx task, all jobs get
the same seed.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agoMerge pull request #24073 from AntonOks/master
Casey Bodley [Mon, 1 Oct 2018 13:39:08 +0000 (09:39 -0400)]
Merge pull request #24073 from AntonOks/master

doc: added some Civetweb configuration options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24343 from jecluis/wip-dashboard-fix-oa
Lenz Grimmer [Mon, 1 Oct 2018 13:01:30 +0000 (15:01 +0200)]
Merge pull request #24343 from jecluis/wip-dashboard-fix-oa

mgr/dashboard: fix reference to oA

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #24237 from votdev/ignore_idea_dir
Lenz Grimmer [Mon, 1 Oct 2018 10:52:18 +0000 (12:52 +0200)]
Merge pull request #24237 from votdev/ignore_idea_dir

.gitignore: Ignore .idea directory

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Exception.message doesn't exist on Python 3 24349/head
Ricardo Marques [Mon, 1 Oct 2018 09:19:05 +0000 (10:19 +0100)]
mgr/dashboard: Exception.message doesn't exist on Python 3

Signed-off-by: Ricardo Marques <rimarques@suse.com>
6 years agodoc: misc fixes cephfs-shell 24346/head
Jos Collin [Wed, 19 Sep 2018 09:27:53 +0000 (14:57 +0530)]
doc: misc fixes cephfs-shell

Signed-off-by: Jos Collin <jcollin@redhat.com>
6 years agoqa: add timeout to cleaning up workunit sandbox 24275/head
Patrick Donnelly [Sun, 30 Sep 2018 00:37:12 +0000 (17:37 -0700)]
qa: add timeout to cleaning up workunit sandbox

If there is a bug preventing rm from completing, the workunit will get stuck.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: add timeout to kclient umount
Patrick Donnelly [Sun, 30 Sep 2018 00:34:37 +0000 (17:34 -0700)]
qa: add timeout to kclient umount

Otherwise QA sits forever waiting for the kclient to umount when there is a
problem.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: do not cleanup sandbox on error
Patrick Donnelly [Wed, 26 Sep 2018 14:38:58 +0000 (07:38 -0700)]
qa: do not cleanup sandbox on error

Otherwise the command will hang if the mount is broken.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: use default timeout in fs workunits
Patrick Donnelly [Mon, 1 Oct 2018 01:10:05 +0000 (18:10 -0700)]
qa: use default timeout in fs workunits

Six hours is unnecessarily long.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomgr/dashboard: fix reference to oA 24343/head
Joao Eduardo Luis [Mon, 1 Oct 2018 00:00:45 +0000 (01:00 +0100)]
mgr/dashboard: fix reference to oA

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
6 years agorbd-mirror: use pool level config overrides 24348/head
Mykola Golub [Sun, 30 Sep 2018 17:14:54 +0000 (20:14 +0300)]
rbd-mirror: use pool level config overrides

Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agolibrbd: add rbd mirror tunables to pool level config overrides
Mykola Golub [Sun, 30 Sep 2018 17:11:45 +0000 (20:11 +0300)]
librbd: add rbd mirror tunables to pool level config overrides

Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agoqa/workunits/mon/test_mon_config_key.py: bump up the size limit 24340/head
Kefu Chai [Sun, 30 Sep 2018 07:54:28 +0000 (15:54 +0800)]
qa/workunits/mon/test_mon_config_key.py: bump up the size limit

in b38b8e980cb477ab2b0f320ab51eaa0c0fec7da6, we changed the upper
limit of size of `config key` 's value to 64k, so we need to update
the test accordingly.

Fixes: http://tracker.ceph.com/issues/36260
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24302 from hydro-b/fix-rbd-nbd-docu
Jason Dillaman [Sat, 29 Sep 2018 19:57:38 +0000 (15:57 -0400)]
Merge pull request #24302 from hydro-b/fix-rbd-nbd-docu

doc: add "--timeout" option to rbd-nbd

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: songweibin <song.weibin@zte.com.cn>
6 years agoMerge pull request #24289 from ukernel/wip-msg-clear-payload
Kefu Chai [Sat, 29 Sep 2018 16:10:18 +0000 (00:10 +0800)]
Merge pull request #24289 from ukernel/wip-msg-clear-payload

msg: clear message middle when clearing encoded message buffer

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24301 from tchaikov/wip-async-connect-timeout
Kefu Chai [Sat, 29 Sep 2018 16:09:33 +0000 (00:09 +0800)]
Merge pull request #24301 from tchaikov/wip-async-connect-timeout

msg/async: keep connection alive only actually sending

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #24278 from wjwithagen/wjw-fix-inline_variant
Kefu Chai [Sat, 29 Sep 2018 16:09:04 +0000 (00:09 +0800)]
Merge pull request #24278 from wjwithagen/wjw-fix-inline_variant

common: fix missing include boost/noncopyable.hpp

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24263 from tchaikov/wip-drop-lock-policy
Kefu Chai [Sat, 29 Sep 2018 16:08:33 +0000 (00:08 +0800)]
Merge pull request #24263 from tchaikov/wip-drop-lock-policy

auth,common: use ceph::mutex instead of LockMutex

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #24336 from alfredodeza/wip-rm36251
Alfredo Deza [Fri, 28 Sep 2018 18:16:54 +0000 (14:16 -0400)]
Merge pull request #24336 from alfredodeza/wip-rm36251

ceph-volume add new ceph-handlers role from ceph-ansible

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agodoc: add "--timeout" option to rbd-nbd 24302/head
Stefan Kooman [Thu, 27 Sep 2018 12:11:05 +0000 (14:11 +0200)]
doc: add "--timeout" option to rbd-nbd

Fixes: https://tracker.ceph.com/issues/22333
Signed-off-by: Stefan Kooman <stefan@bit.nl>
6 years agoceph-volume tests.functional add new ceph-handlers role from ceph-ansible 24336/head
Alfredo Deza [Fri, 28 Sep 2018 16:40:09 +0000 (12:40 -0400)]
ceph-volume tests.functional add new ceph-handlers role from ceph-ansible

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24330 from alfredodeza/wip-rm36098
Andrew Schoen [Fri, 28 Sep 2018 14:54:55 +0000 (09:54 -0500)]
Merge pull request #24330 from alfredodeza/wip-rm36098

ceph-volume:  lsblk can fail to find PARTLABEL, must fallback to blkid

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #24315 from tchaikov/wip-jenkins-does-not-read-package-desc
Kefu Chai [Fri, 28 Sep 2018 13:53:22 +0000 (21:53 +0800)]
Merge pull request #24315 from tchaikov/wip-jenkins-does-not-read-package-desc

install-deps: do not specify unknown options

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agotest: add test for mds drop cache command 21566/head
Venky Shankar [Wed, 22 Aug 2018 15:06:25 +0000 (11:06 -0400)]
test: add test for mds drop cache command

Fixes: http://tracker.ceph.com/issues/23362
Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agomds: command to trim mds cache and client caps
Venky Shankar [Sun, 26 Aug 2018 13:48:56 +0000 (09:48 -0400)]
mds: command to trim mds cache and client caps

With this command, the MDS would request clients to release
caps followed by trimming its own cache and a journal flush.
The command accepts a timeout to wait for clients to respond
to session recall and flush messages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agomds: implement journal flush as asynchronous context execution
Venky Shankar [Fri, 14 Sep 2018 04:23:11 +0000 (00:23 -0400)]
mds: implement journal flush as asynchronous context execution

Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agomds: cleanup some asok commands
Venky Shankar [Sun, 26 Aug 2018 12:55:05 +0000 (08:55 -0400)]
mds: cleanup some asok commands

Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agoinstall-deps: do not specify unknown options 24315/head
Kefu Chai [Fri, 28 Sep 2018 03:45:03 +0000 (11:45 +0800)]
install-deps: do not specify unknown options

per apt.conf(5), and
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=550564,
"Acquire::Translation" is not documented and will be deprecated. it
would be better to use "Acquire::Languages" solely. and it's consistent
with https://github.com/ceph/ceph-build/pull/1137 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoceph-volume simple.scan better detection for ceph-disk data devices 24330/head
Alfredo Deza [Thu, 27 Sep 2018 20:17:29 +0000 (16:17 -0400)]
ceph-volume simple.scan better detection for ceph-disk data devices

Uses the new ``CephDiskDevice`` to look into PARTLABEL from both lsblk
(the default) falling back to blkid, which in some cases has the right
value when lsblk fails.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.util verify CephDiskDevice behavior
Alfredo Deza [Thu, 27 Sep 2018 20:15:26 +0000 (16:15 -0400)]
ceph-volume tests.util verify CephDiskDevice behavior

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.conftest add blkid patching to device_info fixture
Alfredo Deza [Thu, 27 Sep 2018 20:15:00 +0000 (16:15 -0400)]
ceph-volume tests.conftest add blkid patching to device_info fixture

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume util.device add a ceph-disk device object to detect types
Alfredo Deza [Thu, 27 Sep 2018 20:14:28 +0000 (16:14 -0400)]
ceph-volume util.device add a ceph-disk device object to detect types

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24300 from trociny/wip-36236
Jason Dillaman [Thu, 27 Sep 2018 19:56:58 +0000 (15:56 -0400)]
Merge pull request #24300 from trociny/wip-36236

test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #23950 from ceph/wip-rgw-dpp-metasync
Casey Bodley [Thu, 27 Sep 2018 19:33:44 +0000 (15:33 -0400)]
Merge pull request #23950 from ceph/wip-rgw-dpp-metasync

rgw: log refactoring for meta sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agomon/MonClient: use scoped_guard instead of goto 24304/head
Kefu Chai [Thu, 27 Sep 2018 13:28:57 +0000 (21:28 +0800)]
mon/MonClient: use scoped_guard instead of goto

also silences the unused label warning. as "out_shutdown" is not used
anymore after f35e10f4849440f0583d021e23a83563dd3b1607 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoauth: switch from Mutex to ceph::mutex 24263/head
Kefu Chai [Tue, 25 Sep 2018 08:47:57 +0000 (16:47 +0800)]
auth: switch from Mutex to ceph::mutex

to be aligned with our direction to use std::mutex or its wrapper. see
https://trello.com/c/aUSezBRH/365-cephmutex-etc-for-release-builds

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoauth,common: switch to ceph::mutex, etc
Kefu Chai [Tue, 25 Sep 2018 07:42:25 +0000 (15:42 +0800)]
auth,common: switch to ceph::mutex, etc

in this change, along with LockPolicy, src/common/lock_* are completely
removed.

instead of using LockPolicy based template specialization of LockMutex,
etc, it would be simpler if we can just rely on WITH_SEASTAR
preprocessor macro to tell if we are compiling code for crimson or not.
but please bear in mind, we cannot link against the plain libceph-common
in crimson anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/ceph_mutex: add shared_mutex to `ceph` namespace
Kefu Chai [Tue, 25 Sep 2018 08:12:24 +0000 (16:12 +0800)]
common/ceph_mutex: add shared_mutex to `ceph` namespace

for the sake of completeness, also pave the road to ditch
SharedMutex<LockPolicy>. please note, in code used by crimson, we are
not using shared_mutex or SharedMutex yet. so we are not adding
the dummy shared_mutex for WITH_SEASTAR.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomsg/async: keep connection alive only actually sending 24301/head
Kefu Chai [Thu, 27 Sep 2018 12:40:22 +0000 (20:40 +0800)]
msg/async: keep connection alive only actually sending

When connection stuck into odd state, we need to let connection timeout.
If send_message could update last_active, it won't play the role as
expected.
So we move last_active updated to the place actually should.

Signed-off-by: Haomai Wang <haomai@xsky.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agotest/rbd_mirror: race in WaitingOnLeaderReleaseLeader 24300/head
Mykola Golub [Thu, 27 Sep 2018 11:32:30 +0000 (14:32 +0300)]
test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Fixes: http://tracker.ceph.com/issues/36236
Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agoqa/suites/rados/thrash-erasure-code: add clay 4+2 24291/head
Sage Weil [Thu, 6 Sep 2018 16:23:28 +0000 (11:23 -0500)]
qa/suites/rados/thrash-erasure-code: add clay 4+2

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoerasure-code: add clay codes
Myna V [Thu, 6 Sep 2018 16:23:28 +0000 (11:23 -0500)]
erasure-code: add clay codes

Introducing Clay codes to ceph. These codes are optimal
in terms of network, disk traffic utilized during repair of a lost chunk.
This feature also provides gradual increase in network, disk traffic with
respect to the number of lost chunks.

Authors: Myna, Elita.
Fixes: http://tracker.ceph.com/issues/19278
Signed-off-by: Myna V <mynaramana@gmail.com>
6 years agoMerge pull request #24193 from rhcs-dashboard/coverage-disabled-in-api-tests
Lenz Grimmer [Thu, 27 Sep 2018 10:24:01 +0000 (12:24 +0200)]
Merge pull request #24193 from rhcs-dashboard/coverage-disabled-in-api-tests

mgr/dashboard: disable backend tests coverage

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoMerge pull request #24250 from jecluis/wip-mon-increase-ck-default
Kefu Chai [Thu, 27 Sep 2018 10:14:17 +0000 (18:14 +0800)]
Merge pull request #24250 from jecluis/wip-mon-increase-ck-default

mon/config-key: increase max key entry size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24200 from jecluis/wip-dashboard-fix-ac
Lenz Grimmer [Thu, 27 Sep 2018 09:19:37 +0000 (11:19 +0200)]
Merge pull request #24200 from jecluis/wip-dashboard-fix-ac

mgr/dashboard: no side-effects on failed user creation

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #23351 from tspmelo/wip-rbd-trash
Lenz Grimmer [Thu, 27 Sep 2018 09:04:46 +0000 (11:04 +0200)]
Merge pull request #23351 from tspmelo/wip-rbd-trash

mgr/dashboard: Add support for RBD Trash

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #24293 from dillaman/wip-36220
Mykola Golub [Thu, 27 Sep 2018 06:02:00 +0000 (09:02 +0300)]
Merge pull request #24293 from dillaman/wip-36220

librbd: object copy state machine might dereference a deleted object

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #22659 from theanalyst/cmake-pybind-ssl
Kefu Chai [Thu, 27 Sep 2018 02:55:16 +0000 (10:55 +0800)]
Merge pull request #22659 from theanalyst/cmake-pybind-ssl

build: mgr: check for python's ssl version linkage

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24243 from smithfarm/wip-bci-rate-limit
Nathan Cutler [Wed, 26 Sep 2018 22:18:49 +0000 (00:18 +0200)]
Merge pull request #24243 from smithfarm/wip-bci-rate-limit

tools: backport-create-issue: rate-limit to avoid seeming like a spammer

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge pull request #23131 from smithfarm/wip-15100
Nathan Cutler [Wed, 26 Sep 2018 22:17:48 +0000 (00:17 +0200)]
Merge pull request #23131 from smithfarm/wip-15100

qa: add test that builds example librados programs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
6 years agorgw: no DoutPrefixProvider as arg for RGWRemoteDataLog::init 23950/head
Ali Maredia [Tue, 25 Sep 2018 19:54:58 +0000 (15:54 -0400)]
rgw: no DoutPrefixProvider as arg for RGWRemoteDataLog::init

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: pass DoutPrefixProvider into the entrypoints for trim
Ali Maredia [Fri, 21 Sep 2018 13:57:01 +0000 (09:57 -0400)]
rgw: pass DoutPrefixProvider into the entrypoints for trim

Also add a DoutPrefixProvider to all of the
cascading classes that need one as a result

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: add global prefix provider for radosgw-admin
Casey Bodley [Mon, 27 Aug 2018 23:55:14 +0000 (19:55 -0400)]
rgw: add global prefix provider for radosgw-admin

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a5dbc81b774d0be4b51f39e37bcfa15f3b36db8)

6 years agorgw: remove unused variable RGWRados *store
Ali Maredia [Thu, 6 Sep 2018 14:07:52 +0000 (10:07 -0400)]
rgw: remove unused variable RGWRados *store

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: replace ldout with ldpp_dout in coroutine classes
Ali Maredia [Thu, 6 Sep 2018 04:33:13 +0000 (00:33 -0400)]
rgw: replace ldout with ldpp_dout in coroutine classes

The only classes in rgw_sync.cc that remain
with ldouts are:
- RGWBackoffControlCR
- RGWShardCollectCR
- RGWAsyncMetaStoreEntry
- RGWAsyncMetaRemoveEntry
- PurgePeriodLogsCR
- take_min_status
- MetaMasterTrimShardCollectCR
- MetaMasterStatusCollectCR
- MetaMasterTrimCR
- MetaPeerTrimCR
- MetaTrimPollCR

These classes do not have RGWMetaSyncEnv members.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: replace ldouts with ldpp_dout in RGWRemoteMetaLog
Ali Maredia [Thu, 6 Sep 2018 04:32:36 +0000 (00:32 -0400)]
rgw: replace ldouts with ldpp_dout in RGWRemoteMetaLog

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: MetaSyncStatusManager implements DoutPrefixProvider
Ali Maredia [Thu, 6 Sep 2018 04:29:47 +0000 (00:29 -0400)]
rgw: MetaSyncStatusManager implements DoutPrefixProvider

There are no member functions of RGWMetaSyncStatusManager
with ldouts to replace with ldpp_dout.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agolibrbd: object copy state machine might dereference a deleted object 24293/head
Jason Dillaman [Wed, 26 Sep 2018 18:39:25 +0000 (14:39 -0400)]
librbd: object copy state machine might dereference a deleted object

Fixes: http://tracker.ceph.com/issues/36220
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #22043 from dillaman/wip-24139
Mykola Golub [Wed, 26 Sep 2018 19:49:02 +0000 (22:49 +0300)]
Merge pull request #22043 from dillaman/wip-24139

rbd-mirror: bootstrap needs to handle local image id collision

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #24253 from dillaman/wip-24516
Mykola Golub [Wed, 26 Sep 2018 19:48:29 +0000 (22:48 +0300)]
Merge pull request #24253 from dillaman/wip-24516

librbd: potential object map race with copyup state machine

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #23625 from XiangxiangMeng/fix-rgw-bucket-policy-not
Yuri Weinstein [Wed, 26 Sep 2018 16:02:36 +0000 (09:02 -0700)]
Merge pull request #23625 from XiangxiangMeng/fix-rgw-bucket-policy-not

rgw: policy: fix NotAction, NotPricipal, NotResource does not take effect

Reviewed-by: Adam Emerson <aemerson@redhat.com>
6 years agoMerge pull request #24062 from nrdmn/fix-quota
Yuri Weinstein [Wed, 26 Sep 2018 16:00:26 +0000 (09:00 -0700)]
Merge pull request #24062 from nrdmn/fix-quota

rgw: fix max-size in radosgw-admin and REST Admin API

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24177 from cbodley/wip-24595
Yuri Weinstein [Wed, 26 Sep 2018 15:59:51 +0000 (08:59 -0700)]
Merge pull request #24177 from cbodley/wip-24595

rgw: apply quota config to users created via external auth

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #24199 from aclamk/fio-rados-manual
Kefu Chai [Wed, 26 Sep 2018 13:57:18 +0000 (21:57 +0800)]
Merge pull request #24199 from aclamk/fio-rados-manual

test/fio: Added tips for compilation of fio with 'rados' engine.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24273 from tspmelo/wip-html-linter
Lenz Grimmer [Wed, 26 Sep 2018 13:45:52 +0000 (15:45 +0200)]
Merge pull request #24273 from tspmelo/wip-html-linter

mgr/dashboard: Add html-linter

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #23534 from cbodley/wip-26897
Casey Bodley [Wed, 26 Sep 2018 13:28:30 +0000 (09:28 -0400)]
Merge pull request #23534 from cbodley/wip-26897

rgw multisite: enforce spawn_window for data full sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agolibrbd: keep IO blocked until after snapshot object map created 24253/head
Jason Dillaman [Mon, 24 Sep 2018 19:07:15 +0000 (15:07 -0400)]
librbd: keep IO blocked until after snapshot object map created

The IO was being unblocked before object map was created, allowing
a potential copyup request to fail to update a still-to-be-created
object map.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: do not invalidate object map if update races with copyup
Jason Dillaman [Mon, 24 Sep 2018 18:45:09 +0000 (14:45 -0400)]
librbd: do not invalidate object map if update races with copyup

The copyup state machine needs to iterate over all object maps to update
the existence for the object. If an snapshot is being removed concurrently,
it's possible to invalidate the object map for the image.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>