]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agodoc: Fix typo error on cephfs/fuse/ 24367/head
Karun Josy [Tue, 2 Oct 2018 11:53:25 +0000 (17:23 +0530)]
doc: Fix typo error on cephfs/fuse/

Fixes: http://tracker.ceph.com/issues/36180
Signed-off-by: Karun Josy <kjosy@redhat.com>
6 years agoMerge pull request #24266 from theanalyst/doc/releases/13.2.2
Abhishek L [Tue, 2 Oct 2018 08:00:57 +0000 (10:00 +0200)]
Merge pull request #24266 from theanalyst/doc/releases/13.2.2

doc: release notes for 13.2.2 mimic

Reviewed-By: Nathan Cutler <nculter@suse.com>
6 years agoMerge pull request #24354 from idryomov/wip-krbd-kfsx-fancy-striping
Ilya Dryomov [Tue, 2 Oct 2018 07:32:57 +0000 (09:32 +0200)]
Merge pull request #24354 from idryomov/wip-krbd-kfsx-fancy-striping

qa/suites/krbd: more fsx tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #24291 from tchaikov/wip-23964
Kefu Chai [Tue, 2 Oct 2018 02:48:21 +0000 (10:48 +0800)]
Merge pull request #24291 from tchaikov/wip-23964

erasure-code: add clay codes

Reviewed-by: Myna Vajha <mynaramana@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #24256 from dzafman/wip-36170
Neha Ojha [Mon, 1 Oct 2018 22:50:45 +0000 (15:50 -0700)]
Merge pull request #24256 from dzafman/wip-36170

osd: Remove old bft= which has been superceded by backfill=

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #24147 from sebastian-philipp/orchestrator-debuggability
John Spray [Mon, 1 Oct 2018 20:48:28 +0000 (21:48 +0100)]
Merge pull request #24147 from sebastian-philipp/orchestrator-debuggability

mgr/orchestrator: Improve debuggability

Reviewed-by: John Spray <john.spray@redhat.com>
6 years agoMerge PR #24346 into master
Patrick Donnelly [Mon, 1 Oct 2018 20:25:43 +0000 (13:25 -0700)]
Merge PR #24346 into master

* refs/pull/24346/head:
doc: misc fixes cephfs-shell

Reviewed-by: Pavani Rajula <rpavani1998@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24340 from tchaikov/wip-36260
Dan Mick [Mon, 1 Oct 2018 20:04:58 +0000 (13:04 -0700)]
Merge pull request #24340 from tchaikov/wip-36260

qa/workunits/mon/test_mon_config_key.py: bump up the size limit

6 years agoMerge PR #21566 into master
Patrick Donnelly [Mon, 1 Oct 2018 19:47:40 +0000 (12:47 -0700)]
Merge PR #21566 into master

* refs/pull/21566/head:
test: add test for mds drop cache command
mds: command to trim mds cache and client caps
mds: implement journal flush as asynchronous context execution
mds: cleanup some asok commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24355 from alfredodeza/wip-rm36249
Andrew Schoen [Mon, 1 Oct 2018 19:02:46 +0000 (14:02 -0500)]
Merge pull request #24355 from alfredodeza/wip-rm36249

ceph-volume:  activate option --auto-detect-objectstore respects --no-systemd

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge PR #24044 into master
Patrick Donnelly [Mon, 1 Oct 2018 17:43:35 +0000 (10:43 -0700)]
Merge PR #24044 into master

* refs/pull/24044/head:
qa: tolerate failed rank while waiting for state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #23674 from wjwithagen/wjw-wip-ceph-volume-zfs
Alfredo Deza [Mon, 1 Oct 2018 17:42:43 +0000 (13:42 -0400)]
Merge pull request #23674 from wjwithagen/wjw-wip-ceph-volume-zfs

ceph-volume: zfs, the initial first submit.

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #24275 into master
Patrick Donnelly [Mon, 1 Oct 2018 17:41:00 +0000 (10:41 -0700)]
Merge PR #24275 into master

* refs/pull/24275/head:
qa: add timeout to cleaning up workunit sandbox
qa: add timeout to kclient umount
qa: do not cleanup sandbox on error
qa: use default timeout in fs workunits

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoceph-volume lvm.activate pass no_systemd args when detecting objectstore 24355/head
Alfredo Deza [Mon, 1 Oct 2018 15:54:19 +0000 (11:54 -0400)]
ceph-volume lvm.activate pass no_systemd args when detecting objectstore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.lvm verify activate works with --auto-detect-objectstore
Alfredo Deza [Mon, 1 Oct 2018 15:53:37 +0000 (11:53 -0400)]
ceph-volume tests.lvm verify activate works with --auto-detect-objectstore

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume: zfs, the inital first submit. 23674/head
Willem Jan Withagen [Tue, 21 Aug 2018 18:56:21 +0000 (20:56 +0200)]
ceph-volume: zfs, the inital first submit.

Does nothing other than invoce the ceph-volume-zfs modules when
called with 'ceph-volume zfs

Like:
> ceph-volume zfs list

Use ZFS as the underlying technology for OSDs

--verbose   Increase the verbosity level

['list']
-->  TypeError: main() takes exactly 2 arguments (1 given)
Exit 1

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoqa/suites/krbd: more fsx tests 24354/head
Ilya Dryomov [Thu, 20 Sep 2018 08:18:20 +0000 (10:18 +0200)]
qa/suites/krbd: more fsx tests

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agotest/librbd/fsx: don't use time() for seeding
Ilya Dryomov [Wed, 19 Sep 2018 14:37:36 +0000 (16:37 +0200)]
test/librbd/fsx: don't use time() for seeding

When starting multiple concurrent jobs with rbd_fsx task, all jobs get
the same seed.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
6 years agoMerge pull request #24073 from AntonOks/master
Casey Bodley [Mon, 1 Oct 2018 13:39:08 +0000 (09:39 -0400)]
Merge pull request #24073 from AntonOks/master

doc: added some Civetweb configuration options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24343 from jecluis/wip-dashboard-fix-oa
Lenz Grimmer [Mon, 1 Oct 2018 13:01:30 +0000 (15:01 +0200)]
Merge pull request #24343 from jecluis/wip-dashboard-fix-oa

mgr/dashboard: fix reference to oA

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #24237 from votdev/ignore_idea_dir
Lenz Grimmer [Mon, 1 Oct 2018 10:52:18 +0000 (12:52 +0200)]
Merge pull request #24237 from votdev/ignore_idea_dir

.gitignore: Ignore .idea directory

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agodoc: misc fixes cephfs-shell 24346/head
Jos Collin [Wed, 19 Sep 2018 09:27:53 +0000 (14:57 +0530)]
doc: misc fixes cephfs-shell

Signed-off-by: Jos Collin <jcollin@redhat.com>
6 years agoqa: add timeout to cleaning up workunit sandbox 24275/head
Patrick Donnelly [Sun, 30 Sep 2018 00:37:12 +0000 (17:37 -0700)]
qa: add timeout to cleaning up workunit sandbox

If there is a bug preventing rm from completing, the workunit will get stuck.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: add timeout to kclient umount
Patrick Donnelly [Sun, 30 Sep 2018 00:34:37 +0000 (17:34 -0700)]
qa: add timeout to kclient umount

Otherwise QA sits forever waiting for the kclient to umount when there is a
problem.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: do not cleanup sandbox on error
Patrick Donnelly [Wed, 26 Sep 2018 14:38:58 +0000 (07:38 -0700)]
qa: do not cleanup sandbox on error

Otherwise the command will hang if the mount is broken.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: use default timeout in fs workunits
Patrick Donnelly [Mon, 1 Oct 2018 01:10:05 +0000 (18:10 -0700)]
qa: use default timeout in fs workunits

Six hours is unnecessarily long.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomgr/dashboard: fix reference to oA 24343/head
Joao Eduardo Luis [Mon, 1 Oct 2018 00:00:45 +0000 (01:00 +0100)]
mgr/dashboard: fix reference to oA

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
6 years agoqa/workunits/mon/test_mon_config_key.py: bump up the size limit 24340/head
Kefu Chai [Sun, 30 Sep 2018 07:54:28 +0000 (15:54 +0800)]
qa/workunits/mon/test_mon_config_key.py: bump up the size limit

in b38b8e980cb477ab2b0f320ab51eaa0c0fec7da6, we changed the upper
limit of size of `config key` 's value to 64k, so we need to update
the test accordingly.

Fixes: http://tracker.ceph.com/issues/36260
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24302 from hydro-b/fix-rbd-nbd-docu
Jason Dillaman [Sat, 29 Sep 2018 19:57:38 +0000 (15:57 -0400)]
Merge pull request #24302 from hydro-b/fix-rbd-nbd-docu

doc: add "--timeout" option to rbd-nbd

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: songweibin <song.weibin@zte.com.cn>
6 years agoMerge pull request #24289 from ukernel/wip-msg-clear-payload
Kefu Chai [Sat, 29 Sep 2018 16:10:18 +0000 (00:10 +0800)]
Merge pull request #24289 from ukernel/wip-msg-clear-payload

msg: clear message middle when clearing encoded message buffer

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24301 from tchaikov/wip-async-connect-timeout
Kefu Chai [Sat, 29 Sep 2018 16:09:33 +0000 (00:09 +0800)]
Merge pull request #24301 from tchaikov/wip-async-connect-timeout

msg/async: keep connection alive only actually sending

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #24278 from wjwithagen/wjw-fix-inline_variant
Kefu Chai [Sat, 29 Sep 2018 16:09:04 +0000 (00:09 +0800)]
Merge pull request #24278 from wjwithagen/wjw-fix-inline_variant

common: fix missing include boost/noncopyable.hpp

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24263 from tchaikov/wip-drop-lock-policy
Kefu Chai [Sat, 29 Sep 2018 16:08:33 +0000 (00:08 +0800)]
Merge pull request #24263 from tchaikov/wip-drop-lock-policy

auth,common: use ceph::mutex instead of LockMutex

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #24336 from alfredodeza/wip-rm36251
Alfredo Deza [Fri, 28 Sep 2018 18:16:54 +0000 (14:16 -0400)]
Merge pull request #24336 from alfredodeza/wip-rm36251

ceph-volume add new ceph-handlers role from ceph-ansible

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agodoc: add "--timeout" option to rbd-nbd 24302/head
Stefan Kooman [Thu, 27 Sep 2018 12:11:05 +0000 (14:11 +0200)]
doc: add "--timeout" option to rbd-nbd

Fixes: https://tracker.ceph.com/issues/22333
Signed-off-by: Stefan Kooman <stefan@bit.nl>
6 years agoceph-volume tests.functional add new ceph-handlers role from ceph-ansible 24336/head
Alfredo Deza [Fri, 28 Sep 2018 16:40:09 +0000 (12:40 -0400)]
ceph-volume tests.functional add new ceph-handlers role from ceph-ansible

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24330 from alfredodeza/wip-rm36098
Andrew Schoen [Fri, 28 Sep 2018 14:54:55 +0000 (09:54 -0500)]
Merge pull request #24330 from alfredodeza/wip-rm36098

ceph-volume:  lsblk can fail to find PARTLABEL, must fallback to blkid

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #24315 from tchaikov/wip-jenkins-does-not-read-package-desc
Kefu Chai [Fri, 28 Sep 2018 13:53:22 +0000 (21:53 +0800)]
Merge pull request #24315 from tchaikov/wip-jenkins-does-not-read-package-desc

install-deps: do not specify unknown options

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agotest: add test for mds drop cache command 21566/head
Venky Shankar [Wed, 22 Aug 2018 15:06:25 +0000 (11:06 -0400)]
test: add test for mds drop cache command

Fixes: http://tracker.ceph.com/issues/23362
Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agomds: command to trim mds cache and client caps
Venky Shankar [Sun, 26 Aug 2018 13:48:56 +0000 (09:48 -0400)]
mds: command to trim mds cache and client caps

With this command, the MDS would request clients to release
caps followed by trimming its own cache and a journal flush.
The command accepts a timeout to wait for clients to respond
to session recall and flush messages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agomds: implement journal flush as asynchronous context execution
Venky Shankar [Fri, 14 Sep 2018 04:23:11 +0000 (00:23 -0400)]
mds: implement journal flush as asynchronous context execution

Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agomds: cleanup some asok commands
Venky Shankar [Sun, 26 Aug 2018 12:55:05 +0000 (08:55 -0400)]
mds: cleanup some asok commands

Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
6 years agoinstall-deps: do not specify unknown options 24315/head
Kefu Chai [Fri, 28 Sep 2018 03:45:03 +0000 (11:45 +0800)]
install-deps: do not specify unknown options

per apt.conf(5), and
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=550564,
"Acquire::Translation" is not documented and will be deprecated. it
would be better to use "Acquire::Languages" solely. and it's consistent
with https://github.com/ceph/ceph-build/pull/1137 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoceph-volume simple.scan better detection for ceph-disk data devices 24330/head
Alfredo Deza [Thu, 27 Sep 2018 20:17:29 +0000 (16:17 -0400)]
ceph-volume simple.scan better detection for ceph-disk data devices

Uses the new ``CephDiskDevice`` to look into PARTLABEL from both lsblk
(the default) falling back to blkid, which in some cases has the right
value when lsblk fails.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.util verify CephDiskDevice behavior
Alfredo Deza [Thu, 27 Sep 2018 20:15:26 +0000 (16:15 -0400)]
ceph-volume tests.util verify CephDiskDevice behavior

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume tests.conftest add blkid patching to device_info fixture
Alfredo Deza [Thu, 27 Sep 2018 20:15:00 +0000 (16:15 -0400)]
ceph-volume tests.conftest add blkid patching to device_info fixture

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoceph-volume util.device add a ceph-disk device object to detect types
Alfredo Deza [Thu, 27 Sep 2018 20:14:28 +0000 (16:14 -0400)]
ceph-volume util.device add a ceph-disk device object to detect types

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24300 from trociny/wip-36236
Jason Dillaman [Thu, 27 Sep 2018 19:56:58 +0000 (15:56 -0400)]
Merge pull request #24300 from trociny/wip-36236

test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #23950 from ceph/wip-rgw-dpp-metasync
Casey Bodley [Thu, 27 Sep 2018 19:33:44 +0000 (15:33 -0400)]
Merge pull request #23950 from ceph/wip-rgw-dpp-metasync

rgw: log refactoring for meta sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoauth: switch from Mutex to ceph::mutex 24263/head
Kefu Chai [Tue, 25 Sep 2018 08:47:57 +0000 (16:47 +0800)]
auth: switch from Mutex to ceph::mutex

to be aligned with our direction to use std::mutex or its wrapper. see
https://trello.com/c/aUSezBRH/365-cephmutex-etc-for-release-builds

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoauth,common: switch to ceph::mutex, etc
Kefu Chai [Tue, 25 Sep 2018 07:42:25 +0000 (15:42 +0800)]
auth,common: switch to ceph::mutex, etc

in this change, along with LockPolicy, src/common/lock_* are completely
removed.

instead of using LockPolicy based template specialization of LockMutex,
etc, it would be simpler if we can just rely on WITH_SEASTAR
preprocessor macro to tell if we are compiling code for crimson or not.
but please bear in mind, we cannot link against the plain libceph-common
in crimson anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/ceph_mutex: add shared_mutex to `ceph` namespace
Kefu Chai [Tue, 25 Sep 2018 08:12:24 +0000 (16:12 +0800)]
common/ceph_mutex: add shared_mutex to `ceph` namespace

for the sake of completeness, also pave the road to ditch
SharedMutex<LockPolicy>. please note, in code used by crimson, we are
not using shared_mutex or SharedMutex yet. so we are not adding
the dummy shared_mutex for WITH_SEASTAR.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomsg/async: keep connection alive only actually sending 24301/head
Kefu Chai [Thu, 27 Sep 2018 12:40:22 +0000 (20:40 +0800)]
msg/async: keep connection alive only actually sending

When connection stuck into odd state, we need to let connection timeout.
If send_message could update last_active, it won't play the role as
expected.
So we move last_active updated to the place actually should.

Signed-off-by: Haomai Wang <haomai@xsky.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agotest/rbd_mirror: race in WaitingOnLeaderReleaseLeader 24300/head
Mykola Golub [Thu, 27 Sep 2018 11:32:30 +0000 (14:32 +0300)]
test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Fixes: http://tracker.ceph.com/issues/36236
Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agoqa/suites/rados/thrash-erasure-code: add clay 4+2 24291/head
Sage Weil [Thu, 6 Sep 2018 16:23:28 +0000 (11:23 -0500)]
qa/suites/rados/thrash-erasure-code: add clay 4+2

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoerasure-code: add clay codes
Myna V [Thu, 6 Sep 2018 16:23:28 +0000 (11:23 -0500)]
erasure-code: add clay codes

Introducing Clay codes to ceph. These codes are optimal
in terms of network, disk traffic utilized during repair of a lost chunk.
This feature also provides gradual increase in network, disk traffic with
respect to the number of lost chunks.

Authors: Myna, Elita.
Fixes: http://tracker.ceph.com/issues/19278
Signed-off-by: Myna V <mynaramana@gmail.com>
6 years agoMerge pull request #24193 from rhcs-dashboard/coverage-disabled-in-api-tests
Lenz Grimmer [Thu, 27 Sep 2018 10:24:01 +0000 (12:24 +0200)]
Merge pull request #24193 from rhcs-dashboard/coverage-disabled-in-api-tests

mgr/dashboard: disable backend tests coverage

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoMerge pull request #24250 from jecluis/wip-mon-increase-ck-default
Kefu Chai [Thu, 27 Sep 2018 10:14:17 +0000 (18:14 +0800)]
Merge pull request #24250 from jecluis/wip-mon-increase-ck-default

mon/config-key: increase max key entry size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24200 from jecluis/wip-dashboard-fix-ac
Lenz Grimmer [Thu, 27 Sep 2018 09:19:37 +0000 (11:19 +0200)]
Merge pull request #24200 from jecluis/wip-dashboard-fix-ac

mgr/dashboard: no side-effects on failed user creation

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #23351 from tspmelo/wip-rbd-trash
Lenz Grimmer [Thu, 27 Sep 2018 09:04:46 +0000 (11:04 +0200)]
Merge pull request #23351 from tspmelo/wip-rbd-trash

mgr/dashboard: Add support for RBD Trash

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #24293 from dillaman/wip-36220
Mykola Golub [Thu, 27 Sep 2018 06:02:00 +0000 (09:02 +0300)]
Merge pull request #24293 from dillaman/wip-36220

librbd: object copy state machine might dereference a deleted object

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #22659 from theanalyst/cmake-pybind-ssl
Kefu Chai [Thu, 27 Sep 2018 02:55:16 +0000 (10:55 +0800)]
Merge pull request #22659 from theanalyst/cmake-pybind-ssl

build: mgr: check for python's ssl version linkage

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24243 from smithfarm/wip-bci-rate-limit
Nathan Cutler [Wed, 26 Sep 2018 22:18:49 +0000 (00:18 +0200)]
Merge pull request #24243 from smithfarm/wip-bci-rate-limit

tools: backport-create-issue: rate-limit to avoid seeming like a spammer

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge pull request #23131 from smithfarm/wip-15100
Nathan Cutler [Wed, 26 Sep 2018 22:17:48 +0000 (00:17 +0200)]
Merge pull request #23131 from smithfarm/wip-15100

qa: add test that builds example librados programs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
6 years agorgw: no DoutPrefixProvider as arg for RGWRemoteDataLog::init 23950/head
Ali Maredia [Tue, 25 Sep 2018 19:54:58 +0000 (15:54 -0400)]
rgw: no DoutPrefixProvider as arg for RGWRemoteDataLog::init

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: pass DoutPrefixProvider into the entrypoints for trim
Ali Maredia [Fri, 21 Sep 2018 13:57:01 +0000 (09:57 -0400)]
rgw: pass DoutPrefixProvider into the entrypoints for trim

Also add a DoutPrefixProvider to all of the
cascading classes that need one as a result

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: add global prefix provider for radosgw-admin
Casey Bodley [Mon, 27 Aug 2018 23:55:14 +0000 (19:55 -0400)]
rgw: add global prefix provider for radosgw-admin

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a5dbc81b774d0be4b51f39e37bcfa15f3b36db8)

6 years agorgw: remove unused variable RGWRados *store
Ali Maredia [Thu, 6 Sep 2018 14:07:52 +0000 (10:07 -0400)]
rgw: remove unused variable RGWRados *store

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: replace ldout with ldpp_dout in coroutine classes
Ali Maredia [Thu, 6 Sep 2018 04:33:13 +0000 (00:33 -0400)]
rgw: replace ldout with ldpp_dout in coroutine classes

The only classes in rgw_sync.cc that remain
with ldouts are:
- RGWBackoffControlCR
- RGWShardCollectCR
- RGWAsyncMetaStoreEntry
- RGWAsyncMetaRemoveEntry
- PurgePeriodLogsCR
- take_min_status
- MetaMasterTrimShardCollectCR
- MetaMasterStatusCollectCR
- MetaMasterTrimCR
- MetaPeerTrimCR
- MetaTrimPollCR

These classes do not have RGWMetaSyncEnv members.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: replace ldouts with ldpp_dout in RGWRemoteMetaLog
Ali Maredia [Thu, 6 Sep 2018 04:32:36 +0000 (00:32 -0400)]
rgw: replace ldouts with ldpp_dout in RGWRemoteMetaLog

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agorgw: MetaSyncStatusManager implements DoutPrefixProvider
Ali Maredia [Thu, 6 Sep 2018 04:29:47 +0000 (00:29 -0400)]
rgw: MetaSyncStatusManager implements DoutPrefixProvider

There are no member functions of RGWMetaSyncStatusManager
with ldouts to replace with ldpp_dout.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agolibrbd: object copy state machine might dereference a deleted object 24293/head
Jason Dillaman [Wed, 26 Sep 2018 18:39:25 +0000 (14:39 -0400)]
librbd: object copy state machine might dereference a deleted object

Fixes: http://tracker.ceph.com/issues/36220
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #22043 from dillaman/wip-24139
Mykola Golub [Wed, 26 Sep 2018 19:49:02 +0000 (22:49 +0300)]
Merge pull request #22043 from dillaman/wip-24139

rbd-mirror: bootstrap needs to handle local image id collision

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #24253 from dillaman/wip-24516
Mykola Golub [Wed, 26 Sep 2018 19:48:29 +0000 (22:48 +0300)]
Merge pull request #24253 from dillaman/wip-24516

librbd: potential object map race with copyup state machine

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #23625 from XiangxiangMeng/fix-rgw-bucket-policy-not
Yuri Weinstein [Wed, 26 Sep 2018 16:02:36 +0000 (09:02 -0700)]
Merge pull request #23625 from XiangxiangMeng/fix-rgw-bucket-policy-not

rgw: policy: fix NotAction, NotPricipal, NotResource does not take effect

Reviewed-by: Adam Emerson <aemerson@redhat.com>
6 years agoMerge pull request #24062 from nrdmn/fix-quota
Yuri Weinstein [Wed, 26 Sep 2018 16:00:26 +0000 (09:00 -0700)]
Merge pull request #24062 from nrdmn/fix-quota

rgw: fix max-size in radosgw-admin and REST Admin API

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24177 from cbodley/wip-24595
Yuri Weinstein [Wed, 26 Sep 2018 15:59:51 +0000 (08:59 -0700)]
Merge pull request #24177 from cbodley/wip-24595

rgw: apply quota config to users created via external auth

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #24199 from aclamk/fio-rados-manual
Kefu Chai [Wed, 26 Sep 2018 13:57:18 +0000 (21:57 +0800)]
Merge pull request #24199 from aclamk/fio-rados-manual

test/fio: Added tips for compilation of fio with 'rados' engine.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24273 from tspmelo/wip-html-linter
Lenz Grimmer [Wed, 26 Sep 2018 13:45:52 +0000 (15:45 +0200)]
Merge pull request #24273 from tspmelo/wip-html-linter

mgr/dashboard: Add html-linter

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #23534 from cbodley/wip-26897
Casey Bodley [Wed, 26 Sep 2018 13:28:30 +0000 (09:28 -0400)]
Merge pull request #23534 from cbodley/wip-26897

rgw multisite: enforce spawn_window for data full sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agolibrbd: keep IO blocked until after snapshot object map created 24253/head
Jason Dillaman [Mon, 24 Sep 2018 19:07:15 +0000 (15:07 -0400)]
librbd: keep IO blocked until after snapshot object map created

The IO was being unblocked before object map was created, allowing
a potential copyup request to fail to update a still-to-be-created
object map.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: do not invalidate object map if update races with copyup
Jason Dillaman [Mon, 24 Sep 2018 18:45:09 +0000 (14:45 -0400)]
librbd: do not invalidate object map if update races with copyup

The copyup state machine needs to iterate over all object maps to update
the existence for the object. If an snapshot is being removed concurrently,
it's possible to invalidate the object map for the image.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/dashboard: Update frontend linting scripts and documentation 24273/head
Tiago Melo [Tue, 25 Sep 2018 17:02:01 +0000 (18:02 +0100)]
mgr/dashboard: Update frontend linting scripts and documentation

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Add html linter and fix lint errors
Tiago Melo [Tue, 25 Sep 2018 14:43:35 +0000 (15:43 +0100)]
mgr/dashboard: Add html linter and fix lint errors

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomsg: clear message middle when clearing encoded message buffer 24289/head
Yan, Zheng [Wed, 26 Sep 2018 10:50:22 +0000 (18:50 +0800)]
msg: clear message middle when clearing encoded message buffer

Otherwise it may trigger ceph_assert(middle.length() == 0) in
Message::encode()

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agocommon: fix missing include boost/noncopyable.hpp 24278/head
Willem Jan Withagen [Tue, 25 Sep 2018 21:36:30 +0000 (23:36 +0200)]
common: fix missing include boost/noncopyable.hpp

Clang complains:
```
In file included from /home/jenkins/workspace/ceph-master/src/osd/ReplicatedBackend.cc:15:
In file included from /home/jenkins/workspace/ceph-master/src/osd/ReplicatedBackend.h:18:
In file included from /home/jenkins/workspace/ceph-master/src/osd/PGBackend.h:27:
In file included from /home/jenkins/workspace/ceph-master/src/osd/PGTransaction.h:25:
/home/jenkins/workspace/ceph-master/src/common/inline_variant.h:88:64: error: expected class name
struct generic_visitor : boost::static_visitor<Result>, boost::noncopyable
                                                               ^
1 error generated.
gmake[2]: *** [src/osd/CMakeFiles/osd.dir/build.make:141: src/osd/CMakeFiles/osd.dir/ReplicatedBackend.cc.o] Error 1
gmake[2]: *** Waiting for unfinished jobs....
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoMerge PR #24203 into master
Patrick Donnelly [Tue, 25 Sep 2018 23:01:33 +0000 (16:01 -0700)]
Merge PR #24203 into master

* refs/pull/24203/head:
ceph-fuse: add to selinux profile

Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #24221 from cbodley/wip-36034
Yehuda Sadeh [Tue, 25 Sep 2018 22:02:01 +0000 (15:02 -0700)]
Merge pull request #24221 from cbodley/wip-36034

rgw multisite: uses local DataChangesLog to track active buckets for trim

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoMerge pull request #23988 from cbodley/wip-35851
Yehuda Sadeh [Tue, 25 Sep 2018 20:43:17 +0000 (13:43 -0700)]
Merge pull request #23988 from cbodley/wip-35851

rgw: dont access rgw_http_req_data::client of canceled request

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoMerge pull request #23986 from cbodley/wip-35715
Casey Bodley [Tue, 25 Sep 2018 20:40:52 +0000 (16:40 -0400)]
Merge pull request #23986 from cbodley/wip-35715

rgw: fix leak of curl handle on shutdown

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoMerge pull request #24011 from cbodley/wip-qa-rgw-multisite-speedup
Casey Bodley [Tue, 25 Sep 2018 20:39:51 +0000 (16:39 -0400)]
Merge pull request #24011 from cbodley/wip-qa-rgw-multisite-speedup

qa/rgw: reduce number of multisite log shards

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoMerge pull request #23987 from cbodley/wip-35812
Yehuda Sadeh [Tue, 25 Sep 2018 20:20:59 +0000 (13:20 -0700)]
Merge pull request #23987 from cbodley/wip-35812

rgw: RGWAsyncGetBucketInstanceInfo does not access coroutine memory

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoqa/tasks/rbd_mirror_thrash: let daemon gracefully shut down if possible 22043/head
Jason Dillaman [Tue, 18 Sep 2018 15:28:57 +0000 (11:28 -0400)]
qa/tasks/rbd_mirror_thrash: let daemon gracefully shut down if possible

Otherwise, try to capture a core dump to discover what was blocking the
shutdown process.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoqa/workunits/rbd: wait max 2 hrs for all stress images to sync
Jason Dillaman [Mon, 17 Sep 2018 20:20:57 +0000 (16:20 -0400)]
qa/workunits/rbd: wait max 2 hrs for all stress images to sync

Sporadically the rbd-mirror fsx stress test would fail due to very
slow sync times due to overloaded clusters. Attempt to wait for all
images to be replicated before proceeding with the comparison.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoqa/workunits/rbd: exclude rbd-mirror sync-point snaps from comparison
Jason Dillaman [Tue, 25 Sep 2018 20:08:25 +0000 (16:08 -0400)]
qa/workunits/rbd: exclude rbd-mirror sync-point snaps from comparison

This is a temporary workaround to tracker ticket issue #36185

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoceph-volume tests.util verify new blkid API calls
Alfredo Deza [Tue, 25 Sep 2018 19:27:47 +0000 (15:27 -0400)]
ceph-volume tests.util verify new blkid API calls

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24274 from ceph/wip-batch-report-fix
Alfredo Deza [Tue, 25 Sep 2018 19:26:04 +0000 (15:26 -0400)]
Merge pull request #24274 from ceph/wip-batch-report-fix

ceph-volume: fix journal and filestore data size in `lvm batch --report`

6 years agoceph-volume util.disk expand blkid's API calls
Alfredo Deza [Tue, 25 Sep 2018 19:25:13 +0000 (15:25 -0400)]
ceph-volume util.disk expand blkid's API calls

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #24251 from alfredodeza/wip-rm27210
Andrew Schoen [Tue, 25 Sep 2018 18:13:50 +0000 (13:13 -0500)]
Merge pull request #24251 from alfredodeza/wip-rm27210

ceph-volume custom cluster names fail on filestore trigger

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume: only run ceph-common once during tests 24274/head
Andrew Schoen [Tue, 25 Sep 2018 17:09:15 +0000 (12:09 -0500)]
ceph-volume: only run ceph-common once during tests

Using import_role we can have just one play and avoid rerunning
ceph-common over and over again in daemon specific plays.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>