]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoos/bluestore: BitmapAllocator::allocate: log new extents only 28646/head
Igor Fedotov [Tue, 11 Jun 2019 17:31:32 +0000 (20:31 +0300)]
os/bluestore: BitmapAllocator::allocate: log new extents only

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit a90d57ca05c902eab8ca19090b856ea0e08f5d2b)

6 years agoos/bluestore: distinguis request and results in bitmap alloc log
Igor Fedotov [Tue, 11 Jun 2019 17:23:08 +0000 (20:23 +0300)]
os/bluestore: distinguis request and results in bitmap alloc log

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 84c2d4148574373c678ad8f00e35f9e209ba1f18)

6 years agoos/bluestore: fix duplicate allocations in bmap allocator
Igor Fedotov [Tue, 11 Jun 2019 17:05:09 +0000 (20:05 +0300)]
os/bluestore: fix duplicate allocations in bmap allocator

Fixes: http://tracker.ceph.com/issues/40080
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit eac81bc85970287fce60178e80c37628b3df0e7d)

6 years agoMerge pull request #28233 from pdvian/wip-39670-nautilus
Yuri Weinstein [Wed, 19 Jun 2019 00:42:53 +0000 (17:42 -0700)]
Merge pull request #28233 from pdvian/wip-39670-nautilus

nautilus: mds: output lock state in format dump

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28595 from ajarr/wip-nautilus-refactor-volume-module
Yuri Weinstein [Wed, 19 Jun 2019 00:42:31 +0000 (17:42 -0700)]
Merge pull request #28595 from ajarr/wip-nautilus-refactor-volume-module

nautilus: mgr/volumes: refactor volume module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28610 from batrick/i40164
Yuri Weinstein [Wed, 19 Jun 2019 00:42:03 +0000 (17:42 -0700)]
Merge pull request #28610 from batrick/i40164

nautilus: cephfs: mount: key parsing fail when doing a remount

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28612 from batrick/i40161
Yuri Weinstein [Wed, 19 Jun 2019 00:41:12 +0000 (17:41 -0700)]
Merge pull request #28612 from batrick/i40161

nautilus: cephfs: FSAL_CEPH assertion failed in Client::_lookup_name: "parent->is_dir()"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28613 from batrick/i40220
Yuri Weinstein [Wed, 19 Jun 2019 00:40:52 +0000 (17:40 -0700)]
Merge pull request #28613 from batrick/i40220

nautilus: tests: cephfs: TestMisc.test_evict_client fails

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28614 from batrick/i39935
Yuri Weinstein [Wed, 19 Jun 2019 00:39:47 +0000 (17:39 -0700)]
Merge pull request #28614 from batrick/i39935

nautilus: tests: cephfs-shell: teuthology tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28616 from batrick/i39960
Yuri Weinstein [Wed, 19 Jun 2019 00:39:01 +0000 (17:39 -0700)]
Merge pull request #28616 from batrick/i39960

nautilus: cephfs-shell: mkdir error for relative path

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28383 from xiaoxichen/wip-40145-nautilus
Yuri Weinstein [Tue, 18 Jun 2019 16:18:58 +0000 (09:18 -0700)]
Merge pull request #28383 from xiaoxichen/wip-40145-nautilus

nautilus: rgw: fix Multisite sync corruption

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28410 from cbodley/wip-40148
Yuri Weinstein [Tue, 18 Jun 2019 16:18:28 +0000 (09:18 -0700)]
Merge pull request #28410 from cbodley/wip-40148

nautilus: rgw: fix bucket may redundantly list keys after BI_PREFIX_CHAR

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28476 from smithfarm/wip-40192-nautilus
Yuri Weinstein [Tue, 18 Jun 2019 16:17:14 +0000 (09:17 -0700)]
Merge pull request #28476 from smithfarm/wip-40192-nautilus

nautilus: Rados.get_fsid() returning bytes in python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28511 from b-ranto/wip-selinux-rhel8-nautilus
Yuri Weinstein [Tue, 18 Jun 2019 16:16:47 +0000 (09:16 -0700)]
Merge pull request #28511 from b-ranto/wip-selinux-rhel8-nautilus

nautilus: selinux: Update the policy for RHEL8

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28541 from pdvian/wip-39746-nautilus
Yuri Weinstein [Tue, 18 Jun 2019 15:25:55 +0000 (08:25 -0700)]
Merge pull request #28541 from pdvian/wip-39746-nautilus

nautilus: rgw: beast: multiple v4 and v6 endpoints with the same port will cause failure

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28577 from dillaman/wip-40379-nautilus
Yuri Weinstein [Tue, 18 Jun 2019 15:16:32 +0000 (08:16 -0700)]
Merge pull request #28577 from dillaman/wip-40379-nautilus

nautilus: librbd: avoid dereferencing an empty container during deep-copy

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28598 from cbodley/wip-40346-nautilus
Yuri Weinstein [Tue, 18 Jun 2019 15:15:41 +0000 (08:15 -0700)]
Merge pull request #28598 from cbodley/wip-40346-nautilus

nautilus: qa: use curl in wait_for_radosgw() in util/rgw.py

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #28604 from cbodley/wip-40402-nautilus
Yuri Weinstein [Mon, 17 Jun 2019 20:27:54 +0000 (13:27 -0700)]
Merge pull request #28604 from cbodley/wip-40402-nautilus

nautilus: qa/rgw: skip swift tests on rhel 7.6+

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoqa/rgw: fix import error in tasks/swift.py 28604/head
Casey Bodley [Mon, 17 Jun 2019 15:54:36 +0000 (11:54 -0400)]
qa/rgw: fix import error in tasks/swift.py

> ImportError: No module named packaging

replaces packaging.version.Version with distutils.version.LooseVersion

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 2dd5574cf9a5a80cc40a365675bb1e33a32c9f41)

6 years agocephfs-shell: Fix mkdir relative path error 28616/head
Varsha Rao [Fri, 26 Apr 2019 17:50:51 +0000 (23:20 +0530)]
cephfs-shell: Fix mkdir relative path error

Directory is not created for relative path. This patch fixes it.

Fixes: https://tracker.ceph.com/issues/39507
Signed-off-by: Varsha Rao <varao@redhat.com>
(cherry picked from commit e89287673c3470b00125682b1d0bdab6e0e08ef4)

6 years agocephfs-shell: teuthology tests 28614/head
Milind Changire [Thu, 9 May 2019 06:07:31 +0000 (11:37 +0530)]
cephfs-shell: teuthology tests

* mkdir
* get
* put

Fixes: http://tracker.ceph.com/issues/39526
Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit 73ada8d1d92ed2cc8b48d07f05d1dabb6710452e)

6 years agoqa/cephfs: fix test_evict_client 28613/head
Yan, Zheng [Wed, 5 Jun 2019 14:04:22 +0000 (22:04 +0800)]
qa/cephfs: fix test_evict_client

explictly kill stale session, otherwise session count check is racy.

Fixes: https://tracker.ceph.com/issues/40173
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit 4fd0202fdf0410d788402f6eefda44b79cf0a643)

6 years agoclient: clean up error checking and return of _lookup_parent 28612/head
Jeff Layton [Thu, 30 May 2019 19:56:53 +0000 (15:56 -0400)]
client: clean up error checking and return of _lookup_parent

ll_lookup_inode can end up getting back 0 from _lookup_parent,
without zeroing out the parent pointer, which ends up remaining
uninitialized.

Fix this by moving most of the sanity checks in _lookup_parent
into ll_lookup_inode, and only have it issue the call to the MDS.

This also allows us to do the checks in a more sane order.

Fixes: http://tracker.ceph.com/issues/40085
Signed-off-by: Jeff Layton <jlayton@redhat.com>
(cherry picked from commit 3ade7c046c6c5eaf20517d0713a805a681128831)

6 years agoclient: drop Client::lookup_parent
Jeff Layton [Thu, 30 May 2019 19:52:11 +0000 (15:52 -0400)]
client: drop Client::lookup_parent

Nothing calls this method.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
(cherry picked from commit 5c419b64755c200d43b60d1b435f09a4e5b17f7e)

6 years agocommon/secret.c: fix key parsing when doing a remount 28610/head
Luis Henriques [Thu, 16 May 2019 10:50:56 +0000 (11:50 +0100)]
common/secret.c: fix key parsing when doing a remount

When doing a CephFS remount (-o remount) the secret is parsed from procfs
and we get '<hidden>' as a result and the mount will fail with:

  secret is not valid base64: Invalid argument.
  adding ceph secret key to kernel failed: Invalid argument.

As the kernel already have the key, we simply need to use it.

Fixes: https://tracker.ceph.com/issues/39951
Signed-off-by: Luis Henriques <lhenriques@suse.com>
(cherry picked from commit f44516bcde8d48ef5dca4f92017d1e241eb8e26e)

6 years agoMerge pull request #28562 from batrick/i40373
Yuri Weinstein [Mon, 17 Jun 2019 19:01:45 +0000 (12:01 -0700)]
Merge pull request #28562 from batrick/i40373

nautilus: qa: stop testing simple messenger in fs qa

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #28563 from batrick/i40374
Yuri Weinstein [Mon, 17 Jun 2019 19:00:27 +0000 (12:00 -0700)]
Merge pull request #28563 from batrick/i40374

nautilus: qa: ignore legacy bluestore stats errors

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoqa/rgw: skip swift tests on rhel 7.6+
Casey Bodley [Thu, 13 Jun 2019 13:45:29 +0000 (09:45 -0400)]
qa/rgw: skip swift tests on rhel 7.6+

swift bootstrap fails because libev-devel is not available

Fixes: http://tracker.ceph.com/issues/40304
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit c62f89fd752c97e331c09557147791cedf50cd2d)

6 years agoMerge pull request #27532 from dillaman/wip-rbd-ncurses-nautilus
Yuri Weinstein [Mon, 17 Jun 2019 15:02:31 +0000 (08:02 -0700)]
Merge pull request #27532 from dillaman/wip-rbd-ncurses-nautilus

nautilus: cmake: Fix build against ncurses with separate libtinfo

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #27915 from pdvian/wip-39241-nautilus
Yuri Weinstein [Mon, 17 Jun 2019 15:00:46 +0000 (08:00 -0700)]
Merge pull request #27915 from pdvian/wip-39241-nautilus

nautilus: msg/async: connection race + winner fault can leave connection stuck at replacing foreve

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #28127 from dillaman/wip-39739-nautilus
Yuri Weinstein [Mon, 17 Jun 2019 14:59:35 +0000 (07:59 -0700)]
Merge pull request #28127 from dillaman/wip-39739-nautilus

nautilus: librbd: fix issues with object-map/fast-diff feature interlock

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28131 from dillaman/wip-39573-nautilus
Yuri Weinstein [Mon, 17 Jun 2019 14:58:41 +0000 (07:58 -0700)]
Merge pull request #28131 from dillaman/wip-39573-nautilus

nautilus: common: Clang requires a default constructor, but it can be empty

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #28485 from trociny/wip-40122-nautilus
Yuri Weinstein [Mon, 17 Jun 2019 14:57:56 +0000 (07:57 -0700)]
Merge pull request #28485 from trociny/wip-40122-nautilus

nautilus: pybind/mgr: fix format for rbd-mirror prometheus metrics

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoqa: use curl in wait_for_radosgw() in util/rgw.py 28598/head
Ali Maredia [Wed, 12 Jun 2019 20:12:47 +0000 (16:12 -0400)]
qa: use curl in wait_for_radosgw() in util/rgw.py

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit 9c6afa3fb570629a57612f250a6a4890a65cbc6e)

6 years agomgr / volumes: improve error handling 28595/head
Venky Shankar [Sun, 19 May 2019 17:34:57 +0000 (13:34 -0400)]
mgr / volumes: improve error handling

This cleans up lots of return-fu statements and make the source
look much more pythonic. Functions should raise an instance of
VolumeException() class wherever necessary (error handling).

Fixes: http://tracker.ceph.com/issues/39969
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 241c9cea7c1e489461c17fc43eb77ba28a4fd2c0)

6 years agopy / cephfs: invoke base class Error::__init__() from OSError::__init__()
Venky Shankar [Sun, 19 May 2019 17:20:51 +0000 (13:20 -0400)]
py / cephfs: invoke base class Error::__init__() from OSError::__init__()

This will allow access to `args` when catching `Error`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit aad7906fb712d3f15829a8b49f064b616475e72a)

6 years agomgr / volumes: carve out subvolume operations as a separate class
Venky Shankar [Fri, 17 May 2019 05:40:37 +0000 (01:40 -0400)]
mgr / volumes: carve out subvolume operations as a separate class

Move (and refactor) subvolume specific operations from main module
source to SubVolume class in a new subvolume source. Also, provide
hooks in VolumeClient to forward subvolume specific opertaions to
this class.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 8d29816f0f3db6c7d287bbb7469db77c9de701d1)

6 years agomgr / volumes: introduce subvolume specification class
Venky Shankar [Thu, 16 May 2019 05:54:12 +0000 (01:54 -0400)]
mgr / volumes: introduce subvolume specification class

Specifications class that represents a unique subvolume
identified by (subvolume-id, group-id) tuple. Provide
heleper functions for fetching  various subvolume specific
attributes such as subvolume path, group path etc.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 021b80495da2740fedf45793e17a258f3ebf164c)

6 years agomgr / volumes: carve of volume as a separate class
Venky Shankar [Mon, 13 May 2019 12:15:35 +0000 (17:45 +0530)]
mgr / volumes: carve of volume as a separate class

Move volume operations (create/delete) from main module source
to VolumeClient class in new volume source.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit b3dc3b2dba794e942219c385f80632b449ba5751)

6 years agolibrbd: avoid dereferencing an empty container during deep-copy 28577/head
Jason Dillaman [Fri, 14 Jun 2019 17:34:24 +0000 (13:34 -0400)]
librbd: avoid dereferencing an empty container during deep-copy

While updating the image copy progress, a 'while' loop will pop the
last item from the queue and then deference the empty queue.

Fixes: http://tracker.ceph.com/issues/40368
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 0f491cbb96ec55c68a627de71ed6ccd781a46dcc)

6 years agoMerge pull request #28429 from ajarr/wip-fs-subvolumes-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:42:07 +0000 (12:42 -0700)]
Merge pull request #28429 from ajarr/wip-fs-subvolumes-nautilus

nautilus: mgr/volumes: add CephFS subvolumes library

6 years agoMerge pull request #28333 from pdvian/wip-39680-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:30:42 +0000 (12:30 -0700)]
Merge pull request #28333 from pdvian/wip-39680-nautilus

nautilus: cephfs: pybind: added lseek()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28499 from smithfarm/wip-40169-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:29:58 +0000 (12:29 -0700)]
Merge pull request #28499 from smithfarm/wip-40169-nautilus

nautilus: cephfs: client: fix "ceph.snap.btime" vxattr value

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
6 years agoMerge pull request #28500 from smithfarm/wip-40167-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:29:20 +0000 (12:29 -0700)]
Merge pull request #28500 from smithfarm/wip-40167-nautilus

nautilus: cephfs: client: ceph.dir.rctime xattr value incorrectly prefixes 09 to the nanoseconds component

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
6 years agoMerge pull request #28375 from pdvian/wip-39686-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:26:36 +0000 (12:26 -0700)]
Merge pull request #28375 from pdvian/wip-39686-nautilus

nautilus: client: fix fuse client hang because its bad session PipeConnection

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28394 from pdvian/wip-39690-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:26:13 +0000 (12:26 -0700)]
Merge pull request #28394 from pdvian/wip-39690-nautilus

nautilus: mds: check dir fragment to split dir if mkdir makes it oversized.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: ignore legacy bluestore stats errors 28563/head
Patrick Donnelly [Fri, 14 Jun 2019 18:37:35 +0000 (11:37 -0700)]
qa: ignore legacy bluestore stats errors

Partial-backport: 66f18ecd09973ceab4ff9ff177e69d9c61a30bf2
Fixes: http://tracker.ceph.com/issues/40374
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: stop testing simple messenger in fs qa 28562/head
Patrick Donnelly [Fri, 14 Jun 2019 18:27:01 +0000 (11:27 -0700)]
qa: stop testing simple messenger in fs qa

897a1f738566263fde42832dc23f34a99a554b62 was incomplete.

Fixes: http://tracker.ceph.com/issues/40373
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #27439 from liewegas/wip-centos-latest-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 17:23:58 +0000 (10:23 -0700)]
Merge pull request #27439 from liewegas/wip-centos-latest-nautilus

nautilus: qa: centos 7.6 etc

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #28279 from xiexingguo/wip-balancer-new-osd-weight-for-n
Yuri Weinstein [Fri, 14 Jun 2019 17:22:36 +0000 (10:22 -0700)]
Merge pull request #28279 from xiexingguo/wip-balancer-new-osd-weight-for-n

nautilus: mgr/balancer: various compat weight-set fixes

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #28291 from b-ranto/wip-nautilus-restful
Yuri Weinstein [Fri, 14 Jun 2019 17:22:14 +0000 (10:22 -0700)]
Merge pull request #28291 from b-ranto/wip-nautilus-restful

nautilus: mgr: Update the restful module in nautilus

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28392 from smithfarm/wip-grafana-suse-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 17:21:46 +0000 (10:21 -0700)]
Merge pull request #28392 from smithfarm/wip-grafana-suse-nautilus

nautilus: ceph.spec.in: install grafana dashboards world readable

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #28469 from smithfarm/wip-40232-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 17:21:06 +0000 (10:21 -0700)]
Merge pull request #28469 from smithfarm/wip-40232-nautilus

nautilus: build/ops: python3 pybind RPMs do not replace their python2 counterparts on upgrade even though they should

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #28504 from pdvian/wip-39738-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 16:55:25 +0000 (09:55 -0700)]
Merge pull request #28504 from pdvian/wip-39738-nautilus

nautilus: osd: Output Base64 encoding of CRC header if binary data present

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #28309 from pdvian/wip-39676-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 16:54:42 +0000 (09:54 -0700)]
Merge pull request #28309 from pdvian/wip-39676-nautilus

nautilus: rgw: crypto: throw DigestException from Digest and HMAC

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28482 from pdvian/wip-39736-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 16:54:04 +0000 (09:54 -0700)]
Merge pull request #28482 from pdvian/wip-39736-nautilus

nautilus: Add 'RBD_FEATURE_MIGRATING' to rbd.pyx

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agodoc: rgw: document v6 endpoint options 28541/head
Abhishek Lekshmanan [Fri, 29 Mar 2019 17:13:52 +0000 (18:13 +0100)]
doc: rgw: document v6 endpoint options

document that v6 endpoints only binds to ipv6

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit 59c768713e67e45248a9caecec486f0038268d95)

6 years agorgw: beast: bind both v4 and v6 ports when using a port argument
Abhishek Lekshmanan [Fri, 29 Mar 2019 16:37:44 +0000 (17:37 +0100)]
rgw: beast: bind both v4 and v6 ports when using a port argument

This commit adds binding to both v4 and v6 port when specifying a port argument,
endpoint *only* binds to v4 or v6 depending on the address specified. Failure to
bind when the protocol is not supported is not treated as an error and we warn
and continue then.

Fixes: http://tracker.ceph.com/issues/39038
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit 3a57fcdd11ad8ad3cb903d48a5245e7f9d965f34)

6 years agomgr/volume: set cephfs metadata bias at 4x 28429/head
Sage Weil [Tue, 2 Apr 2019 17:20:15 +0000 (12:20 -0500)]
mgr/volume: set cephfs metadata bias at 4x

Count cephfs metadata at 4x regular rate so that the metadata pool scales
more aggressively than data pools.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1b273d3faf7740834d96d127dffcc8873bd30fce)

6 years agomgr/volume: default to 16 PGs (min) for metadata pool
Sage Weil [Tue, 2 Apr 2019 17:18:33 +0000 (12:18 -0500)]
mgr/volume: default to 16 PGs (min) for metadata pool

Set the min so that the pg_autoscaler won't scale it back down.  Choose
something large enough that even for a large FS we'll do reasonably well
distributing the metadata workload across OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b567b110cb6286d4676653179cb86ae1fe861f15)

6 years agotest: remove fs/test-volume.sh workunit
Venky Shankar [Tue, 4 Jun 2019 12:56:03 +0000 (08:56 -0400)]
test: remove fs/test-volume.sh workunit

.. since its ported to python now.

Fixes: http://tracker.ceph.com/issues/39949
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 0d044a97e9aea37ddb8f08536ad474ec12b5d4b5)

6 years agotest: port fs/volume related tests to python
Venky Shankar [Tue, 4 Jun 2019 10:09:56 +0000 (06:09 -0400)]
test: port fs/volume related tests to python

... and add subvolume related tests.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit d92840b59e01d82d901bc5767f707ff32d75074e)

6 years agomgr/volumes: fix error message
Ramana Raja [Wed, 5 Jun 2019 12:25:09 +0000 (17:55 +0530)]
mgr/volumes: fix error message

... when trying to remove a non-existent fs subvolume group
snapshot.

Fixes: http://tracker.ceph.com/issues/40014
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 834bd72d6f51801cd3b35bcc22d0f2979afbdecc)

6 years agoMerge pull request #28512 from smithfarm/wip-39601-nautilus
Nathan Cutler [Thu, 13 Jun 2019 12:21:07 +0000 (14:21 +0200)]
Merge pull request #28512 from smithfarm/wip-39601-nautilus

nautilus: rgw: document CreateBucketConfiguration for s3 PUT Bucket request

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28312 from tspmelo/wip-40075-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:18:13 +0000 (04:18 -0700)]
Merge pull request #28312 from tspmelo/wip-40075-nautilus

nautilus: mgr/dashboard: Angular is creating multiple instances of the same service

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28315 from tspmelo/wip-40076-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:17:37 +0000 (04:17 -0700)]
Merge pull request #28315 from tspmelo/wip-40076-nautilus

nautilus: mgr/dashboard: Reduce the number of renders on the tables

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28316 from tspmelo/wip-40077-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:17:05 +0000 (04:17 -0700)]
Merge pull request #28316 from tspmelo/wip-40077-nautilus

nautilus: mgr/dashboard: Only one root node is shown in the crush map viewer

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28318 from tspmelo/wip-40057-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:16:20 +0000 (04:16 -0700)]
Merge pull request #28318 from tspmelo/wip-40057-nautilus

nautilus: mgr/dashboard: NFS clients information is not displayed in the details view

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28319 from tspmelo/wip-40030-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:15:45 +0000 (04:15 -0700)]
Merge pull request #28319 from tspmelo/wip-40030-nautilus

nautilus: mgr/dashboard: Some validations are not updated and prevent the submission of a form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoMerge pull request #28320 from tspmelo/wip-39975-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:14:05 +0000 (04:14 -0700)]
Merge pull request #28320 from tspmelo/wip-39975-nautilus

nautilus: mgr/dashboard: NFS export creation: Add more info to the validation message of the field Pseudo

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28311 from tspmelo/wip-40074-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:13:27 +0000 (04:13 -0700)]
Merge pull request #28311 from tspmelo/wip-40074-nautilus

nautilus: mgr/dashboard: Error creating NFS client without squash

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28416 from yuriw/wip-yuriw-40181-nautilus
Yuri Weinstein [Wed, 12 Jun 2019 21:08:40 +0000 (14:08 -0700)]
Merge pull request #28416 from yuriw/wip-yuriw-40181-nautilus

qa/tests: added v14.2.1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agodoc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api 28512/head
Casey Bodley [Mon, 6 May 2019 13:33:05 +0000 (09:33 -0400)]
doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api

Fixes: http://tracker.ceph.com/issues/39597
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit e97668bb7a1333850a5791ae16b97496851ac854)

6 years agoselinux: Update the policy for RHEL8 28511/head
Boris Ranto [Wed, 29 May 2019 10:10:54 +0000 (12:10 +0200)]
selinux: Update the policy for RHEL8

We hit a couple more SELinux denials when running ceph on RHEL8. The
dac_read_search change is related to a kernel change where it checks
dac_read_search before dac_override, now.

Signed-off-by: Boris Ranto <branto@redhat.com>
(cherry picked from commit 9c6cdf1e50a000723b4c4c9552ec16874cebb744)

6 years agoMerge pull request #28400 from xiexingguo/wip-pr-27735-for-n
Yuri Weinstein [Wed, 12 Jun 2019 03:30:09 +0000 (20:30 -0700)]
Merge pull request #28400 from xiexingguo/wip-pr-27735-for-n

nautilus: osd: revamp {noup,nodown,noin,noout} related commands

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoPendingReleaseNotes: refresh the no{up,down,in,out} flags change 28400/head
xie xingguo [Wed, 12 Jun 2019 01:47:22 +0000 (09:47 +0800)]
PendingReleaseNotes: refresh the no{up,down,in,out} flags change

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoosd: Output Base64 encoding of CRC header if binary data present 28504/head
David Zafman [Sat, 4 May 2019 18:32:40 +0000 (11:32 -0700)]
osd: Output Base64 encoding of CRC header if binary data present

Add optional paramter so cleanbin() for bufferlist can include "Base64:"

Fixes: https://tracker.ceph.com/issues/39582
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit eea239c03ca8aeb9a1da742b07d8627fbe2317e2)

Conflicts:
src/include/util.h : Resolved for cleanbin

6 years agoMerge pull request #27742 from s0nea/wip-39346-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 23:13:32 +0000 (16:13 -0700)]
Merge pull request #27742 from s0nea/wip-39346-nautilus

nautilus: mgr/dashboard: Manager should complain about wrong dashboard certificate

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #28175 from tspmelo/wip-39961-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 21:48:25 +0000 (14:48 -0700)]
Merge pull request #28175 from tspmelo/wip-39961-nautilus

nautilus: mgr/dashboard: Unify the look of dashboard charts

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28191 from ricardoasmarques/wip-39988-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 21:47:53 +0000 (14:47 -0700)]
Merge pull request #28191 from ricardoasmarques/wip-39988-nautilus

nautilus: mgr/dashboard: Unable to see tcmu-runner perf counters

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by:  Tiago Melo <tmelo@suse.com>

6 years agoMerge pull request #28273 from pdvian/wip-39675-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 21:46:58 +0000 (14:46 -0700)]
Merge pull request #28273 from pdvian/wip-39675-nautilus

nautilus: qa/workunits/rbd: wait for rbd-nbd unmap to complete

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28398 from tchaikov/nautilus-pr-28268
Yuri Weinstein [Tue, 11 Jun 2019 21:46:04 +0000 (14:46 -0700)]
Merge pull request #28398 from tchaikov/nautilus-pr-28268

nautilus: mon: fix off-by-one rendering progress bar

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoclient: fix "ceph.dir.rctime" vxattr value 28500/head
David Disseldorp [Wed, 15 May 2019 16:16:10 +0000 (18:16 +0200)]
client: fix "ceph.dir.rctime" vxattr value

The vxattr value incorrectly places a "09" prefix to the nanoseconds
field, instead of providing it as a zero-pad width specifier after '%'.

Fixes: https://tracker.ceph.com/issues/39943
Signed-off-by: David Disseldorp <ddiss@suse.de>
(cherry picked from commit 8980378ce8f61cb397835f351a7e7e3abc500dfa)

6 years agoclient: fix "ceph.snap.btime" vxattr value 28499/head
David Disseldorp [Wed, 15 May 2019 16:19:06 +0000 (18:19 +0200)]
client: fix "ceph.snap.btime" vxattr value

The vxattr value incorrectly places a "09" prefix to the nanoseconds
field, instead of providing it as a zero-pad width specifier after '%'.

Fixes: https://tracker.ceph.com/issues/39705
Signed-off-by: David Disseldorp <ddiss@suse.de>
(cherry picked from commit 02935988ec61f67fb8203982fa259402c6e545af)

6 years agopybind/mgr: add slash to prometheus illegal metric name characters 28485/head
Mykola Golub [Wed, 29 May 2019 06:38:35 +0000 (07:38 +0100)]
pybind/mgr: add slash to prometheus illegal metric name characters

(replace with underscore)

While here, change the sequence of replaces to a single regex, as it
becomes too long.

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 425c5358fed9376939cff8a922c3ce1186d6b9e2)

6 years agopybind/mgr: fix format for rbd-mirror prometheus metrics
Mykola Golub [Tue, 21 May 2019 16:26:15 +0000 (17:26 +0100)]
pybind/mgr: fix format for rbd-mirror prometheus metrics

Fixes: https://tracker.ceph.com/issues/39977
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 425f97ea990e4e5ea5853c8b462641112eef871d)

6 years agoAdd 'RBD_FEATURE_MIGRATING' to rbd.pyx 28482/head
Ricardo Marques [Tue, 7 May 2019 15:48:07 +0000 (16:48 +0100)]
Add 'RBD_FEATURE_MIGRATING' to rbd.pyx

Fixes: http://tracker.ceph.com/issues/39609
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit aa79986e0c0f644dd18893d84ef5a2f4d0b4eca4)

6 years agoqa/tests: added v14.2.1 28416/head
Yuri Weinstein [Wed, 5 Jun 2019 22:18:36 +0000 (15:18 -0700)]
qa/tests: added v14.2.1

Also white listed "failed to encode map"
Ref: https://tracker.ceph.com/issues/40251

Fixes: http://tracker.ceph.com/issues/40181
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #28458 from yuriw/wip-yuriw-40208-nautilus
Yuri Weinstein [Mon, 10 Jun 2019 19:31:27 +0000 (12:31 -0700)]
Merge pull request #28458 from yuriw/wip-yuriw-40208-nautilus

qa/tests: removed `1node` and `systemd` tests as ceph-deploy is not a…

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agopybind/rados: fixed Python3 string conversion issue on get_fsid 28476/head
Jason Dillaman [Tue, 19 Feb 2019 16:02:41 +0000 (11:02 -0500)]
pybind/rados: fixed Python3 string conversion issue on get_fsid

Fixes: http://tracker.ceph.com/issues/38381
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 005f19eff0b4a92647e5847e306718be76704432)

6 years agorpm: have py3 RPMs provide/obsolete py2 predecessors 28469/head
Nathan Cutler [Thu, 18 Apr 2019 16:32:17 +0000 (18:32 +0200)]
rpm: have py3 RPMs provide/obsolete py2 predecessors

When upgrading from a Python 2 build to a Python 3 one, we need to make the
python3-* packages replace their Python 2 counterparts.

Fixes: http://tracker.ceph.com/issues/40099
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 55bc3493f0cba246f203c2908810db3ec22662d3)

6 years agoosd: unify sources of no{up,down,in,out} flags into singleton helpers
xie xingguo [Thu, 30 May 2019 06:42:23 +0000 (14:42 +0800)]
osd: unify sources of no{up,down,in,out} flags into singleton helpers

Currently there are various ways to set no{up,down,in,out} flags,
by osd, by crush node, or by device class.

Use traditional is_no{up,down,in,out} helper to catch-all,
and add special wrappers for certain internal consumers.

This way osd won't ignore the noup flag set by the new crush node,
device class, or any future sources.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 9d11a3a1c96edd4f38f4584ce76febf920763883)

Conflicts:
        slight conflict from the "Remove dependence on 'using namespac'" change,
        see https://github.com/ceph/ceph/pull/27255

6 years agoMerge pull request #27677 from smithfarm/wip-39197-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:31:18 +0000 (09:31 -0700)]
Merge pull request #27677 from smithfarm/wip-39197-nautilus

nautilus: cephfs-shell: ls command produces error: no colorize attribute found error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27714 from pdvian/wip-39192-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:30:43 +0000 (09:30 -0700)]
Merge pull request #27714 from pdvian/wip-39192-nautilus

nautilus: mds: drop reconnect message from non-existent session

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27736 from pdvian/wip-39199-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:30:11 +0000 (09:30 -0700)]
Merge pull request #27736 from pdvian/wip-39199-nautilus

nautilus: mds/server: check directory split after rename.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27842 from pdvian/wip-39209-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:29:48 +0000 (09:29 -0700)]
Merge pull request #27842 from pdvian/wip-39209-nautilus

nautilus: mds: initialize cap_revoke_eviction_timeout with conf

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27846 from ashishkumsingh/wip-39470-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:29:24 +0000 (09:29 -0700)]
Merge pull request #27846 from ashishkumsingh/wip-39470-nautilus

nautilus: mds: better output of 'ceph health detail'

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27849 from Vicente-Cheng/wip-39473-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:28:58 +0000 (09:28 -0700)]
Merge pull request #27849 from Vicente-Cheng/wip-39473-nautilus

nautilus: mds: fail to resolve snapshot name contains '_'

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoqa/tests: removed `1node` and `systemd` tests as ceph-deploy is not actively developed 28458/head
Yuri Weinstein [Sat, 8 Jun 2019 16:20:07 +0000 (09:20 -0700)]
qa/tests: removed `1node` and `systemd` tests as ceph-deploy is not actively developed

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #27851 from Vicente-Cheng/wip-39232-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 16:35:54 +0000 (09:35 -0700)]
Merge pull request #27851 from Vicente-Cheng/wip-39232-nautilus

nautilus: kclient: nofail option not supported

Reviewed-by: Venky Shankar <vshankar@redhat.com>