]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agomgr / volumes: improve error handling 28595/head
Venky Shankar [Sun, 19 May 2019 17:34:57 +0000 (13:34 -0400)]
mgr / volumes: improve error handling

This cleans up lots of return-fu statements and make the source
look much more pythonic. Functions should raise an instance of
VolumeException() class wherever necessary (error handling).

Fixes: http://tracker.ceph.com/issues/39969
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 241c9cea7c1e489461c17fc43eb77ba28a4fd2c0)

6 years agopy / cephfs: invoke base class Error::__init__() from OSError::__init__()
Venky Shankar [Sun, 19 May 2019 17:20:51 +0000 (13:20 -0400)]
py / cephfs: invoke base class Error::__init__() from OSError::__init__()

This will allow access to `args` when catching `Error`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit aad7906fb712d3f15829a8b49f064b616475e72a)

6 years agomgr / volumes: carve out subvolume operations as a separate class
Venky Shankar [Fri, 17 May 2019 05:40:37 +0000 (01:40 -0400)]
mgr / volumes: carve out subvolume operations as a separate class

Move (and refactor) subvolume specific operations from main module
source to SubVolume class in a new subvolume source. Also, provide
hooks in VolumeClient to forward subvolume specific opertaions to
this class.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 8d29816f0f3db6c7d287bbb7469db77c9de701d1)

6 years agomgr / volumes: introduce subvolume specification class
Venky Shankar [Thu, 16 May 2019 05:54:12 +0000 (01:54 -0400)]
mgr / volumes: introduce subvolume specification class

Specifications class that represents a unique subvolume
identified by (subvolume-id, group-id) tuple. Provide
heleper functions for fetching  various subvolume specific
attributes such as subvolume path, group path etc.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 021b80495da2740fedf45793e17a258f3ebf164c)

6 years agomgr / volumes: carve of volume as a separate class
Venky Shankar [Mon, 13 May 2019 12:15:35 +0000 (17:45 +0530)]
mgr / volumes: carve of volume as a separate class

Move volume operations (create/delete) from main module source
to VolumeClient class in new volume source.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit b3dc3b2dba794e942219c385f80632b449ba5751)

6 years agoMerge pull request #28429 from ajarr/wip-fs-subvolumes-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:42:07 +0000 (12:42 -0700)]
Merge pull request #28429 from ajarr/wip-fs-subvolumes-nautilus

nautilus: mgr/volumes: add CephFS subvolumes library

6 years agoMerge pull request #28333 from pdvian/wip-39680-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:30:42 +0000 (12:30 -0700)]
Merge pull request #28333 from pdvian/wip-39680-nautilus

nautilus: cephfs: pybind: added lseek()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28499 from smithfarm/wip-40169-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:29:58 +0000 (12:29 -0700)]
Merge pull request #28499 from smithfarm/wip-40169-nautilus

nautilus: cephfs: client: fix "ceph.snap.btime" vxattr value

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
6 years agoMerge pull request #28500 from smithfarm/wip-40167-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:29:20 +0000 (12:29 -0700)]
Merge pull request #28500 from smithfarm/wip-40167-nautilus

nautilus: cephfs: client: ceph.dir.rctime xattr value incorrectly prefixes 09 to the nanoseconds component

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
6 years agoMerge pull request #28375 from pdvian/wip-39686-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:26:36 +0000 (12:26 -0700)]
Merge pull request #28375 from pdvian/wip-39686-nautilus

nautilus: client: fix fuse client hang because its bad session PipeConnection

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28394 from pdvian/wip-39690-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 19:26:13 +0000 (12:26 -0700)]
Merge pull request #28394 from pdvian/wip-39690-nautilus

nautilus: mds: check dir fragment to split dir if mkdir makes it oversized.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #27439 from liewegas/wip-centos-latest-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 17:23:58 +0000 (10:23 -0700)]
Merge pull request #27439 from liewegas/wip-centos-latest-nautilus

nautilus: qa: centos 7.6 etc

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #28279 from xiexingguo/wip-balancer-new-osd-weight-for-n
Yuri Weinstein [Fri, 14 Jun 2019 17:22:36 +0000 (10:22 -0700)]
Merge pull request #28279 from xiexingguo/wip-balancer-new-osd-weight-for-n

nautilus: mgr/balancer: various compat weight-set fixes

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #28291 from b-ranto/wip-nautilus-restful
Yuri Weinstein [Fri, 14 Jun 2019 17:22:14 +0000 (10:22 -0700)]
Merge pull request #28291 from b-ranto/wip-nautilus-restful

nautilus: mgr: Update the restful module in nautilus

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28392 from smithfarm/wip-grafana-suse-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 17:21:46 +0000 (10:21 -0700)]
Merge pull request #28392 from smithfarm/wip-grafana-suse-nautilus

nautilus: ceph.spec.in: install grafana dashboards world readable

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #28469 from smithfarm/wip-40232-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 17:21:06 +0000 (10:21 -0700)]
Merge pull request #28469 from smithfarm/wip-40232-nautilus

nautilus: build/ops: python3 pybind RPMs do not replace their python2 counterparts on upgrade even though they should

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #28504 from pdvian/wip-39738-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 16:55:25 +0000 (09:55 -0700)]
Merge pull request #28504 from pdvian/wip-39738-nautilus

nautilus: osd: Output Base64 encoding of CRC header if binary data present

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #28309 from pdvian/wip-39676-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 16:54:42 +0000 (09:54 -0700)]
Merge pull request #28309 from pdvian/wip-39676-nautilus

nautilus: rgw: crypto: throw DigestException from Digest and HMAC

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28482 from pdvian/wip-39736-nautilus
Yuri Weinstein [Fri, 14 Jun 2019 16:54:04 +0000 (09:54 -0700)]
Merge pull request #28482 from pdvian/wip-39736-nautilus

nautilus: Add 'RBD_FEATURE_MIGRATING' to rbd.pyx

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/volume: set cephfs metadata bias at 4x 28429/head
Sage Weil [Tue, 2 Apr 2019 17:20:15 +0000 (12:20 -0500)]
mgr/volume: set cephfs metadata bias at 4x

Count cephfs metadata at 4x regular rate so that the metadata pool scales
more aggressively than data pools.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1b273d3faf7740834d96d127dffcc8873bd30fce)

6 years agomgr/volume: default to 16 PGs (min) for metadata pool
Sage Weil [Tue, 2 Apr 2019 17:18:33 +0000 (12:18 -0500)]
mgr/volume: default to 16 PGs (min) for metadata pool

Set the min so that the pg_autoscaler won't scale it back down.  Choose
something large enough that even for a large FS we'll do reasonably well
distributing the metadata workload across OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b567b110cb6286d4676653179cb86ae1fe861f15)

6 years agotest: remove fs/test-volume.sh workunit
Venky Shankar [Tue, 4 Jun 2019 12:56:03 +0000 (08:56 -0400)]
test: remove fs/test-volume.sh workunit

.. since its ported to python now.

Fixes: http://tracker.ceph.com/issues/39949
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 0d044a97e9aea37ddb8f08536ad474ec12b5d4b5)

6 years agotest: port fs/volume related tests to python
Venky Shankar [Tue, 4 Jun 2019 10:09:56 +0000 (06:09 -0400)]
test: port fs/volume related tests to python

... and add subvolume related tests.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit d92840b59e01d82d901bc5767f707ff32d75074e)

6 years agomgr/volumes: fix error message
Ramana Raja [Wed, 5 Jun 2019 12:25:09 +0000 (17:55 +0530)]
mgr/volumes: fix error message

... when trying to remove a non-existent fs subvolume group
snapshot.

Fixes: http://tracker.ceph.com/issues/40014
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 834bd72d6f51801cd3b35bcc22d0f2979afbdecc)

6 years agoMerge pull request #28512 from smithfarm/wip-39601-nautilus
Nathan Cutler [Thu, 13 Jun 2019 12:21:07 +0000 (14:21 +0200)]
Merge pull request #28512 from smithfarm/wip-39601-nautilus

nautilus: rgw: document CreateBucketConfiguration for s3 PUT Bucket request

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28312 from tspmelo/wip-40075-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:18:13 +0000 (04:18 -0700)]
Merge pull request #28312 from tspmelo/wip-40075-nautilus

nautilus: mgr/dashboard: Angular is creating multiple instances of the same service

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28315 from tspmelo/wip-40076-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:17:37 +0000 (04:17 -0700)]
Merge pull request #28315 from tspmelo/wip-40076-nautilus

nautilus: mgr/dashboard: Reduce the number of renders on the tables

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28316 from tspmelo/wip-40077-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:17:05 +0000 (04:17 -0700)]
Merge pull request #28316 from tspmelo/wip-40077-nautilus

nautilus: mgr/dashboard: Only one root node is shown in the crush map viewer

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28318 from tspmelo/wip-40057-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:16:20 +0000 (04:16 -0700)]
Merge pull request #28318 from tspmelo/wip-40057-nautilus

nautilus: mgr/dashboard: NFS clients information is not displayed in the details view

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28319 from tspmelo/wip-40030-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:15:45 +0000 (04:15 -0700)]
Merge pull request #28319 from tspmelo/wip-40030-nautilus

nautilus: mgr/dashboard: Some validations are not updated and prevent the submission of a form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoMerge pull request #28320 from tspmelo/wip-39975-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:14:05 +0000 (04:14 -0700)]
Merge pull request #28320 from tspmelo/wip-39975-nautilus

nautilus: mgr/dashboard: NFS export creation: Add more info to the validation message of the field Pseudo

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28311 from tspmelo/wip-40074-nautilus
Yuri Weinstein [Thu, 13 Jun 2019 11:13:27 +0000 (04:13 -0700)]
Merge pull request #28311 from tspmelo/wip-40074-nautilus

nautilus: mgr/dashboard: Error creating NFS client without squash

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #28416 from yuriw/wip-yuriw-40181-nautilus
Yuri Weinstein [Wed, 12 Jun 2019 21:08:40 +0000 (14:08 -0700)]
Merge pull request #28416 from yuriw/wip-yuriw-40181-nautilus

qa/tests: added v14.2.1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agodoc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api 28512/head
Casey Bodley [Mon, 6 May 2019 13:33:05 +0000 (09:33 -0400)]
doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api

Fixes: http://tracker.ceph.com/issues/39597
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit e97668bb7a1333850a5791ae16b97496851ac854)

6 years agoMerge pull request #28400 from xiexingguo/wip-pr-27735-for-n
Yuri Weinstein [Wed, 12 Jun 2019 03:30:09 +0000 (20:30 -0700)]
Merge pull request #28400 from xiexingguo/wip-pr-27735-for-n

nautilus: osd: revamp {noup,nodown,noin,noout} related commands

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoPendingReleaseNotes: refresh the no{up,down,in,out} flags change 28400/head
xie xingguo [Wed, 12 Jun 2019 01:47:22 +0000 (09:47 +0800)]
PendingReleaseNotes: refresh the no{up,down,in,out} flags change

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoosd: Output Base64 encoding of CRC header if binary data present 28504/head
David Zafman [Sat, 4 May 2019 18:32:40 +0000 (11:32 -0700)]
osd: Output Base64 encoding of CRC header if binary data present

Add optional paramter so cleanbin() for bufferlist can include "Base64:"

Fixes: https://tracker.ceph.com/issues/39582
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit eea239c03ca8aeb9a1da742b07d8627fbe2317e2)

Conflicts:
src/include/util.h : Resolved for cleanbin

6 years agoMerge pull request #27742 from s0nea/wip-39346-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 23:13:32 +0000 (16:13 -0700)]
Merge pull request #27742 from s0nea/wip-39346-nautilus

nautilus: mgr/dashboard: Manager should complain about wrong dashboard certificate

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #28175 from tspmelo/wip-39961-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 21:48:25 +0000 (14:48 -0700)]
Merge pull request #28175 from tspmelo/wip-39961-nautilus

nautilus: mgr/dashboard: Unify the look of dashboard charts

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28191 from ricardoasmarques/wip-39988-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 21:47:53 +0000 (14:47 -0700)]
Merge pull request #28191 from ricardoasmarques/wip-39988-nautilus

nautilus: mgr/dashboard: Unable to see tcmu-runner perf counters

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by:  Tiago Melo <tmelo@suse.com>

6 years agoMerge pull request #28273 from pdvian/wip-39675-nautilus
Yuri Weinstein [Tue, 11 Jun 2019 21:46:58 +0000 (14:46 -0700)]
Merge pull request #28273 from pdvian/wip-39675-nautilus

nautilus: qa/workunits/rbd: wait for rbd-nbd unmap to complete

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28398 from tchaikov/nautilus-pr-28268
Yuri Weinstein [Tue, 11 Jun 2019 21:46:04 +0000 (14:46 -0700)]
Merge pull request #28398 from tchaikov/nautilus-pr-28268

nautilus: mon: fix off-by-one rendering progress bar

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoclient: fix "ceph.dir.rctime" vxattr value 28500/head
David Disseldorp [Wed, 15 May 2019 16:16:10 +0000 (18:16 +0200)]
client: fix "ceph.dir.rctime" vxattr value

The vxattr value incorrectly places a "09" prefix to the nanoseconds
field, instead of providing it as a zero-pad width specifier after '%'.

Fixes: https://tracker.ceph.com/issues/39943
Signed-off-by: David Disseldorp <ddiss@suse.de>
(cherry picked from commit 8980378ce8f61cb397835f351a7e7e3abc500dfa)

6 years agoclient: fix "ceph.snap.btime" vxattr value 28499/head
David Disseldorp [Wed, 15 May 2019 16:19:06 +0000 (18:19 +0200)]
client: fix "ceph.snap.btime" vxattr value

The vxattr value incorrectly places a "09" prefix to the nanoseconds
field, instead of providing it as a zero-pad width specifier after '%'.

Fixes: https://tracker.ceph.com/issues/39705
Signed-off-by: David Disseldorp <ddiss@suse.de>
(cherry picked from commit 02935988ec61f67fb8203982fa259402c6e545af)

6 years agoAdd 'RBD_FEATURE_MIGRATING' to rbd.pyx 28482/head
Ricardo Marques [Tue, 7 May 2019 15:48:07 +0000 (16:48 +0100)]
Add 'RBD_FEATURE_MIGRATING' to rbd.pyx

Fixes: http://tracker.ceph.com/issues/39609
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit aa79986e0c0f644dd18893d84ef5a2f4d0b4eca4)

6 years agoqa/tests: added v14.2.1 28416/head
Yuri Weinstein [Wed, 5 Jun 2019 22:18:36 +0000 (15:18 -0700)]
qa/tests: added v14.2.1

Also white listed "failed to encode map"
Ref: https://tracker.ceph.com/issues/40251

Fixes: http://tracker.ceph.com/issues/40181
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #28458 from yuriw/wip-yuriw-40208-nautilus
Yuri Weinstein [Mon, 10 Jun 2019 19:31:27 +0000 (12:31 -0700)]
Merge pull request #28458 from yuriw/wip-yuriw-40208-nautilus

qa/tests: removed `1node` and `systemd` tests as ceph-deploy is not a…

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agorpm: have py3 RPMs provide/obsolete py2 predecessors 28469/head
Nathan Cutler [Thu, 18 Apr 2019 16:32:17 +0000 (18:32 +0200)]
rpm: have py3 RPMs provide/obsolete py2 predecessors

When upgrading from a Python 2 build to a Python 3 one, we need to make the
python3-* packages replace their Python 2 counterparts.

Fixes: http://tracker.ceph.com/issues/40099
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 55bc3493f0cba246f203c2908810db3ec22662d3)

6 years agoosd: unify sources of no{up,down,in,out} flags into singleton helpers
xie xingguo [Thu, 30 May 2019 06:42:23 +0000 (14:42 +0800)]
osd: unify sources of no{up,down,in,out} flags into singleton helpers

Currently there are various ways to set no{up,down,in,out} flags,
by osd, by crush node, or by device class.

Use traditional is_no{up,down,in,out} helper to catch-all,
and add special wrappers for certain internal consumers.

This way osd won't ignore the noup flag set by the new crush node,
device class, or any future sources.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 9d11a3a1c96edd4f38f4584ce76febf920763883)

Conflicts:
        slight conflict from the "Remove dependence on 'using namespac'" change,
        see https://github.com/ceph/ceph/pull/27255

6 years agoMerge pull request #27677 from smithfarm/wip-39197-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:31:18 +0000 (09:31 -0700)]
Merge pull request #27677 from smithfarm/wip-39197-nautilus

nautilus: cephfs-shell: ls command produces error: no colorize attribute found error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27714 from pdvian/wip-39192-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:30:43 +0000 (09:30 -0700)]
Merge pull request #27714 from pdvian/wip-39192-nautilus

nautilus: mds: drop reconnect message from non-existent session

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27736 from pdvian/wip-39199-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:30:11 +0000 (09:30 -0700)]
Merge pull request #27736 from pdvian/wip-39199-nautilus

nautilus: mds/server: check directory split after rename.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27842 from pdvian/wip-39209-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:29:48 +0000 (09:29 -0700)]
Merge pull request #27842 from pdvian/wip-39209-nautilus

nautilus: mds: initialize cap_revoke_eviction_timeout with conf

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27846 from ashishkumsingh/wip-39470-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:29:24 +0000 (09:29 -0700)]
Merge pull request #27846 from ashishkumsingh/wip-39470-nautilus

nautilus: mds: better output of 'ceph health detail'

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27849 from Vicente-Cheng/wip-39473-nautilus
Yuri Weinstein [Sat, 8 Jun 2019 16:28:58 +0000 (09:28 -0700)]
Merge pull request #27849 from Vicente-Cheng/wip-39473-nautilus

nautilus: mds: fail to resolve snapshot name contains '_'

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoqa/tests: removed `1node` and `systemd` tests as ceph-deploy is not actively developed 28458/head
Yuri Weinstein [Sat, 8 Jun 2019 16:20:07 +0000 (09:20 -0700)]
qa/tests: removed `1node` and `systemd` tests as ceph-deploy is not actively developed

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #27851 from Vicente-Cheng/wip-39232-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 16:35:54 +0000 (09:35 -0700)]
Merge pull request #27851 from Vicente-Cheng/wip-39232-nautilus

nautilus: kclient: nofail option not supported

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27852 from Vicente-Cheng/wip-39214-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 15:44:25 +0000 (08:44 -0700)]
Merge pull request #27852 from Vicente-Cheng/wip-39214-nautilus

nautilus: mds: there is an assertion when calling Beacon::shutdown()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27853 from Vicente-Cheng/wip-39211-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 15:44:01 +0000 (08:44 -0700)]
Merge pull request #27853 from Vicente-Cheng/wip-39211-nautilus

nautilus: mds: MDSTableServer.cc: 83: FAILED assert(version == tid)

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27879 from pdvian/wip-39222-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 15:43:26 +0000 (08:43 -0700)]
Merge pull request #27879 from pdvian/wip-39222-nautilus

nautilus: mds: behind on trimming and "[dentry] was purgeable but no longer is!"

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27892 from Vicente-Cheng/wip-38876-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 15:42:57 +0000 (08:42 -0700)]
Merge pull request #27892 from Vicente-Cheng/wip-38876-nautilus

nautilus: mds: high debug logging with many subtrees is slow

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #27901 from Vicente-Cheng/wip-39471-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 15:42:19 +0000 (08:42 -0700)]
Merge pull request #27901 from Vicente-Cheng/wip-39471-nautilus

nautilus: mds: Expose CephFS snapshot creation time to clients

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #28040 from sebastian-philipp/wip-26654-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:11:01 +0000 (17:11 -0700)]
Merge pull request #28040 from sebastian-philipp/wip-26654-nautilus

nautilus: mgr/orchestrator: add progress events to all orchestrators

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27625 from liewegas/wip-min-crush-hammer-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:08:46 +0000 (17:08 -0700)]
Merge pull request #27625 from liewegas/wip-min-crush-hammer-nautilus

nautilus: common/options: update mon_crush_min_required_version=hammer

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27824 from liewegas/wip-abort-msg-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:08:02 +0000 (17:08 -0700)]
Merge pull request #27824 from liewegas/wip-abort-msg-nautilus

nautilus: common/assert: include ceph_abort_msg(arg) arg in log output

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27893 from Vicente-Cheng/wip-39050-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:06:38 +0000 (17:06 -0700)]
Merge pull request #27893 from Vicente-Cheng/wip-39050-nautilus

nautilus: ceph_volume_client: Too many arguments for "WriteOpCtx"

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27919 from sebastian-philipp/wip-39559-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:04:31 +0000 (17:04 -0700)]
Merge pull request #27919 from sebastian-philipp/wip-39559-nautilus

nautilus: mgr/ansible: Host ls implementation

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
6 years agoMerge pull request #28178 from tspmelo/wip-39658-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:02:20 +0000 (17:02 -0700)]
Merge pull request #28178 from tspmelo/wip-39658-nautilus

nautilus: mgr/dashboard: Avoid merge conflicts in messages.xlf by auto-generating it at build time?

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
6 years agoMerge pull request #28261 from ricardoasmarques/wip-40031-nautilus
Yuri Weinstein [Fri, 7 Jun 2019 00:00:21 +0000 (17:00 -0700)]
Merge pull request #28261 from ricardoasmarques/wip-40031-nautilus

nautilus: mgr/dashboard: local variable 'cluster_id' referenced before assignment error when trying to list NFS Ganesha daemons

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge pull request #28382 from liewegas/wip-40044-nautilus
Yuri Weinstein [Thu, 6 Jun 2019 23:59:19 +0000 (16:59 -0700)]
Merge pull request #28382 from liewegas/wip-40044-nautilus

nautilus: common: fix parse_env nullptr deref

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
6 years agomgr/volumes: fix subvolume creation with quota
Ramana Raja [Mon, 3 Jun 2019 09:46:18 +0000 (15:16 +0530)]
mgr/volumes: fix subvolume creation with quota

A quota is set on a subvolume by setting a quota virtual
xattr on a fs subdirectory. The value of the quota xattr
should be a bytes object. The quota value wasn't correctly
converted to a bytes object. Fix this.

Fixes: http://tracker.ceph.com/issues/40152
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 695c9e4dc83e77d13e9fad057d77994594fdd226)

6 years agomgr/volumes: convert string to bytes object
Rishabh Dave [Tue, 4 Jun 2019 12:26:11 +0000 (17:56 +0530)]
mgr/volumes: convert string to bytes object

mount method in libcephfs's cython modules expects filesystem_name to
be a bytes object. Therefore, convert string to bytes object
beforehand.

Fixes: http://tracker.ceph.com/issues/39750
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit a203e577098d82a6d0dea86757c9e83dccdba78d)

6 years agomgr/volumes: allow creation/deletion of FS subvolume group snapshots
Ramana Raja [Tue, 30 Apr 2019 10:01:27 +0000 (15:31 +0530)]
mgr/volumes: allow creation/deletion of FS subvolume group snapshots

... using `ceph fs subvolumegroup snapshot create/rm` commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 8b0c5267a06f8ebe29ba6d85499c19b3c2fb36fd)

6 years agomgr/volumes: allow creation/deletion of FS subvolume groups
Ramana Raja [Mon, 29 Apr 2019 12:31:49 +0000 (18:01 +0530)]
mgr/volumes: allow creation/deletion of FS subvolume groups

... using `ceph fs subvolumegroup create/rm` commands.
FS subvolume groups are parent directories of FS subvolumes. They
can be directly mapped to OpenStack Manila share groups.

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit b2ff4d534ad0ec8e306d1e58372200d18c3f5856)

6 years agomgr/volumes: allow creation/deletion of snapshots of FS subvolumes
Ramana Raja [Fri, 19 Apr 2019 16:56:38 +0000 (22:26 +0530)]
mgr/volumes: allow creation/deletion of snapshots of FS subvolumes

... using `ceph fs subvolume snapshot create/rm` commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit a02b58e0a927049aa06b1b08217af021275d77b7)

6 years agomgr/volumes: allow fetching path of FS subvolumes
Ramana Raja [Tue, 23 Apr 2019 13:03:58 +0000 (18:33 +0530)]
mgr/volumes: allow fetching path of FS subvolumes

... using `ceph fs subvolume getpath` command.

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit a47239b7f260ac4dcaf6faeb856f8f5d5dac7b4b)

6 years agomgr/volumes: use the fs_subvolume module
Ramana Raja [Sun, 14 Apr 2019 13:38:50 +0000 (19:08 +0530)]
mgr/volumes: use the fs_subvolume module

... instead of src/pybind/ceph_volume_client.py to manage CephFS
subvolumes using `ceph fs subvolume` set of commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 9d273603b344aa30c114bbc2c58e25c92bcfa232)

6 years agomgr/volumes: add fs_subvolume module
Ramana Raja [Sat, 13 Apr 2019 16:06:05 +0000 (21:36 +0530)]
mgr/volumes: add fs_subvolume module

fs_subvolume module provisions and manages CephFS subvolumes, which are
CephFS subdirectories with a desired layout and quota. Its code is
heavily borrowed from, src/pybind/ceph_volume_client.py

Fixes: http://tracker.ceph.com/issues/39610
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit f37cca105d019243bea4d8d7e42bf57cea659ecc)

6 years agoMerge pull request #27772 from smithfarm/wip-39430-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:55:34 +0000 (12:55 -0700)]
Merge pull request #27772 from smithfarm/wip-39430-nautilus

nautilus: qa: test_sessionmap assumes simple messenger

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #28141 from pdvian/wip-39476-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:54:56 +0000 (12:54 -0700)]
Merge pull request #28141 from pdvian/wip-39476-nautilus

nautilus: common/util: handle long lines in /proc/cpuinfo

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28248 from pdvian/wip-39671-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:54:19 +0000 (12:54 -0700)]
Merge pull request #28248 from pdvian/wip-39671-nautilus

nautilus: commom: make cluster_network work.

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27818 from liewegas/wip-runtime-configs-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:42:19 +0000 (12:42 -0700)]
Merge pull request #27818 from liewegas/wip-runtime-configs-nautilus

nautilus: common/options: annotate some options; enable some runtime updates

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28299 from smithfarm/wip-40067-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:41:13 +0000 (12:41 -0700)]
Merge pull request #28299 from smithfarm/wip-40067-nautilus

nautilus: build/ops: Ceph RPM build fails on openSUSE Tumbleweed with GCC 9

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
6 years agoMerge pull request #28325 from cbodley/wip-40087
Yuri Weinstein [Wed, 5 Jun 2019 19:39:47 +0000 (12:39 -0700)]
Merge pull request #28325 from cbodley/wip-40087

nautilus: common: parse ISO 8601 datetime format

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28347 from smithfarm/wip-40090-nautilus
Yuri Weinstein [Wed, 5 Jun 2019 19:39:12 +0000 (12:39 -0700)]
Merge pull request #28347 from smithfarm/wip-40090-nautilus

nautilus: mgr: log an error if we can't find any modules to load

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoqa: tolerate wildcard position
xie xingguo [Fri, 26 Apr 2019 10:22:19 +0000 (18:22 +0800)]
qa: tolerate wildcard position

It does not make much sense to add this kind of restrictions
as long as user is aware of what is going on.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 199d92aec09f756522bb61ada7951d852c5e3640)

6 years agodoc: refresh {noup,nodown,noin,noout} changes
xie xingguo [Fri, 26 Apr 2019 07:34:06 +0000 (15:34 +0800)]
doc: refresh {noup,nodown,noin,noout} changes

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit a3b0dc29b915f84545ac5bd954b6c68b8dde1c69)

6 years agomon/OSDMonitor: migrate 'osd {add,rm}-{noup,nodown,noin,noout}' command to new implem...
xie xingguo [Fri, 26 Apr 2019 07:24:01 +0000 (15:24 +0800)]
mon/OSDMonitor: migrate 'osd {add,rm}-{noup,nodown,noin,noout}' command to new implementation

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 20d05a13b33d7655709d173c43518f26d22a507b)

6 years agomon/MonCommands: mark 'osd {add,rm}-{noup,nodown,noin,noout}' as deprecated
xie xingguo [Fri, 26 Apr 2019 06:28:49 +0000 (14:28 +0800)]
mon/MonCommands: mark 'osd {add,rm}-{noup,nodown,noin,noout}' as deprecated

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 06e2255f90d178d308c1eaa83c4c591756585bc0)

6 years agoosd: add no{out,down,in,out} flags by device class
xie xingguo [Wed, 24 Apr 2019 00:57:17 +0000 (08:57 +0800)]
osd: add no{out,down,in,out} flags by device class

This works as a good supplement of https://github.com/ceph/ceph/pull/27563.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 5d695267ef03e56bf8b28853554d74e4b94b03b7)

Conflicts:
slight conflict from the "Remove dependence on 'using namespac'" change,
        see https://github.com/ceph/ceph/pull/27255

6 years agoosd,mon: add 'ceph osd {set,unset}-group <flags> <who>' command
xie xingguo [Thu, 25 Apr 2019 09:25:59 +0000 (17:25 +0800)]
osd,mon: add 'ceph osd {set,unset}-group <flags> <who>' command

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 9a05a065b936130219dfb7d11282abd80d13de85)

6 years agomgr/balancer: fix fudge 28279/head
xie xingguo [Tue, 7 May 2019 09:10:21 +0000 (17:10 +0800)]
mgr/balancer: fix fudge

next_* simply record some intermediate results when balancer tries
to find something to optimize, whereas best_* are used for the
final outputs.

Fix by comparing origin_ow with best_ow when determining if we
should use a valid fudge value.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 8f46a351f1fa6f921b373aed4038efc0898a8a44)

6 years agomon: fix off-by-one rendering progress bar 28398/head
Sage Weil [Tue, 28 May 2019 16:31:27 +0000 (11:31 -0500)]
mon: fix off-by-one rendering progress bar

Ensure that if progress is < 1.0, we always have a '.' at the end of the
bar.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 0e49ad74f9ebbefb418f9eb1c8842dbe8f16fa18)

6 years agomds: check dir fragment to split dir if mkdir makes it oversized. 28394/head
chenerqi [Wed, 10 Apr 2019 05:56:29 +0000 (13:56 +0800)]
mds: check dir fragment to split dir if mkdir makes it oversized.
In handle_client_mkdir we hit_dir (via hit_inode) in mkdir finish callback, but by then we might have overshot the split size (multiple mkdir in flight), so check dir fragment for an early chance to split the dir if mkdir makes it oversized.

Fixes: https://tracker.ceph.com/issues/39166
Signed-off-by: Erqi Chen <bestchenerqi@126.com>
(cherry picked from commit 01b4818c26b744ef74ccb09586ec03478f6b1b61)

6 years agoceph.spec.in: install grafana dashboards world readable 28392/head
Jan Fajerski [Thu, 23 May 2019 16:35:18 +0000 (18:35 +0200)]
ceph.spec.in: install grafana dashboards world readable

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 76204d32fb7687af34df296e1b99d793de483eee)

6 years agoMerge pull request #28028 from ifed01/wip-ifed-dump-before-nospanid-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 21:04:17 +0000 (14:04 -0700)]
Merge pull request #28028 from ifed01/wip-ifed-dump-before-nospanid-nautilus

nautilus: os/bluestore: dump before "no-spanning blob id" abort

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27525 from ifed01/wip-ifed-fix-21312-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:47:44 +0000 (13:47 -0700)]
Merge pull request #27525 from ifed01/wip-ifed-fix-21312-nautilus

nautilus: os/bluestore: call fault_range prior to looking for blob to reuse

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #27645 from ifed01/wip-ifed-legacy-statfs-alert-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:47:14 +0000 (13:47 -0700)]
Merge pull request #27645 from ifed01/wip-ifed-legacy-statfs-alert-nautilus

nautilus: os/bluestore: backport more bluestore alerts

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27819 from liewegas/wip-bluestore-deferred-metric-fix-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:46:30 +0000 (13:46 -0700)]
Merge pull request #27819 from liewegas/wip-bluestore-deferred-metric-fix-nautilus

nautilus: os/bluestore: correctly measure deferred writes into new blobs

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge pull request #28007 from smithfarm/wip-39612-nautilus
Yuri Weinstein [Tue, 4 Jun 2019 20:45:18 +0000 (13:45 -0700)]
Merge pull request #28007 from smithfarm/wip-39612-nautilus

nautilus: os/bluestore: fix for FreeBSD iocb structure

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>