]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoinstall-deps.sh: stop preparing wheels for python2
Kefu Chai [Wed, 18 Dec 2019 10:33:24 +0000 (18:33 +0800)]
install-deps.sh: stop preparing wheels for python2

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agopybind/mgr: remove py27 from envlist in tox.ini
Kefu Chai [Mon, 11 Nov 2019 10:38:03 +0000 (18:38 +0800)]
pybind/mgr: remove py27 from envlist in tox.ini

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agopython-common: remove py27 from envlist in tox.ini
Kefu Chai [Mon, 11 Nov 2019 10:38:32 +0000 (18:38 +0800)]
python-common: remove py27 from envlist in tox.ini

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoceph-volume/test: check using python3 instead of python
Kefu Chai [Wed, 18 Dec 2019 09:14:43 +0000 (17:14 +0800)]
ceph-volume/test: check using python3 instead of python

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agosrc,qa: install python bindings into lib/cython_modules/lib.3
Kefu Chai [Wed, 18 Dec 2019 09:12:52 +0000 (17:12 +0800)]
src,qa: install python bindings into lib/cython_modules/lib.3

instead of checking for the WITH_PYTHON* options, just hardwire to lib.3

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocmake: drop WITH_PYTHON2 option
Kefu Chai [Wed, 18 Dec 2019 09:08:21 +0000 (17:08 +0800)]
cmake: drop WITH_PYTHON2 option

* drop WITH_PYTHON2 option
* print warning message if WITH_PYTHON3 is disabled
* drop MGR_PYTHON_VERSION option, as we don't support use different
  python version for python binding and ceph-mgr embedded python
  interpreter anymore. as before switching to python3-only build,
  we can build python3 and python2 python bindings, and ceph-mgr
  can use either of them. but after switching to python3-only
  build, ceph-mgr has to use whatever python version used to
  build python binding.
* move WITH_PYTHON3 option to $top_srcdir/CMakeLists.txt, as ceph-mgr
  and python binding will share this option.
* hardware ${PYTHON_VERSION} to 3
* hardware ${Python${PYTHON_VERSION}_VERSION_MAJOR} to 3
* only build boost library with python3
* s/Python_EXECUTABLE/Python3_EXECUTABLE/
* update the build scripts and packagings accordingly
* rename all cython${PYTHON_VERSION}_* targets to cython_*
* update distutils_install_module() so it does not take python_version
  parameter anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocmake: CMAKE_ROLE defaults to "PROJECT"
Kefu Chai [Thu, 19 Dec 2019 02:56:16 +0000 (10:56 +0800)]
cmake: CMAKE_ROLE defaults to "PROJECT"

so we can use exported targets like "Python3::Python", which is defined
only if CMAKE_ROLE is "PROJECT". but this global property was introduced
by CMake 3.14, but the minimum required version of CMake is 3.10.2 in
Ceph project at this moment. let's set it if it's not defined.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32323 into master
Sage Weil [Wed, 18 Dec 2019 23:10:09 +0000 (17:10 -0600)]
Merge PR #32323 into master

* refs/pull/32323/head:
spec, debian: cephadm requires lvm2

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32191 into master
Sage Weil [Wed, 18 Dec 2019 22:22:36 +0000 (16:22 -0600)]
Merge PR #32191 into master

* refs/pull/32191/head:
doc: clarify priority use

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32310 into master
Sage Weil [Wed, 18 Dec 2019 18:20:03 +0000 (12:20 -0600)]
Merge PR #32310 into master

* refs/pull/32310/head:
Revert "qa/suites/rgw: ragweed on ubuntu"
Revert "qa/suites/rgw: disable remaining ragweed test"

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32121 from yehudasa/wip-42869
Casey Bodley [Wed, 18 Dec 2019 17:35:51 +0000 (12:35 -0500)]
Merge pull request #32121 from yehudasa/wip-42869

rgw: bucket re-creation fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32309 from cbodley/wip-43359
Casey Bodley [Wed, 18 Dec 2019 15:34:15 +0000 (10:34 -0500)]
Merge pull request #32309 from cbodley/wip-43359

rgw: data sync markers include timestamp from datalog entry

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #32311 from cbodley/wip-43360
Casey Bodley [Wed, 18 Dec 2019 15:34:02 +0000 (10:34 -0500)]
Merge pull request #32311 from cbodley/wip-43360

radosgw-admin: sync status displays id of shard furthest behind

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #32324 from tchaikov/wip-copr-repo
Kefu Chai [Wed, 18 Dec 2019 14:11:15 +0000 (22:11 +0800)]
Merge pull request #32324 from tchaikov/wip-copr-repo

install-deps.sh: add ken's copr repo for el8 build

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoMerge pull request #32317 from tchaikov/wip-rpm-pyOpenSSL
Kefu Chai [Wed, 18 Dec 2019 14:10:39 +0000 (22:10 +0800)]
Merge pull request #32317 from tchaikov/wip-rpm-pyOpenSSL

ceph.spec.in: always depends on python3.6-pyOpenSSL

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoinstall-deps.sh: add ken's copr repo for el8 build 32324/head
Kefu Chai [Wed, 18 Dec 2019 13:57:38 +0000 (21:57 +0800)]
install-deps.sh: add ken's copr repo for el8 build

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agospec, debian: cephadm requires lvm2 32323/head
Sebastian Wagner [Wed, 18 Dec 2019 13:38:48 +0000 (14:38 +0100)]
spec, debian: cephadm requires lvm2

cephadm mounts `/run/lvm` into OSD containers, which only exists,
if `lvm2` is installed on the container host. Otherwise we cannot
start ceph-volume or osd containers.

Fixes: https://tracker.ceph.com/issues/43368
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoceph.spec.in: always depends on python3.6-pyOpenSSL 32317/head
Kefu Chai [Wed, 18 Dec 2019 07:00:49 +0000 (15:00 +0800)]
ceph.spec.in: always depends on python3.6-pyOpenSSL

since we've moved to py3-only world, there is no need to depend on
pyOpenSSL anymore.

also, _python_buildid was removed in
3bf8b4d7d6012458fc761edd759a4fb3070a30fe .

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31527 into master
Patrick Donnelly [Wed, 18 Dec 2019 00:56:15 +0000 (16:56 -0800)]
Merge PR #31527 into master

* refs/pull/31527/head:
vstart: Add note for nfs-ganesha dev packages
stop.sh: Add option to kill Ganesha daemons
vstart: Add option to deploy ganesha daemons

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32303 from tchaikov/wip-build-integration-branch
Kefu Chai [Wed, 18 Dec 2019 00:37:58 +0000 (08:37 +0800)]
Merge pull request #32303 from tchaikov/wip-build-integration-branch

build-integration-branch: s/prefix/postfix/

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge PR #32291 into master
Patrick Donnelly [Wed, 18 Dec 2019 00:23:17 +0000 (16:23 -0800)]
Merge PR #32291 into master

* refs/pull/32291/head:
doc: update 'adding an MDS'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32252 into master
Sage Weil [Tue, 17 Dec 2019 21:23:27 +0000 (15:23 -0600)]
Merge PR #32252 into master

* refs/pull/32252/head:
qa/cephfs/begin: libaio-devel on el8
qa/tasks: nosetests -> python -m nose
qa/tasks/rbd_fio: fio 2.21 -> 3.16
src/test/cli-integration/rbd/snap-diff.t: python -> python
qa/workunits: use nose 3
qa/tasks/cbt: install python3 deps
qa/tasks/ceph_manager.py: do not use python to write a file
test/pybind/test_rados: execute takes a bytes (not str) payload
qa/packages/packages: python[3]-ceph is no more
qa: use python3 for venvs etc
packaging: remove python3-ipaddres, as it is part of the stdlib in py3
qa/packages: python-ceph -> python3-ceph
qa/distros: centos7 -> centos8, rhel7 -> rhel8
spec: remove _python_buildid in favor of python3_pkgversion macro
spec: remove python2 packages and conditions
debian: remove python >= 2.7 requirement
debian: add mgr python versions
debian: explicitly set PYTHON2=OFF to prevent picking up python2 interpreter
debian: update control file to use python3 dependency names
debian: remove all python2 overrides and declarations
debian: remove all python2 install files

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoradosgw-admin: sync status displays id of shard furthest behind 32311/head
Casey Bodley [Tue, 17 Dec 2019 18:30:48 +0000 (13:30 -0500)]
radosgw-admin: sync status displays id of shard furthest behind

'radosgw-admin sync status' gives you a timestamp for the "oldest
incremental change not applied", but doesn't tell you which shard that
came from. add [shard-id] to the output

Fixes: https://tracker.ceph.com/issues/43360
Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoRevert "qa/suites/rgw: ragweed on ubuntu" 32310/head
Sage Weil [Tue, 17 Dec 2019 20:40:34 +0000 (14:40 -0600)]
Revert "qa/suites/rgw: ragweed on ubuntu"

This reverts commit 73c2779524cc13bf69e025bdaed04035f5ba3968.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoRevert "qa/suites/rgw: disable remaining ragweed test"
Sage Weil [Tue, 17 Dec 2019 20:40:21 +0000 (14:40 -0600)]
Revert "qa/suites/rgw: disable remaining ragweed test"

This reverts commit 5a80fbe505e203227c4fa0de6141aaa69589d35e.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32146 into master
Sage Weil [Tue, 17 Dec 2019 20:22:04 +0000 (14:22 -0600)]
Merge PR #32146 into master

* refs/pull/32146/head:
mgr/ssh: Fix remove_osds()

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32149 into master
Sage Weil [Tue, 17 Dec 2019 20:21:48 +0000 (14:21 -0600)]
Merge PR #32149 into master

* refs/pull/32149/head:
mgr/orchestrator: Rename PlacementSpec.nodes -> PlacementSpec.hosts
mgr/ansible: Added missing type annotations
mgr/orchestrator: Add __str__ to HostSpec
mgr/ansible: Integrate mgr/ansible/tox into mgr/tox

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32278 into master
Sage Weil [Tue, 17 Dec 2019 19:57:12 +0000 (13:57 -0600)]
Merge PR #32278 into master

* refs/pull/32278/head:
qa/suites/rgw: disable valgrind for tests that require py2/ubuntu
qa/suites/rgw: disable remaining ragweed test
qa/suites/rgw: pin swift tests to py2/ubuntu
qa/suites/rgw: ragweed on ubuntu
qa/suites: run s3tests on ubuntu

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoqa/cephfs/begin: libaio-devel on el8 32252/head
Sage Weil [Tue, 17 Dec 2019 19:39:08 +0000 (13:39 -0600)]
qa/cephfs/begin: libaio-devel on el8

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agorgw: data sync markers include timestamp from datalog entry 32309/head
Casey Bodley [Tue, 17 Dec 2019 19:26:56 +0000 (14:26 -0500)]
rgw: data sync markers include timestamp from datalog entry

this corrects the output of 'radosgw-admin data sync status' to show the
timestamp of the last datalog entry applied

Fixes: https://tracker.ceph.com/issues/43359
Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #32300 into master
Sage Weil [Tue, 17 Dec 2019 19:32:38 +0000 (13:32 -0600)]
Merge PR #32300 into master

* refs/pull/32300/head:
cephadm: drop 'sha256:' prefix on container id

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32302 into master
Sage Weil [Tue, 17 Dec 2019 19:32:24 +0000 (13:32 -0600)]
Merge PR #32302 into master

* refs/pull/32302/head:
cephadm: check for both ntp.service and ntpd.service

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoqa/tasks: nosetests -> python -m nose
Sage Weil [Tue, 17 Dec 2019 18:57:57 +0000 (12:57 -0600)]
qa/tasks: nosetests -> python -m nose

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/suites/rgw: disable valgrind for tests that require py2/ubuntu 32278/head
Sage Weil [Tue, 17 Dec 2019 16:52:37 +0000 (10:52 -0600)]
qa/suites/rgw: disable valgrind for tests that require py2/ubuntu

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32280 from dillaman/wip-librbd-qos-test
Jason Dillaman [Tue, 17 Dec 2019 17:30:52 +0000 (12:30 -0500)]
Merge pull request #32280 from dillaman/wip-librbd-qos-test

qa/workunit/rbd: fixed QoS throughput unit parsing

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge PR #32279 into master
Sage Weil [Tue, 17 Dec 2019 16:59:26 +0000 (10:59 -0600)]
Merge PR #32279 into master

* refs/pull/32279/head:
mgr/orchestrator_cli: combine all host into one 'device ls' table
python-common: 'ssd/nvme' -> 'ssd'
mgr/orchestrator_cli: make 'device ls' table formatting consistent

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32282 into master
Sage Weil [Tue, 17 Dec 2019 16:59:11 +0000 (10:59 -0600)]
Merge PR #32282 into master

* refs/pull/32282/head:
cephadm: clean up shell containers on exit
cephadm: do not force container removal on unit stop

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoqa/suites/rgw: disable remaining ragweed test
Sage Weil [Tue, 17 Dec 2019 14:34:14 +0000 (08:34 -0600)]
qa/suites/rgw: disable remaining ragweed test

Needs to be py3 since it relies on the python bindings.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32284 into master
Sage Weil [Tue, 17 Dec 2019 16:32:52 +0000 (10:32 -0600)]
Merge PR #32284 into master

* refs/pull/32284/head:
qa/suites/rbd/openstack: use 18.04, not 16.04

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agocephadm: drop 'sha256:' prefix on container id 32300/head
Sage Weil [Tue, 17 Dec 2019 14:05:04 +0000 (08:05 -0600)]
cephadm: drop 'sha256:' prefix on container id

Podman doesn't include the prefix--only the (bionic) docker as far as I
can tell.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32273 from changchengx/doc_libvirt
Jason Dillaman [Tue, 17 Dec 2019 15:57:06 +0000 (10:57 -0500)]
Merge pull request #32273 from changchengx/doc_libvirt

doc/rbd: refine rbd/libvirt usage

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agobuild-integration-branch: s/prefix/postfix/ 32303/head
Kefu Chai [Tue, 17 Dec 2019 15:21:06 +0000 (23:21 +0800)]
build-integration-branch: s/prefix/postfix/

prefix is not defined.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32296 from rzarzynski/wip-seastar-pickup-futureopt
Kefu Chai [Tue, 17 Dec 2019 15:30:28 +0000 (23:30 +0800)]
Merge pull request #32296 from rzarzynski/wip-seastar-pickup-futureopt

seastar: pickup the recent future optimizations.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/orchestrator: Rename PlacementSpec.nodes -> PlacementSpec.hosts 32149/head
Sebastian Wagner [Fri, 13 Dec 2019 16:32:00 +0000 (17:32 +0100)]
mgr/orchestrator: Rename PlacementSpec.nodes -> PlacementSpec.hosts

By definition in the orchestrator's docs, we're using `host` insted of `node`

Fixes wrong usage of PlacementSpec in mgr/ansible

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #32301 from tchaikov/wip-build-doc
Kefu Chai [Tue, 17 Dec 2019 15:27:21 +0000 (23:27 +0800)]
Merge pull request #32301 from tchaikov/wip-build-doc

admin/doc-requirements.txt: bump up Sphinx and breathe

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32285 from liewegas/wip-py3-docs
Kefu Chai [Tue, 17 Dec 2019 15:26:46 +0000 (23:26 +0800)]
Merge pull request #32285 from liewegas/wip-py3-docs

admin/build-doc: do not use system site-packages

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agocephadm: check for both ntp.service and ntpd.service 32302/head
Sage Weil [Tue, 17 Dec 2019 14:58:58 +0000 (08:58 -0600)]
cephadm: check for both ntp.service and ntpd.service

Sigh...

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32263 from rosinL/fix-vcluster-stop
Kefu Chai [Tue, 17 Dec 2019 14:50:24 +0000 (22:50 +0800)]
Merge pull request #32263 from rosinL/fix-vcluster-stop

stop.sh: use bash shell to solve syntax error

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoadmin/build-doc: do not use system site-packages 32285/head
Sage Weil [Mon, 16 Dec 2019 23:21:30 +0000 (17:21 -0600)]
admin/build-doc: do not use system site-packages

Don't use site-packages, since the host might have the same version, and
it won't have the ditaa and breathe.

Require Cython to make the venv sufficient.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoadmin/doc-requirements.txt: bump Sphinx and breathe 32301/head
Kefu Chai [Tue, 17 Dec 2019 14:27:28 +0000 (22:27 +0800)]
admin/doc-requirements.txt: bump Sphinx and breathe

* use the latest Sphinx
* use the latest breathe. also, since there is no need to be compatible
  with python2. we can move to 4.14.0 which is python3 only.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoqa/workunit/rbd: fixed QoS throughput unit parsing 32280/head
Jason Dillaman [Mon, 16 Dec 2019 18:10:36 +0000 (13:10 -0500)]
qa/workunit/rbd: fixed QoS throughput unit parsing

The 'rbd bench' command was recently modified to print IEC units
instead of bytes/sec. This broke the handling for QoS throughput
tests since it was incorrectly evaluating the available RBD
throughput. Additionally, the QoS tests should use a "<="
comparison operator since the QoS is the upper-bound limit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge PR #32293 into master
Sage Weil [Tue, 17 Dec 2019 14:10:01 +0000 (08:10 -0600)]
Merge PR #32293 into master

* refs/pull/32293/head:
script/build-integration-branch: Add usage

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32295 from tchaikov/wip-stop.sh
Kefu Chai [Tue, 17 Dec 2019 13:14:23 +0000 (21:14 +0800)]
Merge pull request #32295 from tchaikov/wip-stop.sh

stop.sh: do not try to contact mon unless cluster is up

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
5 years agocephadm: clean up shell containers on exit 32282/head
Sage Weil [Mon, 16 Dec 2019 22:05:26 +0000 (16:05 -0600)]
cephadm: clean up shell containers on exit

The run_cmd() was already passing --rm; do it for shell_cmd too so that
we don't leave behind a mess from shell commands, ceph-volume, etc.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocephadm: do not force container removal on unit stop
Sage Weil [Mon, 16 Dec 2019 21:55:51 +0000 (15:55 -0600)]
cephadm: do not force container removal on unit stop

The -f arg for 'podman rm' will remove the container without actually
stopping it, leaving the running containers and processes (conmon and
daemon) running and generally making a mess of things.

Doing 'podman rm' without the -f on a running container will complain
that the container is still running.

So, first stop, then remove.

Fixes: f1de7060762d31e567a277c02b0d8d533fbb4661
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agostop.sh: use ${CEPH_BIN} and -c ${conf_fn} 32295/head
Kefu Chai [Tue, 17 Dec 2019 11:57:34 +0000 (19:57 +0800)]
stop.sh: use ${CEPH_BIN} and -c ${conf_fn}

to make sure ${CEPH_BIN} and ${CEPH_CONF_PATH} are respected

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agostop.sh: do not try to contact mon unless cluster is up
Kefu Chai [Tue, 17 Dec 2019 11:48:45 +0000 (19:48 +0800)]
stop.sh: do not try to contact mon unless cluster is up

otherwise "ceph mon metadata" will hang, when we try to stop an
already-stopped cluster. and `vstart_runner.py` always calls `stop.sh`
before setting up a cluster.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoseastar: pickup the recent future optimizations. 32296/head
Radoslaw Zarzynski [Tue, 17 Dec 2019 11:24:19 +0000 (12:24 +0100)]
seastar: pickup the recent future optimizations.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agovstart: Add note for nfs-ganesha dev packages 31527/head
Varsha Rao [Tue, 17 Dec 2019 11:31:55 +0000 (17:01 +0530)]
vstart: Add note for nfs-ganesha dev packages

Signed-off-by: Varsha Rao <varao@redhat.com>
5 years agoscript/build-integration-branch: Add usage 32293/head
Sebastian Wagner [Tue, 17 Dec 2019 11:25:43 +0000 (12:25 +0100)]
script/build-integration-branch: Add usage

Also add a --no-date to make it possible to re-use an existing branch name

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agodoc: update 'adding an MDS' 32291/head
Jos Collin [Tue, 17 Dec 2019 10:23:44 +0000 (15:53 +0530)]
doc: update 'adding an MDS'

Fixes: https://tracker.ceph.com/issues/43162
Signed-off-by: Jos Collin <jcollin@redhat.com>
5 years agoMerge pull request #32207 from bk201/wip-43136
Laura Paduano [Tue, 17 Dec 2019 09:57:43 +0000 (10:57 +0100)]
Merge pull request #32207 from bk201/wip-43136

mgr/dashboard: Fix OSD IDs are not displayed when using cephadm backend

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32266 from xiexingguo/wip-balancer-efficiency-1
Xie Xingguo [Tue, 17 Dec 2019 09:15:04 +0000 (17:15 +0800)]
Merge pull request #32266 from xiexingguo/wip-balancer-efficiency-1

mgr/balancer: avoid pulling pg_dump twice

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomgr/ssh: Fix remove_osds() 32146/head
Sebastian Wagner [Tue, 10 Dec 2019 10:11:33 +0000 (11:11 +0100)]
mgr/ssh: Fix remove_osds()

Changed signature from `(str) -> ...` to `(List[str]) -> ...`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #32237 from tchaikov/wip-cmake-rdkafka
Kefu Chai [Tue, 17 Dec 2019 08:29:00 +0000 (16:29 +0800)]
Merge pull request #32237 from tchaikov/wip-cmake-rdkafka

cmake: check version of librdkafka

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agostop.sh: Add option to kill Ganesha daemons
Varsha Rao [Mon, 11 Nov 2019 11:07:57 +0000 (16:37 +0530)]
stop.sh: Add option to kill Ganesha daemons

Signed-off-by: Varsha Rao <varao@redhat.com>
5 years agovstart: Add option to deploy ganesha daemons
Varsha Rao [Tue, 5 Nov 2019 11:20:20 +0000 (16:50 +0530)]
vstart: Add option to deploy ganesha daemons

To create Ganesha daemons with vstart following packages needs to be installed:
nfs-ganesha nfs-ganesha-ceph nfs-ganesha-rados-grace

Version used for these packages 2.7.6-2 on fedora 30 system.

This is an experimental option, it just deploys specified number of ganesha
daemons.

Signed-off-by: Varsha Rao <varao@redhat.com>
5 years agoMerge pull request #31144 from badone/wip-use-dnf-on-rhel-or-centos-8
Kefu Chai [Tue, 17 Dec 2019 04:03:54 +0000 (12:03 +0800)]
Merge pull request #31144 from badone/wip-use-dnf-on-rhel-or-centos-8

install-deps.sh: Use dnf for rhel/centos 8

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31884 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:30:45 +0000 (16:30 -0800)]
Merge PR #31884 into master

* refs/pull/31884/head:
qa/tasks: Fix the volume ls in test_volume_rm
qa/tasks: tests for 'fs volume create' and 'fs volume ls'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #29059 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:07:55 +0000 (16:07 -0800)]
Merge PR #29059 into master

* refs/pull/29059/head:
mds: complete all the replay op when mds is restarted ,no matter the session is closed or not.

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31662 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:06:30 +0000 (16:06 -0800)]
Merge PR #31662 into master

* refs/pull/31662/head:
mds: fix revoking caps after after stale->resume circle
client: fix incorrect debug message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32162 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:04:52 +0000 (16:04 -0800)]
Merge PR #32162 into master

* refs/pull/32162/head:
qa: note timeout in debug message

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31118 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:04:04 +0000 (16:04 -0800)]
Merge PR #31118 into master

* refs/pull/31118/head:
mds: Reorganize class members in MDSMap header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31123 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:02:53 +0000 (16:02 -0800)]
Merge PR #31123 into master

* refs/pull/31123/head:
mds : optimization functions,get_dirfrags_under, to speed up processing directories with tens of millions of files

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31595 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:01:19 +0000 (16:01 -0800)]
Merge PR #31595 into master

* refs/pull/31595/head:
mds: optimize function, fragset_t::simplify, to improve the efficiency of  merging fragment

Reviewed-by: Zheng Yan <zyan@redhat.com>
5 years agoMerge PR #32020 into master
Patrick Donnelly [Tue, 17 Dec 2019 00:00:08 +0000 (16:00 -0800)]
Merge PR #32020 into master

* refs/pull/32020/head:
mds: fix assert(omap_num_objs <= MAX_OBJECTS) of OpenFileTable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: note timeout in debug message 32162/head
Patrick Donnelly [Tue, 10 Dec 2019 21:14:42 +0000 (13:14 -0800)]
qa: note timeout in debug message

Some tests set this to a dynamic value, it'd be helpful to know how long
a test is planning to wait.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32042 into master
Patrick Donnelly [Mon, 16 Dec 2019 23:57:38 +0000 (15:57 -0800)]
Merge PR #32042 into master

* refs/pull/32042/head:
mds: update default MDS cache size memory limit
common/options: note runtime effect for some MDS configs

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoqa/suites/rbd/openstack: use 18.04, not 16.04 32284/head
Sage Weil [Mon, 16 Dec 2019 23:11:47 +0000 (17:11 -0600)]
qa/suites/rbd/openstack: use 18.04, not 16.04

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/tasks/rbd_fio: fio 2.21 -> 3.16
Sage Weil [Mon, 16 Dec 2019 19:31:14 +0000 (13:31 -0600)]
qa/tasks/rbd_fio: fio 2.21 -> 3.16

2.21 doesn't build on el8; 3.16 does.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agosrc/test/cli-integration/rbd/snap-diff.t: python -> python
Sage Weil [Mon, 16 Dec 2019 19:13:35 +0000 (13:13 -0600)]
src/test/cli-integration/rbd/snap-diff.t: python -> python

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/workunits: use nose 3
Sage Weil [Mon, 16 Dec 2019 17:49:20 +0000 (11:49 -0600)]
qa/workunits: use nose 3

Ubuntu is /usr/bin/nosetests3, el is /usr/bin/nosetests-3, so do neither.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/suites/rgw: pin swift tests to py2/ubuntu
Sage Weil [Mon, 16 Dec 2019 17:50:25 +0000 (11:50 -0600)]
qa/suites/rgw: pin swift tests to py2/ubuntu

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32275 into master
Sage Weil [Mon, 16 Dec 2019 19:57:08 +0000 (13:57 -0600)]
Merge PR #32275 into master

* refs/pull/32275/head:
qa/suites/upgrade: all upgrades to octopus on ubuntu only

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32274 from dillaman/wip-rbd-mirror-test
Jason Dillaman [Mon, 16 Dec 2019 19:44:28 +0000 (14:44 -0500)]
Merge pull request #32274 from dillaman/wip-rbd-mirror-test

rbd-mirror: ensure deterministic ordering of method calls

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agoMerge PR #32212 into master
Sage Weil [Mon, 16 Dec 2019 19:26:14 +0000 (13:26 -0600)]
Merge PR #32212 into master

* refs/pull/32212/head:
rpm/cephadm: start description and summary with capital letter
rpm/cephadm: move HOMEDIR to /var/lib and make scriptlets idempotent on SUSE

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
5 years agoMerge PR #32277 into master
Sage Weil [Mon, 16 Dec 2019 19:26:00 +0000 (13:26 -0600)]
Merge PR #32277 into master

* refs/pull/32277/head:
lvm/deactivate: add unit tests, remove --all

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agomgr/orchestrator_cli: combine all host into one 'device ls' table 32279/head
Sage Weil [Mon, 16 Dec 2019 18:56:24 +0000 (12:56 -0600)]
mgr/orchestrator_cli: combine all host into one 'device ls' table

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agopython-common: 'ssd/nvme' -> 'ssd'
Sage Weil [Mon, 16 Dec 2019 18:54:37 +0000 (12:54 -0600)]
python-common: 'ssd/nvme' -> 'ssd'

NVMe's are generally 'solid state disks'.  More importantly, NVMe is an
interface, not a device type, and there is talk of HDDs with NVMe
interfaces.

But mostly this is just makes for a more compact table.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/orchestrator_cli: make 'device ls' table formatting consistent
Sage Weil [Mon, 16 Dec 2019 18:53:44 +0000 (12:53 -0600)]
mgr/orchestrator_cli: make 'device ls' table formatting consistent

- all caps headers
- align left by default
- reorder columns

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/suites/upgrade: all upgrades to octopus on ubuntu only 32275/head
Sage Weil [Mon, 16 Dec 2019 15:29:30 +0000 (09:29 -0600)]
qa/suites/upgrade: all upgrades to octopus on ubuntu only

We cannot do a traditional upgrade (install old package, start cluster,
install new package, ...) because nautilus is el7-only and octopus is
el8-only.

So, do these tests on ubuntu.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32217 from trociny/wip-41557-2
Jason Dillaman [Mon, 16 Dec 2019 18:14:28 +0000 (13:14 -0500)]
Merge pull request #32217 from trociny/wip-41557-2

librbd: explicitly specify mode on mirror image enable

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoqa/suites/rgw: ragweed on ubuntu
Sage Weil [Mon, 16 Dec 2019 17:47:48 +0000 (11:47 -0600)]
qa/suites/rgw: ragweed on ubuntu

ragweed uses nosetests; stick to py2 for now.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/suites: run s3tests on ubuntu
Sage Weil [Mon, 16 Dec 2019 17:37:10 +0000 (11:37 -0600)]
qa/suites: run s3tests on ubuntu

Note that this does not capture the rgw/website test on valgrind, since
valgrind is centos only.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/tasks/cbt: install python3 deps
Sage Weil [Mon, 16 Dec 2019 16:17:26 +0000 (10:17 -0600)]
qa/tasks/cbt: install python3 deps

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agolvm/deactivate: add unit tests, remove --all 32277/head
Jan Fajerski [Mon, 16 Dec 2019 15:57:58 +0000 (16:57 +0100)]
lvm/deactivate: add unit tests, remove --all

Remove the --all flag until its actually implemented.

Fixes: https://tracker.ceph.com/issues/43330
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
5 years agoMerge PR #32198 into master
Sage Weil [Mon, 16 Dec 2019 16:04:13 +0000 (10:04 -0600)]
Merge PR #32198 into master

* refs/pull/32198/head:
cephadm: Fix Python2.7 isssue
cephadm: fix how uid/gid is determined
cephadm: add sample configuration for prometheus
cephadm: support deployment of prometheus

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agorpm/cephadm: start description and summary with capital letter 32212/head
Nathan Cutler [Mon, 16 Dec 2019 09:45:22 +0000 (10:45 +0100)]
rpm/cephadm: start description and summary with capital letter

This commit fixes RPMLINT issue:

cephadm.x86_64: E: summary-not-capitalized (Badness: 20) C cephadm utility to bootstrap Ceph clusters
Summary doesn't begin with a capital letter.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agorpm/cephadm: move HOMEDIR to /var/lib and make scriptlets idempotent on SUSE
Nathan Cutler [Thu, 12 Dec 2019 13:31:24 +0000 (14:31 +0100)]
rpm/cephadm: move HOMEDIR to /var/lib and make scriptlets idempotent on SUSE

Also introduce a cephadm group. Since the cephadm package does not
require ceph-common, the ceph group is not available to be used.

Drop the -r option to useradd, because cephadm does not qualify as a system
user.

Finally, fix the SUSE RPM build. SUSE RPM builds using "osc" implement a check
that compares the cephadm package's "before" and "after" file lists, to enforce
idempotency of the scriptlets. The "userdel cephadm" in the %postun breaks this
check, so omit it from the SUSE RPM builds.

Fixes: https://tracker.ceph.com/issues/43285
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agorbd-mirror: ensure deterministic ordering of method calls 32274/head
Jason Dillaman [Mon, 16 Dec 2019 14:46:15 +0000 (09:46 -0500)]
rbd-mirror: ensure deterministic ordering of method calls

The mock tests will require method calls in a known order. Previously
different environments could evaluate the parameters in different
orders resulting in out-of-order method calls.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>