]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agovstart.sh: update comment to use ganesha from CentOS Storage SIG 35602/head
Kefu Chai [Tue, 16 Jun 2020 09:03:13 +0000 (17:03 +0800)]
vstart.sh: update comment to use ganesha from CentOS Storage SIG

see https://download.nfs-ganesha.org/3/LATEST/RHEL/

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35524 from sebastian-philipp/cephadm-rm-container-storage
Kefu Chai [Tue, 16 Jun 2020 06:44:01 +0000 (14:44 +0800)]
Merge pull request #35524 from sebastian-philipp/cephadm-rm-container-storage

cephadm: call `podman rm --storage`

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35317 from dsavineau/doc_radosgw_key_typo
Kefu Chai [Tue, 16 Jun 2020 01:41:27 +0000 (09:41 +0800)]
Merge pull request #35317 from dsavineau/doc_radosgw_key_typo

doc/radosgw/admin: fix key subuser typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #35541 into master
Patrick Donnelly [Mon, 15 Jun 2020 23:41:43 +0000 (16:41 -0700)]
Merge PR #35541 into master

* refs/pull/35541/head:
doc/dev: mention -l, -e and -n among useful options
doc/dev: add info on how to retest QA changes without rebuilding

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #35561 from tchaikov/wip-crimson-disable-bluestore-with-allocator
Kefu Chai [Mon, 15 Jun 2020 12:59:06 +0000 (20:59 +0800)]
Merge pull request #35561 from tchaikov/wip-crimson-disable-bluestore-with-allocator

crimson/os: disable alienized bluestore if using seastar allocator

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge pull request #35472 from varshar16/wip-vstart-stop-cephadm
Sebastian Wagner [Mon, 15 Jun 2020 09:21:30 +0000 (11:21 +0200)]
Merge pull request #35472 from varshar16/wip-vstart-stop-cephadm

stop.sh: Kill cephadm deployed daemons

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agocephadm: call `podman rm --storage` 35524/head
Sebastian Wagner [Wed, 10 Jun 2020 12:20:20 +0000 (14:20 +0200)]
cephadm: call `podman rm --storage`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agocrimson/os: disable alienized bluestore if using seastar allocator 35561/head
Kefu Chai [Sun, 14 Jun 2020 13:47:28 +0000 (21:47 +0800)]
crimson/os: disable alienized bluestore if using seastar allocator

before figuring out how to colocate alien store and seastar's builtin
allocator. we need to disable alienized bluestore, if
SEASTAR_DEFAULT_ALLOCATOR is not defined.

See-also: https://tracker.ceph.com/issues/45985
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3dd052c4558144d7252aa8a856c1601ea17b74e7)

5 years agoMerge pull request #35538 from bk201/wip-45155
Sebastian Wagner [Fri, 12 Jun 2020 21:19:16 +0000 (23:19 +0200)]
Merge pull request #35538 from bk201/wip-45155

mgr/cephadm: set Ganesha pool/namespace settings in the Dashboard

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #35474 from sebastian-philipp/python-common-hostspec
Sebastian Wagner [Fri, 12 Jun 2020 21:16:47 +0000 (23:16 +0200)]
Merge pull request #35474 from sebastian-philipp/python-common-hostspec

mgr/orch: move HostSpec to python-common

Reviewed-by: Joshua Schmid <jschmid@suse.de>
5 years agoMerge PR #33406 into master
Patrick Donnelly [Fri, 12 Jun 2020 21:12:05 +0000 (14:12 -0700)]
Merge PR #33406 into master

* refs/pull/33406/head:
libcephfs/pybind: Add truncate, ftruncate
libcephfs/pybind: Add get_layout, get_default_pool
libcephfs/pybind: Add setattrx, fsetattrx
libcephfs/pybind: Add pwritev, preadv
libcephfs/pybind: Add rewinddir, telldir, seekdir
libcephfs/pybind: Add set_uuid, set_session_timeout
libcephfs/pybind: Add debug_get_fd_caps, debug_get_file_caps, get_cap_return_timeout
libcephfs/pybind: Add get_pool_id, get_pool_replication
libcephfs/pybind: Add get_file_replication, get_path_replication
libcephfs/pybind: Add lazyio, lazyio_propagate, lazyio_synchronize
libcephfs/pybind: Add fallocate, mknod
libcephfs/pybind: Add lsetxattr, lremovexattr, lgetxattr, llistxattr
libcephfs/pybind: Add fsetxattr, fgetxattr, fremovexattr, flistxattr
libcephfs/pybind: Add fchown, fchmod

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge PR #34716 into master
Patrick Donnelly [Fri, 12 Jun 2020 21:10:14 +0000 (14:10 -0700)]
Merge PR #34716 into master

* refs/pull/34716/head:
mgr/volumes: Add snapshot info command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
5 years agoMerge PR #35261 into master
Patrick Donnelly [Fri, 12 Jun 2020 21:08:13 +0000 (14:08 -0700)]
Merge PR #35261 into master

* refs/pull/35261/head:
qa/vstart_runner.py: ignores when source and destination are same

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
5 years agoMerge PR #35368 into master
Patrick Donnelly [Fri, 12 Jun 2020 21:06:57 +0000 (14:06 -0700)]
Merge PR #35368 into master

* refs/pull/35368/head:
fuse: update to newer FUSE_USE_VERSION

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #35519 from kshtsk/wip-remove-t-py2
Yuri Weinstein [Fri, 12 Jun 2020 19:54:44 +0000 (12:54 -0700)]
Merge pull request #35519 from kshtsk/wip-remove-t-py2

qa/crontab: remove -t py2 from schedule

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #35536 from icepic/patch-1
Kefu Chai [Fri, 12 Jun 2020 08:20:56 +0000 (16:20 +0800)]
Merge pull request #35536 from icepic/patch-1

doc/dev/deduplication.rst: fix a spelling nit

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agodoc/dev/deduplication.rst: fix a spelling nit 35536/head
Janne Johansson [Thu, 11 Jun 2020 09:25:00 +0000 (11:25 +0200)]
doc/dev/deduplication.rst: fix a spelling nit

Signed-off-by: Janne Johansson <icepic.dz@gmail.com>
5 years agomgr/cephadm: set Ganesha pool/namespace settings in the Dashboard 35538/head
Kiefer Chang [Thu, 11 Jun 2020 09:53:57 +0000 (17:53 +0800)]
mgr/cephadm: set Ganesha pool/namespace settings in the Dashboard

- Config Ganesha pool and namespace settings in Dashboard.
- New `config_dashboard` option in cephadm. If the flag is Flase,
  cephadm won't manage Dashboard settings for daemons. This might be
  useful when users want to config API URLs by themselves or for debugging.

Fixes: https://tracker.ceph.com/issues/45155
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
5 years agoMerge pull request #35544 from neha-ojha/wip-reduce-noise
Neha Ojha [Thu, 11 Jun 2020 22:40:46 +0000 (15:40 -0700)]
Merge pull request #35544 from neha-ojha/wip-reduce-noise

qa/tasks/ceph_manager.py: dump more useful info before failing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #35545 from LenzGr/doc-troubleshooting-community
zdover23 [Thu, 11 Jun 2020 19:00:25 +0000 (05:00 +1000)]
Merge pull request #35545 from LenzGr/doc-troubleshooting-community

doc: Updated mailing list addresses

5 years agostop.sh: Remove cephadm deployed daemons 35472/head
Varsha Rao [Mon, 8 Jun 2020 10:51:16 +0000 (16:21 +0530)]
stop.sh: Remove cephadm deployed daemons

Fixes: https://tracker.ceph.com/issues/44746
Signed-off-by: Varsha Rao <varao@redhat.com>
5 years agodoc: Updated mailing list addresses 35545/head
Lenz Grimmer [Thu, 11 Jun 2020 15:32:45 +0000 (17:32 +0200)]
doc: Updated mailing list addresses

The "Community" chapter of the RADOS troubleshooting section
was still pointing to the old mailing list addresses.

Updated to point to the new ceph.io addresses.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
5 years agoqa/tasks/ceph_manager.py: dump more useful info before failing 35544/head
Neha Ojha [Fri, 5 Jun 2020 23:32:38 +0000 (23:32 +0000)]
qa/tasks/ceph_manager.py: dump more useful info before failing

Add helpers that dump information only about PGs that haven't reached
the desired state when we fail. Previously we dumped the output of
"ceph pg dump" before failing, which prints a lot of unnecessary information
about PGs that are not responsible for the failure, making debugging harder.

Also, try to make the failure messages distinct.

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agodoc/dev: mention -l, -e and -n among useful options 35541/head
Rishabh Dave [Thu, 11 Jun 2020 12:49:41 +0000 (18:19 +0530)]
doc/dev: mention -l, -e and -n among useful options

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agodoc/dev: add info on how to retest QA changes without rebuilding
Rishabh Dave [Thu, 11 Jun 2020 12:46:35 +0000 (18:16 +0530)]
doc/dev: add info on how to retest QA changes without rebuilding

Add a section to "Running tests using teuthology" in "Developer's Guide"
that explains how to retest a branch without rebuilding binaries.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge pull request #34380 from jdkruzr/patch-1
Kefu Chai [Thu, 11 Jun 2020 12:25:22 +0000 (20:25 +0800)]
Merge pull request #34380 from jdkruzr/patch-1

doc/man: Update mount.ceph.rst for clarity

Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agomgr/test_orchestrator: Provide proper get_hosts_func 35474/head
Sebastian Wagner [Thu, 11 Jun 2020 12:12:57 +0000 (14:12 +0200)]
mgr/test_orchestrator: Provide proper get_hosts_func

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #35504 from zdover23/wip-doc-cephadm-ssh-key-setup-2020-Jun
Sebastian Wagner [Thu, 11 Jun 2020 11:53:44 +0000 (13:53 +0200)]
Merge pull request #35504 from zdover23/wip-doc-cephadm-ssh-key-setup-2020-Jun

doc/cephadm: Importing existing ssh keys

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #35526 from tchaikov/wip-qa-krbd-whitelist-mon-down
Ilya Dryomov [Thu, 11 Jun 2020 09:22:39 +0000 (11:22 +0200)]
Merge pull request #35526 from tchaikov/wip-qa-krbd-whitelist-mon-down

qa/suites/krbd: whitelist MON_DOWN health warning

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
5 years agoMerge pull request #35521 from sebastian-philipp/dashboard-mgr-module-option-default...
Kefu Chai [Thu, 11 Jun 2020 06:17:15 +0000 (14:17 +0800)]
Merge pull request #35521 from sebastian-philipp/dashboard-mgr-module-option-default-value-none-for-it-or-float

mgr/dashboard: fix None value for ints and floats

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #35318 from ifed01/wip-ifed-fix-ex-frag-test
Kefu Chai [Thu, 11 Jun 2020 01:39:04 +0000 (09:39 +0800)]
Merge pull request #35318 from ifed01/wip-ifed-fix-ex-frag-test

test/objectstore/store_test: kill ExcessiveFragmentation test case.

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #35502 from wjwithagen/wjw-fix-cls-le32
Kefu Chai [Thu, 11 Jun 2020 01:36:24 +0000 (09:36 +0800)]
Merge pull request #35502 from wjwithagen/wjw-fix-cls-le32

cls: fix missing __le32 definition

Reviewed-by: Sage Weil <sage@newdream.net>
5 years agoMerge pull request #35486 from jdurgin/wip-radosbench-qa
Kefu Chai [Thu, 11 Jun 2020 01:28:11 +0000 (09:28 +0800)]
Merge pull request #35486 from jdurgin/wip-radosbench-qa

qa/tasks/radosbench: use long form of option for compatibility

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #35258 from majianpeng/bluefs-flush-use-force
Kefu Chai [Thu, 11 Jun 2020 01:27:09 +0000 (09:27 +0800)]
Merge pull request #35258 from majianpeng/bluefs-flush-use-force

os/bluestore/BlueFS: force flush when call flush().

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #35478 from idryomov/wip-populate-watchers-replica
Kefu Chai [Thu, 11 Jun 2020 01:25:47 +0000 (09:25 +0800)]
Merge pull request #35478 from idryomov/wip-populate-watchers-replica

osd/PrimaryLogPG: don't populate watchers if replica

Reviewed-by: Samuel Just <sjust@redhat.com>
5 years agoqa/suites/krbd: whitelist MON_DOWN health warning 35526/head
Kefu Chai [Wed, 10 Jun 2020 15:20:40 +0000 (23:20 +0800)]
qa/suites/krbd: whitelist MON_DOWN health warning

see also

93de19adcf1233ce4c68f1253e0b9abef6d97a9d
608e002195638e80323780f1907db40c0b9768f0

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #35530 into master
Patrick Donnelly [Wed, 10 Jun 2020 20:59:10 +0000 (13:59 -0700)]
Merge PR #35530 into master

* refs/pull/35530/head:
vstart: set $CEPH_CONF when running ganesha-rados-grace

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agovstart: set $CEPH_CONF when running ganesha-rados-grace 35530/head
Jeff Layton [Wed, 10 Jun 2020 19:55:24 +0000 (15:55 -0400)]
vstart: set $CEPH_CONF when running ganesha-rados-grace

...otherwise we could pick up the wrong ceph.conf file. Also, use the
correct $test_user userid for these ops.

Fixes: https://tracker.ceph.com/issues/45971
Signed-off-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #35459 from sebastian-philipp/orch-apply-unknown-type
Sebastian Wagner [Wed, 10 Jun 2020 14:19:32 +0000 (16:19 +0200)]
Merge pull request #35459 from sebastian-philipp/orch-apply-unknown-type

mgr/orch: apply: Fix proper error when passed unknown type

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agomgr/dashboard: pylint: reduce number of branches 35521/head
Sebastian Wagner [Wed, 10 Jun 2020 13:40:34 +0000 (15:40 +0200)]
mgr/dashboard: pylint: reduce number of branches

fixes: `R0912: Too many branches (14/12) (too-many-branches)`
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/dashboard: fix None value for ints and floats
Sebastian Wagner [Wed, 10 Jun 2020 12:06:44 +0000 (14:06 +0200)]
mgr/dashboard: fix None value for ints and floats

Fixes: https://tracker.ceph.com/issues/45963
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #35007 from rhcs-dashboard/fix-36354-master
Lenz Grimmer [Wed, 10 Jun 2020 11:32:37 +0000 (13:32 +0200)]
Merge pull request #35007 from rhcs-dashboard/fix-36354-master

mgr/dashboard: work with v1 RBD images

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoqa/crontab: remove -t py2 from schedule 35519/head
Kyr Shatskyy [Wed, 10 Jun 2020 11:12:00 +0000 (13:12 +0200)]
qa/crontab: remove -t py2 from schedule

After automating teuthology branch selection we do not need
to provide it exclusively with teuthology-suite.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
5 years agoMerge pull request #35371 from yuriw/wip-yuriw-crontab-master
kshtsk [Wed, 10 Jun 2020 08:49:42 +0000 (10:49 +0200)]
Merge pull request #35371 from yuriw/wip-yuriw-crontab-master

qa/tests: Changed -t from `py2` to default for `octopus`

5 years agoMerge pull request #35455 from Conan-Kudo/ceph-libexec
Kefu Chai [Wed, 10 Jun 2020 04:45:08 +0000 (12:45 +0800)]
Merge pull request #35455 from Conan-Kudo/ceph-libexec

rpm, deb: Use /usr/libexec for libexecdir whenever possible

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35357 from yison/rwl-fix-deadlock-on-ut-issue
Jason Dillaman [Wed, 10 Jun 2020 02:23:48 +0000 (22:23 -0400)]
Merge pull request #35357 from yison/rwl-fix-deadlock-on-ut-issue

rbd/cache: fix deadlock on RWL unit test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #35425 from dzafman/wip-44314
David Zafman [Wed, 10 Jun 2020 00:15:52 +0000 (17:15 -0700)]
Merge pull request #35425 from dzafman/wip-44314

test: osd-backfill-stats.sh use nobackfill to avoid races in remainin…

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoqa/tasks/radosbench: use long form of option for compatibility 35486/head
Josh Durgin [Mon, 8 Jun 2020 18:29:43 +0000 (11:29 -0700)]
qa/tasks/radosbench: use long form of option for compatibility

Since the short version of --object-size changed from -o to -O, it
does not work with upgrade tests.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
5 years agoRevert "qa/tasks/radosbench: only set object size if != block size"
Josh Durgin [Mon, 8 Jun 2020 18:27:50 +0000 (11:27 -0700)]
Revert "qa/tasks/radosbench: only set object size if != block size"

This reverts commit fb991fa5f62c4aaa6c564a6d15aeee4bfaa33b39.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
Conflicts:
qa/tasks/radosbench.py - extra context from -t, trivial resolution

5 years agoRevert "qa/tasks/radosbench: fix usage of -O"
Josh Durgin [Mon, 8 Jun 2020 18:20:16 +0000 (11:20 -0700)]
Revert "qa/tasks/radosbench: fix usage of -O"

This reverts commit da19fd14dbe8bdb62ce376d9df7bf5578f169b9c.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
Conflicts:
qa/tasks/radosbench.py - concurrency arg added in context, trival resolution

5 years agoMerge pull request #35099 from sebastian-philipp/doc-orch-update-specs
Sebastian Wagner [Tue, 9 Jun 2020 20:03:51 +0000 (22:03 +0200)]
Merge pull request #35099 from sebastian-philipp/doc-orch-update-specs

doc/orch: How to update an existing specification

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
5 years agocls: fix missing __le32 definition 35502/head
Willem Jan Withagen [Tue, 9 Jun 2020 15:38:32 +0000 (15:38 +0000)]
cls: fix missing __le32 definition

On platforms that do not the __le* definitions it throws a compiler error.

fixes: https://github.com/ceph/ceph/pull/35186
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agoMerge pull request #35506 from rzarzynski/wip-crimson-thread-comment-fix
Kefu Chai [Tue, 9 Jun 2020 16:01:44 +0000 (00:01 +0800)]
Merge pull request #35506 from rzarzynski/wip-crimson-thread-comment-fix

crimson/thread: fix comment phrasing in ThreadPool.h.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #34492 from xxhdx1985126/wip-crimson-recovery-block-io-pr
Kefu Chai [Tue, 9 Jun 2020 16:00:34 +0000 (00:00 +0800)]
Merge pull request #34492 from xxhdx1985126/wip-crimson-recovery-block-io-pr

crimson/net: fix system shutdown problems

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agodoc/cephadm: Import existing ssh key docs. 35504/head
Zac Dover [Tue, 9 Jun 2020 14:15:43 +0000 (00:15 +1000)]
doc/cephadm: Import existing ssh key docs.

This commit supersedes the commit below, which was suggested by
mohnewald:

https://github.com/ceph/ceph/pull/34453/commits/1cd278b08a342df1acf9b43dbc5c27ee686149c0

Co-author: https://github.com/mohnewald

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agotest/objectstore/store_test: kill ExcessiveFragmentation test case. 35318/head
Igor Fedotov [Fri, 29 May 2020 19:28:15 +0000 (22:28 +0300)]
test/objectstore/store_test: kill ExcessiveFragmentation test case.
This test case was introduced by https://github.com/ceph/ceph/pull/18494
to verify allocation failure handling while gifting during bluefs rebalance
Not it looks outdated as there is no periodic gifting any more.

Fixes: https://tracker.ceph.com/issues/45788
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
5 years agocrimson/thread: fix comment phrasing in ThreadPool.h. 35506/head
Radoslaw Zarzynski [Tue, 9 Jun 2020 11:35:54 +0000 (13:35 +0200)]
crimson/thread: fix comment phrasing in ThreadPool.h.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge pull request #35423 from scoopex/master
Kefu Chai [Tue, 9 Jun 2020 14:30:19 +0000 (22:30 +0800)]
Merge pull request #35423 from scoopex/master

tools/histogram_dump: improve io-latency and -size statistics

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35187 from CodingSpiderFox/patch-3
zdover23 [Tue, 9 Jun 2020 13:10:05 +0000 (23:10 +1000)]
Merge pull request #35187 from CodingSpiderFox/patch-3

doc: Introduce the concept of a pool before talking about it.

5 years agoMerge pull request #32705 from petrutlucian94/windows.3
Kefu Chai [Tue, 9 Jun 2020 12:21:10 +0000 (20:21 +0800)]
Merge pull request #32705 from petrutlucian94/windows.3

include,common: Windows support [part 3]

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35422 from adamemerson/wip-45878
Kefu Chai [Tue, 9 Jun 2020 12:17:26 +0000 (20:17 +0800)]
Merge pull request #35422 from adamemerson/wip-45878

osdc: Fix crash on OSD failure

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #33720 from yunfeiguan/wip-44409
Kefu Chai [Tue, 9 Jun 2020 12:13:04 +0000 (20:13 +0800)]
Merge pull request #33720 from yunfeiguan/wip-44409

log: fix timestap precision of log can't set to millisecond.

Reviewed-by: Adam Emersen <aemerson@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #34667 from aclamk/wip-rocksdb-reshard
Kefu Chai [Tue, 9 Jun 2020 12:11:32 +0000 (20:11 +0800)]
Merge pull request #34667 from aclamk/wip-rocksdb-reshard

Resharding tool for sharded rocksdb

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #35186 from liewegas/wip-cas
Kefu Chai [Tue, 9 Jun 2020 12:10:43 +0000 (20:10 +0800)]
Merge pull request #35186 from liewegas/wip-cas

cls_cas: misc cleanup, and dynamic chunk_refs_t

Reviewed-by: Samuel Just <sjust@redhat.com>
5 years agotools/histogram_dump: improve io-latency and -size statistics 35423/head
Marc Schoechlin [Sat, 25 May 2019 11:05:16 +0000 (13:05 +0200)]
tools/histogram_dump: improve io-latency and -size statistics

The script is part of the ceph distribution but not
part of the official tooling. Nevertheless it was useful to understand
the usage scenarios of my osds.

- add colors to the output to ease interpretation
- add possibility to specify one ore more sockets
- aggregate statistics over multiple sockets
- prevent stacktrace if tool is interrupted by SIGINT
- add possibility to specify the number of data collection
  seconds between loops
- raise loop_seconds default

Signed-off-by: Marc Schoechlin <ms-github@256bit.org>
5 years agodoc/orch: How to update an existing specification 35099/head
Sebastian Wagner [Mon, 18 May 2020 09:24:29 +0000 (11:24 +0200)]
doc/orch: How to update an existing specification

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #34633 from sebastian-philipp/cephadm-total-scheduler
Sebastian Wagner [Tue, 9 Jun 2020 08:10:51 +0000 (10:10 +0200)]
Merge pull request #34633 from sebastian-philipp/cephadm-total-scheduler

mgr/cephadm: make scheduling make sense

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #35460 from agayev/fix-cmake
Kefu Chai [Tue, 9 Jun 2020 04:13:14 +0000 (12:13 +0800)]
Merge pull request #35460 from agayev/fix-cmake

blk: Add missing PUBLIC keyword to target_link_libraries command.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35095 from tchaikov/wip-kefu-onode-v1
Kefu Chai [Tue, 9 Jun 2020 04:02:12 +0000 (12:02 +0800)]
Merge pull request #35095 from tchaikov/wip-kefu-onode-v1

crimson/os: add onode node implementation

Reviewed-by: Samuel Just <sjust@redhat.com>
5 years agocrimson/os: add OnodeBlock 35095/head
Kefu Chai [Sat, 16 May 2020 08:59:29 +0000 (16:59 +0800)]
crimson/os: add OnodeBlock

used for representing the an node of onode tree

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocmake: add crimson::gtest target
Kefu Chai [Sat, 16 May 2020 10:42:59 +0000 (18:42 +0800)]
cmake: add crimson::gtest target

instead re-compiling gtest_seastar.cc, better off creating a static
library and link against it instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocrimson: add node implementation for onode tree
Kefu Chai [Fri, 15 May 2020 16:38:41 +0000 (00:38 +0800)]
crimson: add node implementation for onode tree

* node_t and friends are representations of in-mem and on-disk onode
  block/page/node. it might have different names in different contexts.
  but normally, they are the same thing and are loaded as a logical
  cached extent.
* delta_t holds the mutations against a given node onode. they are
  applied to memory once they are committed to disk as part of the
  log record.

regarding to the name of "simple-fltree", it is a short for simple
Flexible Layout Fixed Tree, which was designed by Samuel Just. My
implementation is a naive implementation of this design. But it
tries to be extensive and should be able to adapt to different policies
for rebalancing nodes when overflow/underflow. But there could be
other variant of flexible layout tree implementations in future,
so i added "simple" prefix.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocrimson/os: extract onode.h out
Kefu Chai [Fri, 15 May 2020 10:52:14 +0000 (18:52 +0800)]
crimson/os: extract onode.h out

so the concrete onode manager implementation can include it without
including the onode_manager.h interface as a whole

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocrimson/os/seastore: add ObjectStore and OnodeManager stubs
Samuel Just [Mon, 4 May 2020 23:57:33 +0000 (16:57 -0700)]
crimson/os/seastore: add ObjectStore and OnodeManager stubs

Signed-off-by: Samuel Just <sjust@redhat.com>
5 years agoMerge pull request #33878 from theanalyst/rgw/cleanup/user-policy-append
J. Eric Ivancich [Mon, 8 Jun 2020 23:52:18 +0000 (19:52 -0400)]
Merge pull request #33878 from theanalyst/rgw/cleanup/user-policy-append

rgw: append user policies to existing policies

Reviewed-by: Pritha Srivastava <prsivas@redhat.com>
Reviewed-by: Adam Emersen <aemerson@redhat.com>
5 years agoMerge pull request #33521 from linuxbox2/wip-getset-ver-nosuch
J. Eric Ivancich [Mon, 8 Jun 2020 23:50:47 +0000 (19:50 -0400)]
Merge pull request #33521 from linuxbox2/wip-getset-ver-nosuch

rgw: fail when get/set-bucket-versioning attempted on a non-existent …

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 years agoMerge pull request #33511 from theanalyst/rgw/append-gc-fixes
J. Eric Ivancich [Mon, 8 Jun 2020 23:50:04 +0000 (19:50 -0400)]
Merge pull request #33511 from theanalyst/rgw/append-gc-fixes

rgw: append obj: prevent tail from being GC'ed

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #33492 from prasakri/multisite-sync-check
J. Eric Ivancich [Mon, 8 Jun 2020 23:49:46 +0000 (19:49 -0400)]
Merge pull request #33492 from prasakri/multisite-sync-check

RGW:Multisite: Verify if the synced object is identical to source

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #35470 into master
Patrick Donnelly [Mon, 8 Jun 2020 19:07:04 +0000 (12:07 -0700)]
Merge PR #35470 into master

* refs/pull/35470/head:
mds: fix compile error with CephContext declaration

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa/tests: removed ceph-deploy suite run on mimic as EOL 35371/head
Yuri Weinstein [Mon, 8 Jun 2020 18:31:10 +0000 (11:31 -0700)]
qa/tests: removed ceph-deploy suite run on mimic as EOL

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge branch 'master' of https://github.com/ceph/ceph into wip-yuriw-crontab-master
Yuri Weinstein [Mon, 8 Jun 2020 18:30:11 +0000 (11:30 -0700)]
Merge branch 'master' of https://github.com/ceph/ceph into wip-yuriw-crontab-master

5 years agoMerge PR #35344 into master
Patrick Donnelly [Mon, 8 Jun 2020 18:25:34 +0000 (11:25 -0700)]
Merge PR #35344 into master

* refs/pull/35344/head:
vstart: Support deployment of ganesha daemon by cephadm with NFS option.
mgr/test_orchestrator: List nfs daemon

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agodebian: Use /usr/libexec for libexecdir 35455/head
Neal Gompa [Mon, 8 Jun 2020 16:59:47 +0000 (12:59 -0400)]
debian: Use /usr/libexec for libexecdir

Debian has adopted FHS 3.0 with Debian Policy Standard version 4.4.0,
and now defaults to /usr/libexec for libexecdir as well. This is
present in Ubuntu 20.04 LTS, for example.

Signed-off-by: Neal Gompa <ngompa13@gmail.com>
5 years agorpm: Drop override on %_libexecdir
Neal Gompa [Mon, 8 Jun 2020 16:56:04 +0000 (12:56 -0400)]
rpm: Drop override on %_libexecdir

We no longer need it, as distributions are converging on /usr/libexec
since FHS 3.0 has specified it as the acceptable path for libexecdir.

Fedora has been using /usr/libexec since the beginning, and
openSUSE has accepted software installed into /usr/libexec since
September 2019 in openSUSE:Factory. openSUSE Leap 15.x still uses
/usr/lib for %_libexecdir, but the rest of the spec should handle the
change gracefully.

Signed-off-by: Neal Gompa <ngompa13@gmail.com>
5 years agoceph.spec.in: use %{_presetdir} for preset settings
Kefu Chai [Mon, 8 Jun 2020 12:15:47 +0000 (20:15 +0800)]
ceph.spec.in: use %{_presetdir} for preset settings

the systemd preset settings should not be located under /usr/libexec
```
$ rpm --eval "%{_presetdir}"
/usr/lib/systemd/system-preset
```

see also
https://www.freedesktop.org/software/systemd/man/systemd.preset.html

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agorpm: Add missing CMake parameter to path to systemd unit dir
Neal Gompa [Sun, 7 Jun 2020 06:11:31 +0000 (02:11 -0400)]
rpm: Add missing CMake parameter to path to systemd unit dir

This mimics the setting passed to CMake in other package builds,
and ensures that systemd units are installed into the right place.

Signed-off-by: Neal Gompa <ngompa13@gmail.com>
5 years agoMerge pull request #35298 from tspmelo/wip-ng-progressbar
Lenz Grimmer [Mon, 8 Jun 2020 16:16:18 +0000 (18:16 +0200)]
Merge pull request #35298 from tspmelo/wip-ng-progressbar

mgr/dashboard: Use ng-bootstrap for Progressbar

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #33083 from mkogan1/wip-rgw-add-beast-access-logs
Casey Bodley [Mon, 8 Jun 2020 15:36:44 +0000 (11:36 -0400)]
Merge pull request #33083 from mkogan1/wip-rgw-add-beast-access-logs

rgw: add access log to the beast frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agosrc: Rename "zns" directory to "zoned". 35460/head
Abutalib Aghayev [Mon, 8 Jun 2020 14:04:58 +0000 (10:04 -0400)]
src: Rename "zns" directory to "zoned".

"zoned" is a more appropriate name for both HDDs and SSDs that support the zone
interface.  ZNS is an NVMe standard for zoned SSDs only.  Zoned HDDs, on the
other hand, use a SATA standard called ZBC/ZAC.

Signed-off-by: Abutalib Aghayev <agayev@cs.cmu.edu>
5 years agosrc: Add missing PRIVATE keyword to target_link_libraries command.
Abutalib Aghayev [Mon, 8 Jun 2020 14:01:19 +0000 (10:01 -0400)]
src: Add missing PRIVATE keyword to target_link_libraries command.

This fixes the following cmake error that happens if you have libzbc installed:

CMake Error at src/blk/CMakeLists.txt:40 (target_link_libraries):
  The keyword signature for target_link_libraries has already been used with
  the target "blk".  All uses of target_link_libraries with a target must be
  either all-keyword or all-plain.

  The uses of the keyword signature are here:

   * src/blk/CMakeLists.txt:32 (target_link_libraries)

Signed-off-by: Abutalib Aghayev <agayev@cs.cmu.edu>
5 years agoMerge pull request #35379 from votdev/issue_45856_show_host_labels
Lenz Grimmer [Mon, 8 Jun 2020 12:49:56 +0000 (14:49 +0200)]
Merge pull request #35379 from votdev/issue_45856_show_host_labels

mgr/dashboard: Show labels in hosts page

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agomds: fix compile error with CephContext declaration 35470/head
Willem Jan Withagen [Mon, 8 Jun 2020 12:30:37 +0000 (12:30 +0000)]
mds: fix compile error with CephContext declaration

SimilarTo: https://github.com/ceph/ceph/pull/35209
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agopython-common: Add Placement.filter_matching_hostspecs()
Sebastian Wagner [Thu, 4 Jun 2020 12:23:46 +0000 (14:23 +0200)]
python-common: Add Placement.filter_matching_hostspecs()

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agopython-common: move HostSpec to python-common
Sebastian Wagner [Thu, 4 Jun 2020 12:13:14 +0000 (14:13 +0200)]
python-common: move HostSpec to python-common

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agorgw: add access log to the beast frontend 33083/head
Mark Kogan [Tue, 18 Feb 2020 10:59:35 +0000 (12:59 +0200)]
rgw: add access log to the beast frontend

Add to the Beast frontend an access log line similar to CivetWeb.
attempting to adhere as much as possible to the Apache Combined Log
Format.

Fixes: https://tracker.ceph.com/issues/45920
rgw: use beast message for access log
(cherry picked from commit 44ec38933cbe6cc864c56332cc99502d86568fdc)

Co-authored-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Mark Kogan <mkogan@redhat.com>
5 years agoosd/PrimaryLogPG: don't populate watchers if replica 35478/head
Ilya Dryomov [Mon, 8 Jun 2020 10:57:18 +0000 (10:57 +0000)]
osd/PrimaryLogPG: don't populate watchers if replica

If an object has an established watch, serving a read from replica
eventually leads to an assert in is_degraded_or_backfilling_object()
called from handle_watch_timeout().

The issue is that after can_serve_replica_read() check is satisfied,
we look up the object context.  If not found, we fetch the object info
and then call populate_obc_watchers() which sees the recorded watch and
treats it as unconnected, arming HandleWatchTimeout on replica.

Fixes: https://tracker.ceph.com/issues/45795
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
5 years agoMerge pull request #35381 from tspmelo/wip-fix-cephfs-directories
Lenz Grimmer [Mon, 8 Jun 2020 09:51:14 +0000 (11:51 +0200)]
Merge pull request #35381 from tspmelo/wip-fix-cephfs-directories

mgr/dashboard: Fix CephFS's Directories not showing

Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #35373 from bk201/wip-45870
Lenz Grimmer [Mon, 8 Jun 2020 09:45:14 +0000 (11:45 +0200)]
Merge pull request #35373 from bk201/wip-45870

mgr/dashboard: remove space after service name in the Hosts List table

Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #35457 from tchaikov/wip-rpm-unitdir
Kefu Chai [Mon, 8 Jun 2020 08:36:38 +0000 (16:36 +0800)]
Merge pull request #35457 from tchaikov/wip-rpm-unitdir

test/crimson: avoid using variadic future

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
5 years agotest/crimson: avoid using variadic future 35457/head
Kefu Chai [Sun, 7 Jun 2020 04:16:55 +0000 (12:16 +0800)]
test/crimson: avoid using variadic future

see also 3cee25ba41069e9e9b4855f99be20910759440ca

Signed-off-by: Kefu Chai <kchai@redhat.com>