]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agoosd/pg_scrubber: use tab-width:8 38863/head
Kefu Chai [Tue, 12 Jan 2021 05:53:05 +0000 (13:53 +0800)]
osd/pg_scrubber: use tab-width:8

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38781 from tchaikov/wip-googletest-gcc11
Kefu Chai [Tue, 12 Jan 2021 04:39:38 +0000 (12:39 +0800)]
Merge pull request #38781 from tchaikov/wip-googletest-gcc11

googletest: pick up change to silence error=maybe-uninitialized warning

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38809 from Rethan/fs-status-style
Kefu Chai [Tue, 12 Jan 2021 04:27:38 +0000 (12:27 +0800)]
Merge pull request #38809 from Rethan/fs-status-style

pybind/mgr: change format_bytes unit color from black to yellow

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38814 from tchaikov/wip-fix-throttle-test
Kefu Chai [Tue, 12 Jan 2021 04:21:22 +0000 (12:21 +0800)]
Merge pull request #38814 from tchaikov/wip-fix-throttle-test

common/Throttle: return new count in put() right away

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #38811 from majianpeng/optimize-is_blackhole
Kefu Chai [Tue, 12 Jan 2021 04:20:24 +0000 (12:20 +0800)]
Merge pull request #38811 from majianpeng/optimize-is_blackhole

msg: using switch-case in place of if-else.

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38780 from majianpeng/fix-wrong-num_ios
Kefu Chai [Tue, 12 Jan 2021 04:19:29 +0000 (12:19 +0800)]
Merge pull request #38780 from majianpeng/fix-wrong-num_ios

os/bluestore: fix wrong num_ios for read op.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
4 years agoMerge pull request #38837 from vbashkirtsev/master
Kefu Chai [Tue, 12 Jan 2021 04:18:43 +0000 (12:18 +0800)]
Merge pull request #38837 from vbashkirtsev/master

common/options.h: use uint64_t for TYPE_SIZE options

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38768 from votdev/fix_path_to_dash_devel_doc
Ernesto Puerta [Mon, 11 Jan 2021 18:27:06 +0000 (19:27 +0100)]
Merge pull request #38768 from votdev/fix_path_to_dash_devel_doc

mgr/dashboard: Fix path to dash_devel.rst

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge PR #38790 into master
Patrick Donnelly [Mon, 11 Jan 2021 18:20:27 +0000 (10:20 -0800)]
Merge PR #38790 into master

* refs/pull/38790/head:
common: remove dead option

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge PR #38788 into master
Patrick Donnelly [Mon, 11 Jan 2021 18:14:06 +0000 (10:14 -0800)]
Merge PR #38788 into master

* refs/pull/38788/head:
mount.ceph: collect v2 addresses for non-legacy ms_mode options

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38640 into master
Patrick Donnelly [Mon, 11 Jan 2021 18:12:17 +0000 (10:12 -0800)]
Merge PR #38640 into master

* refs/pull/38640/head:
qa: add test for reserved keyword feature
qa: use no client for required client feature tests
mds: do not allow setting a reserved feature by name
mds: return sv for efficiency

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
4 years agoMerge pull request #38766 from sebastian-philipp/cephadm-service-action-async
Sebastian Wagner [Mon, 11 Jan 2021 17:39:13 +0000 (18:39 +0100)]
Merge pull request #38766 from sebastian-philipp/cephadm-service-action-async

mgr/cephadm: make `ceph orch {restart|...}` asynchronous

Reviewed-by: Michael Fritch <mfritch@suse.com>
4 years agoMerge pull request #38255 from linuxbox2/wip-fio-librgw
Matt Benjamin [Mon, 11 Jan 2021 17:24:59 +0000 (12:24 -0500)]
Merge pull request #38255 from linuxbox2/wip-fio-librgw

rgw:fio: introduce libfio_rgw

4 years agoMerge pull request #36120 from smithfarm/wip-rpath-ceph-diff-sorted
Nathan Cutler [Mon, 11 Jan 2021 16:48:46 +0000 (17:48 +0100)]
Merge pull request #36120 from smithfarm/wip-rpath-ceph-diff-sorted

cmake: add empty RPATH to ceph-diff-sorted

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
4 years agoMerge pull request #38671 from rhcs-dashboard/48685-upgrade-grafana
Ernesto Puerta [Mon, 11 Jan 2021 16:45:52 +0000 (17:45 +0100)]
Merge pull request #38671 from rhcs-dashboard/48685-upgrade-grafana

mgr/dashboard/monitoring: upgrade Grafana version due to CVE-2020-13379

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: b-ranto <branto@redhat.com>
Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: p-se <pseidensal@suse.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge PR #38108 into master
Patrick Donnelly [Mon, 11 Jan 2021 16:38:52 +0000 (08:38 -0800)]
Merge PR #38108 into master

* refs/pull/38108/head:
doc, man: man page for `cephfs-top` utility
doc: document `cephfs-top` utility
test: selftest for `cephfs-top` utility
spec, deb: package cephfs-top utility
cephfs-top: top(1) like utility for Ceph Filesystem
mgr/stats: include kernel version (for kclients) in `perf stats` command output
mgr/stats: include version with `perf stats` output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38836 into master
Patrick Donnelly [Mon, 11 Jan 2021 15:48:13 +0000 (07:48 -0800)]
Merge PR #38836 into master

* refs/pull/38836/head:
client: add debug messages for osdmap wait

Reviewed-by: Xiubo Li <xiubli@redhat.com>
4 years agoMerge pull request #38141 from Daniel-Pivonka/nodeexporterpullauth
Sebastian Wagner [Mon, 11 Jan 2021 14:04:55 +0000 (15:04 +0100)]
Merge pull request #38141 from Daniel-Pivonka/nodeexporterpullauth

cephadm: fix podman failure to pull authenticated registry image from systemd unit

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38712 from orozery/librbd-encryption-api
Jason Dillaman [Mon, 11 Jan 2021 13:29:51 +0000 (08:29 -0500)]
Merge pull request #38712 from orozery/librbd-encryption-api

librbd: encryption API

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agocmake: add empty RPATH to ceph-diff-sorted 36120/head
Nathan Cutler [Wed, 15 Jul 2020 16:21:37 +0000 (18:21 +0200)]
cmake: add empty RPATH to ceph-diff-sorted

This fixes a transient FTBFS on openSUSE:

[ 5365s] -- Installing: /home/abuild/rpmbuild/BUILDROOT/ceph-15.2.4.337+g55cec95eaf-1.1.x86_64/usr/bin/ceph-diff-sorted
[ 5365s] CMake Error at src/tools/cmake_install.cmake:230 (file):
[ 5365s]   file RPATH_CHANGE could not write new RPATH:
[ 5365s]
[ 5365s]     /usr/lib64/ceph
[ 5365s]
[ 5365s]   to the file:
[ 5365s]
[ 5365s]     /home/abuild/rpmbuild/BUILDROOT/ceph-15.2.4.337+g55cec95eaf-1.1.x86_64/usr/bin/ceph-diff-sorted
[ 5365s]
[ 5365s]   No valid ELF RPATH or RUNPATH entry exists in the file;

Fixes: https://tracker.ceph.com/issues/46553
Signed-off-by: Nathan Cutler <ncutler@suse.com>
4 years agolibrbd: add encryption api 38712/head
Or Ozeri [Sun, 10 Jan 2021 16:46:28 +0000 (18:46 +0200)]
librbd: add encryption api

This commit exposes librbd encryption api

Signed-off-by: Or Ozeri <oro@il.ibm.com>
4 years agolibrbd: change remap_extents to lvalue reference
Or Ozeri [Mon, 11 Jan 2021 11:50:30 +0000 (13:50 +0200)]
librbd: change remap_extents to lvalue reference

This commit changes the remap_extents api to use lvalue instead of ravlue references

Signed-off-by: Or Ozeri <oro@il.ibm.com>
4 years agolibrbd: fix wrong delete type in DataCryptor
Or Ozeri [Mon, 11 Jan 2021 11:45:00 +0000 (13:45 +0200)]
librbd: fix wrong delete type in DataCryptor

This commit fixes a delete which does not match its allocation

Signed-off-by: Or Ozeri <oro@il.ibm.com>
4 years agodoc, man: man page for `cephfs-top` utility 38108/head
Venky Shankar [Tue, 8 Dec 2020 07:09:47 +0000 (02:09 -0500)]
doc, man: man page for `cephfs-top` utility

Fixes: http://tracker.ceph.com/issues/48602
Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agodoc: document `cephfs-top` utility
Venky Shankar [Wed, 18 Nov 2020 07:49:45 +0000 (02:49 -0500)]
doc: document `cephfs-top` utility

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agotest: selftest for `cephfs-top` utility
Venky Shankar [Mon, 16 Nov 2020 11:45:48 +0000 (06:45 -0500)]
test: selftest for `cephfs-top` utility

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agospec, deb: package cephfs-top utility
Venky Shankar [Mon, 16 Nov 2020 14:07:03 +0000 (09:07 -0500)]
spec, deb: package cephfs-top utility

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agocephfs-top: top(1) like utility for Ceph Filesystem
Venky Shankar [Mon, 16 Nov 2020 14:02:24 +0000 (09:02 -0500)]
cephfs-top: top(1) like utility for Ceph Filesystem

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agomgr/stats: include kernel version (for kclients) in `perf stats` command output
Venky Shankar [Mon, 21 Dec 2020 05:40:59 +0000 (00:40 -0500)]
mgr/stats: include kernel version (for kclients) in `perf stats` command output

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agomgr/stats: include version with `perf stats` output
Venky Shankar [Mon, 16 Nov 2020 14:07:39 +0000 (09:07 -0500)]
mgr/stats: include version with `perf stats` output

So that `fstop` infers the version of mgr/stats to parse the
JSON command output.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
4 years agoMerge pull request #38804 from sebastian-philipp/cephadm-silence-evict-container
Sebastian Wagner [Mon, 11 Jan 2021 11:03:29 +0000 (12:03 +0100)]
Merge pull request #38804 from sebastian-philipp/cephadm-silence-evict-container

cephadm: silence "Failed to evict container" log msg

Reviewed-by: Adam King <adking@redhat.com>
4 years agoMerge pull request #38615 from adk3798/haproxy-stuff
Sebastian Wagner [Mon, 11 Jan 2021 11:02:25 +0000 (12:02 +0100)]
Merge pull request #38615 from adk3798/haproxy-stuff

mgr/cephadm: HA for RGW endpoints

Reviewed-by: Daniel-Pivonka <dpivonka@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agomgr/dashboard: Fix path to dash_devel.rst 38768/head
Volker Theile [Tue, 5 Jan 2021 13:32:08 +0000 (14:32 +0100)]
mgr/dashboard: Fix path to dash_devel.rst

Signed-off-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #38543 from zjcmszh/cmpext_op
Kefu Chai [Mon, 11 Jan 2021 10:26:45 +0000 (18:26 +0800)]
Merge pull request #38543 from zjcmszh/cmpext_op

pybind/rados: add WriteOp::cmpext() and ReadOp::cmpext()

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38531 from gregsfortytwo/wip-stretch-updates
Gregory Farnum [Mon, 11 Jan 2021 06:06:22 +0000 (22:06 -0800)]
Merge pull request #38531 from gregsfortytwo/wip-stretch-updates

More stretch updates for overly-aggressive safety checks that broke clients

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoclient: add debug messages for osdmap wait 38836/head
Patrick Donnelly [Sat, 9 Jan 2021 22:25:32 +0000 (14:25 -0800)]
client: add debug messages for osdmap wait

To help debug i47294.

See-also: https://tracker.ceph.com/issues/47294
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agolibrbd: move object create before set alloc hint
Or Ozeri [Sun, 10 Jan 2021 15:55:29 +0000 (17:55 +0200)]
librbd: move object create before set alloc hint

This commit fixes the order of ops in write requests to have create before set alloc hint, so that exclusive create will not falsely fail

Signed-off-by: Or Ozeri <oro@il.ibm.com>
4 years agoMerge pull request #38701 from rosinL/fix-memory-over-use
Kefu Chai [Sun, 10 Jan 2021 11:58:03 +0000 (19:58 +0800)]
Merge pull request #38701 from rosinL/fix-memory-over-use

commom/buffer: use small page aligned when bufferlist prealloc memory

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38747 from tchaikov/wip-scrub-event
Kefu Chai [Sun, 10 Jan 2021 11:52:00 +0000 (19:52 +0800)]
Merge pull request #38747 from tchaikov/wip-scrub-event

osd/scrub_machine: pass an instance of event to post_event()

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
4 years agocommon/options.h: use uint64_t for TYPE_SIZE options regardless of CPU architecture 38837/head
Vladimir Bashkirtsev [Sun, 10 Jan 2021 01:07:56 +0000 (11:37 +1030)]
common/options.h: use uint64_t for TYPE_SIZE options regardless of CPU architecture

On 32 bit systems TYPE_SIZE should remain as 64 bit value as large number of default options of TYPE_SIZE easily overflow 32 bit word. Also cluster wide options from 64 bit systems should fit unmodified into options structures on 32 bit systems.

Signed-off-by: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
4 years agolibrbd: fix crypto related memory leaks
Or Ozeri [Sat, 9 Jan 2021 20:26:59 +0000 (22:26 +0200)]
librbd: fix crypto related memory leaks

This commit fixes memory leaks introduced by the new librbd encryption feature

Signed-off-by: Or Ozeri <oro@il.ibm.com>
4 years agoMerge pull request #38796 from MahatiC/wip-ssd-read
Jason Dillaman [Sat, 9 Jan 2021 21:52:20 +0000 (16:52 -0500)]
Merge pull request #38796 from MahatiC/wip-ssd-read

librbd/cache: Implement aio_read operation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38272 from vbashkirtsev/master
Kefu Chai [Sat, 9 Jan 2021 16:25:06 +0000 (00:25 +0800)]
Merge pull request #38272 from vbashkirtsev/master

test/test_arch.cc: search "pni" in CPU flags also when detecting SSE3

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agotest/test_arch.cc: search "pni" in CPU flags also when detecting SSE3 38272/head
Vladimir Bashkirtsev [Wed, 25 Nov 2020 01:54:03 +0000 (12:24 +1030)]
test/test_arch.cc: search "pni" in CPU flags also when detecting SSE3

as sometimes a SSE-3 CPU reports "pni" (Prescott New Instructions) in /proc/cpuinfo.

Signed-off-by: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
4 years agodo_cmake.sh: do not perform 'git submodule update' if building from tarball
Vladimir Bashkirtsev [Wed, 25 Nov 2020 01:40:49 +0000 (12:10 +1030)]
do_cmake.sh: do not perform 'git submodule update' if building from tarball

Signed-off-by: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
4 years agoMerge pull request #38753 from Rethan/style-ceph-df-output
Kefu Chai [Sat, 9 Jan 2021 04:06:47 +0000 (12:06 +0800)]
Merge pull request #38753 from Rethan/style-ceph-df-output

mon/PGMap: align to same side when output ceph df / ceph df detail

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge PR #38775 into master
Patrick Donnelly [Sat, 9 Jan 2021 03:06:58 +0000 (19:06 -0800)]
Merge PR #38775 into master

* refs/pull/38775/head:
qa: remove ceph file systems on completion

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
4 years agoMerge PR #38791 into master
Patrick Donnelly [Fri, 8 Jan 2021 23:17:47 +0000 (15:17 -0800)]
Merge PR #38791 into master

* refs/pull/38791/head:
mon/MDSMonitor: add missing frozen checks

Reviewed-by: Jos Collin <jcollin@redhat.com>
4 years agoMerge PR #38778 into master
Patrick Donnelly [Fri, 8 Jan 2021 23:17:10 +0000 (15:17 -0800)]
Merge PR #38778 into master

* refs/pull/38778/head:
mds: don't use dentry_key_t in C_IO_Dir_Commit_Ops

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
4 years agoMerge PR #38773 into master
Patrick Donnelly [Fri, 8 Jan 2021 23:15:54 +0000 (15:15 -0800)]
Merge PR #38773 into master

* refs/pull/38773/head:
mds: avoid spurious sleeps

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
4 years agoMerge PR #38698 into master
Patrick Donnelly [Fri, 8 Jan 2021 23:14:10 +0000 (15:14 -0800)]
Merge PR #38698 into master

* refs/pull/38698/head:
client: fix the cache size check
client: add more detail info for the _put_inode debug log
client: skip putting inodes if map is empty

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38683 into master
Patrick Donnelly [Fri, 8 Jan 2021 23:13:22 +0000 (15:13 -0800)]
Merge PR #38683 into master

* refs/pull/38683/head:
mds: add scrub perf counters support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38642 into master
Patrick Donnelly [Fri, 8 Jan 2021 23:12:42 +0000 (15:12 -0800)]
Merge PR #38642 into master

* refs/pull/38642/head:
rpm/deb/cmake: install mount.fuse.ceph man page

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoosd: osdmap: do not assert target_v when encoding in stretch mode 38531/head
Greg Farnum [Fri, 8 Jan 2021 22:17:07 +0000 (22:17 +0000)]
osd: osdmap: do not assert target_v when encoding in stretch mode

Again, this was an overly-strict safety check. It passed testing against
(even old) userspace clients, but the kernel clients don't have all the
same feature bits and so when encoding for them, we see lower target_v values
and assert out erroneously.

As before, monitors and OSDs that actually need to interpret this data
are gated on cluster entry, so we don't need this safety check here.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
4 years agocephadm: HA for RGW endpoints 38615/head
Daniel-Pivonka [Mon, 26 Oct 2020 18:34:39 +0000 (14:34 -0400)]
cephadm: HA for RGW endpoints

Cephadm deploying keepalived and HAproxy for providing High availability for RGW endpoints

Fixes: https://tracker.ceph.com/issues/45116
Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
4 years agoMerge pull request #37882 from cbodley/wip-rgw-data-sync-notification-fix
Casey Bodley [Fri, 8 Jan 2021 20:16:23 +0000 (15:16 -0500)]
Merge pull request #37882 from cbodley/wip-rgw-data-sync-notification-fix

rgw: data sync: fix obligation check

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
4 years agoMerge pull request #38720 from bk201/wip-48717
Ernesto Puerta [Fri, 8 Jan 2021 20:09:46 +0000 (21:09 +0100)]
Merge pull request #38720 from bk201/wip-48717

mgr/dashboard: fix Reads/Writes ratio of Clients IOPS donut chart

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge PR #38776 into master
Patrick Donnelly [Fri, 8 Jan 2021 19:27:08 +0000 (11:27 -0800)]
Merge PR #38776 into master

* refs/pull/38776/head:
qa: get pool holding file data from file layout

Reviewed-by: Jeff Layton <jlayton@redhat.com>
4 years agoMerge PR #38664 into master
Patrick Donnelly [Fri, 8 Jan 2021 19:25:23 +0000 (11:25 -0800)]
Merge PR #38664 into master

* refs/pull/38664/head:
qa: bump scrub timeout
qa: move cephfs_ec_profile under cephfs
qa: do not use ec pools for default data pool
qa: skip check-counters for light workloads
qa: remove empty multimds suite
qa: merge multimds:verify with fs:verify
qa: merge multimds:thrash to fs:thrash
qa: remove dead multimds:basic
qa: move functional multimds tests to fs:functional
qa: migrate multimds workloads to fs:workloads
qa: only run valgrind on cephfs daemons
qa: stop testing filestore on cephfs suites
qa: load data pools before deleting fs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Tested-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38693 into master
Patrick Donnelly [Fri, 8 Jan 2021 18:47:07 +0000 (10:47 -0800)]
Merge PR #38693 into master

* refs/pull/38693/head:
qa: execute scrubs only on rank 0
client: print debug information about resolved MDS
qa: let Client::resolve_mds lookup the rank

Reviewed-by: Xiubo Li <xiubli@redhat.com>
4 years agoqa: remove ceph file systems on completion 38775/head
Patrick Donnelly [Tue, 5 Jan 2021 20:34:00 +0000 (12:34 -0800)]
qa: remove ceph file systems on completion

So that we can avoid MDS replacement warnings.

Fixes: https://tracker.ceph.com/issues/48757
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38510 into master
Patrick Donnelly [Fri, 8 Jan 2021 18:39:38 +0000 (10:39 -0800)]
Merge PR #38510 into master

* refs/pull/38510/head:
PendingReleaseNotes: Update about volume/nfs cluster id changes
mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #38537 from IlsooByun/fix_ret_invalid_err
Harish Munjulur [Fri, 8 Jan 2021 17:25:35 +0000 (09:25 -0800)]
Merge pull request #38537 from IlsooByun/fix_ret_invalid_err

rgw: return error when trying to copy encrypted object without key

4 years agoMerge pull request #38283 from dvanders/dvanders_throttle
Harish Munjulur [Fri, 8 Jan 2021 17:24:42 +0000 (09:24 -0800)]
Merge pull request #38283 from dvanders/dvanders_throttle

rgw: add an outstanding_requests perf counter

4 years agoMerge pull request #38242 from theanalyst/rgw/reset-stats-1-fix
Harish Munjulur [Fri, 8 Jan 2021 17:23:46 +0000 (09:23 -0800)]
Merge pull request #38242 from theanalyst/rgw/reset-stats-1-fix

rgw: cls/user: set from_index for reset stats calls

4 years agoqa: add test for reserved keyword feature 38640/head
Patrick Donnelly [Thu, 17 Dec 2020 20:11:23 +0000 (12:11 -0800)]
qa: add test for reserved keyword feature

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #38725 from CongMinYin/immutable-obejct-cache-doc
Jason Dillaman [Fri, 8 Jan 2021 14:24:21 +0000 (09:24 -0500)]
Merge pull request #38725 from CongMinYin/immutable-obejct-cache-doc

doc/rbd: Immutable object cache doc

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38667 from pcuzner/fix-cephadm-stdout
Sebastian Wagner [Fri, 8 Jan 2021 14:23:31 +0000 (15:23 +0100)]
Merge pull request #38667 from pcuzner/fix-cephadm-stdout

cephadm: make host add failure message more friendly

4 years agoMerge pull request #37920 from votdev/issue_48068_timezone
Sebastian Wagner [Fri, 8 Jan 2021 14:21:45 +0000 (15:21 +0100)]
Merge pull request #37920 from votdev/issue_48068_timezone

cephadm: Various properties like 'last_refresh' do not contain timezone

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38807 from tchaikov/wip-mon-cmd-doc
Kefu Chai [Fri, 8 Jan 2021 12:35:28 +0000 (20:35 +0800)]
Merge pull request #38807 from tchaikov/wip-mon-cmd-doc

doc: build mon_command_api.rst using a homebrew extension

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agopybind/rados: add test_cmpext_op() 38543/head
zhangjiao [Fri, 11 Dec 2020 10:43:37 +0000 (18:43 +0800)]
pybind/rados: add test_cmpext_op()

Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
4 years agopybind/rados: add ReadOp::cmpext()
zhangjiao [Fri, 11 Dec 2020 10:36:48 +0000 (18:36 +0800)]
pybind/rados: add ReadOp::cmpext()

Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
4 years agopybind/rados:add WriteOp::cmpext()
zhangjiao [Fri, 11 Dec 2020 10:21:51 +0000 (18:21 +0800)]
pybind/rados:add WriteOp::cmpext()

Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
4 years agomsg: using switch-case in place of if-else. 38811/head
Jianpeng Ma [Fri, 8 Jan 2021 08:11:27 +0000 (16:11 +0800)]
msg: using switch-case in place of if-else.

For point of performance, swith-case is better than if-else for
blackhole check.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
4 years agocommon/Throttle: return new count in put() right away 38814/head
Kefu Chai [Fri, 8 Jan 2021 07:55:49 +0000 (15:55 +0800)]
common/Throttle: return new count in put() right away

before this change, the is a racing after updating `count`, where
`count` could be updated again by another thread using this Throttle
instance. but the caller expects the value before the second mutation.

actually, the only caller which care about the return value is the
unittests in test/common/Throttle.cc. and without this change, the
ThrottleTest.get test fails randomly. almost 1 out of 5 runs fails.

after this change, the test passes after running for 256 times without
failures.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoPendingReleaseNotes: Update about volume/nfs cluster id changes 38510/head
Varsha Rao [Tue, 5 Jan 2021 11:28:20 +0000 (16:58 +0530)]
PendingReleaseNotes: Update about volume/nfs cluster id changes

Signed-off-by: Varsha Rao <varao@redhat.com>
4 years agomgr/volumes/nfs: remove 'ganesha-' prefix from cluster id
Varsha Rao [Tue, 8 Dec 2020 18:16:27 +0000 (23:46 +0530)]
mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id

Orchestrator defines service name as "<service_type>.<service_id>". The ganesha
common config object name in orchestrator is "conf-<service_name>". Volume's
nfs plugin deploys nfs-ganesha clusters with 'ganesha' prefixed to cluster id
and common config object.  It can cause unecessary issues in rook and cephadm.
So let's remove the prefix.

Fixes: https://tracker.ceph.com/issues/48514
Signed-off-by: Varsha Rao <varao@redhat.com>
4 years agoMerge pull request #38754 from tchaikov/wip-confutil-string-view
Kefu Chai [Fri, 8 Jan 2021 06:00:06 +0000 (14:00 +0800)]
Merge pull request #38754 from tchaikov/wip-confutil-string-view

common/ConfUtils: pass string_view instead of string

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agogoogletest: pick up change to silence error=maybe-uninitialized warning 38781/head
Kefu Chai [Wed, 6 Jan 2021 08:18:17 +0000 (16:18 +0800)]
googletest: pick up change to silence error=maybe-uninitialized warning

to include the fix of https://github.com/google/googletest/pull/3024

otherwise GCC-11 fails to compile the tests with following warning:

In file included from ../src/googletest/googletest/src/gtest-all.cc:42:
../src/googletest/googletest/src/gtest-death-test.cc: In function ‘bool testing::internal::StackGrowsDown()’:
../src/googletest/googletest/src/gtest-death-test.cc:1301:24: error: ‘dummy’ may be used uninitialized [-Werror=maybe-uninitialized]
 1301 |   StackLowerThanAddress(&dummy, &result);
      |   ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
../src/googletest/googletest/src/gtest-death-test.cc:1290:13: note: by argument 1 of type ‘const void*’ to ‘void testing::internal::StackLowerThanAddress(const void*, bool*)’ declared here
 1290 | static void StackLowerThanAddress(const void* ptr, bool* result) {
      |             ^~~~~~~~~~~~~~~~~~~~~
../src/googletest/googletest/src/gtest-death-test.cc:1299:7: note: ‘dummy’ declared here
 1299 |   int dummy;
      |       ^~~~~
cc1plus: all warnings being treated as errors

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agotest/test_rbd_replay: move operator<<(..rbd_loc& name) to rbd_replay
Kefu Chai [Fri, 8 Jan 2021 05:42:18 +0000 (13:42 +0800)]
test/test_rbd_replay: move operator<<(..rbd_loc& name) to rbd_replay

so gtest can print out rbd_loc when printing out diagnostic information
when test fails. after moving operator<<(ostream&, const rbd_loc&) to
the `rbd_replay` namespace, ADL is able to find it. for more details on
the lookup rules, see https://en.cppreference.com/w/cpp/language/adl

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ceph_time: add operator<< for signedspan
Kefu Chai [Thu, 7 Jan 2021 03:56:25 +0000 (11:56 +0800)]
common/ceph_time: add operator<< for signedspan

* templatize operator<<(ostream&, duration<>), so it works for more
  duration<> classes with minimal efforts -- we just need to explicitly
  instantiate these template operators
* explicitly instantiate operator<< for timespan, signedspan, seconds
  and milliseconds. they are most likely to be used in Ceph. we can add
  more of them when necessary.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ceph_time: move operator<<(ostream&, timespan&) into std namespace
Kefu Chai [Thu, 7 Jan 2021 07:17:45 +0000 (15:17 +0800)]
common/ceph_time: move operator<<(ostream&, timespan&) into std namespace

otherwise compiler is not able to find it as the "timespan" here is
actually a class defined in std namespace, even it has an alias defined
in ceph namespace like:

typedef std::chrono::duration<rep, std::nano> timespan;

but this does not make it a member of "ceph" namespace. for more details
on the lookup rules, see https://en.cppreference.com/w/cpp/language/adl

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoinclude/CompatSet: do not "using ceph::operator<<"
Kefu Chai [Thu, 7 Jan 2021 07:14:57 +0000 (15:14 +0800)]
include/CompatSet: do not "using ceph::operator<<"

it's simply not correct. because "operator<<(std::ostream&out, const
std::pair<A,B>&)" and friends are defined in "namespace std", and what
this source file intents to use are exactly these operator<<'s, there is
no need to bring any "ceph::operator<<" into this scope.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ceph_time: format duration using libfmt
Kefu Chai [Thu, 7 Jan 2021 03:55:48 +0000 (11:55 +0800)]
common/ceph_time: format duration using libfmt

for better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/mgr: change format_bytes unit color from black to yellow 38809/head
haoyixing [Fri, 8 Jan 2021 03:29:01 +0000 (11:29 +0800)]
pybind/mgr: change format_bytes unit color from black to yellow

Currently format_bytes output (such as ceph fs status) makes unit black, which is
hard to distinguish on black terminals, so change them as same as the data itself.

Signed-off-by: haoyixing <haoyixing@kuaishou.com>
4 years agodoc/_ext: accept params separated with ", " 38807/head
Kefu Chai [Thu, 7 Jan 2021 17:48:36 +0000 (01:48 +0800)]
doc/_ext: accept params separated with ", "

"mon enable_stretch_mode" command's arg descriptors are delimited with
", ", so we should ignore empty kv when split the params with ",".

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agodoc: build mon_command_api.rst using a homebrew extension
Kefu Chai [Thu, 7 Jan 2021 15:43:26 +0000 (23:43 +0800)]
doc: build mon_command_api.rst using a homebrew extension

so we can build the command doc using ReadTheDoc infra, without adding
the generated rst file to the source repo.

before this change, all the commands are ordered alphabetically. after
this change, command docs are generated by two directives, and are
ordered separately. we could restructure the directives and merge them.

but let's leave it for a future change if this is important.

for more details on writing sphinx directives, see
https://www.sphinx-doc.org/en/master/extdev/markupapi.html and
https://docutils.sourceforge.io/docs/howto/rst-directives.html

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoqa: use no client for required client feature tests
Patrick Donnelly [Thu, 7 Jan 2021 21:30:21 +0000 (13:30 -0800)]
qa: use no client for required client feature tests

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa: bump scrub timeout 38664/head
Patrick Donnelly [Tue, 5 Jan 2021 20:24:32 +0000 (12:24 -0800)]
qa: bump scrub timeout

To avoid timeouts for large workloads.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa: move cephfs_ec_profile under cephfs
Patrick Donnelly [Wed, 23 Dec 2020 23:44:57 +0000 (15:44 -0800)]
qa: move cephfs_ec_profile under cephfs

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa: do not use ec pools for default data pool
Patrick Donnelly [Wed, 23 Dec 2020 17:39:03 +0000 (09:39 -0800)]
qa: do not use ec pools for default data pool

This configuration unnecessarily slows down backtrace writes and bloats
the used disk space.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa: skip check-counters for light workloads
Patrick Donnelly [Tue, 22 Dec 2020 18:08:08 +0000 (10:08 -0800)]
qa: skip check-counters for light workloads

None of these are likely to generate exports.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa: remove empty multimds suite
Patrick Donnelly [Sun, 20 Dec 2020 03:19:52 +0000 (19:19 -0800)]
qa: remove empty multimds suite

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
4 years agoqa: merge multimds:verify with fs:verify
Patrick Donnelly [Sun, 20 Dec 2020 03:19:19 +0000 (19:19 -0800)]
qa: merge multimds:verify with fs:verify

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
4 years agoqa: merge multimds:thrash to fs:thrash
Patrick Donnelly [Sun, 20 Dec 2020 02:55:40 +0000 (18:55 -0800)]
qa: merge multimds:thrash to fs:thrash

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
4 years agoqa: remove dead multimds:basic
Patrick Donnelly [Sun, 20 Dec 2020 02:34:26 +0000 (18:34 -0800)]
qa: remove dead multimds:basic

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
4 years agoqa: move functional multimds tests to fs:functional
Patrick Donnelly [Sun, 20 Dec 2020 02:33:52 +0000 (18:33 -0800)]
qa: move functional multimds tests to fs:functional

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
4 years agoqa: migrate multimds workloads to fs:workloads
Patrick Donnelly [Sun, 20 Dec 2020 02:25:26 +0000 (18:25 -0800)]
qa: migrate multimds workloads to fs:workloads

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
4 years agoqa: only run valgrind on cephfs daemons
Patrick Donnelly [Sun, 20 Dec 2020 03:26:50 +0000 (19:26 -0800)]
qa: only run valgrind on cephfs daemons

OSD valgrind slows things down too much to the point where some tasks
fail to complete.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa: stop testing filestore on cephfs suites
Patrick Donnelly [Sat, 19 Dec 2020 22:09:24 +0000 (14:09 -0800)]
qa: stop testing filestore on cephfs suites

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>