]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Kefu Chai [Sat, 14 Aug 2021 01:40:35 +0000 (09:40 +0800)]
msg/async: build without "using namespace std"
* add "std::" prefix in headers
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Fri, 13 Aug 2021 16:14:12 +0000 (00:14 +0800)]
Merge pull request #42730 from tchaikov/wip-cmake-build-type
cmake: set CMAKE_BUILD_TYPE only if it is not specified
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Kefu Chai [Fri, 13 Aug 2021 16:12:06 +0000 (00:12 +0800)]
Merge pull request #42742 from tchaikov/wip-no-using-namespace-std
src: build without "using namespace std"
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Kefu Chai [Mon, 9 Aug 2021 07:54:22 +0000 (15:54 +0800)]
include/object.h: do not "using namespace std"
so the identifiers in "std" namespace do not conflict the ones in C code
or the idenfitiers in other namespaces.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Fri, 13 Aug 2021 05:24:58 +0000 (13:24 +0800)]
dokan: : build without "using namespace std"
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Thu, 12 Aug 2021 14:42:47 +0000 (22:42 +0800)]
java: build without "using namespace std"
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 10:44:08 +0000 (18:44 +0800)]
tools/cephfs: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 10:42:52 +0000 (18:42 +0800)]
tools/rbd_nbd: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 10:41:28 +0000 (18:41 +0800)]
mount.ceph: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 10:24:34 +0000 (18:24 +0800)]
crimson/tools: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 10:22:40 +0000 (18:22 +0800)]
tools/erasure-code: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 09:57:00 +0000 (17:57 +0800)]
cephfs-mirror: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 08:00:32 +0000 (16:00 +0800)]
client: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 07:55:39 +0000 (15:55 +0800)]
ceph_fuse: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:03:26 +0000 (12:03 +0800)]
krbd: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:02:57 +0000 (12:02 +0800)]
crush: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:02:35 +0000 (12:02 +0800)]
compressor: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:02:08 +0000 (12:02 +0800)]
auth: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:01:50 +0000 (12:01 +0800)]
kv: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:01:08 +0000 (12:01 +0800)]
msg: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:00:47 +0000 (12:00 +0800)]
neorados: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:00:21 +0000 (12:00 +0800)]
libradosstriper: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 04:00:00 +0000 (12:00 +0800)]
libcephfs: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:58:38 +0000 (11:58 +0800)]
blk: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:57:31 +0000 (11:57 +0800)]
libcephsqlite: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:56:21 +0000 (11:56 +0800)]
common: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:55:49 +0000 (11:55 +0800)]
osdc: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:55:32 +0000 (11:55 +0800)]
rbd_replay: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:54:56 +0000 (11:54 +0800)]
cls: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:54:10 +0000 (11:54 +0800)]
librados: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:53:50 +0000 (11:53 +0800)]
os: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:53:25 +0000 (11:53 +0800)]
osd: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:53:01 +0000 (11:53 +0800)]
test: : build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:52:02 +0000 (11:52 +0800)]
test/erasure-code: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:51:25 +0000 (11:51 +0800)]
test/common: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:50:47 +0000 (11:50 +0800)]
test/objectstore: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:49:52 +0000 (11:49 +0800)]
mon: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:48:33 +0000 (11:48 +0800)]
mgr: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:48:00 +0000 (11:48 +0800)]
librbd: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:47:21 +0000 (11:47 +0800)]
client: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:46:41 +0000 (11:46 +0800)]
messages: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:46:14 +0000 (11:46 +0800)]
mds: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:45:41 +0000 (11:45 +0800)]
test/librbd: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:44:59 +0000 (11:44 +0800)]
test/rbd_mirror: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:44:27 +0000 (11:44 +0800)]
test/rgw: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:43:42 +0000 (11:43 +0800)]
rgw: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:42:44 +0000 (11:42 +0800)]
tools: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:41:42 +0000 (11:41 +0800)]
tools/rbd_mirror: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:40:46 +0000 (11:40 +0800)]
tools/rbd: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 03:38:07 +0000 (11:38 +0800)]
test/crimson: build without "using namespace std"
* add "std::" prefix in headers
* add "using" declarations in .cc files.
so we don't rely on "using namespace std" in one or more included
headers.
Signed-off-by: Kefu Chai <kchai@redhat.com>
zdover23 [Thu, 12 Aug 2021 22:48:40 +0000 (08:48 +1000)]
Merge pull request #42167 from emenguy/nomad_ceph_integration_documentation
[docs]: RBD and Nomad integration
Reviewed-by: Zac Dover <zac.dover@gmail.com>
Sage Weil [Thu, 12 Aug 2021 20:04:21 +0000 (16:04 -0400)]
Merge PR #42771 into master
* refs/pull/42771/head:
.githubmap: fix format
Reviewed-by: Sage Weil <sage@redhat.com>
Ernesto Puerta [Thu, 12 Aug 2021 18:53:07 +0000 (20:53 +0200)]
Merge pull request #41570 from jhrcz-ls/wip-cephfs-overview-use-rate
mgr/dashboard: cephfs MDS Workload to use rate for counter type metric
Ernesto Puerta [Thu, 12 Aug 2021 18:52:03 +0000 (20:52 +0200)]
Merge pull request #42745 from rhcs-dashboard/52130-tox-cleanup
mgr/dashboard: tox.ini: delete useless env. 'apidocs'
Ernesto Puerta [Thu, 12 Aug 2021 18:50:51 +0000 (20:50 +0200)]
Merge pull request #42724 from rhcs-dashboard/52082-cephadm-e2e-improv
mgr/dashboard: run-cephadm-e2e-tests.sh improvements
Ernesto Puerta [Thu, 12 Aug 2021 18:22:39 +0000 (20:22 +0200)]
.githubmap: fix format
Issue introduced by merge commit
4b9a3b217127d003d4ae6addb1f0e1d8ce21b816
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
Yuri Weinstein [Thu, 12 Aug 2021 18:24:39 +0000 (11:24 -0700)]
Merge pull request #42630 from mark15213/licephsqlitefix
libcephsqlite: fix unconditional success bug in CheckReservedLock
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Thu, 12 Aug 2021 18:21:36 +0000 (11:21 -0700)]
Merge pull request #42345 from aclamk/wip-resharding-column-options
Add handling of block_cache option for resharding
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Daniel Gryniewicz [Thu, 12 Aug 2021 17:57:30 +0000 (13:57 -0400)]
Merge pull request #42767 from soumyakoduri/wip-skoduri-sqlite-freebsd
rgw/dbstore: Resolve library link issues on FreeBSD
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Willem Jan Withagen
Ernesto Puerta [Thu, 12 Aug 2021 16:39:25 +0000 (18:39 +0200)]
Merge pull request #42766 from rhcs-dashboard/fix-grafonnet-42194
mgr/dashboard: fix grafonnet build error
Neha Ojha [Thu, 12 Aug 2021 16:14:59 +0000 (09:14 -0700)]
Merge pull request #42725 from ifed01/wip-ifed-fix-deferred
os/bluestore: make deferred writes less aggressive for large writes
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Casey Bodley [Thu, 12 Aug 2021 14:06:51 +0000 (10:06 -0400)]
Merge pull request #42685 from BenoitKnecht/rgw-opa-100-continue
rgw: Use 100-continue in OPA requests to reduce latency
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Soumya Koduri [Thu, 12 Aug 2021 13:52:08 +0000 (19:22 +0530)]
rgw/dbstore: Resolve library link issues on FreeBSD
Add "rgw_common" to the target_link_libraries list to
resolve issues with sqlite_db target build on FreeBSD
Reported-by: Willem Jan Withagen wjw@digiware.nl
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Kefu Chai [Thu, 12 Aug 2021 13:13:54 +0000 (21:13 +0800)]
Merge pull request #42657 from tchaikov/wip-optional-wheel
tools/setup-virtualenv: do not use wheel if wheelhouse does not exist
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Aashish Sharma [Thu, 12 Aug 2021 08:58:23 +0000 (14:28 +0530)]
mgr/dashboard: fix grafonnet build error
This PR tends to fix the issue caused by #42194
Fixes:https://tracker.ceph.com/issues/52238
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Sebastian Wagner [Thu, 12 Aug 2021 11:06:11 +0000 (13:06 +0200)]
Merge pull request #42293 from zdover23/wip-doc-cephadm-client-setup-2021-07-12
doc/cephadm: rewrite client-setup.rst
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Sage Weil [Wed, 11 Aug 2021 19:28:40 +0000 (15:28 -0400)]
Merge PR #42759 into master
* refs/pull/42759/head:
doc/mgr/nfs: add section on updating an nfs cluster
Reviewed-by: Varsha Rao <varao@redhat.com>
Neha Ojha [Wed, 11 Aug 2021 18:29:12 +0000 (11:29 -0700)]
Merge pull request #39871 from benhanokh/no_column_b
BlueStore: Remove Allocations from RocksDB
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Casey Bodley [Wed, 11 Aug 2021 17:36:10 +0000 (13:36 -0400)]
Merge pull request #42122 from yehudasa/wip-rgw-realm-resolve
rgw: modify realm entities init resolution
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Sage Weil [Wed, 11 Aug 2021 16:31:21 +0000 (11:31 -0500)]
doc/mgr/nfs: add section on updating an nfs cluster
Signed-off-by: Sage Weil <sage@newdream.net>
Ernesto Puerta [Wed, 11 Aug 2021 16:11:59 +0000 (18:11 +0200)]
Merge pull request #42194 from rhcs-dashboard/add-grafonnet-grafana
mgr/dashboard: monitoring: replace Grafana JSON with Grafonnet based code
Sage Weil [Wed, 11 Aug 2021 15:28:28 +0000 (11:28 -0400)]
Merge PR #42252 into master
* refs/pull/42252/head:
mgr/dashboard: set rgw credentials: fix api tests
mgr/dashboard: run-frontend-e2e-tests.sh: remove unneeded rgw setting
mgr/dashboard: rgw service creation form: add realm and zone to service spec.
mgr/dashboard: connect-rgw: rename to set-rgw-credentials; refactoring
mgr/dashboard: connect-rgw: adaptation and test coverage
mgr/cephadm: re-check dashboard <-> rgw creds when rgw daemons created/destroyed
mgr/dashboard: add 'dashboard connect-rgw' command
doc/mgr/dashboard: simplify dashboard+rgw config docs
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Sage Weil [Wed, 11 Aug 2021 14:58:39 +0000 (10:58 -0400)]
Merge PR #42682 into master
* refs/pull/42682/head:
cephadm: no need to explicitly enable prometheus module
mgr/cephadm: enable prometheus module before deploying prometheus
mgr/cephadm: drop daemon_id arg to CephadmService.config()
doc/cephadm: no need to manually enable the prometheus module
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Aashish Sharma [Tue, 6 Jul 2021 11:02:20 +0000 (16:32 +0530)]
mgr/dashboard: monitoring: replace Grafana JSON with Grafonnet based Code
This PR intends to add grafonnet to generate grafana JSON files
Fixes: https://tracker.ceph.com/issues/45184
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Gabriel BenHanokh [Thu, 14 Jan 2021 06:59:35 +0000 (08:59 +0200)]
[BlueStore]: [Remove Allocations from RocksDB]
Currently BlueStore keeps its allocation info inside RocksDB.
BlueStore is committing all allocation information (alloc/release) into RocksDB (column-family B) before the client Write is performed causing a delay in write path and adding significant load to the CPU/Memory/Disk.
Committing all state into RocksDB allows Ceph to survive failures without losing the allocation state.
The new code skips the RocksDB updates on allocation time and instead perform a full desatge of the allocator object with all the OSD allocation state in a single step during umount().
This results with an 25% increase in IOPS and reduced latency in small random-write workloads, but exposes the system to losing allocation info in failure cases where we don't call umount.
We added code to perform a full allocation-map rebuild from information stored inside the ONode which is used in failure cases.
When we perform a graceful shutdown there is no need for recovery and we simply read the allocation-map from a flat file where the allocation-map was stored during umount() (in fact this mode is faster and shaves few seconds from boot time since reading a flat file is faster than iterating over RocksDB)
Open Issues:
There is a bug in the src/stop.sh script killing ceph without invoking umount() which means anyone using it will always invoke the recovery path.
Adam Kupczyk is fixing this issue in a separate PR.
A simple workaround is to add a call to 'killall -15 ceph-osd' before calling src/stop.sh
Fast-Shutdown and Ceph Suicide (done when the system underperforms) stop the system without a proper drain and a call to umount.
This will trigger a full recovery which can be long( 3 minutes in my testing, but your your mileage may vary).
We plan on adding a follow up PR doing the following in Fast-Shutdown and Ceph Suicide:
Block the OSD queues from accepting any new request
Delete all items in queue which we didn't start yet
Drain all in-flight tasks
call umount (and destage the allocation-map)
If drain didn't complete within a predefined time-limit (say 3 minutes) -> kill the OSD
Signed-off-by: Gabriel Benhanokh <gbenhano@redhat.com>
create allocator from on-disk onodes and BlueFS inodes
change allocator + add stat counters + report illegal physical-extents
compare allocator after rebuild from ONodes
prevent collection from being open twice
removed FSCK repo check for null-fm
Bug-Fix: don't add BlueFS allocation to shared allocator
add configuration option to commit to No-Column-B
Only invalidate allocation file after opening rocksdb in read-write mode
fix tests not to expect failure in cases unapplicable to null-allocator
accept non-existing allocation file and don't fail the invaladtion as it could happen legally
don't commit to null-fm when db is opened in repair-mode
add a reverse mechanism from null_fm to real_fm (using RocksDB)
Using Ceph encode/decode, adding more info to header/trailer, add crc protection
Code cleanup
some changes requested by Adam (cleanup and style changes)
Signed-off-by: Gabriel Benhanokh <gbenhano@redhat.com>
Sage Weil [Thu, 5 Aug 2021 14:31:09 +0000 (10:31 -0400)]
cephadm: no need to explicitly enable prometheus module
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil [Thu, 5 Aug 2021 14:24:13 +0000 (10:24 -0400)]
mgr/cephadm: enable prometheus module before deploying prometheus
The mon will restart the mgr when the module is enabled, so we don't
really have to do anything here. The raise is there just in case the
mgr doesn't immediately get the new mgrmap and respawn, although there is
likely no harm done if we continue to deploy prometheus in the meantime,
even if we're interrupted partway through.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil [Thu, 5 Aug 2021 14:17:40 +0000 (10:17 -0400)]
mgr/cephadm: drop daemon_id arg to CephadmService.config()
Unused (and nonsensical since this is *service* config).
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil [Thu, 5 Aug 2021 14:24:46 +0000 (10:24 -0400)]
doc/cephadm: no need to manually enable the prometheus module
Signed-off-by: Sage Weil <sage@newdream.net>
Kefu Chai [Wed, 11 Aug 2021 12:30:16 +0000 (20:30 +0800)]
Merge pull request #42748 from tchaikov/wip-crimson-cleanup
crimson/tools/store_nbd: do not capture unused variable
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 11:22:57 +0000 (19:22 +0800)]
Merge pull request #42746 from tchaikov/wip-boost-j
do_cmake:sh: do not set BOOST_J
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 11:22:28 +0000 (19:22 +0800)]
Merge pull request #42743 from tchaikov/wip-install-dep
install-deps.sh: retry if dpkg was interrupted
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 10:33:41 +0000 (18:33 +0800)]
crimson/tools/store_nbd: do not capture unused variable
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 08:29:10 +0000 (16:29 +0800)]
script/run-make.sh: retry if dpkg was interrupted
there is chance that apt-get is interrupted in the middle when a new PR
cancels the running jenkins job, the next job running apt-get or dpkg
would run into issues like:
E: dpkg was interrupted, you must manually run 'sudo dpkg --configure -a' to correct the problem.
Build step 'Execute shell' marked build as failure
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 11 Aug 2021 09:32:20 +0000 (17:32 +0800)]
do_cmake:sh: do not set BOOST_J
do_cmake.sh is called by src/script/run-make.sh in configure() function,
in src/script/run-make.sh, BOOST_J is also set if it is not set. so we
can drop the code setting BOOST_J in do_cmake.sh.
this helps to silence the cmake warning like:
CMake Warning:
Manually-specified variables were not used by the project:
BOOST_J
Signed-off-by: Kefu Chai <kchai@redhat.com>
Alfonso Martínez [Wed, 11 Aug 2021 09:14:53 +0000 (11:14 +0200)]
mgr/dashboard: tox.ini: delete useless env. 'apidocs'
Fixes: https://tracker.ceph.com/issues/52130
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Alfonso Martínez [Wed, 11 Aug 2021 08:25:42 +0000 (10:25 +0200)]
mgr/dashboard: run-cephadm-e2e-tests.sh improvements
- Jenkins env.: make sure the cluster is always started.
- PR template: add trigger phrase to the jenkins commands list.
- Cypress: add --no-install flag; clean previous reports.
Fixes: https://tracker.ceph.com/issues/52082
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Alfonso Martínez [Wed, 11 Aug 2021 06:59:13 +0000 (08:59 +0200)]
mgr/dashboard: set rgw credentials: fix api tests
Fixes: https://tracker.ceph.com/issues/44605
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Sage Weil [Tue, 10 Aug 2021 20:47:34 +0000 (16:47 -0400)]
Merge PR #42318 into master
* refs/pull/42318/head:
mgr/rook: update DefaultFetcher device path to look at local and fix bug
mgr/rook: add node and PV name information to Device in DefaultFetcher
mgr/rook: fix typing errors in Fetcher classes
mgr/rook: create and use DefaultFetcher and LSOFetcher classes
mgr/rook: create KubernetesCustomResource class to fetch CRs
mgr/rook: fix device ls error handling
mgr/rook: change storage class module option name and default value
mgr/rook: fix typing errors related to storage_class_name and device ls
mgr/rook: make `device ls` only display pvs in specified storage class
mgr/rook: add StorageV1Api and storage_class_name to RookCluster
mgr/rook: add StorageV1Api to RookOrchestrator
mgr/rook: add mgr/rook/storage_class_name to ceph config
mgr/rook: ceph orch device ls fetch and display info about PVs
mgr/rook: add CustomObjectsApi to RookCluster
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Sage Weil [Tue, 10 Aug 2021 20:47:21 +0000 (16:47 -0400)]
Merge PR #42613 into master
* refs/pull/42613/head:
qa/suites/roch/rook/smoke: test rook 1.7.0, not 1.6.2
qa/tasks/rook: set storage_class to scratch
Reviewed-by: merge 42318
Sage Weil [Tue, 10 Aug 2021 20:37:38 +0000 (16:37 -0400)]
Merge PR #42691 into master
* refs/pull/42691/head:
mgr/nfs: add --port to 'nfs cluster create' and port to 'nfs cluster info'
qa/suites/orch/cephadm/smoke-roleless: test taking ganeshas offline
qa/tasks/vip: exec with bash -ex
qa/suites/orch/cephadm: separate test_nfs from test_orch_cli
Reviewed-by: Varsha Rao <varao@redhat.com>
Daniel Gryniewicz [Tue, 10 Aug 2021 17:49:17 +0000 (13:49 -0400)]
Merge pull request #42574 from soumyakoduri/wip-skoduri-dbstore-fixes
rgw/dbstore: Fix DBstore build conflicts
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Kefu Chai [Tue, 10 Aug 2021 16:45:00 +0000 (00:45 +0800)]
Merge pull request #42729 from cyx1231st/wip-seastore-interruptive-future
crimson/os/seastore: wrap up interruptive-futures in seastore
Reviewed-by: Samuel Just <sjust@redhat.com>
Kefu Chai [Tue, 10 Aug 2021 15:29:42 +0000 (23:29 +0800)]
Merge pull request #42733 from rzarzynski/wip-script-run-cbt-with-cyanstore
script: run-cbt.sh tests crimson with CyanStore instead of MemStore.
Reviewed-by: Kefu Chai <kchai@redhat.com>
Josh Durgin [Tue, 10 Aug 2021 15:11:35 +0000 (08:11 -0700)]
Merge pull request #42525 from zdover23/wip-doc-rados-config-storage-devices-front-matter-2021-07-28
doc/rados: rewrite storage device front matter
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Sage Weil [Tue, 10 Aug 2021 14:36:37 +0000 (10:36 -0400)]
Merge PR #42680 into master
* refs/pull/42680/head:
src/pybind/mgr/nfs/tests: pass cluster_id to from_export_block()
src/pybind/mgr/nfs: remove `tag` option
src/pybind/mgr/nfs: remove per daemon config test
src/pybind/mgr/nfs: directly use cluster_id and remove daemon related stuff
Reviewed-by: Sage Weil <sage@redhat.com>
Sage Weil [Tue, 10 Aug 2021 14:35:59 +0000 (10:35 -0400)]
Merge PR #42627 into master
* refs/pull/42627/head:
.github/labeler: add nfs dev doc
doc/dev/vstart-ganesha: update about RGW export
src/vstart: update ganesha pid dir location
src/vstart: create rgw export for nfs
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Radoslaw Zarzynski [Tue, 10 Aug 2021 12:34:45 +0000 (12:34 +0000)]
script: run-cbt.sh tests crimson with CyanStore instead of MemStore.
These tests were always supposed to run against CyanStore. However,
commit
e6ed65db8b4e0a2f8026c2e35a12dd292c5f2b8c (PR #42437) changed
the meaning of `--memstore` and introduced `--cyanstore` to be used
instead. This commit makes `run-cbt.sh` aware about the new switch.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Zac Dover [Mon, 12 Jul 2021 20:07:49 +0000 (06:07 +1000)]
doc/cephadm: rewrite client-setup.rst
This improves the text in client-setup.rst.
We should make certain that the technical details
in this file remain current in July 2021. This
file was origingally written in November 2019.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Zac Dover [Wed, 28 Jul 2021 14:37:46 +0000 (00:37 +1000)]
doc/rados: rewrite storage device front matter
This PR updates the text in the RADOS Guide
(the Ceph Storage Cluster Guide) that appears
at the beginning of the "Storage Devices"
chapter. I did the following:
- rewrote some of the sentences so that
they read more like written text than like
spoken language
- added "Ceph Manager" to the list of daemons
that a Ceph cluster comprises
- that's about it.
Signed-off-by: Zac Dover <zac.dover@gmail.com>