]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agogoogletest: pick up change to silence error=maybe-uninitialized warning 38781/head
Kefu Chai [Wed, 6 Jan 2021 08:18:17 +0000 (16:18 +0800)]
googletest: pick up change to silence error=maybe-uninitialized warning

to include the fix of https://github.com/google/googletest/pull/3024

otherwise GCC-11 fails to compile the tests with following warning:

In file included from ../src/googletest/googletest/src/gtest-all.cc:42:
../src/googletest/googletest/src/gtest-death-test.cc: In function ‘bool testing::internal::StackGrowsDown()’:
../src/googletest/googletest/src/gtest-death-test.cc:1301:24: error: ‘dummy’ may be used uninitialized [-Werror=maybe-uninitialized]
 1301 |   StackLowerThanAddress(&dummy, &result);
      |   ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
../src/googletest/googletest/src/gtest-death-test.cc:1290:13: note: by argument 1 of type ‘const void*’ to ‘void testing::internal::StackLowerThanAddress(const void*, bool*)’ declared here
 1290 | static void StackLowerThanAddress(const void* ptr, bool* result) {
      |             ^~~~~~~~~~~~~~~~~~~~~
../src/googletest/googletest/src/gtest-death-test.cc:1299:7: note: ‘dummy’ declared here
 1299 |   int dummy;
      |       ^~~~~
cc1plus: all warnings being treated as errors

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agotest/test_rbd_replay: move operator<<(..rbd_loc& name) to rbd_replay
Kefu Chai [Fri, 8 Jan 2021 05:42:18 +0000 (13:42 +0800)]
test/test_rbd_replay: move operator<<(..rbd_loc& name) to rbd_replay

so gtest can print out rbd_loc when printing out diagnostic information
when test fails. after moving operator<<(ostream&, const rbd_loc&) to
the `rbd_replay` namespace, ADL is able to find it. for more details on
the lookup rules, see https://en.cppreference.com/w/cpp/language/adl

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ceph_time: add operator<< for signedspan
Kefu Chai [Thu, 7 Jan 2021 03:56:25 +0000 (11:56 +0800)]
common/ceph_time: add operator<< for signedspan

* templatize operator<<(ostream&, duration<>), so it works for more
  duration<> classes with minimal efforts -- we just need to explicitly
  instantiate these template operators
* explicitly instantiate operator<< for timespan, signedspan, seconds
  and milliseconds. they are most likely to be used in Ceph. we can add
  more of them when necessary.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ceph_time: move operator<<(ostream&, timespan&) into std namespace
Kefu Chai [Thu, 7 Jan 2021 07:17:45 +0000 (15:17 +0800)]
common/ceph_time: move operator<<(ostream&, timespan&) into std namespace

otherwise compiler is not able to find it as the "timespan" here is
actually a class defined in std namespace, even it has an alias defined
in ceph namespace like:

typedef std::chrono::duration<rep, std::nano> timespan;

but this does not make it a member of "ceph" namespace. for more details
on the lookup rules, see https://en.cppreference.com/w/cpp/language/adl

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoinclude/CompatSet: do not "using ceph::operator<<"
Kefu Chai [Thu, 7 Jan 2021 07:14:57 +0000 (15:14 +0800)]
include/CompatSet: do not "using ceph::operator<<"

it's simply not correct. because "operator<<(std::ostream&out, const
std::pair<A,B>&)" and friends are defined in "namespace std", and what
this source file intents to use are exactly these operator<<'s, there is
no need to bring any "ceph::operator<<" into this scope.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ceph_time: format duration using libfmt
Kefu Chai [Thu, 7 Jan 2021 03:55:48 +0000 (11:55 +0800)]
common/ceph_time: format duration using libfmt

for better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge PR #38794 into master
Patrick Donnelly [Thu, 7 Jan 2021 16:46:24 +0000 (08:46 -0800)]
Merge PR #38794 into master

* refs/pull/38794/head:
qa: add debug vstart_runner option

Reviewed-by: Rishabh Dave <ridave@redhat.com>
4 years agoMerge pull request #38377 from yanghonggang/master
Harish Munjulur [Thu, 7 Jan 2021 15:11:25 +0000 (07:11 -0800)]
Merge pull request #38377 from yanghonggang/master

rgw/rgw_http_client.cc: Introduce a new configuration item - rgw_curl_buffersize

4 years agoMerge pull request #38800 from sebastian-philipp/doc-cephadm-rm-link-to-de
Sebastian Wagner [Thu, 7 Jan 2021 14:44:58 +0000 (15:44 +0100)]
Merge pull request #38800 from sebastian-philipp/doc-cephadm-rm-link-to-de

doc/cephadm: some minor updates

Reviewed-by: Varsha Rao <varao@redhat.com>
4 years agodoc/cephadm: /etc/ceph is created automaticlly now 38800/head
Sebastian Wagner [Thu, 7 Jan 2021 11:06:30 +0000 (12:06 +0100)]
doc/cephadm: /etc/ceph is created automaticlly now

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agodoc/cephadm: CephFS: Encourage users to call `ceph fs volume create`
Sebastian Wagner [Thu, 7 Jan 2021 11:05:58 +0000 (12:05 +0100)]
doc/cephadm: CephFS: Encourage users to call `ceph fs volume create`

Manually deploying MDS daemons is an advanced topic.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agodoc/cephadm: update stability notes
Sebastian Wagner [Thu, 7 Jan 2021 10:50:36 +0000 (11:50 +0100)]
doc/cephadm: update stability notes

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agodoc/cephadm: Rm doc/dev/cephadm from user docs
Sebastian Wagner [Thu, 7 Jan 2021 10:50:13 +0000 (11:50 +0100)]
doc/cephadm: Rm doc/dev/cephadm from user docs

We should not link the dev guide form the user documentation. The user docs are already convoluted and hard to follow. Adding the dev guide is not helpful.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38784 from sebastian-philipp/resurect-doc-dev-cephadm
Sebastian Wagner [Thu, 7 Jan 2021 10:46:12 +0000 (11:46 +0100)]
Merge pull request #38784 from sebastian-philipp/resurect-doc-dev-cephadm

doc/dev: resurrect hidden dev/cephadm.rst

Reviewed-by: Varsha Rao <varao@redhat.com>
4 years agoMerge pull request #38560 from pcuzner/cephadm-maintenance-mode
Sebastian Wagner [Thu, 7 Jan 2021 10:02:15 +0000 (11:02 +0100)]
Merge pull request #38560 from pcuzner/cephadm-maintenance-mode

cephadm: add host-maintenance subcommand

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
4 years agoMerge pull request #38681 from pcuzner/enable-exporter
Sebastian Wagner [Thu, 7 Jan 2021 09:30:53 +0000 (10:30 +0100)]
Merge pull request #38681 from pcuzner/enable-exporter

cephadm: enable exporter deployment at bootstrap

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38704 from varshar16/wip-fix-rook-rm-service
Sebastian Wagner [Thu, 7 Jan 2021 09:29:49 +0000 (10:29 +0100)]
Merge pull request #38704 from varshar16/wip-fix-rook-rm-service

mgr/rook: Remove service_type param from remove_service()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
4 years agoMerge pull request #38025 from MahatiC/wip-ssd-write
Jason Dillaman [Thu, 7 Jan 2021 03:45:09 +0000 (22:45 -0500)]
Merge pull request #38025 from MahatiC/wip-ssd-write

librbd/cache: Implement aio_write operation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38795 from yuriw/wip-yuriw-octopus-x-master
Yuri Weinstein [Wed, 6 Jan 2021 23:23:56 +0000 (15:23 -0800)]
Merge pull request #38795 from yuriw/wip-yuriw-octopus-x-master

qa/tests: changed the dirs structure

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge PR #38792 into master
Patrick Donnelly [Wed, 6 Jan 2021 22:30:21 +0000 (14:30 -0800)]
Merge PR #38792 into master

* refs/pull/38792/head:
.github: add MDSMonitor to cephfs label

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge PR #38587 into master
Patrick Donnelly [Wed, 6 Jan 2021 21:34:38 +0000 (13:34 -0800)]
Merge PR #38587 into master

* refs/pull/38587/head:
doc: add explanatory note about cache trim rate setting

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa/tests: changed the dirs structure 38795/head
Yuri Weinstein [Wed, 6 Jan 2021 20:50:10 +0000 (12:50 -0800)]
qa/tests: changed the dirs structure

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
4 years agoMerge pull request #38787 from yuriw/wip-yuriw-octopus-x-master
Yuri Weinstein [Wed, 6 Jan 2021 20:47:06 +0000 (12:47 -0800)]
Merge pull request #38787 from yuriw/wip-yuriw-octopus-x-master

qa/tests: octopus-x suite added more workloads

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #38789 from neha-ojha/wip-fix-cephadm-task
Neha Ojha [Wed, 6 Jan 2021 20:31:50 +0000 (12:31 -0800)]
Merge pull request #38789 from neha-ojha/wip-fix-cephadm-task

qa/tasks/cephadm.py: do not create rbd pool by default

Reviewed-by: Sebastian Wagner <swagner@suse.com>
4 years agoqa: add debug vstart_runner option 38794/head
Patrick Donnelly [Wed, 6 Jan 2021 19:36:49 +0000 (11:36 -0800)]
qa: add debug vstart_runner option

The default was changed to INFO recently but there was no way to restore
visibility of DEBUG messages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years ago.github: add MDSMonitor to cephfs label 38792/head
Patrick Donnelly [Wed, 6 Jan 2021 18:59:41 +0000 (10:59 -0800)]
.github: add MDSMonitor to cephfs label

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa/tests: octopus-x suite added more workloads 38787/head
Yuri Weinstein [Wed, 6 Jan 2021 16:52:54 +0000 (08:52 -0800)]
qa/tests: octopus-x suite added more workloads

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
4 years agoqa/tasks/cephadm.py: do not create rbd pool by default 38789/head
Neha Ojha [Wed, 6 Jan 2021 15:37:47 +0000 (15:37 +0000)]
qa/tasks/cephadm.py: do not create rbd pool by default

rados/cephadm/smoke* does not use the install task and the adjust-ulimits
dependency is met as a part of it. create_rbd_pool needs adjust-ulimits,
so for now we will disable create_rbd_pool by default and only set it
to true for the upgrade suite.

Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #38714 from tchaikov/wip-better-vstart
Kefu Chai [Wed, 6 Jan 2021 14:53:34 +0000 (22:53 +0800)]
Merge pull request #38714 from tchaikov/wip-better-vstart

vstart: format the customized options in ceph.conf

Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #38769 into master
Patrick Donnelly [Wed, 6 Jan 2021 14:50:24 +0000 (06:50 -0800)]
Merge PR #38769 into master

* refs/pull/38769/head:
doc/cephfs: add data pool-MDS instructions link

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
4 years agolibrbd/cache: Implement aio_write operation 38025/head
Mahati Chamarthy [Fri, 6 Nov 2020 12:09:55 +0000 (17:39 +0530)]
librbd/cache: Implement aio_write operation

...along with load_existing_entries and shutdown cache
operation

Signed-off-by: Lisa Li <xiaoyan.li@intel.com>
Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
4 years agodoc/dev: resurrect hidden dev/cephadm.rst 38784/head
Sebastian Wagner [Wed, 6 Jan 2021 13:11:47 +0000 (14:11 +0100)]
doc/dev: resurrect hidden dev/cephadm.rst

some time ago, a cephadm folder was added that did hide the
old dev documentation page.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agodoc/cephfs: add data pool-MDS instructions link 38769/head
Zac Dover [Tue, 5 Jan 2021 13:55:16 +0000 (23:55 +1000)]
doc/cephfs: add data pool-MDS instructions link

- This commit adds a link to the "Create a Ceph
File System" page. The link that it adds is to the
"Adding a data pool to the MDS" subsection of the
file layouts page.
- s/mds/file system/

Fixes: https://tracker.ceph.com/issues/48531
Signed-off-by: Zac Dover <zac.dover@gmail.com>
4 years agoMerge pull request #38713 from tchaikov/wip-ceph-annotations
Kefu Chai [Wed, 6 Jan 2021 03:34:09 +0000 (11:34 +0800)]
Merge pull request #38713 from tchaikov/wip-ceph-annotations

ceph.in: return bytes as outbuf in error path, add type annotations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #38777 from neha-ojha/wip-cephadm-rbd
Neha Ojha [Wed, 6 Jan 2021 00:31:37 +0000 (16:31 -0800)]
Merge pull request #38777 from neha-ojha/wip-cephadm-rbd

qa: allow the cephadm task to create an RBD pool and add workload to use it

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
4 years agoqa/suites/upgrade/octopus-x: add rados_loadgenbig workload 38777/head
Neha Ojha [Tue, 5 Jan 2021 21:36:04 +0000 (21:36 +0000)]
qa/suites/upgrade/octopus-x: add rados_loadgenbig workload

Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agoqa/tasks/cephadm.py: create RBD pool
Neha Ojha [Tue, 5 Jan 2021 17:38:52 +0000 (17:38 +0000)]
qa/tasks/cephadm.py: create RBD pool

The ceph task already does this and a bunch of tests rely on this pool
being already present. Can be disabled by setting create_rbd_pool to False.

Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge PR #38742 into master
Patrick Donnelly [Tue, 5 Jan 2021 16:38:41 +0000 (08:38 -0800)]
Merge PR #38742 into master

* refs/pull/38742/head:
doc/cephfs/nfs: Add more details about path and pseudo path
doc/cephfs/nfs: Add note about how to fetch port details with rook
doc/cephfs/nfs: Add warning note about management of dashboard created exports

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
4 years agoMerge pull request #38735 from changchengx/pwl_load_existing_cache
Jason Dillaman [Tue, 5 Jan 2021 14:33:49 +0000 (09:33 -0500)]
Merge pull request #38735 from changchengx/pwl_load_existing_cache

librbd/cache/pwl: correct update previous_sync_point_entry

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38520 from lixiaoy1/wip-doc-pwl
Jason Dillaman [Tue, 5 Jan 2021 14:12:20 +0000 (09:12 -0500)]
Merge pull request #38520 from lixiaoy1/wip-doc-pwl

doc: add RBD persistent write-back cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agodoc: add RBD persistent write-back cache 38520/head
lixiaoy1 [Tue, 17 Nov 2020 14:47:42 +0000 (09:47 -0500)]
doc: add RBD persistent write-back cache

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
4 years agodoc/cephfs/nfs: Add more details about path and pseudo path 38742/head
Varsha Rao [Thu, 31 Dec 2020 11:30:29 +0000 (17:00 +0530)]
doc/cephfs/nfs: Add more details about path and pseudo path

Fixes: https://tracker.ceph.com/issues/48731
Signed-off-by: Varsha Rao <varao@redhat.com>
4 years agodoc/cephfs/nfs: Add note about how to fetch port details with rook
Varsha Rao [Thu, 31 Dec 2020 10:54:34 +0000 (16:24 +0530)]
doc/cephfs/nfs: Add note about how to fetch port details with rook

Fixes: https://tracker.ceph.com/issues/48731
Signed-off-by: Varsha Rao <varao@redhat.com>
4 years agodoc/cephfs/nfs: Add warning note about management of dashboard created exports
Varsha Rao [Thu, 31 Dec 2020 10:45:09 +0000 (16:15 +0530)]
doc/cephfs/nfs: Add warning note about management of dashboard created exports

Fixes: https://tracker.ceph.com/issues/48731
Signed-off-by: Varsha Rao <varao@redhat.com>
4 years agoMerge PR #32776 into master
Jan Fajerski [Tue, 5 Jan 2021 11:50:37 +0000 (12:50 +0100)]
Merge PR #32776 into master

* refs/pull/32776/head:
win32*.sh: fetch WNBD dependency
win32*.sh: bump win32 boost dependency
cmake: skip osd, Lua and neorados on Windows
win32*.sh: improve lib handling
win32*.sh: update openssl location
win32*.sh: cleanup dependency build dir when targetting Windows
win32*.sh: Strip binaries individually
win32*.sh: Cleanup zip archive creation
cmake,win32*.sh: Add OS=(ubuntu|suse) flag, for distro settings
win32*.sh: Use nproc for CPU count when targeting win32
test: Include compat.h to find uid_t/gid_t/gidlist when cross compiling
win32*.sh: improve win32 dependency check
win32*.sh: isolate network operations when building win32 dependencies
cmake: drop Python dependency when targeting Windows
win32*.sh: cleanup Windows build script
win32*.sh: fix patch command
win32*.sh: update Windows build scripts and readme

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38699 from rosinL/boost-paralllel
Kefu Chai [Tue, 5 Jan 2021 11:06:57 +0000 (19:06 +0800)]
Merge pull request #38699 from rosinL/boost-paralllel

do_cmake: add a default value to BOOST_J

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38745 from zdover23/wip-doc-jan-2021-dev-guide-basic-workflow...
zdover23 [Tue, 5 Jan 2021 08:34:19 +0000 (18:34 +1000)]
Merge pull request #38745 from zdover23/wip-doc-jan-2021-dev-guide-basic-workflow-reorg

doc/dev: restructure basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #38749 from tchaikov/wip-cmake-check-nasm
Kefu Chai [Tue, 5 Jan 2021 02:32:48 +0000 (10:32 +0800)]
Merge pull request #38749 from tchaikov/wip-cmake-check-nasm

cmake: only display the result of checking nasm once

Reviewed-by: Changcheng Liu <changcheng.liu@aliyun.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge PR #38703 into master
Patrick Donnelly [Mon, 4 Jan 2021 17:49:00 +0000 (09:49 -0800)]
Merge PR #38703 into master

* refs/pull/38703/head:
test: move snap delete operation to non-root directory
client: optionally check client permission on rmsnap()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #38758 from tchaikov/wip-crimson-cleanup
Kefu Chai [Mon, 4 Jan 2021 17:39:14 +0000 (01:39 +0800)]
Merge pull request #38758 from tchaikov/wip-crimson-cleanup

crimson/os: do not let omap_get_values() return input_output_error

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
4 years agoMerge pull request #38757 from rosinL/wip-remove-unused-options
Kefu Chai [Mon, 4 Jan 2021 15:32:18 +0000 (23:32 +0800)]
Merge pull request #38757 from rosinL/wip-remove-unused-options

common/options: remove ununsed options

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/os: do not let omap_get_values() return input_output_error 38758/head
Kefu Chai [Mon, 4 Jan 2021 15:25:10 +0000 (23:25 +0800)]
crimson/os: do not let omap_get_values() return input_output_error

BlueStore only returns 0 or -ENOENT. so no need to handle the cases
where the return value is neither of them.

but Seastore might return EIO, so keep the interface unchanged.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38616 from ofriedma/wip-ofriedma-dist-cache
ofriedma [Mon, 4 Jan 2021 15:11:37 +0000 (17:11 +0200)]
Merge pull request #38616 from ofriedma/wip-ofriedma-dist-cache

rgw: distribute cache for exclusive put

4 years agoMerge pull request #38663 from tchaikov/wip-crimson-recovery-cleanups
Kefu Chai [Mon, 4 Jan 2021 14:54:10 +0000 (22:54 +0800)]
Merge pull request #38663 from tchaikov/wip-crimson-recovery-cleanups

crimson/osd: fixes and cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 years agocommon/options: remove ununsed options 38757/head
luo rixin [Mon, 4 Jan 2021 12:40:54 +0000 (20:40 +0800)]
common/options: remove ununsed options

Signed-off-by: luo rixin <luorixin@huawei.com>
4 years agoMerge pull request #38676 from ronen-fr/wip-48690
Kefu Chai [Mon, 4 Jan 2021 11:04:45 +0000 (19:04 +0800)]
Merge pull request #38676 from ronen-fr/wip-48690

qa/standalone/scrub/osd-scrub-snaps.sh: fix Python print syntax

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38603 from smithfarm/wip-48604
Nathan Cutler [Mon, 4 Jan 2021 09:58:54 +0000 (10:58 +0100)]
Merge pull request #38603 from smithfarm/wip-48604

rpm: require smartmontools on SUSE

Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agovstart: format the customized options in ceph.conf 38714/head
Kefu Chai [Thu, 24 Dec 2020 14:16:52 +0000 (22:16 +0800)]
vstart: format the customized options in ceph.conf

better formatted in ceph.conf, no extra spaces and tabs anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocmake: only display the result of checking nasm once 38749/head
Kefu Chai [Sun, 3 Jan 2021 17:15:54 +0000 (01:15 +0800)]
cmake: only display the result of checking nasm once

if nasm is able to emit AVX512 instructions, we can assume that it's
able to generate AVX2 instructions as well. so no need to print "Found
nasm" multiple times.

and by chaining mutual exclusive branches with "elseif", we can have
better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocmake: drop duplicated variable
Kefu Chai [Sun, 3 Jan 2021 17:28:23 +0000 (01:28 +0800)]
cmake: drop duplicated variable

not_arch_x32 replicates ${_support_x64}. and a variable starts with
"not" is just difficult to parse. so drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38694 from dillaman/wip-migration-import
Mykola Golub [Sun, 3 Jan 2021 09:07:20 +0000 (11:07 +0200)]
Merge pull request #38694 from dillaman/wip-migration-import

librbd/migration: tweaks and initial set of documentation

Reviewed-by: Mykola Golub <mgolub@suse.com>
4 years agodoc/rbd: incorporate external data source support for live-migration 38694/head
Jason Dillaman [Mon, 21 Dec 2020 19:40:13 +0000 (14:40 -0500)]
doc/rbd: incorporate external data source support for live-migration

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agolibrbd/migration: fixed missing return statements on stream error path
Jason Dillaman [Tue, 22 Dec 2020 18:56:59 +0000 (13:56 -0500)]
librbd/migration: fixed missing return statements on stream error path

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agolibrbd/migration: optionally pull S3 keys from MON config store
Jason Dillaman [Tue, 22 Dec 2020 18:36:57 +0000 (13:36 -0500)]
librbd/migration: optionally pull S3 keys from MON config store

This allows the S3 keys to be better protected since the MON can
be configured to restrict access to keys by user and the results
can be encrypted in transit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agolibrbd: helper utility to retrieve config from the MON config store
Jason Dillaman [Tue, 22 Dec 2020 18:34:51 +0000 (13:34 -0500)]
librbd: helper utility to retrieve config from the MON config store

A special "config://" URI prefix can be used to denote configuration
settings that should be (securely) pulled from the MON config store.
This will be first used in a follow-up commit to support storing
the S3 access and secret keys in the MON config store.

This "config://" syntax is already in-use by RGW and ceph-iscsi for
pulling secrets when deployed via cephadm.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agolibrbd/migration: require snapshot when importing from native source
Jason Dillaman [Tue, 22 Dec 2020 14:46:04 +0000 (09:46 -0500)]
librbd/migration: require snapshot when importing from native source

Since we cannot mark the source image read-only when running in import-only
migration mode, we should require the user to provide a snapshot to ensure
that data cannot change while the migration is running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agoceph.in: remove unused indent 38713/head
Kefu Chai [Fri, 1 Jan 2021 12:34:21 +0000 (20:34 +0800)]
ceph.in: remove unused indent

no need to put `if True`. it was used when removing unused variables.
but it'd be better to have less indent for better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoceph.in: do not apply rados.cstr() to a bytes
Kefu Chai [Fri, 1 Jan 2021 12:28:37 +0000 (20:28 +0800)]
ceph.in: do not apply rados.cstr() to a bytes

since the parameter is already a bytes instance, there is no need to encode it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/rados: correct annotation of {mon,pg,osd}_command
Kefu Chai [Fri, 1 Jan 2021 12:14:37 +0000 (20:14 +0800)]
pybind/rados: correct annotation of {mon,pg,osd}_command

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/ceph_argparse: no need to import print()
Kefu Chai [Thu, 24 Dec 2020 14:50:44 +0000 (22:50 +0800)]
pybind/ceph_argparse: no need to import print()

we are already in a python3 world.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agopybind/ceph_argparse: PEP8 related cleanups
Kefu Chai [Thu, 24 Dec 2020 14:12:35 +0000 (22:12 +0800)]
pybind/ceph_argparse: PEP8 related cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoceph.in: return bytes as outbuf in error path
Kefu Chai [Thu, 24 Dec 2020 14:04:25 +0000 (22:04 +0800)]
ceph.in: return bytes as outbuf in error path

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoceph.in,ceph_argparse: add type annotations
Kefu Chai [Thu, 24 Dec 2020 14:03:46 +0000 (22:03 +0800)]
ceph.in,ceph_argparse: add type annotations

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #30027 from majianpeng/optimize-mutex-contention
Kefu Chai [Fri, 1 Jan 2021 04:12:43 +0000 (12:12 +0800)]
Merge pull request #30027 from majianpeng/optimize-mutex-contention

os/bluestore: optimize mutex contention

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
4 years agoMerge pull request #36088 from rhcs-dashboard/fix-45822-master
Kefu Chai [Fri, 1 Jan 2021 04:10:25 +0000 (12:10 +0800)]
Merge pull request #36088 from rhcs-dashboard/fix-45822-master

mgr/dashboard:minimize console log traces of Ceph backend API test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
4 years agoMerge pull request #38651 from ifed01/wip-ifed-new-omap-naming
Kefu Chai [Fri, 1 Jan 2021 04:06:39 +0000 (12:06 +0800)]
Merge pull request #38651 from ifed01/wip-ifed-new-omap-naming

os/bluestore: introduce new "per-pg" naming scheme for omap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
4 years agoMerge pull request #38680 from ifed01/wip-ifed-rocksdb-options-annex
Kefu Chai [Fri, 1 Jan 2021 04:01:55 +0000 (12:01 +0800)]
Merge pull request #38680 from ifed01/wip-ifed-rocksdb-options-annex

os/bluestore: introduce bluestore_rocksdb_options_annex config parame…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
4 years agoMerge pull request #38738 from ronen-fr/wip-ronenf-rawformat
Jason Dillaman [Thu, 31 Dec 2020 13:00:37 +0000 (08:00 -0500)]
Merge pull request #38738 from ronen-fr/wip-ronenf-rawformat

librbd/migration: removing an unused capture

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38709 from wuhongsong/aios_be_truncated
Kefu Chai [Thu, 31 Dec 2020 11:41:37 +0000 (19:41 +0800)]
Merge pull request #38709 from wuhongsong/aios_be_truncated

blk: add upper bound of bluestore_deferred_batch_ops* options

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agodoc/dev: restructure basic-workflow.rst 38745/head
Zac Dover [Wed, 30 Dec 2020 10:20:41 +0000 (20:20 +1000)]
doc/dev: restructure basic-workflow.rst

- Rewrote a sentence about forking.
- s/exactly how to proceed/how to proceed/
- Changed titles to present participles
- Rewrote "Fixing the Bug Locally" to improve its elegance.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
4 years agoMerge pull request #38655 from dillaman/wip-47828
Mykola Golub [Wed, 30 Dec 2020 14:15:47 +0000 (16:15 +0200)]
Merge pull request #38655 from dillaman/wip-47828

librbd: ensure stripe unit is at least 512 bytes

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Mykola Golub <mgolub@suse.com>
4 years agolibrbd/migration: removing an unused capture 38738/head
Ronen Friedman [Wed, 30 Dec 2020 06:35:00 +0000 (08:35 +0200)]
librbd/migration: removing an unused capture

...silencing a compiler warning.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
4 years agolibrbd/cache/pwl: correct update previous_sync_point_entry 38735/head
Changcheng Liu [Wed, 30 Dec 2020 05:30:41 +0000 (13:30 +0800)]
librbd/cache/pwl: correct update previous_sync_point_entry

Always update previous_sync_point_entry value whatever its old
value.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
4 years agoMerge pull request #38733 from ukernel/wip-yanzheng-email
Kefu Chai [Wed, 30 Dec 2020 03:23:57 +0000 (11:23 +0800)]
Merge pull request #38733 from ukernel/wip-yanzheng-email

mailmap: update affiliation for Yan, Zheng

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38237 from myoungwon/wip-fix-clone-size-mismatch
Kefu Chai [Wed, 30 Dec 2020 03:19:51 +0000 (11:19 +0800)]
Merge pull request #38237 from myoungwon/wip-fix-clone-size-mismatch

osd: fix clone size mismatch when deduped object is evicted

Reviewed-by: Samuel Just <sjust@redhat.com>
4 years agomailmap: update affiliation for Yan, Zheng 38733/head
Yan, Zheng [Wed, 30 Dec 2020 02:37:20 +0000 (10:37 +0800)]
mailmap: update affiliation for Yan, Zheng

Signed-off-by: "Yan, Zheng" <ukernel@gmail.com>
4 years agoMerge pull request #37704 from Huber-ming/log_error
Kefu Chai [Tue, 29 Dec 2020 16:31:02 +0000 (00:31 +0800)]
Merge pull request #37704 from Huber-ming/log_error

radosgw-admin: fix error message when datalog list

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
4 years agoblk: add upper bound of bluestore_deferred_batch_ops* options 38709/head
hzwuhongsong [Tue, 29 Dec 2020 06:24:01 +0000 (14:24 +0800)]
blk: add upper bound of bluestore_deferred_batch_ops* options

so the number of pending io does not overflow when being passed to submit_batch().

Signed-off-by: hzwuhongsong <hzwuhongsong@corp.netease.com>
4 years agoMerge pull request #38728 from xxhdx1985126/wip-crimson-osd_op-no-splice
Kefu Chai [Tue, 29 Dec 2020 07:52:41 +0000 (15:52 +0800)]
Merge pull request #38728 from xxhdx1985126/wip-crimson-osd_op-no-splice

crimson/osd: do not splice osd_op indata

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/osd: make sure PGBackend's modification operations not change osd_op state 38728/head
Xuehan Xu [Tue, 29 Dec 2020 07:19:52 +0000 (15:19 +0800)]
crimson/osd: make sure PGBackend's modification operations not change osd_op state

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
4 years agocrimson/osd: do not splice osd_op indata
Xuehan Xu [Tue, 29 Dec 2020 04:06:43 +0000 (12:06 +0800)]
crimson/osd: do not splice osd_op indata

As each osd_op's indata holds only its own data, there's no need to drop their it.
On the other hand, indata is still needed when osd_op needs to be redone in case of
acting set change.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
4 years agoMerge pull request #38633 from rhcs-dashboard/fix-logs-copy-button
Kiefer Chang [Mon, 28 Dec 2020 13:12:14 +0000 (21:12 +0800)]
Merge pull request #38633 from rhcs-dashboard/fix-logs-copy-button

mgr/dashboard: Fix for copy2Clipboard failing to copy on the first time

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
4 years agomgr/dashboard: Fix for copy2Clipboard failing to copy on the first time. 38633/head
Avan Thakkar [Thu, 17 Dec 2020 09:44:46 +0000 (15:14 +0530)]
mgr/dashboard: Fix for copy2Clipboard failing to copy on the first time.

Fixes: https://tracker.ceph.com/issues/48601
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Fix for the copy2Clipboard button to work on the first click itself.

4 years agoMerge pull request #37267 from TheJJ/fix-up-acting-docs
Kefu Chai [Mon, 28 Dec 2020 06:38:12 +0000 (14:38 +0800)]
Merge pull request #37267 from TheJJ/fix-up-acting-docs

doc: fix up and acting set explanation

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agodoc: fix and improve the explainations of up and acting osd sets 37267/head
Jonas Jelten [Sun, 20 Sep 2020 21:05:33 +0000 (23:05 +0200)]
doc: fix and improve the explainations of up and acting osd sets

acting = where clients requests are processed
up = where pgs were planned to be by crush+upmap

Fixes: https://tracker.ceph.com/issues/48718
Signed-off-by: Jonas Jelten <jj@sft.lol>
4 years agomailmap: update mail for Jonas Jelten
Jonas Jelten [Sun, 20 Sep 2020 21:07:54 +0000 (23:07 +0200)]
mailmap: update mail for Jonas Jelten

Signed-off-by: Jonas Jelten <jj@sft.lol>
4 years agoMerge pull request #38719 from fengchunsong/master
Kefu Chai [Sat, 26 Dec 2020 17:11:53 +0000 (01:11 +0800)]
Merge pull request #38719 from fengchunsong/master

test/perf_local: Add div32,prefetch,memory barrier bench for arm64

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38568 from batrick/i48594
Sebastian Wagner [Sat, 26 Dec 2020 12:08:33 +0000 (13:08 +0100)]
Merge pull request #38568 from batrick/i48594

pybind/mgr/cephadm: limit rgw osd caps

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38644 from pcuzner/fix-missing-py3-error
Sebastian Wagner [Sat, 26 Dec 2020 12:04:16 +0000 (13:04 +0100)]
Merge pull request #38644 from pcuzner/fix-missing-py3-error

mgr/cephadm: correct connection failure message

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #38654 from Daniel-Pivonka/osddryrunbug
Sebastian Wagner [Sat, 26 Dec 2020 12:03:07 +0000 (13:03 +0100)]
Merge pull request #38654 from Daniel-Pivonka/osddryrunbug

mgr/cephadm:fix bug in orch apply osd --dry-run where empty table printed

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>