]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agoexamples: add elasticsearch and prometheus examples 42875/head
Zulai Wang [Wed, 18 Aug 2021 05:51:46 +0000 (13:51 +0800)]
examples: add elasticsearch and prometheus examples

Add examples on how to use lua scripting to push request fields from the RGW to Elasticsearch and Prometheus.

Signed-off-by: Zulai Wang <zl31wang@gmail.com>
3 years agoMerge pull request #42801 from ivancich/wip-update-rados-rm-help
Kefu Chai [Wed, 18 Aug 2021 03:46:45 +0000 (11:46 +0800)]
Merge pull request #42801 from ivancich/wip-update-rados-rm-help

doc: clarify use of `rados rm` command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #42822 from tchaikov/wip-drop-gdbm
Kefu Chai [Wed, 18 Aug 2021 03:36:02 +0000 (11:36 +0800)]
Merge pull request #42822 from tchaikov/wip-drop-gdbm

ceph.spec.in: drop gdbm from build deps

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoceph.spec.in: drop gdbm from build deps 42822/head
Kefu Chai [Tue, 17 Aug 2021 17:04:39 +0000 (01:04 +0800)]
ceph.spec.in: drop gdbm from build deps

neither gdbm nor libgdbm is used when building ceph, so let's drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42738 from sebastian-philipp/mypy-3.7
Sebastian Wagner [Tue, 17 Aug 2021 14:37:15 +0000 (16:37 +0200)]
Merge pull request #42738 from sebastian-philipp/mypy-3.7

pybind/mgr: tox: also test mypy with python 3.7

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42811 from tchaikov/wip-dashboard-test
Kefu Chai [Tue, 17 Aug 2021 12:40:47 +0000 (20:40 +0800)]
Merge pull request #42811 from tchaikov/wip-dashboard-test

mgr/dashboard/api: set a UTF-8 locale when running pip

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
3 years agoMerge pull request #42732 from rhcs-dashboard/bug-1950644
Alfonso Martínez [Tue, 17 Aug 2021 12:35:24 +0000 (14:35 +0200)]
Merge pull request #42732 from rhcs-dashboard/bug-1950644

mgr/dashboard: disable create snapshot with subvolumes

3 years agoMerge pull request #42717 from rhcs-dashboard/iscsi-target-refresh-btn
Alfonso Martínez [Tue, 17 Aug 2021 12:32:49 +0000 (14:32 +0200)]
Merge pull request #42717 from rhcs-dashboard/iscsi-target-refresh-btn

mgr/dashboard: Refresh button on the iscsi targets page

3 years agoMerge pull request #42786 from aaryanporwal/visual-tests
Alfonso Martínez [Tue, 17 Aug 2021 09:57:41 +0000 (11:57 +0200)]
Merge pull request #42786 from aaryanporwal/visual-tests

mgr/dashboard: visual tests: Add more ignore regions for dashboard component

3 years agomgr/dashboard: disable create snapshot with subvolumes 42732/head
Pere Diaz Bou [Tue, 17 Aug 2021 07:41:58 +0000 (09:41 +0200)]
mgr/dashboard: disable create snapshot with subvolumes

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoMerge pull request #42808 from tchaikov/wip-crimson-test-cleanup
Kefu Chai [Tue, 17 Aug 2021 08:03:06 +0000 (16:03 +0800)]
Merge pull request #42808 from tchaikov/wip-crimson-test-cleanup

test/crimson: do not discard returned future<>

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agomgr/dashboard/api: set a UTF-8 locale when running pip 42811/head
Kefu Chai [Tue, 17 Aug 2021 07:53:51 +0000 (15:53 +0800)]
mgr/dashboard/api: set a UTF-8 locale when running pip

ansible-core started to include files whose filenames are encoded in
non-ascii characters, so we have to use a more capable encoding for the
locale in order to install this package. otherwise we'd have following
error:

Collecting ansible-core<2.12,>=2.11.3
  Using cached ansible-core-2.11.4.tar.gz (6.8 MB)
ERROR: Exception:

Traceback (most recent call last):
  File "/tmp/tmp.fX76ASIrch/venv/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 173, in _main
    status = self.run(options, args)
...
  File "/tmp/tmp.fX76ASIrch/venv/lib/python3.8/site-packages/pip/_internal/utils/unpacking.py", line 226, in untar_file
    with open(path, "wb") as destfp:
UnicodeEncodeError: 'latin-1' codec can't encode characters in position 137-140: ordinal not in range(256)

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42807 from tchaikov/wip-crimson-test-more-chatty
Kefu Chai [Tue, 17 Aug 2021 07:01:45 +0000 (15:01 +0800)]
Merge pull request #42807 from tchaikov/wip-crimson-test-more-chatty

test/crimson: re-enable logging output

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xuehan Xu <xuxuehan@360.cn>
3 years agoMerge pull request #42791 from ideepika/wip-50947-blk-cmake
Kefu Chai [Tue, 17 Aug 2021 06:32:32 +0000 (14:32 +0800)]
Merge pull request #42791 from ideepika/wip-50947-blk-cmake

src/blk: fix block_device_t return if no aio libs present

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42800 from tchaikov/wip-cmake-debug-build
Kefu Chai [Tue, 17 Aug 2021 06:28:07 +0000 (14:28 +0800)]
Merge pull request #42800 from tchaikov/wip-cmake-debug-build

cmake: set CMAKE_BUILD_TYPE to Debug when .git exists

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
3 years agotest/crimson: do not discard returned future<> 42808/head
Kefu Chai [Tue, 17 Aug 2021 06:11:20 +0000 (14:11 +0800)]
test/crimson: do not discard returned future<>

to silence following warning:

../src/test/crimson/seastore/test_randomblock_manager.cc:122:7: warning: ignoring return value of function declared with 'nodiscard' attribute [-Wunused-result]
      rbm_manager->add_free_extent(t.allocated_blocks, r.first * DEFAULT_BLOCK_SIZE,
      ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agotest/crimson: use structured binding
Kefu Chai [Tue, 17 Aug 2021 06:09:48 +0000 (14:09 +0800)]
test/crimson: use structured binding

for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42798 from xxhdx1985126/wip-52275
Kefu Chai [Tue, 17 Aug 2021 05:43:39 +0000 (13:43 +0800)]
Merge pull request #42798 from xxhdx1985126/wip-52275

crimson/common: allow the tls interrupt_cond to exist when a continuation starts to run

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agotest/crimson: re-enable logging output 42807/head
Kefu Chai [Tue, 17 Aug 2021 05:39:39 +0000 (13:39 +0800)]
test/crimson: re-enable logging output

this change reverts 57877075c0b6885c7e35dc4c4a881b140c30cfb0

per Yingxin's request, we should enable it for better debugging
experience when the test fails.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42787 from rzarzynski/wip-crimson-fix-warn-storenbd
Kefu Chai [Tue, 17 Aug 2021 05:07:25 +0000 (13:07 +0800)]
Merge pull request #42787 from rzarzynski/wip-crimson-fix-warn-storenbd

crimson/tools: silence [[maybe_unused]] warning in store-nbd.cc.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoRevert "crimson/onode-staged-tree: force test work with invalidated transactions" 42798/head
Yingxin Cheng [Mon, 16 Aug 2021 08:09:59 +0000 (16:09 +0800)]
Revert "crimson/onode-staged-tree: force test work with invalidated transactions"

This reverts commit 8b6428c4ac08a7d3beabf64f549bfe11e5245978.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agotest/crimson: avoid creating interrupt condition within an already interruptible...
Xuehan Xu [Tue, 17 Aug 2021 04:17:27 +0000 (12:17 +0800)]
test/crimson: avoid creating interrupt condition within an already interruptible continuation chain

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocrimson/common: assert the existence of interrupt_cond even in release builds
Xuehan Xu [Mon, 16 Aug 2021 16:20:02 +0000 (00:20 +0800)]
crimson/common: assert the existence of interrupt_cond even in release builds

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocrimson/common: allow the tls interrupt_cond to exist when a continuation starts...
Xuehan Xu [Mon, 16 Aug 2021 16:16:10 +0000 (00:16 +0800)]
crimson/common: allow the tls interrupt_cond to exist when a continuation starts to run

Release build of seastar invokes continuations synchronously if their predecessor futures
are resolved at the time when those continuations are constructed, so we have to allow
these circumstances to happen

Fixes: https://tracker.ceph.com/issues/52275
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agoMerge pull request #42658 from tchaikov/wip-doc-build
Kefu Chai [Tue, 17 Aug 2021 03:26:07 +0000 (11:26 +0800)]
Merge pull request #42658 from tchaikov/wip-doc-build

admin/build-doc: rebuild venv if md5 does not match

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoMerge PR #42749 into master
Patrick Donnelly [Tue, 17 Aug 2021 02:15:37 +0000 (19:15 -0700)]
Merge PR #42749 into master

* refs/pull/42749/head:
doc: document that NEARFULL conditions can result in slow writes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #42797 from rzarzynski/wip-crimson-no-prometheus-by-default
Kefu Chai [Tue, 17 Aug 2021 01:09:52 +0000 (09:09 +0800)]
Merge pull request #42797 from rzarzynski/wip-crimson-no-prometheus-by-default

crimson/osd: disable Premetheous by default.

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agocmake: set CMAKE_BUILD_TYPE to Debug when .git exists 42800/head
Kefu Chai [Mon, 16 Aug 2021 17:07:45 +0000 (01:07 +0800)]
cmake: set CMAKE_BUILD_TYPE to Debug when .git exists

if CMAKE_BUILD_TYPE is an empty string, we should also set it to Debug.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoerasure-code/clay: do not set unreferenced variable
Kefu Chai [Tue, 17 Aug 2021 00:46:08 +0000 (08:46 +0800)]
erasure-code/clay: do not set unreferenced variable

plane_count was introduced by 2a3e56b22c5b52e4834a9fd5047b3cdff7e8859f,
and presumably it is only used for debugging. let's drop it as it is not
referenced in production.

this change silences following warning:

../src/erasure-code/clay/ErasureCodeClay.cc:502:7: error: variable 'plane_count' set but not used [-Werror,-Wunused-but-set-variable]
  int plane_count = 0;
      ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoerasure-code/lrc: early return if to_string() fails
Kefu Chai [Tue, 17 Aug 2021 00:43:46 +0000 (08:43 +0800)]
erasure-code/lrc: early return if to_string() fails

so far to_string() always return 0, but it is designed to return
an error code if it fails to parse a string.

this change silences following warning:

../src/erasure-code/lrc/ErasureCodeLrc.cc:399:7: error: variable 'err' set but not used [-Werror,-Wunused-but-set-variable]
  int err = 0;
      ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agomds/CDir: do not set referenced variable
Kefu Chai [Tue, 17 Aug 2021 00:38:30 +0000 (08:38 +0800)]
mds/CDir: do not set referenced variable

off is set by never get referenced, let's just drop it.

this variable was introduced by
0ec5f3a84aa29ec422e920fb5dc989ed90897e6b.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42731 from liu-chunmei/seastore-alloc-extent-hint
Liu-Chunmei [Tue, 17 Aug 2021 00:15:22 +0000 (17:15 -0700)]
Merge pull request #42731 from liu-chunmei/seastore-alloc-extent-hint

crimson/seastore alloc extent hint

Replace L_ADDR_MIN by obj hash in onode, omap, object_data when alloc_extent.

Reviewed-by: Sam Just <sjust@redhat.com> and Cheng, Yingxin <yingxin.cheng@intel.com>
3 years agorgw: disable -Wimplicit-const-int-float-conversion conditionally
Kefu Chai [Tue, 17 Aug 2021 00:04:28 +0000 (08:04 +0800)]
rgw: disable -Wimplicit-const-int-float-conversion conditionally

to silence warning like:

 unknown warning group '-Wimplicit-const-int-float-conversion', ignored [-Werror,-Wunknown-warning-option]
 #pragma clang diagnostic ignored "-Wimplicit-const-int-float-conversion"

clang-10 does not support this option yet.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agodoc: clarify use of `rados rm` command 42801/head
J. Eric Ivancich [Mon, 16 Aug 2021 22:28:07 +0000 (18:28 -0400)]
doc: clarify use of `rados rm` command

The man page did not make it clear that multiple objects could be
specified, nor did it describe use of "--force-full".

Info displayed about "rm" with `rados --help` was poorly formatted and
the wording was adjusted.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
3 years agocrimson/seastore: change unit test using hint 42731/head
Chunmei Liu [Wed, 11 Aug 2021 03:22:17 +0000 (20:22 -0700)]
crimson/seastore: change unit test using hint

Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
3 years agocrimson/seastore: replace L_ADDR_MIN by hint in omap
chunmei-liu [Sat, 7 Aug 2021 20:39:45 +0000 (13:39 -0700)]
crimson/seastore: replace L_ADDR_MIN by hint in omap

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agocrimson/seastore: use get_hint in object_data_handler
Chunmei Liu [Thu, 12 Aug 2021 00:45:55 +0000 (17:45 -0700)]
crimson/seastore: use get_hint in object_data_handler

Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
3 years agocrimson/seastore: replace L_ADDR_MIN by obj hash in Onode
Chunmei Liu [Mon, 16 Aug 2021 20:54:07 +0000 (13:54 -0700)]
crimson/seastore: replace L_ADDR_MIN by obj hash in Onode

Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
3 years agoMerge pull request #42340 from mkogan1/wip-d3n-docs
Casey Bodley [Mon, 16 Aug 2021 20:11:33 +0000 (16:11 -0400)]
Merge pull request #42340 from mkogan1/wip-d3n-docs

doc/radosgw/d3n: add user docs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
3 years agocrimson/osd: disable Prometheous by default. 42797/head
Radoslaw Zarzynski [Mon, 16 Aug 2021 16:00:54 +0000 (16:00 +0000)]
crimson/osd: disable Prometheous by default.

As we lack the machinery for distributed port allocation, spawning
multiple instances of crimson on the same node is impossible. This
makes almost all Teuthology jobs red very early.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agodoc/radosgw/d3n: add user docs 42340/head
Mark Kogan [Wed, 14 Jul 2021 16:37:16 +0000 (19:37 +0300)]
doc/radosgw/d3n: add user docs

(high-level feature description, setup instructions, config options)
Fixes: https://tracker.ceph.com/issues/51409
Signed-off-by: Mark Kogan <mkogan@redhat.com>
3 years agoMerge pull request #42790 from ronen-fr/wip-ronenf-std-fix
Kefu Chai [Mon, 16 Aug 2021 15:05:41 +0000 (23:05 +0800)]
Merge pull request #42790 from ronen-fr/wip-ronenf-std-fix

key_value_store: fix missing std

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42795 from tchaikov/wip-cmake-quiet
Kefu Chai [Mon, 16 Aug 2021 14:38:58 +0000 (22:38 +0800)]
Merge pull request #42795 from tchaikov/wip-cmake-quiet

cmake: silence build output when building external deps

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agosrc/blk: fix block_device_t return if no aio libs present 42791/head
Deepika Upadhyay [Mon, 16 Aug 2021 14:04:33 +0000 (19:34 +0530)]
src/blk: fix block_device_t return if no aio libs present

In cases, when no libaio are present in the system, compilation fails,
return block_device_t as unknown

fixes: https://tracker.ceph.com/issues/50947#note-1

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agocmake: do not quote string 42795/head
Kefu Chai [Mon, 16 Aug 2021 13:02:06 +0000 (21:02 +0800)]
cmake: do not quote string

otherwise we have

CMake Error at /home/jenkins-build/build/workspace/ceph-pull-requests/build/spdk-ext-prefix/src/spdk-ext-stamp/spdk-ext-build-.cmake:37 (message):
  Command failed: 2

   'env' '-i' 'PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' 'CC=/usr/bin/clang-10' '/usr/bin/make' 'EXTRA_CFLAGS=' '-fPIC' '-Wno-address-of-packed-member""'

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocmake: silence build output when building external deps
Kefu Chai [Mon, 16 Aug 2021 10:42:18 +0000 (18:42 +0800)]
cmake: silence build output when building external deps

when download/building grafonnet-lib, dpdk, spdk, liburing and fio,
they dump lots of output during configuration and building phrases,
all of which is irrelevant to us. so let's just silence it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42784 from tchaikov/wip-rgw_dencoder
Kefu Chai [Mon, 16 Aug 2021 13:12:05 +0000 (21:12 +0800)]
Merge pull request #42784 from tchaikov/wip-rgw_dencoder

rgw/rgw_dencoder: set identity_type when creating samples

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agokey_value_store: fix missing std 42790/head
Ronen Friedman [Mon, 16 Aug 2021 11:28:28 +0000 (11:28 +0000)]
key_value_store: fix missing std

following PR #42742

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoMerge pull request #42785 from tchaikov/wip-no-warnings
Kefu Chai [Mon, 16 Aug 2021 13:08:33 +0000 (21:08 +0800)]
Merge pull request #42785 from tchaikov/wip-no-warnings

run-make-check: pass -Werror when compiling C++ code and a couple cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #42714 from ronen-fr/wip-ronenf-last-update
Kefu Chai [Mon, 16 Aug 2021 12:20:12 +0000 (20:20 +0800)]
Merge pull request #42714 from ronen-fr/wip-ronenf-last-update

osd/scrub: only telling the scrubber of 'updates' events if these eve…

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #42754 from aclamk/wip-aclamk-bluefs-improve-allocation-check
Kefu Chai [Mon, 16 Aug 2021 12:18:02 +0000 (20:18 +0800)]
Merge pull request #42754 from aclamk/wip-aclamk-bluefs-improve-allocation-check

os/bluestore/bluefs: Cleanup allocation consistency check code

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
3 years agomgr/dashboard: visual tests: Add more ignore regions for dashboard component 42786/head
Aaryan Porwal [Sun, 15 Aug 2021 23:04:40 +0000 (04:34 +0530)]
mgr/dashboard: visual tests: Add more ignore regions for dashboard component

Fixes: https://tracker.ceph.com/issues/52282
Signed-off-by: Aaryan Porwal <aaryanporwal2233@gmail.com>
3 years agocrimson/tools: silence [[maybe_unused]] warning in store-nbd.cc. 42787/head
Radoslaw Zarzynski [Mon, 16 Aug 2021 09:49:28 +0000 (09:49 +0000)]
crimson/tools: silence [[maybe_unused]] warning in store-nbd.cc.

```
[595/2463] Building CXX object src/crimson/tools/CMakeFiles/crimson-store-nbd.dir/store_nbd/store-nbd.cc.o
../src/crimson/tools/store_nbd/store-nbd.cc:324:43: warning: maybe_unused attribute ignored [-Wattributes]
  324 |   [[maybe_unused]] char reserved[124] = {0};
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agorun-make-check: pass -Werror when compiling C++ code 42785/head
Kefu Chai [Mon, 16 Aug 2021 09:36:30 +0000 (17:36 +0800)]
run-make-check: pass -Werror when compiling C++ code

to raise the bar so we can identify potential issues earlier.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocmake: use -Wno-unused-but-set-variable when compiling SPDK if supported
Kefu Chai [Mon, 16 Aug 2021 09:32:33 +0000 (17:32 +0800)]
cmake: use -Wno-unused-but-set-variable when compiling SPDK if supported

to silence warnings like:

In file included from nvme_tcp.c:52:
/home/jenkins-build/build/workspace/ceph-pull-requests/src/spdk/include/spdk_internal/nvme_tcp.h:369:17: warning: variable 'plen' set but not used [-Wunused-but-set-variable]
        uint32_t hlen, plen;
                       ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42580 from hualongfeng/solve_competition_between_read_and_retire
Ilya Dryomov [Mon, 16 Aug 2021 09:30:01 +0000 (11:30 +0200)]
Merge pull request #42580 from hualongfeng/solve_competition_between_read_and_retire

librbd/cache/pwl/ssd: solve competition between read and retire

Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agocmake: use string(APPEND ..) to append to string
Kefu Chai [Mon, 16 Aug 2021 09:29:35 +0000 (17:29 +0800)]
cmake: use string(APPEND ..) to append to string

more readable and less repeating this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agorgw/rgw_rest: do not set unused variable
Kefu Chai [Mon, 16 Aug 2021 09:26:09 +0000 (17:26 +0800)]
rgw/rgw_rest: do not set unused variable

`len` is used to track the total length of received data, but we already
collect the data in `bl`, so we can always check `bl` for the total
length. this change also silences following warning from Clang:

../src/rgw/rgw_rest.cc:1477:21: warning: variable 'len' set but not used [-Wunused-but-set-variable]
  int read_len = 0, len = 0;
                    ^
1 warning generated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agomgr/dashboard: Refresh button on the iscsi targets page 42717/head
Nizamudeen A [Mon, 9 Aug 2021 07:52:51 +0000 (13:22 +0530)]
mgr/dashboard: Refresh button on the iscsi targets page

Added a refresh button on the iscsi targets page. I've noticed that the
auto reload causes some load on the backend. So I disabled the auto
reload and went for the same approach as we have on rgw. A yellow
warning color on refresh btn to let the user know to manually refresh
that whenever needed.

Fixes: https://tracker.ceph.com/issues/52102
Signed-off-by: Nizamudeen A <nia@redhat.com>
3 years agoos/bluestore/BlueStore: make maybe unused variable [[maybe_unused]]
Kefu Chai [Mon, 16 Aug 2021 09:17:48 +0000 (17:17 +0800)]
os/bluestore/BlueStore: make maybe unused variable [[maybe_unused]]

cct is defined so it can be used by dout(), but when the source code is
compiled for crimson, dout() does not use cct at all, so in that case,
compiler complains like:

../src/os/bluestore/BlueStore.cc:17413:8: warning: unused variable 'cct' [-Wunused-variable]
  auto cct  = onode->c->store->cct;
       ^
1 warning generated.

in this change, cct is marked with [[maybe_unused]] to silence this
warning.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42777 from tchaikov/wip-clang-build
Kefu Chai [Mon, 16 Aug 2021 08:59:09 +0000 (16:59 +0800)]
Merge pull request #42777 from tchaikov/wip-clang-build

run-make-check,cmake: use clang in run-make-check.sh

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agorgw/rgw_json_enc: dump rgw_log_entry::identity_type 42784/head
Kefu Chai [Mon, 16 Aug 2021 08:23:26 +0000 (16:23 +0800)]
rgw/rgw_json_enc: dump rgw_log_entry::identity_type

should dump it for better debugging experience

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agorgw/rgw_json_enc: dump obj using dump_stream()
Kefu Chai [Mon, 16 Aug 2021 08:21:42 +0000 (16:21 +0800)]
rgw/rgw_json_enc: dump obj using dump_stream()

use dump_stream() instead of dump_string() for dumping stringify object.

more readably this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agorgw/rgw_dencoder: set identity_type when creating samples
Kefu Chai [Mon, 16 Aug 2021 08:01:42 +0000 (16:01 +0800)]
rgw/rgw_dencoder: set identity_type when creating samples

otherwise identity_type is a random number on stack. and there is good
chance that it does not match with the one decoded from the encoded
blob.

this change should address the failures like:

**** rgw_log_entry test 2 binary reencode check failed ****
   ceph-dencoder type rgw_log_entry select_test 2 encode export /tmp/typ-O8hVYK2Gb
   ceph-dencoder type rgw_log_entry select_test 2 encode decode encode export /tmp/typ-G09itHHIC
   cmp /tmp/typ-O8hVYK2Gb /tmp/typ-G09itHHIC

The following tests FAILED:
132 - check-generated.sh (Failed)
..

Fixes: https://tracker.ceph.com/issues/52278
Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agotest/crimson: disable logging for unittest-*fltree* 42777/head
Kefu Chai [Sat, 14 Aug 2021 12:28:07 +0000 (20:28 +0800)]
test/crimson: disable logging for unittest-*fltree*

these two tests are very chatty, just silence it. we can always re-enable the
logging, if something goes wrong with any of them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocmake: pass -Wunused-but-set-variable when building dpdk
Kefu Chai [Sun, 15 Aug 2021 08:31:02 +0000 (16:31 +0800)]
cmake: pass -Wunused-but-set-variable when building dpdk

otherwise we have:

src/spdk/dpdk/lib/librte_eal/linux/eal.c:591:11: error: variable 'total_mem' set but not used [-Werror,-Wunused-but-set-variable]
        uint64_t total_mem = 0;
                 ^
1 error generated.

when building dpdk with Clang. dpdk passes -Werror to compiler, so
we have to disable this option.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocmake/modules/BuildFIO: use ceph fork
Kefu Chai [Sat, 14 Aug 2021 01:47:36 +0000 (09:47 +0800)]
cmake/modules/BuildFIO: use ceph fork

to pick up the clang build fix. we should use the upstream repo, once the
clang build fix gets merged.

bumping up the fio helps to address following error, as this part was rewritten:

src/test/fio/CMakeFiles/fio_ceph_objectstore.dir/fio_ceph_objectstore.cc.o.d -o src/test/fio/CMakeFiles/fio_ceph_objectstore.dir/fio_ceph_objectstore.cc.o -c ../src/test/fio/fio_ceph_objectstore.cc
In file included from ../src/test/fio/fio_ceph_objectstore.cc:26:
In file included from src/fio/fio.h:18:
In file included from src/fio/thread_options.h:6:
In file included from src/fio/options.h:8:
src/fio/parse.h:128:13: error: arithmetic on a pointer to void
        return ret + offset;
               ~~~ ^
1 error generated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agobuild: switch the make check bot to Clang.
Radoslaw Zarzynski [Mon, 2 Aug 2021 19:26:00 +0000 (19:26 +0000)]
build: switch the make check bot to Clang.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #42781 from cyx1231st/wip-seastore-disable-test-intr-future
Kefu Chai [Mon, 16 Aug 2021 06:21:58 +0000 (14:21 +0800)]
Merge pull request #42781 from cyx1231st/wip-seastore-disable-test-intr-future

crimson/onode-staged-tree: force test to work with invalidated transactions

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agocrimson/onode-staged-tree: force test work with invalidated transactions 42781/head
Yingxin Cheng [Mon, 16 Aug 2021 02:33:32 +0000 (10:33 +0800)]
crimson/onode-staged-tree: force test work with invalidated transactions

is_then() is failed to interrupt the continuation chain and cause
unit test failure. So add a workaround to make the test pass again.

Fixes: https://tracker.ceph.com/issues/52259
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoMerge pull request #42778 from tchaikov/wip-crimson-cleanup
Kefu Chai [Mon, 16 Aug 2021 03:10:00 +0000 (11:10 +0800)]
Merge pull request #42778 from tchaikov/wip-crimson-cleanup

crimson/os/seastore: do not capture unused variable

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoMerge pull request #42776 from tchaikov/wip-freebsd
Kefu Chai [Sat, 14 Aug 2021 10:28:37 +0000 (18:28 +0800)]
Merge pull request #42776 from tchaikov/wip-freebsd

msg/async: build without "using namespace std"

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
3 years agotest: s/INSTANTIATE_TEST_CASE_P/INSTANTIATE_TEST_SUITE_P/ 42778/head
Kefu Chai [Sat, 14 Aug 2021 02:25:25 +0000 (10:25 +0800)]
test: s/INSTANTIATE_TEST_CASE_P/INSTANTIATE_TEST_SUITE_P/

to silence warnings like:

../src/test/osd/TestOSDMap.cc:2076:1: warning: 'InstantiateTestCase_P_IsDeprecated' is deprecated: INSTANTIATE_TEST_CASE_P is deprecated, please use INSTANTIATE_TEST_SUITE_P
[-Wdeprecated-declarations]
INSTANTIATE_TEST_CASE_P(
^
../src/googletest/googletest/include/gtest/gtest-param-test.h:505:38: note: expanded from macro 'INSTANTIATE_TEST_CASE_P'
  static_assert(::testing::internal::InstantiateTestCase_P_IsDeprecated(), \
                                     ^
../src/googletest/googletest/include/gtest/internal/gtest-internal.h:1298:1: note: 'InstantiateTestCase_P_IsDeprecated' has been explicitly marked deprecated here
GTEST_INTERNAL_DEPRECATED(
^
../src/googletest/googletest/include/gtest/internal/gtest-port.h:2249:59: note: expanded from macro 'GTEST_INTERNAL_DEPRECATED'
 #define GTEST_INTERNAL_DEPRECATED(message) __attribute__((deprecated(message)))
                                                          ^
1 warning generated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocrimson/os/seastore: do not capture unused variable
Kefu Chai [Sat, 14 Aug 2021 01:58:29 +0000 (09:58 +0800)]
crimson/os/seastore: do not capture unused variable

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42744 from wjwithagen/wjw-fix-varlength-init
Kefu Chai [Sat, 14 Aug 2021 02:28:52 +0000 (10:28 +0800)]
Merge pull request #42744 from wjwithagen/wjw-fix-varlength-init

rgw/store: Do not init var-length arrays

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agomsg/async: build without "using namespace std" 42776/head
Kefu Chai [Sat, 14 Aug 2021 01:40:35 +0000 (09:40 +0800)]
msg/async: build without "using namespace std"

* add "std::" prefix in headers

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #42730 from tchaikov/wip-cmake-build-type
Kefu Chai [Fri, 13 Aug 2021 16:14:12 +0000 (00:14 +0800)]
Merge pull request #42730 from tchaikov/wip-cmake-build-type

cmake: set CMAKE_BUILD_TYPE only if it is not specified

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
3 years agoMerge pull request #42742 from tchaikov/wip-no-using-namespace-std
Kefu Chai [Fri, 13 Aug 2021 16:12:06 +0000 (00:12 +0800)]
Merge pull request #42742 from tchaikov/wip-no-using-namespace-std

src: build without "using namespace std"

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
3 years agoinclude/object.h: do not "using namespace std" 42742/head
Kefu Chai [Mon, 9 Aug 2021 07:54:22 +0000 (15:54 +0800)]
include/object.h: do not "using namespace std"

so the identifiers in "std" namespace do not conflict the ones in C code
or the idenfitiers in other namespaces.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agodokan: : build without "using namespace std"
Kefu Chai [Fri, 13 Aug 2021 05:24:58 +0000 (13:24 +0800)]
dokan: : build without "using namespace std"

* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agojava: build without "using namespace std"
Kefu Chai [Thu, 12 Aug 2021 14:42:47 +0000 (22:42 +0800)]
java: build without "using namespace std"

* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agotools/cephfs: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 10:44:08 +0000 (18:44 +0800)]
tools/cephfs: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agotools/rbd_nbd: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 10:42:52 +0000 (18:42 +0800)]
tools/rbd_nbd: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agomount.ceph: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 10:41:28 +0000 (18:41 +0800)]
mount.ceph: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocrimson/tools: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 10:24:34 +0000 (18:24 +0800)]
crimson/tools: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agotools/erasure-code: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 10:22:40 +0000 (18:22 +0800)]
tools/erasure-code: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocephfs-mirror: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 09:57:00 +0000 (17:57 +0800)]
cephfs-mirror: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoclient: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 08:00:32 +0000 (16:00 +0800)]
client: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoceph_fuse: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 07:55:39 +0000 (15:55 +0800)]
ceph_fuse: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agokrbd: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:03:26 +0000 (12:03 +0800)]
krbd: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocrush: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:02:57 +0000 (12:02 +0800)]
crush: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agocompressor: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:02:35 +0000 (12:02 +0800)]
compressor: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoauth: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:02:08 +0000 (12:02 +0800)]
auth: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agokv: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:01:50 +0000 (12:01 +0800)]
kv: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agomsg: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:01:08 +0000 (12:01 +0800)]
msg: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoneorados: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:00:47 +0000 (12:00 +0800)]
neorados: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agolibradosstriper: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:00:21 +0000 (12:00 +0800)]
libradosstriper: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agolibcephfs: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 04:00:00 +0000 (12:00 +0800)]
libcephfs: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agoblk: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 03:58:38 +0000 (11:58 +0800)]
blk: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 years agolibcephsqlite: build without "using namespace std"
Kefu Chai [Wed, 11 Aug 2021 03:57:31 +0000 (11:57 +0800)]
libcephsqlite: build without "using namespace std"

* add "std::" prefix in headers
* add "using" declarations in .cc files.

so we don't rely on "using namespace std" in one or more included
headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>