]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agomgr/dashboard: monitoring: grafonnet refactoring for cephfs dashboards 43465/head
Aashish Sharma [Fri, 8 Oct 2021 10:07:17 +0000 (15:37 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for cephfs dashboards

This PR intends to refactor cephfs dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for osds dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:58:13 +0000 (15:28 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for osds dashboards

This PR intends to refactor osds dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for pools dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:52:46 +0000 (15:22 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for pools dashboards

This PR intends to refactor pools dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for rbd dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:42:41 +0000 (15:12 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for rbd dashboards

This PR intends to refactor rbd dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for radosgw dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:30:09 +0000 (15:00 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for radosgw dashboards

This PR intends to refactor radosgw dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agoMerge PR #43504 into master
Sage Weil [Mon, 18 Oct 2021 19:03:33 +0000 (15:03 -0400)]
Merge PR #43504 into master

* refs/pull/43504/head:
mgr/nfs: add some test coverage for cluster info, cluster config
mgr/nfs: add 'nfs cluster config get'

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
3 years agoMerge PR #43510 into master
Sage Weil [Mon, 18 Oct 2021 19:03:24 +0000 (15:03 -0400)]
Merge PR #43510 into master

* refs/pull/43510/head:
qa/suites/orch/cephadm/upgrade: smoke test for 'orch upgrade ls'
mgr/cephadm: make upgrade ls output structured
mgr/cephadm: add 'orch upgrade ls' to list available versions

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge PR #43549 into master
Sage Weil [Mon, 18 Oct 2021 17:56:39 +0000 (13:56 -0400)]
Merge PR #43549 into master

* refs/pull/43549/head:
mgr/rook: fix mds service list

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #43469 from rhcs-dashboard/hosts-grafana-dashboards
Ernesto Puerta [Mon, 18 Oct 2021 15:14:03 +0000 (17:14 +0200)]
Merge pull request #43469 from rhcs-dashboard/hosts-grafana-dashboards

mgr/dashboard: monitoring: grafonnet refactoring for hosts dashboards

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoqa/suites/orch/cephadm/upgrade: smoke test for 'orch upgrade ls' 43510/head
Sage Weil [Fri, 15 Oct 2021 15:58:41 +0000 (11:58 -0400)]
qa/suites/orch/cephadm/upgrade: smoke test for 'orch upgrade ls'

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #42760 from ideepika/wip-iscsi-testing
Ilya Dryomov [Mon, 18 Oct 2021 12:25:36 +0000 (14:25 +0200)]
Merge pull request #42760 from ideepika/wip-iscsi-testing

qa/suites/rbd: switch iscsi tests to cephadm

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #43564 from sebastian-philipp/doc-cephadm-host-location
Sebastian Wagner [Mon, 18 Oct 2021 11:58:55 +0000 (13:58 +0200)]
Merge pull request #43564 from sebastian-philipp/doc-cephadm-host-location

doc/cephadm: Hosts: Add "initial CRUSH location"

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agosrc/test/cli-integration: correct hostname for iscsi gateway 42760/head
Deepika Upadhyay [Thu, 14 Oct 2021 07:10:14 +0000 (12:40 +0530)]
src/test/cli-integration: correct hostname for iscsi gateway

iscsi accepts first word of hostname as local hostname[0] instead of
smithi061.front.sepia.ceph.com we use: smithi061 otherwise gateway
creation will error out with:
```The first gateway defined must be the local machine```

[0] https://github.com/ceph/ceph-iscsi-cli/blob/ff3e430b70a62257a560b8988bd54bf845c01fb7/gwcli/utils.py#L36

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agosrc/test/cli-integration/rbd: update gwcli_* to use podman exec
Deepika Upadhyay [Wed, 13 Oct 2021 06:30:38 +0000 (12:00 +0530)]
src/test/cli-integration/rbd: update gwcli_* to use podman exec

* since iscsi now resides inside the container, for testing we use the
  hack:
  - find the iscsi container/
  - use found container and podman exec command to test gateway creation
    deletion from host itself

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoqa/tasks: adapt ceph_iscsi.py task to ceph_iscsi_client
Deepika Upadhyay [Wed, 13 Oct 2021 06:19:02 +0000 (11:49 +0530)]
qa/tasks: adapt ceph_iscsi.py task to ceph_iscsi_client

* we use setup_iscsi_client.py to deploy iscsi client services,
  configuring intiator and mulitpath this is done by qa task
  ceph_iscsi_client
* qa/cephadm: adds remotes ip addresses to iscsi gateway,
* rename poolname: iscsi >> datapool, which we usually use for tests and
  expresses type of pool more clearly.

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoqa/suites/rbd: remove baremetal based setup needed for iscsi testing
Deepika Upadhyay [Wed, 13 Oct 2021 06:17:11 +0000 (11:47 +0530)]
qa/suites/rbd: remove baremetal based setup needed for iscsi testing

* replace ceph baremetal deployment with cephadm based deployment

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agodoc: add iSCSI initiator client configuration section for cephadm
Deepika Upadhyay [Wed, 13 Oct 2021 06:03:39 +0000 (11:33 +0530)]
doc: add iSCSI initiator client configuration section for cephadm

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoMerge pull request #43571 from tchaikov/wip-bl-prepare-iovs
Kefu Chai [Sat, 16 Oct 2021 02:57:05 +0000 (10:57 +0800)]
Merge pull request #43571 from tchaikov/wip-bl-prepare-iovs

common/bl: bl::prepare_iovs() related cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocommon/bl: mark bl::prepare_iovs() const 43571/head
Kefu Chai [Sat, 16 Oct 2021 00:31:08 +0000 (08:31 +0800)]
common/bl: mark bl::prepare_iovs() const

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/bl: simplify bl::prepare_iovs()
Kefu Chai [Fri, 15 Oct 2021 23:58:50 +0000 (07:58 +0800)]
common/bl: simplify bl::prepare_iovs()

* consolidate the code to initialize a vector<iov>
* use an iterator to track the current vector<iovec>. less
  repeating this way.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/bl: define iov_vec_t using a dedicated struct
Kefu Chai [Fri, 15 Oct 2021 23:48:55 +0000 (07:48 +0800)]
common/bl: define iov_vec_t using a dedicated struct

more readable this way

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/bl: move bl::prepare_iovs() to .cc file
Kefu Chai [Fri, 15 Oct 2021 23:35:21 +0000 (07:35 +0800)]
common/bl: move bl::prepare_iovs() to .cc file

to reduce the compilation time by having a smaller header file.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #43478 from anthonyeleven/anthonyeleven/fix-52830
Anthony D'Atri [Fri, 15 Oct 2021 22:34:30 +0000 (15:34 -0700)]
Merge pull request #43478 from anthonyeleven/anthonyeleven/fix-52830

common/options: document rgw_lc_debug_interval configuration option

3 years agoMerge pull request #43537 from xxhdx1985126/wip-seastore-iov-max
Samuel Just [Fri, 15 Oct 2021 22:04:22 +0000 (15:04 -0700)]
Merge pull request #43537 from xxhdx1985126/wip-seastore-iov-max

crimson/os/seastore: deal with scenarios in which bufferlist of do_writev has more than IOV_MAX buffers

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #43507 from cbodley/wip-rgw-log-spam
Casey Bodley [Fri, 15 Oct 2021 18:05:05 +0000 (14:05 -0400)]
Merge pull request #43507 from cbodley/wip-rgw-log-spam

rgw: hide some unnecessary log spam

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43488 from cbodley/wip-52873
Casey Bodley [Fri, 15 Oct 2021 18:04:13 +0000 (14:04 -0400)]
Merge pull request #43488 from cbodley/wip-52873

radosgw-admin: 'reshard list' doesn't log ENOENT errors

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43428 from cfsnyder/wip-52818-random-rgw-req-id
Casey Bodley [Fri, 15 Oct 2021 18:03:37 +0000 (14:03 -0400)]
Merge pull request #43428 from cfsnyder/wip-52818-random-rgw-req-id

rgw/rgw_rados: make RGW request IDs non-deterministic

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
3 years agoMerge pull request #42981 from mkogan1/rgw-d3n-fix-lru-exp
Casey Bodley [Fri, 15 Oct 2021 18:02:26 +0000 (14:02 -0400)]
Merge pull request #42981 from mkogan1/rgw-d3n-fix-lru-exp

rgw: d3n: fix d3n cached objects on disk lru eviction entering infini…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #42208 from BryceCao/wip-add-return-when-access-key-exist-in-subus...
Casey Bodley [Fri, 15 Oct 2021 18:01:58 +0000 (14:01 -0400)]
Merge pull request #42208 from BryceCao/wip-add-return-when-access-key-exist-in-subuser-create

rgw : add return when access key exist in subuser create

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #40144 from hualongfeng/osd_compression_bypass
Casey Bodley [Fri, 15 Oct 2021 17:59:58 +0000 (13:59 -0400)]
Merge pull request #40144 from hualongfeng/osd_compression_bypass

rgw: osd compression bypass after rgw compression

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agocommon/options: document rgw_lc_debug_interval configuration option 43478/head
Anthony D'Atri [Sun, 10 Oct 2021 20:25:00 +0000 (13:25 -0700)]
common/options: document rgw_lc_debug_interval configuration option

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #43533 from tchaikov/wip-cmake-less-chatty
Kefu Chai [Fri, 15 Oct 2021 16:10:32 +0000 (00:10 +0800)]
Merge pull request #43533 from tchaikov/wip-cmake-less-chatty

cmake: only pass --verbose when VERBOSE env variable is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agorgw: silence error message for nonexistent realm 43507/head
Casey Bodley [Fri, 15 Oct 2021 15:57:13 +0000 (11:57 -0400)]
rgw: silence error message for nonexistent realm

in a normal vstart cluster without a realm or period, every command
prints this error message:

0 RGWPeriod::init failed to init realm  id  : (2) No such file or directory

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge PR #43558 into master
Sage Weil [Fri, 15 Oct 2021 15:48:29 +0000 (11:48 -0400)]
Merge PR #43558 into master

* refs/pull/43558/head:
doc/governance.rst: update clt membership

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
3 years agoMerge PR #43430 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:16:25 +0000 (11:16 -0400)]
Merge PR #43430 into master

* refs/pull/43430/head:
qa: skip c-v install on pacific start

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge PR #43426 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:15:41 +0000 (11:15 -0400)]
Merge PR #43426 into master

* refs/pull/43426/head:
qa/cephfs: update xfstests_dev for centos stream

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43425 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:13:55 +0000 (11:13 -0400)]
Merge PR #43425 into master

* refs/pull/43425/head:
qa: import CommandFailedError from exceptions not run

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
3 years agoMerge PR #43420 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:13:05 +0000 (11:13 -0400)]
Merge PR #43420 into master

* refs/pull/43420/head:
qa: skip internal metadata directory when scanning ceph debugfs directory

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43382 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:11:48 +0000 (11:11 -0400)]
Merge PR #43382 into master

* refs/pull/43382/head:
mds: skip journaling blocklisted clients when in `replay` state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomgr/cephadm: make upgrade ls output structured
Sage Weil [Fri, 15 Oct 2021 15:09:07 +0000 (11:09 -0400)]
mgr/cephadm: make upgrade ls output structured

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43120 from dang/wip-dang-user-load-attrs
Daniel Gryniewicz [Fri, 15 Oct 2021 15:02:18 +0000 (11:02 -0400)]
Merge pull request #43120 from dang/wip-dang-user-load-attrs

RGW Zipper - load user attributes with user

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agodoc/cephadm: Hosts: Add "initial CRUSH location" 43564/head
Sebastian Wagner [Fri, 15 Oct 2021 11:13:02 +0000 (13:13 +0200)]
doc/cephadm: Hosts: Add "initial CRUSH location"

Followup on d2a9a35993

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #31909 from rosinL/wip-fix-dpdk-cond-wait
Kefu Chai [Fri, 15 Oct 2021 11:25:55 +0000 (19:25 +0800)]
Merge pull request #31909 from rosinL/wip-fix-dpdk-cond-wait

msg/async/dpdk: exit condition waiting when DPDKStack is destructed

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agocrimson/os/seastore: deal with scenarios in which bufferlist of do_writev has more... 43537/head
Xuehan Xu [Thu, 14 Oct 2021 09:43:23 +0000 (17:43 +0800)]
crimson/os/seastore: deal with scenarios in which bufferlist of do_writev has more than IOV_MAX buffers

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agomsg/async/dpdk: exit condition waiting when DPDKStack is destructed 31909/head
Chunsong Feng [Wed, 20 Nov 2019 01:42:11 +0000 (09:42 +0800)]
msg/async/dpdk: exit condition waiting when DPDKStack is destructed

exit() will call pthread_cond_destroy attempting to destroy dpdk::eal::cond
upon which other threads are currently blocked results in undefine
behavior. Link different libc version test, libc-2.17 can exit,
libc-2.27 will deadlock, the call stack is as follows:

Thread 3 (Thread 0xffff7e5749f0 (LWP 62213)):
 #0  0x0000ffff7f3c422c in futex_wait_cancelable (private=<optimized out>, expected=0,
    futex_word=0xaaaadc0e30f4 <dpdk::eal::cond+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
 #1  __pthread_cond_wait_common (abstime=0x0, mutex=0xaaaadc0e30f8 <dpdk::eal::lock>, cond=0xaaaadc0e30c8 <dpdk::eal::cond>)
    at pthread_cond_wait.c:502
 #2  __pthread_cond_wait (cond=0xaaaadc0e30c8 <dpdk::eal::cond>, mutex=0xaaaadc0e30f8 <dpdk::eal::lock>)
    at pthread_cond_wait.c:655
 #3  0x0000ffff7f1f1f80 in std::condition_variable::wait(std::unique_lock<std::mutex>&) ()
   from /usr/lib/aarch64-linux-gnu/libstdc++.so.6
 #4  0x0000aaaad37f5078 in dpdk::eal::<lambda()>::operator()(void) const (__closure=<optimized out>, __closure=<optimized out>)
    at ./src/msg/async/dpdk/dpdk_rte.cc:136
 #5  0x0000ffff7f1f7ed4 in ?? () from /usr/lib/aarch64-linux-gnu/libstdc++.so.6
 #6  0x0000ffff7f3be088 in start_thread (arg=0xffffe73e197f) at pthread_create.c:463
 #7  0x0000ffff7efc74ec in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78

Thread 1 (Thread 0xffff7ee3b010 (LWP 62200)):
 #0  0x0000ffff7f3c3c38 in futex_wait (private=<optimized out>, expected=12, futex_word=0xaaaadc0e30ec <dpdk::eal::cond+36>)
    at ../sysdeps/unix/sysv/linux/futex-internal.h:61
 #1  futex_wait_simple (private=<optimized out>, expected=12, futex_word=0xaaaadc0e30ec <dpdk::eal::cond+36>)
    at ../sysdeps/nptl/futex-internal.h:135
 #2  __pthread_cond_destroy (cond=0xaaaadc0e30c8 <dpdk::eal::cond>) at pthread_cond_destroy.c:54
 #3  0x0000ffff7ef2be34 in __run_exit_handlers (status=-6, listp=0xffff7f04a5a0 <__exit_funcs>, run_list_atexit=255,
    run_list_atexit@entry=true, run_dtors=run_dtors@entry=true) at exit.c:108
 #4  0x0000ffff7ef2bf6c in __GI_exit (status=<optimized out>) at exit.c:139
 #5  0x0000ffff7ef176e4 in __libc_start_main (main=0x0, argc=0, argv=0x0, init=<optimized out>, fini=<optimized out>,
    rtld_fini=<optimized out>, stack_end=<optimized out>) at ../csu/libc-start.c:344
 #6  0x0000aaaad2939db0 in _start () at ./src/include/buffer.h:642

Fixes: https://tracker.ceph.com/issues/42890
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Signed-off-by: luo rixin <luorixin@huawei.com>
3 years agoMerge pull request #43555 from tchaikov/wip-dashboard-tsconfig
Kefu Chai [Fri, 15 Oct 2021 08:07:36 +0000 (16:07 +0800)]
Merge pull request #43555 from tchaikov/wip-dashboard-tsconfig

mgr/dashboard: s/hosts.clickHostTab/hosts.clickTab/

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agomgr/dashboard: s/hosts.clickHostTab/hosts.clickTab/ 43555/head
Kefu Chai [Thu, 14 Oct 2021 22:44:55 +0000 (06:44 +0800)]
mgr/dashboard: s/hosts.clickHostTab/hosts.clickTab/

this change is a follow-up fix of
3276147049511a9a8d45d84c95154a4ec014cd83

otherwise we have following test failure:

[lint:tsc     ] cypress/integration/orchestrator/01-hosts.e2e-spec.ts(29,13): error TS2339: Property 'clickHostTab' does not exist on type 'HostsPageHelper'.

also change "host" to "hostname" to be more consistent

Fixes: https://tracker.ceph.com/issues/52645
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon: add prepare_iovs to bufferlist
Xuehan Xu [Fri, 15 Oct 2021 05:42:41 +0000 (13:42 +0800)]
common: add prepare_iovs to bufferlist

Enable bufferlist that have more than IOV_MAX buffers to build a vector of iov.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocrimson/common: extract parallel_for_each into errorator-loop.h
Xuehan Xu [Thu, 14 Oct 2021 09:41:18 +0000 (17:41 +0800)]
crimson/common: extract parallel_for_each into errorator-loop.h

otherwise, crimson::errorator<AllowedErrors...>::parallel_for_each would be
referencing incomplete crimson::parallel_for_each_state type

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agorgw: osd compression bypass after rgw compression 40144/head
Feng Hualong [Tue, 10 Aug 2021 08:22:33 +0000 (16:22 +0800)]
rgw: osd compression bypass after rgw compression

In particular, when rgw is itself doing compression,
rgw should send a incompressible hint to OSD.
Because the OSD has little effect on the data
compressed in the condition. So there bypassing the
osd compression is to avoid repeated compression
calculation.

Signed-off-by: Feng Hualong <hualong.feng@intel.com>
3 years agoMerge pull request #43554 from athanatos/sjust/wip-block-segment-manager-sync
Kefu Chai [Fri, 15 Oct 2021 02:09:52 +0000 (10:09 +0800)]
Merge pull request #43554 from athanatos/sjust/wip-block-segment-manager-sync

crimson/os/seastore/segment_manager/block: open with dsync

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agodoc/governance.rst: update clt membership 43558/head
Josh Durgin [Fri, 15 Oct 2021 00:52:50 +0000 (20:52 -0400)]
doc/governance.rst: update clt membership

This now matches the mailing list which Sage audited.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
3 years agoMerge PR #43333 into master
Sage Weil [Fri, 15 Oct 2021 01:00:13 +0000 (21:00 -0400)]
Merge PR #43333 into master

* refs/pull/43333/head:
.github/CODEOWNERS: tag rook devs on rook related PRs

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agomgr/nfs: add some test coverage for cluster info, cluster config 43504/head
Sage Weil [Thu, 14 Oct 2021 17:21:40 +0000 (13:21 -0400)]
mgr/nfs: add some test coverage for cluster info, cluster config

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/nfs: add 'nfs cluster config get'
Sage Weil [Tue, 12 Oct 2021 16:13:04 +0000 (11:13 -0500)]
mgr/nfs: add 'nfs cluster config get'

Fixes: https://tracker.ceph.com/issues/52942
Signed-off-by: Sage Weil <sage@newdream.net>
3 years agocrimson/os/seastore/segment_manager/block: open with dsync 43554/head
Samuel Just [Thu, 14 Oct 2021 21:51:38 +0000 (14:51 -0700)]
crimson/os/seastore/segment_manager/block: open with dsync

67efc4 appears to be simply incorrect, I don't see any calls
to flush(), so we do need to open with dsync until we
implement a smarter flushing scheme.

Also, refactor open_device to remove mode param -- we always
pass the same value.

Reverts: 67efc48332cebb69497c5676be6ed2a6e5365e03
Signed-off-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #43477 from anthonyeleven/anthonyeleven/fix-23027
Casey Bodley [Thu, 14 Oct 2021 20:13:28 +0000 (16:13 -0400)]
Merge pull request #43477 from anthonyeleven/anthonyeleven/fix-23027

ceph: document rgw_multipart_min_part_size

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agomgr/rook: fix mds service list 43549/head
Sage Weil [Tue, 12 Oct 2021 14:43:05 +0000 (09:43 -0500)]
mgr/rook: fix mds service list

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #42997 from josephsawaya/wip-mgr-rook-orch-ls
Sebastian Wagner [Thu, 14 Oct 2021 15:33:26 +0000 (17:33 +0200)]
Merge pull request #42997 from josephsawaya/wip-mgr-rook-orch-ls

mgr/rook: orch ls displays info about OSDs

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
3 years agoMerge pull request #43332 from sebastian-philipp/sphinx-rgw-spec
Sebastian Wagner [Thu, 14 Oct 2021 14:54:18 +0000 (16:54 +0200)]
Merge pull request #43332 from sebastian-philipp/sphinx-rgw-spec

doc/cephadm: use sphinx autoclass to document RGWSpec

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #43239 from trociny/wip-48959
Kefu Chai [Thu, 14 Oct 2021 14:43:16 +0000 (22:43 +0800)]
Merge pull request #43239 from trociny/wip-48959

osd: handle inconsistent hash info during backfill and deep scrub gracefully

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #43498 from dheart-joe/bluestore_fix
Kefu Chai [Thu, 14 Oct 2021 14:41:52 +0000 (22:41 +0800)]
Merge pull request #43498 from dheart-joe/bluestore_fix

os/bluestore: _do_write_small fix head_pad

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
3 years agoMerge pull request #42099 from aclamk/wip-bluefs-fine-grain-locking-2
Kefu Chai [Thu, 14 Oct 2021 14:40:20 +0000 (22:40 +0800)]
Merge pull request #42099 from aclamk/wip-bluefs-fine-grain-locking-2

os/bluestore: BlueFS fine grain locking

Reviewed-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43374 from ljflores/wip-remove-pool-name
Kefu Chai [Thu, 14 Oct 2021 14:39:14 +0000 (22:39 +0800)]
Merge pull request #43374 from ljflores/wip-remove-pool-name

mgr/telemetry: remove pool name from telemetry perf report

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
3 years agoMerge pull request #43463 from Zhiwei-Dai/wip-enhance-qa-python3-compatibility
Kefu Chai [Thu, 14 Oct 2021 14:38:39 +0000 (22:38 +0800)]
Merge pull request #43463 from Zhiwei-Dai/wip-enhance-qa-python3-compatibility

qa/tasks: replace iterkeys() with keys() for Python 3

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #43405 from ljflores/wip-perfcounter-priorities
Kefu Chai [Thu, 14 Oct 2021 14:37:36 +0000 (22:37 +0800)]
Merge pull request #43405 from ljflores/wip-perfcounter-priorities

os/bluestore: update perf counter priorities

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #43422 from ronen-fr/wip-rf-exact-time-sec
Kefu Chai [Thu, 14 Oct 2021 14:36:30 +0000 (22:36 +0800)]
Merge pull request #43422 from ronen-fr/wip-rf-exact-time-sec

common/ceph_time: fix wrong seconds output in exact_timespan_str()

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #43515 from fengchunsong/dpdk-dev
Kefu Chai [Thu, 14 Oct 2021 14:34:56 +0000 (22:34 +0800)]
Merge pull request #43515 from fengchunsong/dpdk-dev

msgs/async/dpdk: fix dpdk build error

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #43531 from tchaikov/wip-pick-addr
Kefu Chai [Thu, 14 Oct 2021 14:33:39 +0000 (22:33 +0800)]
Merge pull request #43531 from tchaikov/wip-pick-addr

common/pick_address: refactor pick_addresses()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #43073 from strenuous-life/wip-cephadm-osd-rm-status
Sebastian Wagner [Thu, 14 Oct 2021 14:29:05 +0000 (16:29 +0200)]
Merge pull request #43073 from strenuous-life/wip-cephadm-osd-rm-status

mgr/cephadm: the display of 'orch osd rm status' is incorrect

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43214 from batrick/i52654
Sebastian Wagner [Thu, 14 Oct 2021 14:28:30 +0000 (16:28 +0200)]
Merge pull request #43214 from batrick/i52654

pybind/mgr/cephadm: set allow_standby_replay during CephFS upgrade

Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43253 from guits/fix_orch_ls_osd
Sebastian Wagner [Thu, 14 Oct 2021 14:28:03 +0000 (16:28 +0200)]
Merge pull request #43253 from guits/fix_orch_ls_osd

cephadm: fix osd size reported in 'orch ls'

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43339 from adk3798/volume-chunk
Sebastian Wagner [Thu, 14 Oct 2021 14:27:10 +0000 (16:27 +0200)]
Merge pull request #43339 from adk3798/volume-chunk

mgr/cephadm: use json-pretty for ceph-volume calls

Reviewed-by: Sage Weil <sage@newdream.net>
3 years agoMerge PR #43517 into master
Patrick Donnelly [Thu, 14 Oct 2021 14:08:18 +0000 (10:08 -0400)]
Merge PR #43517 into master

* refs/pull/43517/head:
doc / cephfs: health message codes should be permalinks

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #43538 from rzarzynski/wip-crimson-net-actual-bind-failure
Kefu Chai [Thu, 14 Oct 2021 14:00:27 +0000 (22:00 +0800)]
Merge pull request #43538 from rzarzynski/wip-crimson-net-actual-bind-failure

crimson/osd: print the actual reason on bind failure.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #42557 from ceph/feature-50336-cluster-creation-wizard
Ernesto Puerta [Thu, 14 Oct 2021 13:12:42 +0000 (15:12 +0200)]
Merge pull request #42557 from ceph/feature-50336-cluster-creation-wizard

mgr/dashboard: Cluster Creation/Expansion Wizard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
Reviewed-by: Volker Theile <vtheile@suse.com>
3 years agoMerge pull request #43453 from rhcs-dashboard/e2e-host-fix-teuth
Ernesto Puerta [Thu, 14 Oct 2021 11:26:44 +0000 (13:26 +0200)]
Merge pull request #43453 from rhcs-dashboard/e2e-host-fix-teuth

mgr/dashboard: Fix orchestrator/01-hosts.e2e-spec.ts failure

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agosrc/msg/dpdk: reserve funcs capacity to avoid reallocation 43515/head
Chunsong Feng [Wed, 13 Oct 2021 03:55:08 +0000 (03:55 +0000)]
src/msg/dpdk: reserve funcs capacity to avoid reallocation

When a new vector is added larger than then current vector capacity,
it reallocates space. lamda function accesses the previous adress will
cause a segment fault. Therefore, reserve sufficient funcs space to
avoid reallocation.

Fixes: https://tracker.ceph.com/issues/52907
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
3 years agomsgs/async/dpdk: fix dpdk build error
Chunsong Feng [Wed, 13 Oct 2021 03:33:02 +0000 (03:33 +0000)]
msgs/async/dpdk: fix dpdk build error

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
3 years agocrimson/osd: print the actual reason on bind failure. 43538/head
Radoslaw Zarzynski [Wed, 13 Oct 2021 12:21:04 +0000 (12:21 +0000)]
crimson/osd: print the actual reason on bind failure.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #43308 from TRYTOBE8TME/wip-rgw-post-object-upload
Yuval Lifshitz [Thu, 14 Oct 2021 07:41:15 +0000 (10:41 +0300)]
Merge pull request #43308 from TRYTOBE8TME/wip-rgw-post-object-upload

src/rgw: HTTP POST object upload

3 years agocmake: only pass --verbose when VERBOSE env variable is set 43533/head
Kefu Chai [Thu, 14 Oct 2021 06:39:55 +0000 (14:39 +0800)]
cmake: only pass --verbose when VERBOSE env variable is set

so that the setuptools is less chatty by default when building python
bindings.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/pick_address: refactor pick_addresses() 43531/head
Kefu Chai [Wed, 13 Oct 2021 23:51:31 +0000 (07:51 +0800)]
common/pick_address: refactor pick_addresses()

* consolidate the logic handling CEPH_PICK_ADDRESS_PREFER_IPV4 using
  std::sort(). this might be overkill. but it helps to explain
  what CEPH_PICK_ADDRESS_PREFER_IPV4 is for, and helps to dedup
  the code to order the addresses.
* let fill_in_one_address() return an optional<entity_addrvec_t>.
  more readable this way
* early return if the required address is not found, instead of
  checking variables like ipv4_r
* rename fill_in_one_address() to get_one_address() to reflect
  the change of the function's return value's type

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agodoc / cephfs: health message codes should be permalinks 43517/head
Venky Shankar [Wed, 13 Oct 2021 05:32:15 +0000 (11:02 +0530)]
doc / cephfs: health message codes should be permalinks

... so that such links can be included in alert warnings.

Additionally, document some other health warnings. Credit to @pcuzner
to point out that not all health warnings have been documented.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
3 years agocommon/pick_address: use string_view when appropriate
Kefu Chai [Wed, 13 Oct 2021 23:38:09 +0000 (07:38 +0800)]
common/pick_address: use string_view when appropriate

we don't need a string when string_view is good enough.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #43526 from adk3798/disable-agent-default
adk3798 [Wed, 13 Oct 2021 21:45:42 +0000 (17:45 -0400)]
Merge pull request #43526 from adk3798/disable-agent-default

mgr/cephadm: disable agent by default

Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge PR #43049 into master
Sage Weil [Wed, 13 Oct 2021 21:08:20 +0000 (17:08 -0400)]
Merge PR #43049 into master

* refs/pull/43049/head:
mgr/rook: apply mds using placement spec and osd_pool_default_size
mgr/rook: factor out replica/failureDomain calc

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
3 years agomgr/cephadm: add 'orch upgrade ls' to list available versions
Sage Weil [Tue, 12 Oct 2021 19:22:14 +0000 (15:22 -0400)]
mgr/cephadm: add 'orch upgrade ls' to list available versions

Optionally pass image name to query an alternative image/registry, or
--tags to list tags instead of ceph versions.

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/cephadm: disable agent by default 43526/head
Adam King [Wed, 13 Oct 2021 16:33:47 +0000 (12:33 -0400)]
mgr/cephadm: disable agent by default

to avoid issues while it is stabilized

Signed-off-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #43490 from Daniel-Pivonka/cephadm-doc-adopt-sshuser
Sebastian Wagner [Wed, 13 Oct 2021 16:11:36 +0000 (18:11 +0200)]
Merge pull request #43490 from Daniel-Pivonka/cephadm-doc-adopt-sshuser

doc/cephadm: document setting ssh-user during adopt

Reviewed-by: Adam King <adking@redhat.com>
3 years agodoc/cephadm: document setting ssh-user during adopt 43490/head
Daniel Pivonka [Mon, 11 Oct 2021 21:15:35 +0000 (17:15 -0400)]
doc/cephadm: document setting ssh-user during adopt

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
3 years agoos/bluestore: update priorities and nicks of bluestore perf counters 43405/head
Laura Flores [Mon, 4 Oct 2021 04:41:10 +0000 (04:41 +0000)]
os/bluestore: update priorities and nicks of bluestore perf counters

These perf counters do not show up in telemetry unless they are set to a "useful" priority or higher. Fetching these counters in telemetry may help to diagnose problems with RocksDB / BlueFS prefetching / insufficient cache sizes.

Signed-off-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #43377 from rhcs-dashboard/fix-clients-connection-query
Ernesto Puerta [Wed, 13 Oct 2021 11:37:51 +0000 (13:37 +0200)]
Merge pull request #43377 from rhcs-dashboard/fix-clients-connection-query

 mgr/dashboard: replace "Ceph-cluster" Client connections with active-standby MGRs

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: neha-ojha <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agomgr/dashboard: Cluster expansion e2e cleanups 42557/head
Nizamudeen A [Fri, 17 Sep 2021 13:13:01 +0000 (18:43 +0530)]
mgr/dashboard: Cluster expansion e2e cleanups

Fixes: https://tracker.ceph.com/issues/52645
Signed-off-by: Nizamudeen A <nia@redhat.com>
3 years agomgr/dashboard: introduce gather facts in host list
Avan Thakkar [Tue, 3 Aug 2021 09:01:57 +0000 (14:31 +0530)]
mgr/dashboard: introduce gather facts in host list

Fixes: https://tracker.ceph.com/issues/52017
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
3 years agomgr/dashboard: Cluster Creation Add Services Section
Aashish Sharma [Tue, 7 Sep 2021 06:30:45 +0000 (12:00 +0530)]
mgr/dashboard: Cluster Creation Add Services Section

Add Services section in cluster creation wizard
Create Cluster OSD Section Followups

1. The device preview disappearing when going to next step and coming back to the previous step
2. Even when clearing the device preview, the Storage Capacity count and the drive group spec doesn't get cleared.
3. Expanding the cluster without selecting any devices gives a 400
   error.
4. Renamed "Delete Host" to "Remove Host"
5. Generalizing most of the sub component code

Fixes: https://tracker.ceph.com/issues/52499
Fixes: https://tracker.ceph.com/issues/51991
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: Cluster Creation Create OSDs Section
Nizamudeen A [Tue, 17 Aug 2021 13:34:31 +0000 (19:04 +0530)]
mgr/dashboard: Cluster Creation Create OSDs Section

Create OSDs section in cluster creation wizard

Fixes: https://tracker.ceph.com/issues/51991
Fixes: https://tracker.ceph.com/issues/52298
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: Review Section for the Create Cluster Workflow
Avan Thakkar [Fri, 9 Jul 2021 13:27:35 +0000 (18:57 +0530)]
mgr/dashboard: Review Section for the Create Cluster Workflow

Fixes: https://tracker.ceph.com/issues/50566
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
3 years agomgr/dashboard: Cluster Creation Add Host Section and e2es
Nizamudeen A [Sun, 4 Jul 2021 13:16:45 +0000 (18:46 +0530)]
mgr/dashboard: Cluster Creation Add Host Section and e2es

Add host section of the cluster creation workflow.

1. Fix bug in the modal where going forward one step on the wizard and coming back opens up the add host modal.
2. Rename Create Cluster to Expand Cluster as per the discussions
3. A skip confirmation modal to warn the user when he tries to skip the
   cluster creation
4. Adapted all the tests
5. Did some UI improvements like fixing and aligning the styles,
   colors..
- Used routed modal for host Additon form
- Renamed the Create to Add in Host Form

Fixes: https://tracker.ceph.com/issues/51517
Fixes: https://tracker.ceph.com/issues/51640
Fixes: https://tracker.ceph.com/issues/50336
Fixes: https://tracker.ceph.com/issues/50565
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
3 years agomgr/dashboard: Create Cluster Workflow welcome screen and e2e tests
Avan Thakkar [Tue, 1 Jun 2021 12:55:15 +0000 (18:25 +0530)]
mgr/dashboard: Create Cluster Workflow welcome screen and e2e tests

A module option called CLUSTER_STATUS has two option. INSTALLED
AND POST_INSTALLED. When CLUSTER_STATUS is INSTALLED it will allow to show the
create-cluster-wizard after login the initial time.  After the cluster
creation is succesfull this option is set to POST_INSTALLED
Also has the e2e codes for the Review Section

Fixes: https://tracker.ceph.com/issues/50336
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>