]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agolibrbd/cache: Rename namespaces and move files 36586/head
Mahati Chamarthy [Wed, 2 Sep 2020 09:53:06 +0000 (15:23 +0530)]
librbd/cache: Rename namespaces and move files

Signed-off-by: Lisa Li <xiaoyan.li@intel.com>
Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
4 years agolibrbd/cache: Establish the framework to integrate RWL and SSD
Mahati Chamarthy [Fri, 3 Jul 2020 11:08:50 +0000 (16:38 +0530)]
librbd/cache: Establish the framework to integrate RWL and SSD

- Create WriteLogCache class
- Rename ReplicatedWriteLog files to AbstractWriteLog and
  modify the I/O method names
- fix the test
- Modify CMakeLists.txt to add newly created classes

Signed-off-by: Lisa Li <xiaoyan.li@intel.com>
Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
4 years agoMerge pull request #36228 from vosdev/doc-mgr-crash-typo
Kefu Chai [Mon, 17 Aug 2020 03:17:02 +0000 (11:17 +0800)]
Merge pull request #36228 from vosdev/doc-mgr-crash-typo

doc/mgr/crash: Add missing command in rm example

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36623 from cheese/master
Kefu Chai [Mon, 17 Aug 2020 02:41:49 +0000 (10:41 +0800)]
Merge pull request #36623 from cheese/master

common: document the current semantics of bl::append(std::istream)

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36418 from changchengx/osd_map
Kefu Chai [Mon, 17 Aug 2020 02:33:15 +0000 (10:33 +0800)]
Merge pull request #36418 from changchengx/osd_map

osd/OSDMap: corret osd_info_t last_clean comment

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36642 from tchaikov/wip-crimson-silence-warnings
Kefu Chai [Sun, 16 Aug 2020 14:48:56 +0000 (22:48 +0800)]
Merge pull request #36642 from tchaikov/wip-crimson-silence-warnings

crimson: silence warnings from clang++

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 years agocrimson/osd: do not capture unused variables 36642/head
Kefu Chai [Sat, 15 Aug 2020 11:05:46 +0000 (19:05 +0800)]
crimson/osd: do not capture unused variables

this change silences warnings like

src/crimson/osd/pg_backend.cc:232:34: warning: lambda capture 'this' is not used [-Wunused-lambda-capture]
        [&os, &osd_op, &extents, this](auto&& bl) -> read_errorator::future<> {

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/os: do not return a value for non-reachable branch
Kefu Chai [Sat, 15 Aug 2020 11:04:19 +0000 (19:04 +0800)]
crimson/os: do not return a value for non-reachable branch

for silencing a warning like

btree/btree_lba_manager.cc:177:12: warning: binding dereferenced null pointer to reference has undefined behavior [-Wnull-dereference]
    return *static_cast<btree_range_pin_t*>(nullptr);
           ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ceph_abort_msg() is marked [[noreturn]], so we can just use it here
without worrying about complains from compiler.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36479 from dillaman/wip-46669
Mykola Golub [Sat, 15 Aug 2020 15:31:10 +0000 (18:31 +0300)]
Merge pull request #36479 from dillaman/wip-46669

test/rbd-mirror: pool watcher registration error might result in race

Reviewed-by: Mykola Golub <mgolub@suse.com>
4 years agoMerge pull request #36639 from tchaikov/wip-crimson-build-push-op
Kefu Chai [Sat, 15 Aug 2020 10:47:46 +0000 (18:47 +0800)]
Merge pull request #36639 from tchaikov/wip-crimson-build-push-op

crimson/osd: clear data_included if fiemap fails

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 years agoMerge pull request #36505 from rzarzynski/wip-crimson-bump-up-seastar
Kefu Chai [Sat, 15 Aug 2020 10:41:42 +0000 (18:41 +0800)]
Merge pull request #36505 from rzarzynski/wip-crimson-bump-up-seastar

crimson: bump up seastar version to freshest master

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36529 from tchaikov/wip-crimson-dts-9
Kefu Chai [Sat, 15 Aug 2020 10:39:48 +0000 (18:39 +0800)]
Merge pull request #36529 from tchaikov/wip-crimson-dts-9

ceph.spec.in: use devtoolset-9 for building crimson

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
4 years agoinstall-deps.sh: add tchaikov's copr repo for crimson build on el8 36529/head
Kefu Chai [Sat, 15 Aug 2020 03:22:53 +0000 (11:22 +0800)]
install-deps.sh: add tchaikov's copr repo for crimson build on el8

we need it before the updated version of gcc-toolset9 addressing
https://bugzilla.redhat.com/show_bug.cgi?id=1853900 is available in
RHEL8/CentOS8.

see https://copr.fedorainfracloud.org/coprs/tchaikov/gcc-toolset-9

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoceph.spec.in: use gcc-toolset-9 for building crimson
Kefu Chai [Sat, 8 Aug 2020 06:33:01 +0000 (14:33 +0800)]
ceph.spec.in: use gcc-toolset-9 for building crimson

since seastar dropped support from C++14, we have to move to a compiler
with a decent C++17 support.

in this change, gcc-toolset-9 is used for compiling ceph if seastar is
enabled. use version >= 9.2.1-2.2, because of
https://bugzilla.redhat.com/show_bug.cgi?id=1853900

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/osd: clear data_included if read fails 36639/head
Kefu Chai [Sat, 15 Aug 2020 02:51:04 +0000 (10:51 +0800)]
crimson/osd: clear data_included if read fails

* extract read_object_for_push_op() out of build_push_op().
  build_push_op() is composed of multiple steps. would be better
  if we can split and extract them into separated method for better
  readability
* clear push_op->data_included() if fiemap fails. before this change,
  a local copy of `copy_subset` is cleared if fiemap fails, but
  push_op->data_included is not updated in this case. we should
  clear the latter if no data is returned in push_op->data. so,
  in this change, push_op->data_included is cleared if fiemap
  fails. the same applies to other cases where no data is returned in
  push_op
* add comments to outline the steps in read_object_for_push_op().

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/osd: print detailed info of object being recovered
Kefu Chai [Fri, 14 Aug 2020 14:53:15 +0000 (22:53 +0800)]
crimson/osd: print detailed info of object being recovered

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/osd: remove stale comment
Kefu Chai [Fri, 14 Aug 2020 14:00:14 +0000 (22:00 +0800)]
crimson/osd: remove stale comment

CyanStore supports readv() now, so remove this comment.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/osd: do not use __func__ in a lambda
Kefu Chai [Fri, 14 Aug 2020 13:26:21 +0000 (21:26 +0800)]
crimson/osd: do not use __func__ in a lambda

otherwise we would have logging messages like

operator(): returning obc ...

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36618 from tspmelo/wip-backport-jq
Nathan Cutler [Fri, 14 Aug 2020 18:07:06 +0000 (20:07 +0200)]
Merge pull request #36618 from tspmelo/wip-backport-jq

script/ceph-backport.sh: Check if jq is installed

4 years agoMerge pull request #36609 from tspmelo/wip-doc-browsers
Lenz Grimmer [Fri, 14 Aug 2020 13:31:40 +0000 (15:31 +0200)]
Merge pull request #36609 from tspmelo/wip-doc-browsers

mgr/dashboard: Update list of supported browsers

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #36624 from lixiaoy1/fix_config
Jason Dillaman [Fri, 14 Aug 2020 12:29:35 +0000 (08:29 -0400)]
Merge pull request #36624 from lixiaoy1/fix_config

rbd/rwl: fix the config issue

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #36466 from lixiaoy1/rbd_image_info_br
Jason Dillaman [Fri, 14 Aug 2020 12:21:11 +0000 (08:21 -0400)]
Merge pull request #36466 from lixiaoy1/rbd_image_info_br

rbd/status: get image cache state

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #36422 from orozery/object_dispatch_assert_version_write
Jason Dillaman [Fri, 14 Aug 2020 12:20:49 +0000 (08:20 -0400)]
Merge pull request #36422 from orozery/object_dispatch_assert_version_write

librbd: support writing with version assertion on object dispatch

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #36366 from runsisi/wip-fix-free
Jason Dillaman [Fri, 14 Aug 2020 12:20:30 +0000 (08:20 -0400)]
Merge pull request #36366 from runsisi/wip-fix-free

librbd: fix possible use after free error while shuting down exclusive lock

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #36561 from lixiaoy1/fix_queue
Jason Dillaman [Fri, 14 Aug 2020 12:20:10 +0000 (08:20 -0400)]
Merge pull request #36561 from lixiaoy1/fix_queue

rbd/rwl: fix the construction of ContextWQ

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agomgr/dashboard: Update list of supported browsers 36609/head
Tiago Melo [Thu, 13 Aug 2020 13:46:56 +0000 (13:46 +0000)]
mgr/dashboard: Update list of supported browsers

Fixes: https://tracker.ceph.com/issues/46923
Signed-off-by: Tiago Melo <tmelo@suse.com>
4 years agorbd/rwl: fix the config issue 36624/head
lixiaoy1 [Fri, 14 Aug 2020 11:09:57 +0000 (07:09 -0400)]
rbd/rwl: fix the config issue

Include acconfig.h to the librbd/cache/Util.h.

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
4 years agoscript/ceph-backport.sh: Check if jq is installed 36618/head
Tiago Melo [Thu, 13 Aug 2020 15:38:37 +0000 (15:38 +0000)]
script/ceph-backport.sh: Check if jq is installed

If you tried to setup ceph-backport.sh without having 'jq' installed, you would
get a totally unrelated error message and it was hard to figure out the problem.

Signed-off-by: Tiago Melo <tmelo@suse.com>
4 years agoMerge pull request #36604 from tspmelo/wip-favicon-circle
Lenz Grimmer [Fri, 14 Aug 2020 08:22:12 +0000 (10:22 +0200)]
Merge pull request #36604 from tspmelo/wip-favicon-circle

mgr/dashboard: Fix favicon white circle

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #36602 from tspmelo/wip-spell-check
Lenz Grimmer [Fri, 14 Aug 2020 08:19:46 +0000 (10:19 +0200)]
Merge pull request #36602 from tspmelo/wip-spell-check

mgr/dashboard: Fix spell errors

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
4 years agoMerge pull request #36585 from votdev/proper_format_portals
Lenz Grimmer [Fri, 14 Aug 2020 08:16:56 +0000 (10:16 +0200)]
Merge pull request #36585 from votdev/proper_format_portals

mgr/dashboard: Proper format iSCSI target portals

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
4 years agoMerge pull request #36566 from votdev/issue_46900_autocomplete
Lenz Grimmer [Fri, 14 Aug 2020 08:13:30 +0000 (10:13 +0200)]
Merge pull request #36566 from votdev/issue_46900_autocomplete

mgr/dashboard: Strange iSCSI discovery auth behavior

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
4 years agoMerge pull request #36567 from votdev/issue_46901_hide_limit_action_field
Lenz Grimmer [Fri, 14 Aug 2020 08:06:30 +0000 (10:06 +0200)]
Merge pull request #36567 from votdev/issue_46901_hide_limit_action_field

mgr/dashboard: Hide table action input field if limit=0

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
4 years agocommon: document the current semantics of bl::append(std::istream) 36623/head
Robin Lee [Thu, 13 Aug 2020 06:42:52 +0000 (14:42 +0800)]
common: document the current semantics of bl::append(std::istream)

bl::append(std::istream) comes with a surprise implementation. People may think
it would just slurp the indentical binary data from the stream. Document the
trap to let people don't mis-use it.

Signed-off-by: Robin Lee <cheeselee@fedoraproject.org>
4 years agoMerge pull request #36510 from athanatos/sjust/wip-tm-decref
Kefu Chai [Thu, 13 Aug 2020 19:47:55 +0000 (03:47 +0800)]
Merge pull request #36510 from athanatos/sjust/wip-tm-decref

crimson: remove extent from cache in TransactionManager::dec_ref

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/os/seastore/transaction_manager: complete dec_ref 36510/head
Samuel Just [Wed, 5 Aug 2020 02:50:45 +0000 (19:50 -0700)]
crimson/os/seastore/transaction_manager: complete dec_ref

Previously, dec_ref didn't handle actually retiring the
extent from the cache.  dec_ref will now reach into the
cache and mark the extent retired if it exists either
in the cache or in the current transaction.

Signed-off-by: Samuel Just <sjust@redhat.com>
4 years agocrimson/os/seastore/lba_manager: clarify ref count operation return
Samuel Just [Thu, 6 Aug 2020 04:35:48 +0000 (21:35 -0700)]
crimson/os/seastore/lba_manager: clarify ref count operation return

Previously, we returned a refcount from inc_ref and dec_ref.  Now,
return the paddr as well for future code accounting for released
extents.

In addition, replumb btree_lba_manager to return an enoent error if
the mapping does not exist, and the resulting refcount, paddr
otherwise with a refcount of 0 indicating that the mapping has
been removed.

Signed-off-by: Samuel Just <sjust@redhat.com>
4 years agocrimson/os/seastore/cache: don't mark invalid extents clean
Samuel Just [Thu, 6 Aug 2020 00:03:31 +0000 (17:03 -0700)]
crimson/os/seastore/cache: don't mark invalid extents clean

In the event that an extent is created and removed in the same
transaction (invalid extent in fresh_block_list), update
block specific metadata but don't add to cache and especially
do not mark clean.  LBAManager::complete_commit implementations
are meant to use skip based on state in the same way.

Signed-off-by: Samuel Just <sjust@redhat.com>
4 years agocrimson/os/seastore/cached_extent: add print_detail for logical extents
Samuel Just [Thu, 6 Aug 2020 00:00:07 +0000 (17:00 -0700)]
crimson/os/seastore/cached_extent: add print_detail for logical extents

This way we can always see laddr in debug output.

Signed-off-by: Samuel Just <sjust@redhat.com>
4 years agoMerge pull request #36591 from idryomov/wip-snap-create-progress
Ilya Dryomov [Thu, 13 Aug 2020 14:25:06 +0000 (16:25 +0200)]
Merge pull request #36591 from idryomov/wip-snap-create-progress

qa: update krbd tests for snap create

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #36434 from ricardoasmarques/fix-iscsi-logged-in-client-edit
Lenz Grimmer [Thu, 13 Aug 2020 13:58:46 +0000 (15:58 +0200)]
Merge pull request #36434 from ricardoasmarques/fix-iscsi-logged-in-client-edit

mgr/dashboard: Unable to edit iSCSI logged-in client

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #36564 from ceph/46899-log-info-from-unhandled-errors
Lenz Grimmer [Thu, 13 Aug 2020 13:31:38 +0000 (15:31 +0200)]
Merge pull request #36564 from ceph/46899-log-info-from-unhandled-errors

mgr/dashboard: log useful information from internal server errors

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Fabrizio D'Angelo <fdangelo@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
4 years agomgr/dashboard: Fix favicon white circle 36604/head
Tiago Melo [Thu, 13 Aug 2020 11:38:15 +0000 (11:38 +0000)]
mgr/dashboard: Fix favicon white circle

A white circle was displayed when the user logged out.

Fixes: https://tracker.ceph.com/issues/46919
Signed-off-by: Tiago Melo <tmelo@suse.com>
4 years agomgr/dashboard: Fix spell errors 36602/head
Tiago Melo [Mon, 22 Jun 2020 14:59:23 +0000 (14:59 +0000)]
mgr/dashboard: Fix spell errors

Fixes: https://tracker.ceph.com/issues/46917
Signed-off-by: Tiago Melo <tmelo@suse.com>
4 years agomgr/dashboard: Proper format iSCSI target portals 36585/head
Volker Theile [Wed, 12 Aug 2020 10:54:07 +0000 (12:54 +0200)]
mgr/dashboard: Proper format iSCSI target portals

Proper format the 'Portals' and 'Images' columns.

Fixes: https://tracker.ceph.com/issues/46908
Signed-off-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #36532 from simon-rock/crash_on_restart
Yan, Zheng [Thu, 13 Aug 2020 01:55:16 +0000 (09:55 +0800)]
Merge pull request #36532 from simon-rock/crash_on_restart

mds : move start_files_to_recover() to recovery_done

4 years agomds : move start_files_to_recover() to recovery_done 36532/head
Simon Gao [Sun, 9 Aug 2020 07:38:30 +0000 (15:38 +0800)]
mds : move start_files_to_recover()  to recovery_done

the requests in the queue, named waiting_for_replay, may modify the state of the filelock,
resulting in the wrong lock state when repairing file (start_files_to_recover)

Fixes : https://tracker.ceph.com/issues/46906
Signed-off-by: Simon Gao <simon29rock@gmail.com>
4 years agoMerge pull request #36119 from votdev/issue_44831_deploy_service
Lenz Grimmer [Wed, 12 Aug 2020 16:05:25 +0000 (18:05 +0200)]
Merge pull request #36119 from votdev/issue_44831_deploy_service

mgr/dashboard: Create Ceph services via Orchestrator by using ServiceSpec

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
4 years agoqa: update krbd tests for snap create 36591/head
Ilya Dryomov [Tue, 11 Aug 2020 15:45:18 +0000 (17:45 +0200)]
qa: update krbd tests for snap create

"rbd snap create" now reports progress.  Pass --no-progress, as in
commit b5a5fea9e2b4 ("test/cli-integration/rbd: tweak after snap create
started to show progress").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
4 years agoMerge pull request #36569 from yuriw/wip-yuriw-crontab-master
Yuri Weinstein [Wed, 12 Aug 2020 14:43:20 +0000 (07:43 -0700)]
Merge pull request #36569 from yuriw/wip-yuriw-crontab-master

qa/tests: use "-k distro" for all suites (except krbd)

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #36570 from theanalyst/doc/releases/v14.2.11
Abhishek L [Wed, 12 Aug 2020 14:10:57 +0000 (16:10 +0200)]
Merge pull request #36570 from theanalyst/doc/releases/v14.2.11

doc: releases: notes for v14.2.11 nautilus

Reviewed-By: Neha Ojha <nojha@redhat.com>
Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Patrick Donelly <pdonell@redhat.com>
4 years agorbd/rwl: fix the construction of ContextWQ 36561/head
lixiaoy1 [Tue, 11 Aug 2020 16:26:01 +0000 (12:26 -0400)]
rbd/rwl: fix the construction of ContextWQ

Fix the build issue caused by the commit c11594a which changed the constructor
of ContextWQ.

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
4 years agomgr/dashboard: log useful information from internal server errors 36564/head
Alfonso Martínez [Wed, 12 Aug 2020 11:22:27 +0000 (13:22 +0200)]
mgr/dashboard: log useful information from internal server errors

Fixes: https://tracker.ceph.com/issues/46899
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
4 years agorbd/status: get image cache state 36466/head
lixiaoy1 [Fri, 7 Aug 2020 09:11:20 +0000 (05:11 -0400)]
rbd/status: get image cache state

Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
4 years agomgr/dashboard: Strange iSCSI discovery auth behavior 36566/head
Volker Theile [Tue, 11 Aug 2020 12:53:56 +0000 (14:53 +0200)]
mgr/dashboard: Strange iSCSI discovery auth behavior

Disable 'autocomplete' for the user and password form fields.

Fixes: https://tracker.ceph.com/issues/46900
Signed-off-by: Volker Theile <vtheile@suse.com>
4 years agodoc: releases: notes for v14.2.11 nautilus 36570/head
Abhishek Lekshmanan [Tue, 11 Aug 2020 19:02:11 +0000 (21:02 +0200)]
doc: releases: notes for v14.2.11 nautilus

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
4 years agoMerge pull request #36550 from tspmelo/wip-npm-update
Lenz Grimmer [Wed, 12 Aug 2020 07:48:59 +0000 (09:48 +0200)]
Merge pull request #36550 from tspmelo/wip-npm-update

mgr/dashboard: Update npm packages

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #36565 from jan--f/c-v-py3-flake8
Jan Fajerski [Wed, 12 Aug 2020 07:21:17 +0000 (09:21 +0200)]
Merge pull request #36565 from jan--f/c-v-py3-flake8

ceph-volume: run flake8 in python3

4 years agoMerge PR #36351 into master
Patrick Donnelly [Tue, 11 Aug 2020 22:55:52 +0000 (15:55 -0700)]
Merge PR #36351 into master

* refs/pull/36351/head:
qa/tasks/cephfs/nfs: Add tests for cluster config set and reset
doc/cephfs/nfs: Update the doc about 'reset' and 'set' config interfaces
mgr/volumes/nfs: Add interface for adding user defined configuration

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoqa/tests: use "-k distro" for all suites (except krbd) 36569/head
Yuri Weinstein [Tue, 11 Aug 2020 17:53:00 +0000 (10:53 -0700)]
qa/tests: use "-k distro" for all suites (except krbd)

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
4 years agoMerge pull request #36437 from yuriw/wip-yuriw-crontab-master
Yuri Weinstein [Tue, 11 Aug 2020 17:43:31 +0000 (10:43 -0700)]
Merge pull request #36437 from yuriw/wip-yuriw-crontab-master

qa/tests: changes related to #36435 and #36436

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #36111 from vosdev/patch-2
Lenz Grimmer [Tue, 11 Aug 2020 16:09:24 +0000 (18:09 +0200)]
Merge pull request #36111 from vosdev/patch-2

doc/mgr/dashboard: Fix haproxy example to use ssl for backends

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
4 years agomgr/dashboard: Hide table action input field if limit=0 36567/head
Volker Theile [Tue, 11 Aug 2020 13:26:24 +0000 (15:26 +0200)]
mgr/dashboard: Hide table action input field if limit=0

Fixes: https://tracker.ceph.com/issues/46901
Signed-off-by: Volker Theile <vtheile@suse.com>
4 years agoMerge pull request #36456 from sebastian-philipp/orch-type-py3
Sebastian Wagner [Tue, 11 Aug 2020 12:52:01 +0000 (14:52 +0200)]
Merge pull request #36456 from sebastian-philipp/orch-type-py3

mgr/orch: _interface.py cleanup: PEP8 and type annotations

Reviewed-by: Joshua Schmid <jschmid@suse.de>
4 years agoceph-volume: run flake8 in pyhton3 36565/head
Jan Fajerski [Tue, 11 Aug 2020 12:08:33 +0000 (14:08 +0200)]
ceph-volume: run flake8 in pyhton3

Fixes: https://tracker.ceph.com/issues/46897
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
4 years agoMerge pull request #36431 from rishabh-d-dave/cv-add-tests-for-new-lvm-functions
Jan Fajerski [Tue, 11 Aug 2020 11:00:27 +0000 (13:00 +0200)]
Merge pull request #36431 from rishabh-d-dave/cv-add-tests-for-new-lvm-functions

ceph-volume: add tests for new functions that run LVM commands

4 years agoMerge pull request #35937 from rishabh-d-dave/cv-rm-container-classes
Jan Fajerski [Tue, 11 Aug 2020 09:51:15 +0000 (11:51 +0200)]
Merge pull request #35937 from rishabh-d-dave/cv-rm-container-classes

ceph-volume: remove container classes from api/lvm.py

4 years agoMerge pull request #36425 from majianpeng/rocksdb-remove-redundant-perfcount
Kefu Chai [Tue, 11 Aug 2020 02:50:04 +0000 (10:50 +0800)]
Merge pull request #36425 from majianpeng/rocksdb-remove-redundant-perfcount

kv/RocksdbStore: remove perfcounter l_rocksdb_txns/l_rocksdb_txns_sync

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
4 years agoMerge pull request #36528 from dmick/wip-ctags
Kefu Chai [Tue, 11 Aug 2020 02:14:40 +0000 (10:14 +0800)]
Merge pull request #36528 from dmick/wip-ctags

cmake: don't include tags for Python imports, .tox, build/ dirs

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36538 from zdover23/wip-docs-45678-fix
Sebastian Wagner [Mon, 10 Aug 2020 23:15:54 +0000 (01:15 +0200)]
Merge pull request #36538 from zdover23/wip-docs-45678-fix

doc/cephadm: Remove shell alias

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agocmake: don't include tags for Python imports, .tox, build/ dirs 36528/head
Dan Mick [Thu, 6 Aug 2020 02:05:10 +0000 (02:05 +0000)]
cmake: don't include tags for Python imports, .tox, build/ dirs

For things like cephadm, where there is a lot of "from X import Y",
the import tags become cumbersome.  .tox dirs and
python-common/build are just repeats of source files found elsewhere
so result in duplicate tags

Signed-off-by: Dan Mick <dmick@redhat.com>
4 years agomgr/dashboard: Update npm packages 36550/head
Tiago Melo [Mon, 10 Aug 2020 21:36:46 +0000 (21:36 +0000)]
mgr/dashboard: Update npm packages

Fixes: https://tracker.ceph.com/issues/46888
Signed-off-by: Tiago Melo <tmelo@suse.com>
4 years agoMerge PR #36221 into master
Patrick Donnelly [Mon, 10 Aug 2020 20:40:36 +0000 (13:40 -0700)]
Merge PR #36221 into master

* refs/pull/36221/head:
client: switch lock_guard to scoped_lock
client: remove useless unsafe_sync_write
client: make the root member under the client_lock
client: add mount/initialize states support and convert to RWRef
client: add RWRef support

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #36487 into master
Patrick Donnelly [Mon, 10 Aug 2020 19:55:56 +0000 (12:55 -0700)]
Merge PR #36487 into master

* refs/pull/36487/head:
mds: avoid calling g_conf().get_val() in MDSRank::heartbeat_reset()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #36522 from kalebskeithley/rgw_rados_h
kalebskeithley [Mon, 10 Aug 2020 19:52:05 +0000 (15:52 -0400)]
Merge pull request #36522 from kalebskeithley/rgw_rados_h

rgw: remove unnecessary #include "rgw_rados.h"

4 years agoMerge PR #32731 into master
Patrick Donnelly [Mon, 10 Aug 2020 19:47:47 +0000 (12:47 -0700)]
Merge PR #32731 into master

* refs/pull/32731/head:
mgr/mds_autoscaler: plugin to configure mds instances

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge PR #35161 into master
Patrick Donnelly [Mon, 10 Aug 2020 19:46:38 +0000 (12:46 -0700)]
Merge PR #35161 into master

* refs/pull/35161/head:
mgr/mgr_module: metadata is fetched async
mgr/status: metadata is fetched async

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36548 from votdev/fix_colors
Yuri Weinstein [Mon, 10 Aug 2020 19:46:05 +0000 (12:46 -0700)]
Merge pull request #36548 from votdev/fix_colors

mgr/dashboard: correct color names which are not defined

Reviewed-by: Tiago Melo <tmelo@suse.com>
4 years agomgr/dashboard: correct color names which are not defined 36548/head
Volker Theile [Mon, 10 Aug 2020 16:25:02 +0000 (18:25 +0200)]
mgr/dashboard: correct color names which are not defined

Fix regression introduced by https://github.com/ceph/ceph/pull/35954.
Rename some color names that have been changed by the mentioned PR.

Signed-off-by: Volker Theile <vtheile@suse.com>
4 years agoMerge PR #36547 into master
Patrick Donnelly [Mon, 10 Aug 2020 16:48:00 +0000 (09:48 -0700)]
Merge PR #36547 into master

* refs/pull/36547/head:
client: add on space before the inode info

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #34869 from linuxbox2/wip-reset-stats2
J. Eric Ivancich [Mon, 10 Aug 2020 15:46:28 +0000 (11:46 -0400)]
Merge pull request #34869 from linuxbox2/wip-reset-stats2

rgw: introduce safe user-reset-stats

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #35316 from cbodley/wip-45771
J. Eric Ivancich [Mon, 10 Aug 2020 15:43:19 +0000 (11:43 -0400)]
Merge pull request #35316 from cbodley/wip-45771

rgw: fix shutdown crash in RGWAsyncReadMDLogEntries

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
4 years agoMerge pull request #35597 from soumyakoduri/http_client_fix
J. Eric Ivancich [Mon, 10 Aug 2020 15:41:24 +0000 (11:41 -0400)]
Merge pull request #35597 from soumyakoduri/http_client_fix

rgw: Empty reqs_change_state queue before unregistered_reqs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #36015 from cbodley/wip-46456
J. Eric Ivancich [Mon, 10 Aug 2020 15:40:28 +0000 (11:40 -0400)]
Merge pull request #36015 from cbodley/wip-46456

cls/rgw: preserve olh entry's name on last unlink

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
4 years agoMerge pull request #36516 from tchaikov/wip-crimson-parse-conffile
Kefu Chai [Mon, 10 Aug 2020 15:37:28 +0000 (23:37 +0800)]
Merge pull request #36516 from tchaikov/wip-crimson-parse-conffile

crimson/common: read conf file in async

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
4 years agoMerge pull request #36069 from mkogan1/wip-fix-endpoint-not-connected-r1
J. Eric Ivancich [Mon, 10 Aug 2020 15:36:58 +0000 (11:36 -0400)]
Merge pull request #36069 from mkogan1/wip-fix-endpoint-not-connected-r1

rgw: improve scheduler log

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
4 years agoMerge pull request #35792 from thmour/theo_rgw_url_test
J. Eric Ivancich [Mon, 10 Aug 2020 15:34:43 +0000 (11:34 -0400)]
Merge pull request #35792 from thmour/theo_rgw_url_test

rgw: fix double slash (//) killing the gateway

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
4 years agoMerge pull request #36082 from winndows/superfluous_break3
J. Eric Ivancich [Mon, 10 Aug 2020 15:32:47 +0000 (11:32 -0400)]
Merge pull request #36082 from winndows/superfluous_break3

rgw: Remove superfluous breaks

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #36084 from winndows/superfluous_break9
J. Eric Ivancich [Mon, 10 Aug 2020 15:32:02 +0000 (11:32 -0400)]
Merge pull request #36084 from winndows/superfluous_break9

rgw: Remove superfluous breaks

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4 years agoMerge pull request #36092 from Huber-ming/dump_RGWLifecycleConfiguration
J. Eric Ivancich [Mon, 10 Aug 2020 15:27:12 +0000 (11:27 -0400)]
Merge pull request #36092 from Huber-ming/dump_RGWLifecycleConfiguration

rgw: dump transitions in RGWLifecycleConfiguration::dump()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #36264 from theanalyst/rgw/bucket-not-impl
J. Eric Ivancich [Mon, 10 Aug 2020 15:07:55 +0000 (11:07 -0400)]
Merge pull request #36264 from theanalyst/rgw/bucket-not-impl

rgw: s3: mark bucket encryption as not implemented

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #36303 from theanalyst/rgw/empty-princ-policy
J. Eric Ivancich [Mon, 10 Aug 2020 15:06:27 +0000 (11:06 -0400)]
Merge pull request #36303 from theanalyst/rgw/empty-princ-policy

rgw: policy: reuse eval_principal to evaluate the policy principal

Reviewed-by: Pritha Srivastava <prsivas@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
4 years agoMerge pull request #35954 from SchoolGuy/dashboard/bootrapify
Lenz Grimmer [Mon, 10 Aug 2020 14:55:20 +0000 (16:55 +0200)]
Merge pull request #35954 from SchoolGuy/dashboard/bootrapify

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
4 years agocrimson/common: read conf file in async 36516/head
Kefu Chai [Fri, 7 Aug 2020 08:54:04 +0000 (16:54 +0800)]
crimson/common: read conf file in async

otherwise seastar's stall detector could complain, if the task takes too
long to complete.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/config: extract md_config_t::parse_buffer()
Kefu Chai [Fri, 7 Aug 2020 08:53:02 +0000 (16:53 +0800)]
common/config: extract md_config_t::parse_buffer()

so we can reuse it in crimson.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocommon/ConfUtils: expose parse_buffer()
Kefu Chai [Fri, 7 Aug 2020 08:49:58 +0000 (16:49 +0800)]
common/ConfUtils: expose parse_buffer()

so it can be used by crimson for reading settings from a conf file.
crimson reads file with async read. since we already have a specialized
ConfigProxy for crimson, it'd be simpler to expose the shared facility
from ConfUtils instead of specializing it in ConfUtils.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/osd: use "ceph" for default cluster_name
Kefu Chai [Fri, 7 Aug 2020 08:28:30 +0000 (16:28 +0800)]
crimson/osd: use "ceph" for default cluster_name

for couple reasons:

* to avoid the pain to guess / update the cluster name when loading
  conf file. in the past, we use "ceph" as a fallback for the cluster
  name, which is in turn used as a meta name when expanding setting
  values containing "$cluster". so to ensure those settings continue
  working, we have to at least set cluster_name a safe value, and
  "ceph" is what we've been using.
* in
  http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-June/018519.html,
  we decided to drop the cluster_name support in deploy tools, and to
  keep this feature in code. so in the long run, we can assume
  new clusters will be all named "ceph".
* it's difficult to properly implement the feature to use "ceph",
  if no --conf option is specified, as, in Ceph, even the path pointing
  to conf file is allowed to contain "$cluster". so, to get it
  right, we need to update cluster name stored in options before
  reading the option files, this forces us to populate the setting
  twice when reading the settings from a conf file. or we could
  specialize the process, but i don't think it worthy of the
  efforts.

so i think we can just use "ceph" for the cluster name in crimson.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agocrimson/common: move ConfigProxy::parse_config_files() into .cc
Kefu Chai [Thu, 6 Aug 2020 08:08:40 +0000 (16:08 +0800)]
crimson/common: move ConfigProxy::parse_config_files() into .cc

prepare for a proper async version, which will be a little bit more
complicated than the existing one, so better off moving it into .cc file.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 years agoclient: add on space before the inode info 36547/head
Xiubo Li [Mon, 10 Aug 2020 13:47:00 +0000 (21:47 +0800)]
client: add on space before the inode info

Signed-off-by: Xiubo Li <xiubli@redhat.com>
4 years agoMerge pull request #36150 from rhcs-dashboard/fix-45414-master
Lenz Grimmer [Mon, 10 Aug 2020 13:46:13 +0000 (15:46 +0200)]
Merge pull request #36150 from rhcs-dashboard/fix-45414-master

mgr/dashboard: Improve notification badge

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>