Ernesto Puerta [Fri, 6 Aug 2021 17:32:24 +0000 (19:32 +0200)]
.github: include Dashboard/Orch in checklist
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
J. Eric Ivancich [Wed, 4 Aug 2021 14:15:28 +0000 (10:15 -0400)]
Merge pull request #41897 from ivancich/wip-versioned-deletes
rgw: when deleted obj removed in versioned bucket, extra del-marker added
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Sebastian Wagner [Wed, 4 Aug 2021 12:49:41 +0000 (14:49 +0200)]
Merge pull request #42395 from sebastian-philipp/cephadm-improve-no-enigne-msg
cephadm: Clarify no container engine message
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Casey Bodley [Wed, 4 Aug 2021 12:31:40 +0000 (08:31 -0400)]
Merge pull request #42587 from liewegas/rgw-mon-secure
rgw: default ms_mon_client_mode = secure
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Ernesto Puerta [Wed, 4 Aug 2021 11:55:48 +0000 (13:55 +0200)]
Merge pull request #42610 from rhcs-dashboard/52022-fix-rgw-perf-counters
mgr/dashboard: show perf. counters for rgw svc. on Cluster > Hosts
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Ernesto Puerta [Wed, 4 Aug 2021 11:37:33 +0000 (13:37 +0200)]
Merge pull request #42554 from rhcs-dashboard/fix-rgw-ssl-cert-validation
mgr/dashboard: fix ssl cert validation for rgw service creation
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Kefu Chai [Wed, 4 Aug 2021 10:37:45 +0000 (18:37 +0800)]
Merge pull request #42575 from tchaikov/wip-venv
*: s/virtualenv/python -m venv/
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Kefu Chai [Wed, 4 Aug 2021 10:35:38 +0000 (18:35 +0800)]
Merge pull request #42594 from sebastian-philipp/mypy-ini-disallow-untyped-root
mypy.ini: Globally enable `disallow_untyped_defs = True`
Reviewed-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 4 Aug 2021 10:31:40 +0000 (18:31 +0800)]
Merge pull request #42571 from tchaikov/wip-disable-kvs
cmake: disable kvs rados cls by default
Reviewed-by: Neha Ojha <nojha@redhat.com>
Kefu Chai [Wed, 4 Aug 2021 09:56:18 +0000 (17:56 +0800)]
Merge pull request #42614 from soumyakoduri/wip-skoduri-sqlite3
cmake: Remove duplicate SQLITE module
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Alfonso Martínez [Wed, 4 Aug 2021 09:11:50 +0000 (11:11 +0200)]
mgr/dashboard: show perf. counters for rgw svc. on Cluster > Hosts
- Use service_map_id to retrieve perf. counters for rgw services.
- Move logic from controller to CephService.
Fixes: https://tracker.ceph.com/issues/52022
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 03:36:37 +0000 (11:36 +0800)]
cmake: disable kvs rados cls by default
libcls_kvs was introduced back in
73d016fdb304ad19bba8aed3f2877b4bdb6ed32e, but we don't have an internal
user so far. to reduce the build time. let's disable the build of it by
default.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Wed, 4 Aug 2021 00:56:37 +0000 (08:56 +0800)]
Merge pull request #42567 from dsavineau/issue_51973
cephadm: set global default container for ingress
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Kefu Chai [Wed, 4 Aug 2021 00:33:38 +0000 (08:33 +0800)]
Merge pull request #42559 from tchaikov/wip-rpm-dwz
rpm: enable dwz
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Avan Thakkar [Thu, 29 Jul 2021 22:53:43 +0000 (04:23 +0530)]
mgr/dashboard: fix ssl cert validation for rgw service creation
Fixes: https://tracker.ceph.com/issues/51965
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Soumya Koduri [Tue, 3 Aug 2021 17:46:06 +0000 (23:16 +0530)]
cmake: Remove duplicate SQLite module
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Ernesto Puerta [Tue, 3 Aug 2021 15:41:51 +0000 (17:41 +0200)]
Merge pull request #42605 from aaryanporwal/visual-tests
mgr/dashboard: Jenkins Applitools plugin: add batchId variable
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Sage Weil [Tue, 3 Aug 2021 14:46:42 +0000 (10:46 -0400)]
Merge PR #42463 into master
* refs/pull/42463/head:
src/pybind/mgr/test_orchestrator: remove nfs pool and namespace
src/vstart: update nfs-ganesha pool name
Reviewed-by: Sage Weil <sage@redhat.com>
Sage Weil [Tue, 3 Aug 2021 14:45:01 +0000 (10:45 -0400)]
Merge PR #42518 into master
* refs/pull/42518/head:
doc/cephadm: update about disabling logging to journald for quincy
doc/cephadm: remove repeated section on disabling logging to stderr
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Sage Weil [Tue, 3 Aug 2021 14:40:53 +0000 (09:40 -0500)]
Merge pull request #42588 from liewegas/doc-foundation-didi
doc/foundation: drop didi
Sebastian Wagner [Mon, 19 Jul 2021 08:23:52 +0000 (10:23 +0200)]
cephadm: Clarify no container engine message
Multiple people didn't understand the message. Let's try to impove it.
(Also make mypy happy)
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
Alfonso Martínez [Tue, 3 Aug 2021 13:20:54 +0000 (15:20 +0200)]
mgr/dashboard: Cluster > Hosts > Performance Counters: do not show context bar.
Do not show the context bar (Object Gateway selection).
Fixes: https://tracker.ceph.com/issues/52022
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Sebastian Wagner [Tue, 3 Aug 2021 12:38:32 +0000 (14:38 +0200)]
cephadm: Add missing type annotations
Turnd out `command_maintenance` missing an if-branch that returned
None instead of a str
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
Varsha Rao [Tue, 3 Aug 2021 11:51:45 +0000 (17:21 +0530)]
doc/cephadm: update about disabling logging to journald for quincy
Signed-off-by: Varsha Rao <varao@redhat.com>
Aaryan Porwal [Tue, 3 Aug 2021 11:54:43 +0000 (17:24 +0530)]
mgr/dashboard: Jenkins Applitools plugin: add batchId variable
batchId variable is mandatory for the applitools test runner to show up in jenkins build reports, for more details, check out: https://plugins.jenkins.io/applitools-eyes/
Signed-off-by: Aaryan Porwal <aaryanporwal2233@gmail.com>
Ilya Dryomov [Tue, 3 Aug 2021 11:58:57 +0000 (13:58 +0200)]
Merge pull request #42601 from idryomov/wip-rbd-qemu-iotests-8stream
qa/workunits/rbd: use xenial version of qemu-iotests for centos stream 8
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
zdover23 [Tue, 3 Aug 2021 11:19:22 +0000 (21:19 +1000)]
Merge pull request #42446 from zdover23/wip-doc-cephadm-troubleshooting-logs-2021-07-20
doc/cephadm: linking to log material
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Varsha Rao [Wed, 28 Jul 2021 09:27:41 +0000 (14:57 +0530)]
doc/cephadm: remove repeated section on disabling logging to stderr
Signed-off-by: Varsha Rao <varao@redhat.com>
Ernesto Puerta [Tue, 3 Aug 2021 10:55:45 +0000 (12:55 +0200)]
Merge pull request #42328 from aaryanporwal/visual-tests
mgr/dashboard: Visual regression tests for ceph dashboard
Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Yingxin [Tue, 3 Aug 2021 08:55:04 +0000 (16:55 +0800)]
Merge pull request #42514 from liu-chunmei/seastore-onode-interruptible-future
crimson/onode-staged-tree: integrate interruptible future
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Ilya Dryomov [Tue, 3 Aug 2021 07:44:18 +0000 (09:44 +0200)]
qa/workunits/rbd: use xenial version of qemu-iotests for centos stream 8
It is already used for centos 8(.3) and rhel 8(.4).
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
Yingxin Cheng [Tue, 3 Aug 2021 03:52:41 +0000 (11:52 +0800)]
crimson/onode-staged-tree: misc fixes to integrate interruptive-future
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Zac Dover [Tue, 20 Jul 2021 00:08:47 +0000 (10:08 +1000)]
doc/cephadm: linking to log material
This PR rewrites a section in the Troubleshooting
chapter of the Cephadm Guide. The material that this
section discusses has been covered already in the
Cephadm Guide in the Cephadm Operations chapter.
There's no reason to repeat this information twice,
unless adding technical debt to the documentation
is our goal (which of course it is not, and the
opposite of adding technical debt to the documentation
has been the aim that has guided my work these past
six months).
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Ilya Dryomov [Mon, 2 Aug 2021 20:04:04 +0000 (22:04 +0200)]
Merge pull request #42471 from Dorthu/fix-pybind-rbd-mirror-image-get-status
pybind/rbd: fix mirror_image_get_status
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Ilya Dryomov [Mon, 2 Aug 2021 19:35:16 +0000 (21:35 +0200)]
Merge pull request #42570 from tchaikov/wip-libcryptsetup
librbd/crypto/luks: require libcryptsetup v2.0.5
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Sebastian Wagner [Mon, 2 Aug 2021 17:58:21 +0000 (19:58 +0200)]
pybind/mgr: enable `disallow_untyped_defs` for mgr_module
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
Sebastian Wagner [Mon, 2 Aug 2021 17:04:07 +0000 (19:04 +0200)]
mypy.ini: Globally enable `disallow_untyped_defs = True`
Plus introduce an ignorelist of all modules that are not compatible yet.
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
Sage Weil [Mon, 2 Aug 2021 15:31:32 +0000 (10:31 -0500)]
rgw: default ms_mon_client_mode = secure
Require a secure connection to the monitor. This is important because
we may store SSL certs on the mon.
Note that secure mode was introduce before Nautilus, so this can be
backported at least to Pacific.
Fixes: https://tracker.ceph.com/issues/52000
Signed-off-by: Sage Weil <sage@newdream.net>
Sebastian Wagner [Mon, 2 Aug 2021 16:00:48 +0000 (18:00 +0200)]
Merge pull request #42551 from adk3798/maint-message
mgr/cephadm: make return message for entering maintenance mode more explicit
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Sage Weil [Mon, 2 Aug 2021 15:45:32 +0000 (10:45 -0500)]
doc/foundation: drop didi
Signed-off-by: Sage Weil <sage@newdream.net>
Harish Munjulur [Mon, 2 Aug 2021 15:28:02 +0000 (08:28 -0700)]
Merge pull request #42382 from xrmeng8756/master
rgw: avoid occuring radosgw daemon crash when access a conditionally …
Harish Munjulur [Mon, 2 Aug 2021 15:27:53 +0000 (08:27 -0700)]
Merge pull request #42387 from wzbxqt327/master
rgw:add lock to copy object
Harish Munjulur [Mon, 2 Aug 2021 15:27:37 +0000 (08:27 -0700)]
Merge pull request #42404 from ivancich/wip-broken-list-plain-entries
rgw: bucket index list can produce I/O errors
Kefu Chai [Mon, 2 Aug 2021 13:40:48 +0000 (21:40 +0800)]
Merge pull request #42582 from tchaikov/wip-doc-health-report
doc/dev: add health-reports.rst
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Mon, 2 Aug 2021 12:15:04 +0000 (20:15 +0800)]
Merge pull request #42577 from tchaikov/wip-rtd
.readthedocs.yml: use python3.8 and native ditaa
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Kefu Chai [Mon, 2 Aug 2021 10:59:30 +0000 (18:59 +0800)]
doc/dev: add health-reports.rst
to explain the data flow of health metrics.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Ernesto Puerta [Mon, 2 Aug 2021 11:09:32 +0000 (13:09 +0200)]
Merge pull request #42263 from rhcs-dashboard/51612-cephadm-e2e-improvements
mgr/dashboard: cephadm-e2e job script: improvements
Kefu Chai [Mon, 2 Aug 2021 11:04:23 +0000 (19:04 +0800)]
Merge pull request #42562 from tchaikov/wip-bluestore-cleanups
os/bluestore: use scope_guard do to cleanups
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Ernesto Puerta [Mon, 2 Aug 2021 11:03:46 +0000 (13:03 +0200)]
Merge pull request #41880 from david-caro/fix_cluster_grafana_dashboard
monitoring/grafana/cluster: use per-unit max and limit values
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
Kefu Chai [Mon, 2 Aug 2021 11:00:35 +0000 (19:00 +0800)]
admin, doc: introduce sphinxcontrib.seqdiag
for rendering sequence-diagram. unlike ditaa, seqdiag allows us to
create sequence-diagram without worrying about the layout. and the
syntax is quite like that of dot.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Mon, 2 Aug 2021 03:09:47 +0000 (11:09 +0800)]
Merge pull request #42572 from tchaikov/wip-cmake-mgr-cleanup
cmake: initialize dpdk_LIBRARIES with empty list
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Kefu Chai [Sun, 1 Aug 2021 17:41:47 +0000 (01:41 +0800)]
doc/conf.py: run ditaa with java
just in case, otherwise we could have
File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/42577/lib/python3.8/site-packages/sphinxcontrib/ditaa.py", line 200, in html_visit_ditaa
render_ditaa_html(self, node, node['code'], node['options'])
File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/42577/lib/python3.8/site-packages/sphinxcontrib/ditaa.py", line 177, in render_ditaa_html
fname, outfn = render_ditaa(self, code, options, prefix)
File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/42577/lib/python3.8/site-packages/sphinxcontrib/ditaa.py", line 141, in render_ditaa
p = Popen(ditaa_args, stdout=PIPE, stdin=PIPE, stderr=PIPE)
File "/home/docs/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 854, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/home/docs/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 1702, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
OSError: [Errno 8] Exec format error: '/usr/bin/ditaa'
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sun, 1 Aug 2021 16:37:19 +0000 (00:37 +0800)]
.readthedocs.yml: use ditaa instead of plantweb
use ditaa to reader ditaa images instead of relying plantweb service.
more stable this way.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sun, 1 Aug 2021 16:34:08 +0000 (00:34 +0800)]
.readthedocs.yml: use python3.8
to prepare the python3.8 migration
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sun, 1 Aug 2021 04:24:07 +0000 (12:24 +0800)]
Merge pull request #42129 from tchaikov/wip-cmake-build-type
cmake: set CMAKE_BUILD_TYPE only if .git exists
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Kefu Chai [Sun, 1 Aug 2021 01:58:56 +0000 (09:58 +0800)]
Merge pull request #42573 from tchaikov/wip-crimson-header
cmake: let crimson-admin depend on legacy-option-headers
Reviewed-by: Samuel Just <sjust@redhat.com>
Kefu Chai [Sun, 1 Aug 2021 01:58:15 +0000 (09:58 +0800)]
Merge pull request #42445 from LiumxNL/ups-eliminate-rollfwd
osd/PGLog: set acceptable rollback_info_trimmed_to for pg of replicated pool
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Patrick Donnelly [Sat, 31 Jul 2021 20:34:56 +0000 (13:34 -0700)]
Merge PR #40511 into master
* refs/pull/40511/head:
qa: update mds_pre_upgrade to no longer stop standbys
qa: update mds_pre_upgrade to disable standby-replay
qa: add tests for compat manipulation and upgrade
doc: remove deprecated compat commands
doc: update MDS upgrade procedure
mon,mds: use per-MDS compat to inform replacement
mon: do not update inline incompat except via mds
mds: add MDSMap method for creating null MDSMap
mds: only update beacon epoch if newer
mds: harden standby_mds lookup
mon/FSCommands: accept generic ostream rather than stringstream
include: add less verbose CompatSet dump
include: add dump operator for Feature
include: add const qualifier to appropriate CompatSet methods
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 13:15:48 +0000 (21:15 +0800)]
rpm, debian: drop virtualenv from build deps
since we've replaced "virtualenv" with "python3 -m venv", there is no
need to have it in the build deps list.
since, on ubuntu, venv modules is not available by default, we need to
install python3-venv.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 13:13:50 +0000 (21:13 +0800)]
script/ceph-release-notes: s/virtualenv/python3 -m venv/
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 13:11:23 +0000 (21:11 +0800)]
test/rgw/bucket_notification: s/virtualenv/python3 -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 13:06:23 +0000 (21:06 +0800)]
qa/tasks: s/virtualenv/python3 -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:59:33 +0000 (20:59 +0800)]
admin/build-doc: s/virtualenv/python3 -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:57:38 +0000 (20:57 +0800)]
doc/man/8/cephfs-shell: s/virtualenv/python3 -m venv/
so user does not have to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:55:55 +0000 (20:55 +0800)]
install-deps.sh: s/virtualenv/python -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:53:56 +0000 (20:53 +0800)]
pybind/mgr/dashboard: s/virtualenv/python -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:51:57 +0000 (20:51 +0800)]
test/run-cli-tests: s/virtualenv/python -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:47:28 +0000 (20:47 +0800)]
tools/setup-virtualenv: s/virtualenv/python -m venv/
so we don't need to use virtualenv python package for creating a
virtualenv, the "venv" module in Python3 would suffice.
see also https://docs.python.org/3/library/venv.html
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 12:44:57 +0000 (20:44 +0800)]
script/run_tox.sh: drop support of python2
since we don't support python2 anymore, there is not need to mention or
support python2 when performing tests
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 09:01:38 +0000 (17:01 +0800)]
cmake: let crimson-admin depend on legacy-option-headers
legacy-option-headers provides global_legacy_options.h, which is in turn
required for building crimson-admin.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 08:35:37 +0000 (16:35 +0800)]
Merge pull request #42400 from adk3798/offline-daemon-removal
mgr/cephadm: don't remove daemons from offline hosts
Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 08:08:44 +0000 (16:08 +0800)]
cmake: prefer static library when finding DPDK
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 07:49:20 +0000 (15:49 +0800)]
cmake: initialize dpdk_LIBRARIES with empty list
set(dpdk_LIBRARIES) does not reset this variable, it leaves it
unchanged.
if pkg-config manages to find DPDK libraries, dpdk_LIBRARIES would be
set with a string like "rte_node;rte_graph;..." by
pkg_check_modules(dpdk QUIET libdpdk).
but we would want to set this variable to the import paths of the
required libraries. so reset it before appending them to this variable.
this change helps to address the build failure when building Ceph with
DPDK installed into system along with its .pc file.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 04:13:40 +0000 (12:13 +0800)]
mgr/ServiceMap: do not include unused headers
<experimental/iterator> was included for std::experimental::make_ostream_joiner
in
a968f65d784b3d6c6a172929aa293f09e6917fa6. but the code using
std::experimental::make_ostream_joiner was later rewritten in
ab0d8f2ae9f551e15a4c7bacbf69161e91263785, in which
std::experimental::make_ostream_joiner is not used anymore.
so let's drop it.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 05:10:06 +0000 (13:10 +0800)]
Merge pull request #42553 from cfsnyder/wip_51961
mgr/cephadm: fix exceptions causing stuck progress indicators
Reviewed-by: Adam King <adking@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 05:08:01 +0000 (13:08 +0800)]
Merge pull request #42506 from p-se/mgr-prom-counter-type
mgr/prometheus: Fix metric types from gauge to counter
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Kefu Chai [Sat, 31 Jul 2021 03:19:26 +0000 (11:19 +0800)]
librbd/crypto/luks: require libcryptsetup v2.0.5
- ubuntu focal ships libcryptsetup-dev (2:2.2.2),
- centos 8 app stream comes with cryptsetup-devel-2.3.3.
- openSUSE Leap 15.3 packages libcryptsetup-devel-2.3.4
- openSUSE Leap 15.2 packages libcryptsetup-devel-2.0.5
so we can drop the support for libcryptsetup < 2.0.5
see also
ea3c1bfb9ef2edcdf572df0cb143c463b7551905
Signed-off-by: Kefu Chai <kchai@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:55:54 +0000 (14:55 -0700)]
qa: update mds_pre_upgrade to no longer stop standbys
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:53:04 +0000 (14:53 -0700)]
qa: update mds_pre_upgrade to disable standby-replay
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:06:28 +0000 (14:06 -0700)]
qa: add tests for compat manipulation and upgrade
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Wed, 31 Mar 2021 13:45:08 +0000 (06:45 -0700)]
doc: remove deprecated compat commands
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:46:45 +0000 (14:46 -0700)]
doc: update MDS upgrade procedure
Now that CompatSet changes to the FSMap no longer cause old MDS to
suicide.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:26:08 +0000 (14:26 -0700)]
mon,mds: use per-MDS compat to inform replacement
This diff makes the following changes:
- FSMap::compat is now just a "default compat" of currently unknown
utility. It is used when constructing a new file system but does
not really have any effect or current use.
- The `mds compat *` CLI commands are deprecated. They manipulate
the default compat which has no useful effect.
- Each MDS sends its compat to the mons in its beacon. This is from
MDSMap::get_compat_set_all() at MDS boot. This CompatSet does not
change for the duration of the MDS lifetime.
- Mons record each MDS compat in the FSMap to inform standby failover.
An MDS is only promoted if it is compatible with the file system
compat.
- Mons upgrade (merge) the file system compat when (a) the number of
*in* MDS is 1 (effected by max_mds=1) and (b) the mons are promoting a
standby with a new compat. A file system is never upgraded when there
is more than 1 rank to prevent two MDS with incompatible compat.
- A suite of `fs compat` commands exist to manipulate the file system
compat. These exist mostly for testing.
The consequence of these changes is that the upgrade procedure for MDS
can be updated to no longer require turning off all MDS but rank 0
before performing any upgrades. A CompatSet change would cause all MDS
receiving the new MDSMap to suicide due to incompatibility (if so).
Instead, the monitors will no longer assign an incompatible MDS to a
file system and enforce an upgrade procedure if incompatibilities exist.
Fixes: https://tracker.ceph.com/issues/49720
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:07:46 +0000 (14:07 -0700)]
mon: do not update inline incompat except via mds
The MDS_FEATURE_INCOMPAT_INLINE feature indicates that an MDS knows how
to read/write inline data and that the file system may have it. The
separate setting for inline_data protects this file system feature.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Wed, 17 Mar 2021 16:55:04 +0000 (09:55 -0700)]
mds: add MDSMap method for creating null MDSMap
It's not necessary to distribute a CompatSet with the null mdsmap. We
only need to communicate that the MDS is not part of any map.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 6 Apr 2021 15:20:54 +0000 (08:20 -0700)]
mds: only update beacon epoch if newer
This is a defensive programming change. We don't want the beacon epoch
to ever go backwards.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:13:42 +0000 (14:13 -0700)]
mds: harden standby_mds lookup
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 19:40:58 +0000 (12:40 -0700)]
mon/FSCommands: accept generic ostream rather than stringstream
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 5 Apr 2021 14:55:20 +0000 (07:55 -0700)]
include: add less verbose CompatSet dump
For printing in `fs dump`.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 21:10:28 +0000 (14:10 -0700)]
include: add dump operator for Feature
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Tue, 30 Mar 2021 19:39:36 +0000 (12:39 -0700)]
include: add const qualifier to appropriate CompatSet methods
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Fri, 30 Jul 2021 21:03:36 +0000 (14:03 -0700)]
Merge PR #42513 into master
* refs/pull/42513/head:
qa: multifs already enabled as default
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Fri, 30 Jul 2021 21:02:33 +0000 (14:02 -0700)]
Merge PR #42499 into master
* refs/pull/42499/head:
client:make sure only to update dir dist from auth mds
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Fri, 30 Jul 2021 21:00:19 +0000 (14:00 -0700)]
Merge PR #42201 into master
* refs/pull/42201/head:
qa: fold frag confs into conf/mds.yaml
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Neha Ojha [Fri, 30 Jul 2021 20:14:03 +0000 (13:14 -0700)]
Merge pull request #42133 from sseshasa/wip-persist-osd-iops-cap-mclock
osd: Add mechanism to avoid running OSD bench on every OSD init when mclock_scheduler is enabled
Reviewed-by: Neha Ojha <nojha@redhat.com>
Dimitri Savineau [Fri, 30 Jul 2021 19:27:52 +0000 (15:27 -0400)]
cephadm: set global default container for ingress
This was partially done in
b94c8de but only for haproxy in the cephadm
mgr module not in the cephadm binary.
This adds the same change for keepalived container image.
Now both haproxy and keepalived container images are fully qualified
(registry + namespace + image).
Fixes: https://tracker.ceph.com/issues/51973
Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
Daniel Gryniewicz [Fri, 30 Jul 2021 19:12:21 +0000 (15:12 -0400)]
Merge pull request #42550 from dang/wip-dang-zipper-writer
Zipper Writer API
Reviewed-by: cbodley@redhat.com
Daniel Gryniewicz [Fri, 30 Jul 2021 18:00:30 +0000 (14:00 -0400)]
Merge pull request #31454 from soumyakoduri/dbstore
rgw/Zipper: DB Backend store
Reviewed-by: dang@redhat.com
Reviewed-by: amaredia@redhat.com
Daniel Gryniewicz [Wed, 21 Jul 2021 14:56:59 +0000 (10:56 -0400)]
RGW - Zipper - Proper Writer API
With the implementation of DBStore, it was determined that the API used
for writing in Zipper was too tied to RADOS. Implement a clean writing
API named Writer.
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
Daniel Gryniewicz [Fri, 30 Jul 2021 14:06:56 +0000 (10:06 -0400)]
Merge pull request #42266 from dang/wip-dang-zipper-raw_obj
Wip dang zipper raw obj
Reviewed-by: Soumya Koduri <skoduri@redhat.com>