]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agomgr/cephadm: update caps if necessary when getting keyring
Adam King [Wed, 24 Feb 2021 21:13:01 +0000 (16:13 -0500)]
mgr/cephadm: update caps if necessary when getting keyring

If the caps change from the old version to the new one it causes
issues in the upgrade. This allows the caps to be updated. Currently
only seeing this with iscsi but changing it for other as a precaution

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 7c0d532f3a4839f4199a13773fb5fa8b6fb3f183)

4 years agomgr/cephadm: add cephfs-mirror to CEPH_UPGRADE_ORDER
Sebastian Wagner [Fri, 26 Feb 2021 12:34:52 +0000 (13:34 +0100)]
mgr/cephadm: add cephfs-mirror to CEPH_UPGRADE_ORDER

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit f885072ffa14dcbf74e42ec364867e36aacdd926)

4 years agocephadm: Add cephfs-mirror
Sebastian Wagner [Tue, 23 Feb 2021 15:06:56 +0000 (16:06 +0100)]
cephadm: Add cephfs-mirror

Fixes: https://tracker.ceph.com/issues/47261
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 8fa941b35d89db6a40f7d2912b69eadf40c5004c)

4 years agoqa/cephadm: Add cephfs-mirror test
Sebastian Wagner [Tue, 23 Feb 2021 15:05:47 +0000 (16:05 +0100)]
qa/cephadm: Add cephfs-mirror test

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit d4bf7157a13970e417e79469e9db0559d612ebbb)

4 years agoqa/tasks: some type annotations
Sebastian Wagner [Tue, 23 Feb 2021 15:05:22 +0000 (16:05 +0100)]
qa/tasks: some type annotations

Mostly for making my IDE aware of things

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 340281fe76dc1d9170815f68a0553c50fb0b157f)

4 years agomgr/orch: Add cephfs-mirror to enum
Sebastian Wagner [Tue, 23 Feb 2021 14:48:29 +0000 (15:48 +0100)]
mgr/orch: Add cephfs-mirror to enum

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit d9d8d717335227a83812acbf33e8fa8bb3383de0)

4 years agomgr/cephadm: Add CephfsMirrorService
Sebastian Wagner [Tue, 23 Feb 2021 13:45:02 +0000 (14:45 +0100)]
mgr/cephadm: Add CephfsMirrorService

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit f2f9f51d742c582c08fb590cdaa4d959ee9fb7f5)

4 years agomgr/orch: replace def add_{type}(...) with generic add_daemon()
Sebastian Wagner [Tue, 23 Feb 2021 14:42:01 +0000 (15:42 +0100)]
mgr/orch: replace def add_{type}(...) with generic add_daemon()

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 175ee8390985ae12b1b67d602338a4d1b1c81b52)

4 years agomgr/cephadm: drop `create_func` arg from _add_daemon
Sebastian Wagner [Tue, 23 Feb 2021 13:42:38 +0000 (14:42 +0100)]
mgr/cephadm: drop `create_func` arg from _add_daemon

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 2465f986680cc489bc82ec2a6f5652b24cdf171b)

4 years agomgr/cephadm: move CephadmExporter to new module
Sebastian Wagner [Tue, 23 Feb 2021 12:50:12 +0000 (13:50 +0100)]
mgr/cephadm: move CephadmExporter to new module

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 935a15fd06421786096a37c4bae6571bf6467aec)

4 years agomgr/cephadm: fix CephadmExporter deployment
Sebastian Wagner [Tue, 16 Feb 2021 12:17:13 +0000 (13:17 +0100)]
mgr/cephadm: fix CephadmExporter deployment

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit c40436e70089322619ed00621354ae46a29ec9d1)

4 years agocephadm: exporter: use os.path.realpath(__file__)
Sebastian Wagner [Fri, 26 Feb 2021 10:20:35 +0000 (11:20 +0100)]
cephadm: exporter: use os.path.realpath(__file__)

Because we now always have a script on the remote hosts.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 470d79bee5101e7d4c11378450591f55e6ede4cc)

4 years agomgr/cephadm: root mode: call (and deploy) cephadm binary
Sebastian Wagner [Mon, 22 Feb 2021 15:30:42 +0000 (16:30 +0100)]
mgr/cephadm: root mode: call (and deploy) cephadm binary

Avoid copying cephadm all the time.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit e7a8fac550aed5da9dbf4ef633602d3634c20da6)

4 years agocephadm: Get rid of injected_argv
Sebastian Wagner [Mon, 22 Feb 2021 14:12:39 +0000 (15:12 +0100)]
cephadm: Get rid of injected_argv

Removed the injected_argv parameter and the injection of code in the cephadm
script we send to hosts.
Now the script is copied and after that we execute the cephadm command.
I would like to copy it only one time (when adding new hosts) but this will be
part of a future PR, together with other prs to:

- Introduce cephadm version
- Get rid of packaged/root mode
- Use pex or eggs

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 2142dcfc2bac3159b7a24f92ae75df2a14599377)

4 years agocephadm: Make path to cephadm binary unique
Sebastian Wagner [Fri, 26 Feb 2021 10:14:52 +0000 (11:14 +0100)]
cephadm: Make path to cephadm binary unique

right now, an upgrade might overwrite the existing
binary which would force us to have the CLI stable.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 8f05520d03c9fb9d57a0d7ed674d4d9dba8d699c)

4 years agopython-common: continue to allow RGWSpec(realm=r,zone=z)
Sage Weil [Mon, 8 Mar 2021 14:49:14 +0000 (09:49 -0500)]
python-common: continue to allow RGWSpec(realm=r,zone=z)

This is for backward compatibility: an octopus spec yaml can still be
applied to an existing cluster.  Note that it might not work on a new
cluster, since cephadm no longer tries to create the realm or zone if
they don't exist.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit cca7391f54b724730ea091669627731bc74f3519)

4 years agoPendingReleaseNodes: note changes in cephadm rgw behavior
Sage Weil [Mon, 8 Mar 2021 14:47:57 +0000 (09:47 -0500)]
PendingReleaseNodes: note changes in cephadm rgw behavior

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit f4ff70941fa585e14cdc628f913b001c208a3327)

4 years agoqa/tasks/cephadm: drop realm.zone convention for rgw
Sage Weil [Fri, 5 Mar 2021 21:30:20 +0000 (16:30 -0500)]
qa/tasks/cephadm: drop realm.zone convention for rgw

Note that cephadm.py will no longer do anything with rgw realms and
zones.  That means that the setup of rgw roles here is only useful
for the default zone and a non-multisite config.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 1bfb0cd84b86e23896a967214a3fa89941addd27)

4 years agodoc: update docs
Sage Weil [Tue, 9 Mar 2021 19:29:39 +0000 (14:29 -0500)]
doc: update docs

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 50bc4913735e684c7f0b7feda9444b38fc96588a)

4 years agodoc/cephadm: rewrite "adoption process"
Zac Dover [Mon, 8 Mar 2021 22:06:05 +0000 (08:06 +1000)]
doc/cephadm: rewrite "adoption process"

This rewrites the "Adoption Process" section
of the "Converting and Existing Cluster to
cephadm" chapter of the Cephadm guide.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit c01112189377e17966fb342262b2f0e16121c882)

4 years agodoc/cephadm: rewrite "preparation" in adoption.rst
Zac Dover [Mon, 8 Mar 2021 16:23:51 +0000 (02:23 +1000)]
doc/cephadm: rewrite "preparation" in adoption.rst

This rewrites the "Adoption" section of
preparation.rst in the Cephadm manual.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 2a47caff720424c895724b7927139f9fbe3d3fee)

4 years agodoc/cephadm: add prompts to adoption.rst
Zac Dover [Tue, 2 Mar 2021 18:16:27 +0000 (04:16 +1000)]
doc/cephadm: add prompts to adoption.rst

This PR formats the bash prompts. It also formats the
bash output so that it appears in the correct (easily
copy-and-pasteable) format. This PR will be followed by
a grammar-improving PR, but this PR is just a
formatting PR.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 7eb65fe2cfa5fe78f40f7978191848a7a2a49a71)

4 years agodoc/cephadm: rewrite part of adoption.rst
Zac Dover [Fri, 5 Mar 2021 18:37:01 +0000 (04:37 +1000)]
doc/cephadm: rewrite part of adoption.rst

This PR adds a bit of explanatory text to the
section of the cephadm docs that explains how
to convert Ceph deployments that were not deployed
with cephadm to deployments that can be managed by
the cephadm command line tool.

(cherry picked from commit a445653511b07af360bda37175eadf2870e053f7)

4 years agopython-common/ceph/deployment: RGWSpec: accept (and drop) subcluster arg
Sage Weil [Fri, 5 Mar 2021 21:01:00 +0000 (16:01 -0500)]
python-common/ceph/deployment: RGWSpec: accept (and drop) subcluster arg

This is just so we can load up a stored spec after upgrade.  We'll silently
drop it, since we have the service_id, and this was only used to generate
that anyway.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit d35e1d791bedd8d2ed48a456fd1f5bba978f7f37)

4 years agomgr/orchestrator: drop $realm.$zone naming convention
Sage Weil [Mon, 15 Mar 2021 22:05:45 +0000 (17:05 -0500)]
mgr/orchestrator: drop $realm.$zone naming convention

- Let users name the rgw service(s) whatever they like
- Make the rgw_zone and rgw_realm arguments optional, so that they can
  omit them and let radosgw start up in the generic single-cluster
  configuration (whichk, notably, has no realm).
- Continue to set the rgw_realm and rgw_zone options for the daemon(s),
  but only when those values are specified.
- Adjust the CLI accordingly.  Drop the subcluster argument, which was
  only used to generate a service_id.
- Adjust rook. This is actually a simplification and improved mapping onto
  the rook CRD, *except* that for octopus we enforced the realm.zone
  naming *and* realm==zone.  I doubt a single user actually did this
  so it is not be worth dealing with, but we need a special case for
  where there is a . in the service name.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit af0216d93fb522d239b10b5d7d18208ee02fed77)

# Conflicts:
# src/pybind/mgr/rook/rook_cluster.py
  - pacific branch does not have type annotation on apply_objectstore()

4 years agomgr/cephadm: rgw: do not mess with realm configuration
Sage Weil [Fri, 5 Mar 2021 18:13:56 +0000 (13:13 -0500)]
mgr/cephadm: rgw: do not mess with realm configuration

It is simpler to consider this out of scope for the orchestrator.  The
user should set up their multisite realms/zones before deploying the
daemons (or the daemons will not start).  In the future we can wrap this
with a more friendly tool, perhaps.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 4498f7dc204cada316ba0ea73ca9954d23c437d2)

4 years agomgr/cephadm:Document the cephadm config-check feature
Paul Cuzner [Tue, 2 Mar 2021 02:40:46 +0000 (15:40 +1300)]
mgr/cephadm:Document the cephadm config-check feature

This patch updates the docs to describe the config-check feature,
describing how these checks can be enabled and managed.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit e407c6343d419b7003d143c213fdf3f69462cd83)

4 years agomgr/cephadm:fix to resolve mypy issue
Paul Cuzner [Tue, 2 Mar 2021 01:18:37 +0000 (14:18 +1300)]
mgr/cephadm:fix to resolve mypy issue

Build of ceph metadata needed addition type hints.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 14074887db099c7b9b4cf89ccad10f224453696c)

4 years agomgr/cephadm:add unit test for the lookup_check helper
Paul Cuzner [Fri, 19 Feb 2021 02:09:58 +0000 (15:09 +1300)]
mgr/cephadm:add unit test for the lookup_check helper

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit c29e6ac3dc6df27dfb777588690d8b6a21a27a6d)

4 years agomgr/cephadm:Drop active healthcheck during a disable request
Paul Cuzner [Fri, 19 Feb 2021 02:09:02 +0000 (15:09 +1300)]
mgr/cephadm:Drop active healthcheck during a disable request

The healthcheck could already be active when the admin attempts
to disable it. This patch removes the related healthcheck if it's set
during a config-check disable request.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit f3cf41f98955a2c3b8c31374981e5ecbf5d4eda9)

4 years agomgr/cephadm:Added helper function to return a specific healthcheck
Paul Cuzner [Fri, 19 Feb 2021 02:06:45 +0000 (15:06 +1300)]
mgr/cephadm:Added helper function to return a specific healthcheck

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit baa2c9313ade4dcd40e5b42e367ab4c0f8d4b9d9)

4 years agomgr/cephadm:unit test added for nics better than most
Paul Cuzner [Thu, 18 Feb 2021 23:52:24 +0000 (12:52 +1300)]
mgr/cephadm:unit test added for nics better than most

checks that we're not raising a healthcheck for a host if it's
nic speed it better than the rest!

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 0d7ecb18e33b05bb957f4da7c43199086c7d8ab9)

4 years agomgr/cephadm:skip an alert if the linkspeed is better than most
Paul Cuzner [Thu, 18 Feb 2021 23:50:22 +0000 (12:50 +1300)]
mgr/cephadm:skip an alert if the linkspeed is better than most

The logic was issuing a healthcheck if the linkspeed was different
to the majority. But if the difference is good (i.e. better!) we should
not be raising a healthcheck

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 74a3599a83b5b1dde094721f7754d284e8acf8fa)

4 years agomgr/cephadm:fix mypy warning
Paul Cuzner [Thu, 18 Feb 2021 23:41:12 +0000 (12:41 +1300)]
mgr/cephadm:fix mypy warning

Since switching how the roles for a host are determining the
type hint was missed..this patch addresses that

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 83f531239b8d2e148bfae2eba6f1effab359b4b8)

4 years agomgr/cephadm:Remove check from ceph metadata gathering
Paul Cuzner [Thu, 18 Feb 2021 23:37:36 +0000 (12:37 +1300)]
mgr/cephadm:Remove check from ceph metadata gathering

A check for _ceph_get_server was included for unit testing, but
the tests have been updated to make this obsolete.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit b2f0b6f6d29cbe33bfe200e9fa709284677cd6b9)

4 years agomgr/cephadm:Add unit test for hosts without public network NIC
Paul Cuzner [Thu, 18 Feb 2021 23:24:07 +0000 (12:24 +1300)]
mgr/cephadm:Add unit test for hosts without public network NIC

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit d271987a4dc8727f2d90ebcce16bdb3f8c56b6ca)

4 years agomgr/cephadm:Minor updates to address review comments
Paul Cuzner [Thu, 18 Feb 2021 23:23:13 +0000 (12:23 +1300)]
mgr/cephadm:Minor updates to address review comments

Changes to reflect review comments
- picked up on subscribed = unknown state
- using get_daemon_types() call
- use log.exception more
- changed logic and errors from the public_network check

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit c6ba8bca0ed11b8cd243a88c21e5893ba3c0ba17)

4 years agomgr/cephadm:Added CLI interface for the configuration checker
Paul Cuzner [Thu, 18 Feb 2021 03:22:11 +0000 (16:22 +1300)]
mgr/cephadm:Added CLI interface for the configuration checker

Patch to add CLI commands to show and manage the state of the
configuration checker feature

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 0668ffb36d8ba7fa57d7316fc128e7910ba86968)

4 years agomgr/cephadm:Multiple updates related to the addition of the CLI
Paul Cuzner [Thu, 18 Feb 2021 03:17:22 +0000 (16:17 +1300)]
mgr/cephadm:Multiple updates related to the addition of the CLI

Some changes needed to support the introduction of the CLI commands
used to manage the cephadm checks. For example, the main Cephadm
check class now interacts with the keystore directly to determine
status, and provides support for commands like ls to list the
check definitions. In addition the main class now handles existing
configuration checks and ensure that the stored state in the keystore
matches the checks defined by the module

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 64d5365273617af0ae6eff04796b475b2c8238a0)

4 years agomgr/cephadm:Moved 'ownership' of the checker to cephadm
Paul Cuzner [Thu, 18 Feb 2021 03:11:55 +0000 (16:11 +1300)]
mgr/cephadm:Moved 'ownership' of the checker to cephadm

Initial implementation used the Serve class as the owner of the
configuration checker. This patch moves the checker up to the
cephadm module itself, to make the CLI command logic cleaner

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 9ef3bb373362acb4436d3a6d32e290a713edc26a)

4 years agomgr/cephadm:Unit tests updated to account for upgrades
Paul Cuzner [Thu, 18 Feb 2021 03:09:27 +0000 (16:09 +1300)]
mgr/cephadm:Unit tests updated to account for upgrades

Upgrades may change the config checks, so the tests now validate
that new checks and old bogus checks are handled correctly

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit bf02fb98bb7159baa376010fa6daae0a3ebbddb2)

4 years agomgr/cephadm:Updates to CephadmConfigChecks class
Paul Cuzner [Tue, 16 Feb 2021 23:49:41 +0000 (12:49 +1300)]
mgr/cephadm:Updates to CephadmConfigChecks class

Multiple updates to ensure
- mgr health checks are raised correctly
- checks are independent and may be disabled

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 13713b5caaca151f7b45e5ef27eccd028778efd7)

4 years agomgr/cephadm:Adds unit tests for the CephadmConfigChecks class
Paul Cuzner [Tue, 16 Feb 2021 23:45:38 +0000 (12:45 +1300)]
mgr/cephadm:Adds unit tests for the CephadmConfigChecks class

Add unit tests to test suite to verify functionality. The unit tests use
a sample host definition and scale that to simulate a cluster to run
the tests against

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 4b1b136d3e97e39936f3e3bd94e2106dc6e42c73)

4 years agomgr/cephadm:add module option to enable configuration checks
Paul Cuzner [Tue, 16 Feb 2021 23:43:02 +0000 (12:43 +1300)]
mgr/cephadm:add module option to enable configuration checks

Adds config_checks_enabled (bool) option

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit fae0adf4f07d8af0d3cb0b9d0eb4c3da14a2cf78)

4 years agomgr/cephadm:added ceph version consistency check
Paul Cuzner [Thu, 11 Feb 2021 00:03:59 +0000 (13:03 +1300)]
mgr/cephadm:added ceph version consistency check

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit bcd6acf4a6ff137d98dbaa28aff4927c1075979f)

4 years agomgr/cephadm: added config checker to main serve loop
Paul Cuzner [Wed, 10 Feb 2021 22:31:22 +0000 (11:31 +1300)]
mgr/cephadm: added config checker to main serve loop

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 3ea8eaf9b5e0e60edd06da927e3c6f375687dbb1)

4 years agomgr/cephadm: adding check logic
Paul Cuzner [Wed, 10 Feb 2021 22:30:05 +0000 (11:30 +1300)]
mgr/cephadm: adding check logic

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 5a555ba93854bc8cf7cfd7ead23509fa5782374a)

4 years agomgr/cephadm: resolve rebase conflicts
Paul Cuzner [Tue, 9 Feb 2021 19:49:31 +0000 (08:49 +1300)]
mgr/cephadm: resolve rebase conflicts

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 80a9d71d3cd3add8039a52c2ba3efe4388a5185b)

4 years agomgr/cephadm:Document the intergration with libstoragemgmt
Paul Cuzner [Wed, 3 Mar 2021 00:12:05 +0000 (13:12 +1300)]
mgr/cephadm:Document the intergration with libstoragemgmt

Updates the cephadm osd documentation to include details about
including integration with libstoragement - including the potential
hardware issues that may arise.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 3b6f21834128bdb1eb763c5fce351b113963fa66)

4 years agomgr/cephadm:Enable cephadm device scan to use LSM
Paul Cuzner [Mon, 22 Feb 2021 01:35:03 +0000 (14:35 +1300)]
mgr/cephadm:Enable cephadm device scan to use LSM

Using libstoragemgmt (LSM) in ceph-volume was disabled by default,
(nov 2020) which meant cephadm's inventory never had a way to
request the LSM data. This patch adds a module option called
'device_enhanced_scan' (bool), that if set will append the
--with-lsm parameter to the ceph-volume inventory call.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 3105fa254b70f0fb56c86eb110580108dcd03509)

4 years agomgr/cephadm: prevent traceback when invalid osd id passed to 'orch osd rm stop'
Daniel Pivonka [Mon, 8 Mar 2021 19:04:29 +0000 (14:04 -0500)]
mgr/cephadm: prevent traceback when invalid osd id passed to 'orch osd rm stop'

orch osd rm exepcts a str that can be converted to an int passed to it
if the user passed something that cant be converted it shows a traceback
catching the ValueError prevents this traceback.

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
(cherry picked from commit 6e8adcfee6ef8996badac3167007b6c76e33a2e4)

4 years agomgr/cephadm: do not prime service cache on reconfig
Sage Weil [Tue, 9 Mar 2021 18:15:20 +0000 (12:15 -0600)]
mgr/cephadm: do not prime service cache on reconfig

Ceph daemon reconfig does not need any daemon state refresh since we don't
do a restart--we just rewrite the ceph.conf.  This also avoids priming
our cache with a 'starting' state when the daemon wasn't touched.

Fixes: https://tracker.ceph.com/issues/49675
Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 248cb6a76ff52a4e5b5758b97a0d6cd812d9f9f5)

4 years agomgr/cephadm/osd: PEP-8 fix
Sebastian Wagner [Tue, 2 Mar 2021 11:22:47 +0000 (12:22 +0100)]
mgr/cephadm/osd: PEP-8 fix

Otherwise `tox -e fix` will continue to
create this hunk

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit bf9d5cb52e8c7d47ea75f3a6f193fbc198bc08b6)

4 years agomgr/cephadm: Activate existing OSDs
Sebastian Wagner [Tue, 23 Feb 2021 11:24:06 +0000 (12:24 +0100)]
mgr/cephadm: Activate existing OSDs

Adds `ceph cephadm osd activate`

Fixes: https://tracker.ceph.com/issues/49159
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 50295a65a177dbc0803fe5af92459d51d9aff71a)

4 years agomgr/cephadm: osd: Use _run_cephadm_json()
Sebastian Wagner [Tue, 23 Feb 2021 10:30:36 +0000 (11:30 +0100)]
mgr/cephadm: osd: Use _run_cephadm_json()

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit 555cada8e554e7ec5707bae0d69336af9fe4ae51)

4 years agomgr/cephadm: document ok_to_stop output argument for clarity
Sage Weil [Thu, 4 Mar 2021 17:01:28 +0000 (12:01 -0500)]
mgr/cephadm: document ok_to_stop output argument for clarity

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 2a1c3997cdb3c046bf8db2b257e28b4cb56abfeb)

4 years agomgr/DaemonServer: make warning language a bit friendlier
Sage Weil [Fri, 26 Feb 2021 17:14:09 +0000 (12:14 -0500)]
mgr/DaemonServer: make warning language a bit friendlier

This message is shown during the upgrade process.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit fb778a3205801a49e4f9c4d3bd24e07dfb410a44)

4 years agomgr/cephadm/upgrade: improve language a bit
Sage Weil [Fri, 26 Feb 2021 17:12:24 +0000 (12:12 -0500)]
mgr/cephadm/upgrade: improve language a bit

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit bae8394c5e35b52b2cfaabfe79148a490efdf2dc)

4 years agomgr/cephadm/upgrade: restart multiple osds at once
Sage Weil [Fri, 26 Feb 2021 16:53:54 +0000 (11:53 -0500)]
mgr/cephadm/upgrade: restart multiple osds at once

Restart multiple osds in a single upgrade pass, when possible.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit b3d0420e60bcaede1d253bd551f201e756cc3d9a)

4 years agomgr/cephadm: gather other osds that are safe to stop
Sage Weil [Fri, 26 Feb 2021 16:50:51 +0000 (11:50 -0500)]
mgr/cephadm: gather other osds that are safe to stop

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 075d6fc18858bb552ed1a020d7971578680c4104)

4 years agomgr/cephadm: optional pass 'known' through to ok_to_stop
Sage Weil [Fri, 26 Feb 2021 13:46:26 +0000 (08:46 -0500)]
mgr/cephadm: optional pass 'known' through to ok_to_stop

Optionally provide a list of previously known-to-be-ok-to-stop items to
the ok_to_stop method. This has to get plumbed through a zillion instances
of this class method.

No functional change (yet).

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit d9da769079a6a78efd1016af28e7bcf0b8ab830c)

4 years agomgr/cephadm/upgrade: log start/stop/pause/resume
Sage Weil [Fri, 26 Feb 2021 14:15:39 +0000 (09:15 -0500)]
mgr/cephadm/upgrade: log start/stop/pause/resume

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 94b190d4a567ed65ece8aa1981f3aeaa59a292e7)

4 years agomgr/cephadm: add CEPHADM_STRAY_DAEMON unittest
Michael Fritch [Thu, 4 Mar 2021 20:48:35 +0000 (13:48 -0700)]
mgr/cephadm: add CEPHADM_STRAY_DAEMON unittest

Fixes: https://tracker.ceph.com/issues/49573
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 88dc55266958d77ffa1da34a3d20c039cb249ac5)

4 years agomgr/cephadm: alias rgw-nfs -> nfs
Michael Fritch [Wed, 3 Mar 2021 22:44:26 +0000 (15:44 -0700)]
mgr/cephadm: alias rgw-nfs -> nfs

RGW will register a daemon_type `rgw-nfs` which needs to map to
the corresponding cephadm nfs daemon to avoid stray daemon warnings

Fixes: https://tracker.ceph.com/issues/49573
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 0f237223accbea49cf9792400a657cbf696a5d67)

4 years agoqa/tasks/cephadm: remove mirror code
Sage Weil [Wed, 3 Mar 2021 18:35:07 +0000 (12:35 -0600)]
qa/tasks/cephadm: remove mirror code

This is being done from ansible now.  Also, it breaks when
the conf file has unqualified-search-registries but not 'registry'
entries.

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 208407c5c05e29c33d9decdba9455bdc2fe32e90)

4 years agocephadm: fixup `alrady` -> `already`
Michael Fritch [Thu, 25 Feb 2021 15:12:46 +0000 (08:12 -0700)]
cephadm: fixup `alrady` -> `already`

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit d6323e3e01208967a511c246337cfef18cbf141e)

4 years agocephadm: Change outer quotes to avoid escaping inner quotes (Q003)
Michael Fritch [Thu, 25 Feb 2021 15:12:37 +0000 (08:12 -0700)]
cephadm: Change outer quotes to avoid escaping inner quotes (Q003)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 55788a0bdb1220d2b2df758579366030c8e27947)

4 years agocephadm: Remove bad quotes from multiline string (Q001)
Michael Fritch [Thu, 25 Feb 2021 15:12:24 +0000 (08:12 -0700)]
cephadm: Remove bad quotes from multiline string (Q001)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 3b8656d496237651971332ccc29f40baad6883ee)

4 years agocephadm: Remove bad quotes (Q000)
Sage Weil [Mon, 15 Mar 2021 21:46:44 +0000 (16:46 -0500)]
cephadm: Remove bad quotes (Q000)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 6ca31b99e14f4c5518ad348b0b30392f108f5a6a)

# Conflicts:
# src/cephadm/cephadm
  - some ' quotes were already in pacific

4 years agocephadm: introduce flake8-quotes
Michael Fritch [Wed, 24 Feb 2021 20:48:37 +0000 (13:48 -0700)]
cephadm: introduce flake8-quotes

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 49f25f56ae44b2b8d185e866d75cb7a5041c8dcc)

4 years agocephadm: line break after binary operator (W504)
Michael Fritch [Fri, 19 Feb 2021 15:09:49 +0000 (08:09 -0700)]
cephadm: line break after binary operator (W504)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 7ac0479726b5d9ae925faff3c221f50e39547dd2)

4 years agocephadm: blank line contains whitespace (W293)
Sage Weil [Mon, 15 Mar 2021 21:45:52 +0000 (16:45 -0500)]
cephadm: blank line contains whitespace (W293)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 06e02b73c7c1ec20d6594cdc792c5643cdd06b5f)

# Conflicts:
# src/cephadm/cephadm
 whitespace

4 years agocephadm: trailing whitespace (W291)
Sage Weil [Mon, 15 Mar 2021 21:45:32 +0000 (16:45 -0500)]
cephadm: trailing whitespace (W291)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 1870056fa50c833d9ab545a35437013bf4bea74a)

# Conflicts:
# src/cephadm/cephadm
  - whitespace

Signed-off-by: Sage Weil <sage@newdream.net>
4 years agocephadm: local variable 'e' is assigned to but never used (F841)
Michael Fritch [Fri, 19 Feb 2021 15:09:22 +0000 (08:09 -0700)]
cephadm: local variable 'e' is assigned to but never used (F841)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit ec56db113f28d59cf5baf833be2a77aa8eeb5863)

4 years agocephadm: 'select' imported but unused (F401)
Michael Fritch [Fri, 19 Feb 2021 15:09:08 +0000 (08:09 -0700)]
cephadm: 'select' imported but unused (F401)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit bb0331841408cbcf7c1835974cdb77694d56fdc6)

4 years agocephadm: ambiguous variable name 'l' (E741)
Michael Fritch [Thu, 18 Feb 2021 22:30:02 +0000 (15:30 -0700)]
cephadm: ambiguous variable name 'l' (E741)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit c58701642dad678f6cf3ff946b10fc2a78b053c0)

4 years agocephadm: do not use bare 'except' (E722)
Michael Fritch [Thu, 18 Feb 2021 22:25:27 +0000 (15:25 -0700)]
cephadm: do not use bare 'except' (E722)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 8eb4c38f10251386b190194dd12f2787b083e383)

4 years agocephadm: statement ends with a semicolon (E703)
Michael Fritch [Thu, 18 Feb 2021 22:24:03 +0000 (15:24 -0700)]
cephadm: statement ends with a semicolon (E703)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 6237df7527b0384b2c1d47d17369e58cf9c5b0a4)

4 years agocephadm: module level import not at top of file (E402)
Sage Weil [Mon, 15 Mar 2021 21:43:48 +0000 (16:43 -0500)]
cephadm: module level import not at top of file (E402)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 9bbb35958cca8f8f72da324aa35f4d631e8c31a4)

# Conflicts:
# src/cephadm/cephadm
  - top definitions moved; kept pacific and is_master=False in place

4 years agocephadm: expected 1 blank line before a nested definition (E306)
Michael Fritch [Thu, 18 Feb 2021 22:15:48 +0000 (15:15 -0700)]
cephadm: expected 1 blank line before a nested definition (E306)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 6c8ea9fb65cb63db0aac4d53d507e21a0f85d726)

4 years agocephadm: expected 2 blank lines after end of function or class (E305)
Michael Fritch [Thu, 18 Feb 2021 22:13:57 +0000 (15:13 -0700)]
cephadm: expected 2 blank lines after end of function or class (E305)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit cf9e974284e34cc71438cf9ce0eac19e77e911b8)

4 years agocephadm: too many blank lines (E303)
Michael Fritch [Thu, 18 Feb 2021 22:12:50 +0000 (15:12 -0700)]
cephadm: too many blank lines (E303)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit f1af846c60598b573697ba2c55266ae88087227b)

4 years agocephadm: expected 2 blank lines, found 1 (E302)
Sage Weil [Mon, 15 Mar 2021 21:42:06 +0000 (16:42 -0500)]
cephadm: expected 2 blank lines, found 1 (E302)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit dea779803445cc83fa0a63570d0068f572ccbd20)

# Conflicts:
# src/cephadm/cephadm
  - whitespace

4 years agocephadm: expected 1 blank line, found 0 (E301)
Michael Fritch [Thu, 18 Feb 2021 22:04:42 +0000 (15:04 -0700)]
cephadm: expected 1 blank line, found 0 (E301)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 858b55c3acd0380565c7a2f565614d2ac61a3d13)

4 years agocephadm: too many leading '#' for block comment (E266)
Sage Weil [Mon, 15 Mar 2021 21:41:48 +0000 (16:41 -0500)]
cephadm: too many leading '#' for block comment (E266)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 3dcb56e3e31d11041a48c2749bb248240bb14134)

# Conflicts:
# src/cephadm/cephadm
  - whitespacea roudn comment

4 years agocephadm: block comment should start with '# ' (E265)
Michael Fritch [Wed, 17 Feb 2021 15:23:44 +0000 (08:23 -0700)]
cephadm: block comment should start with '# ' (E265)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 20c5f3d186f606ec4a5b66b6edd3f3c0056a8a27)

4 years agocephadm: at least two spaces before inline comment (E261)
Michael Fritch [Wed, 17 Feb 2021 15:18:31 +0000 (08:18 -0700)]
cephadm: at least two spaces before inline comment (E261)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 6d937393f872a484d1a4c80a72b327b7280278e3)

4 years agocephadm: unexpected spaces around keyword / parameter equals (E251)
Michael Fritch [Wed, 17 Feb 2021 04:10:36 +0000 (21:10 -0700)]
cephadm: unexpected spaces around keyword / parameter equals (E251)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit d47b26d792cfff7c64c78e781e7e38494f9a4c85)

4 years agocephadm: multiple spaces after ',' (E241)
Michael Fritch [Wed, 17 Feb 2021 04:08:39 +0000 (21:08 -0700)]
cephadm: multiple spaces after ',' (E241)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit d2bb74a8964ecb0f995874335e20a7f2fda1b3f1)

4 years agocephadm: missing whitespace after ':' (E231)
Michael Fritch [Wed, 17 Feb 2021 04:05:04 +0000 (21:05 -0700)]
cephadm: missing whitespace after ':' (E231)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 3e3ace6f31ce5758dc56150f762f9d2e2ca41301)

4 years agocephadm: missing whitespace around arithmetic operator (E226)
Michael Fritch [Wed, 17 Feb 2021 03:56:03 +0000 (20:56 -0700)]
cephadm: missing whitespace around arithmetic operator (E226)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 549258b4c6fe3945acdd03eeedab5070d1d81d01)

4 years agocephadm: missing whitespace around operator (E225)
Sage Weil [Mon, 15 Mar 2021 21:40:57 +0000 (16:40 -0500)]
cephadm: missing whitespace around operator (E225)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 2af78e9358838d04c9b92ee76736de53466a11f6)

# Conflicts:
# src/cephadm/cephadm
 - whitespace mismatch

4 years agocephadm: whitespace before ':' (E203)
Michael Fritch [Wed, 17 Feb 2021 03:50:10 +0000 (20:50 -0700)]
cephadm: whitespace before ':' (E203)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit f2f76a25179743f46bd9981d141fc8277799addd)

4 years agocephadm: whitespace after '{' (E201)
Michael Fritch [Wed, 17 Feb 2021 03:47:39 +0000 (20:47 -0700)]
cephadm: whitespace after '{' (E201)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 9e4fd38f32e8a972d64eda66a2a8623ea8bde179)

4 years agocephadm: continuation line unaligned for hanging indent (E131)
Michael Fritch [Wed, 17 Feb 2021 03:46:19 +0000 (20:46 -0700)]
cephadm: continuation line unaligned for hanging indent (E131)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 5ba2b30f788aa5001e0ec6a5fb168be5e8b59bad)

4 years agocephadm: continuation line under-indented for visual indent (E128)
Michael Fritch [Wed, 17 Feb 2021 03:38:37 +0000 (20:38 -0700)]
cephadm: continuation line under-indented for visual indent (E128)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 4611df9669f1ec78d62fcb8c2b475d2e4c3467d3)

4 years agocephadm: continuation line over-indented for visual indent (E127)
Michael Fritch [Wed, 17 Feb 2021 03:18:50 +0000 (20:18 -0700)]
cephadm: continuation line over-indented for visual indent (E127)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 460e6e84aa433559ae63fb0f13fb1e9d0df82385)

4 years agocephadm: continuation line over-indented for hanging indent (E126)
Sage Weil [Mon, 15 Mar 2021 21:39:28 +0000 (16:39 -0500)]
cephadm: continuation line over-indented for hanging indent (E126)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit fa2b17c8ecffb1c91c3e9f34ff0e7eea0f09ba3b)

# Conflicts:
# src/cephadm/cephadm
 - master has trailing whitespace; pacific did not

4 years agocephadm: continuation line with same indent as next logical line (E125)
Michael Fritch [Tue, 2 Mar 2021 20:50:10 +0000 (13:50 -0700)]
cephadm: continuation line with same indent as next logical line (E125)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 0d57f5496e0b4b486e4c723d150f789b58c960e7)

4 years agocephadm: closing bracket does not match visual indentation (E124)
Michael Fritch [Fri, 12 Feb 2021 16:20:49 +0000 (09:20 -0700)]
cephadm: closing bracket does not match visual indentation (E124)

Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit 91b54fcabcdac2c6ce7af8a934a5292cf252d608)