Fix compatibility with Python 3.8

The deprecated platform.linux_distribution function was removed
in Python 3.8 - fallback to using parse_os_release if the function
is not found.

Signed-off-by: James Page <james.page@ubuntu.com>

Merge pull request #489 from Zhiwei-Dai/master

Add support for EulerOS

Add support for EulerOS

My server has installed Huawei EulerOS(v2.0sp8-arm64 Kunpeng920) and it's a client server in my ceph cluster. url:https://developer.huaweicloud.com/en-us/euleros/download.html?developlan=Other
[root@client12 ~]# cat /etc/os-release
NAME="EulerOS"
VERSION="2.0 (SP5)"
ID="euleros"
ID_LIKE="rhel fedora centos"
VERSION_ID="2.0"
PRETTY_NAME="EulerOS 2.0 (SP5)"
ANSI_COLOR="0;31"

When I use ceph-deploy commond to push ceph conf file to this client, I get following error:

root@node1:/etc/ceph# ceph-deploy --overwrite-conf config push client12
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy --overwrite-conf config push client12
[ceph_deploy.cli][INFO ] ceph-deploy options:
[ceph_deploy.cli][INFO ] username : None
[ceph_deploy.cli][INFO ] verbose : False
[ceph_deploy.cli][INFO ] overwrite_conf : True
[ceph_deploy.cli][INFO ] subcommand : push
[ceph_deploy.cli][INFO ] quiet : False
[ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0xffffb253d7a0>
[ceph_deploy.cli][INFO ] cluster : ceph
[ceph_deploy.cli][INFO ] client : ['client12']
[ceph_deploy.cli][INFO ] func : <function config at 0xffffb257ef50>
[ceph_deploy.cli][INFO ] ceph_conf : None
[ceph_deploy.cli][INFO ] default_release : False
[ceph_deploy.config][DEBUG ] Pushing config to client12
[client12][DEBUG ] connected to host: client12
[client12][DEBUG ] detect platform information from remote host
[ceph_deploy][ERROR ] UnsupportedPlatform: Platform is not supported: EulerOS SP5 2.0

After adding the euleros support in line 122, the error is fixed.
root@node1:/etc/ceph# ceph-deploy --overwrite-conf config push client12
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (2.0.1): /usr/bin/ceph-deploy --overwrite-conf config push client12
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : True
[ceph_deploy.cli][INFO  ]  subcommand                    : push
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0xffffaefd67e8>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  client                        : ['client12']
[ceph_deploy.cli][INFO  ]  func                          : <function config at 0xffffaf017ed8>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.config][DEBUG ] Pushing config to client12
[client12][DEBUG ] connected to host: client12
[client12][DEBUG ] detect platform information from remote host
[client12][DEBUG ] detect machine type
[client12][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf

Merge pull request #487 from ceph/RM-39489

Fix bytes decoding

gatherkeys: ensure decoded strings are used when writing to a file

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

util: add helper to convert to string

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

tests: update to avoid binary/decode issues

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

gatherkeys: no need to decode, do not write binary

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

gatherkeys: no need to decode - already done by remoto

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

osd: no need to decode - already done by remoto

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

mon: no need to decode - already done by remoto

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

setup: pin to newer version of remoto

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39489

util: remove bytes usage - remoto doesn't require it anymore

Signed-off-by: Alfredo Deza <adeza@redhat.com>

tox: add both py35 and py36 to test whichever is available

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #486 from ceph/RM-39527

upgrade setuptools first and install rest of the dependencies later

upgrade setuptools first and install rest of the dependencies later

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #485 from ceph/RM-39322

util: use 'true' when testing ssh connections

util/ssh remoto now returns strings, not bytes on Python 3

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39322

tests: update fake mon connection to return cmd from remoto

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39322

util: use new location for needs_ssh

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39322

util: use 'true' when testing ssh connections

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Resolves: rm#39322

Merge pull request #484 from ceph/wip-nautilus

default to nautilus

default to nautilus

Merge pull request #482 from dsavineau/tests_remove_print

test_altlinux: Remove print statement

test_altlinux: Remove print statement

The commit 6190bb2 introduced an unnecessary print statement in the
altlinux tests.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #475 from mrandybu/alt_tests

Tests altlinux platform for pull request #472

Tests altlinux platform for pull request #472

Merge pull request #481 from ceph/RM-37939

Fix hard deprecation errors in tests

[RM-37939] tests: consume the tmpdir fixture directly

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #480 from ceph/RM-37848

Fix remoto vendoring, bump remoto version to 0.0.35

[RM-37848] debian: add python-remoto as a requirement

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-37848] build: add python-remoto to the spec file as a requirement

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-37848] add remoto as a requirement in setup.py

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #472 from shaba/alt

Add support for ALT Linux

Merge pull request #477 from jcsp/wip-rm-calamari

Remove Calamari-related functionality

Remove Calamari-related functionality

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #476 from ceph/RM-24943

bump to release 2.0.2

[RM-24943] docs: update the changelog for 2.0.2

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-24943] setup: bump remoto requirement to 0.0.33

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-24943] bump to 2.0.2

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #474 from ceph/extend-env

extend environ instead of overwriting

[extend-env] setup: update remoto version required

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[extend-env] osd: extend environ, do not overwrite

Signed-off-by: Alfredo Deza <adeza@redhat.com>

2.0.1

Merge pull request #473 from ceph/RM-24577

release 2.0.1

[RM-24577] docs: update changelog for 2.0.1

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-24577] bump to 2.0.1

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-24577] install: default to mimic

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #457 from squidboylan/add_command_help_message

Add epliog help text

Add support for ALT Linux

Signed-off-by: Alexey Shabalin <shaba@altlinux.org>

Merge pull request #471 from HacKanCuBa/RM-23534

[RM-23534] Fix distro detection for Arch Linux

[RM-23534] Fix distro detection for Arch Linux

Merge pull request #470 from int32bit/RM-23218

[RM-23218] fix UnboundLocalError when create mds/mgr with bad hosts

[RM-23218] fix UnboundLocalError when create mgr with bad hosts

[RM-23218] fix UnboundLocalError when create mds with bad hosts

Merge pull request #468 from ceph/RM-23190

[RM-23190] install default to luminous

[RM-23190] install default to luminous

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #467 from ceph/RM-22816

[RM-22816] osd use logger.info to get the output on disk list

[RM-22816] osd use logger.info to get the output on disk list

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #466 from ceph/RM-19125

[RM-19125] run apt-get update before debian installs

[RM-19125] run apt-get update before debian installs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #465 from ceph/RM-21677

do not consider directories as executable paths

[RM-21677] tests verify that directories are not used

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-21677] hosts ensure that executable is a file

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #463 from wido/ipv6-address

net: Return both IPv4 and IPv6 addresses

Merge pull request #464 from rleimenstoll/fix_ceph_deploy_22871

add debug arg to parser for disk zap

[RM-22871] add debug arg to parser for disk zap

Signed-off-by: Ryan Leimenstoll <rleimens@umiacs.umd.edu>

Merge pull request #461 from HacKanCuBa/RM-7505

RM-7505 Add support for Arch Linux

net: Return both IPv4 and IPv6 addresses

When using ceph-deploy it will now also show the IPv6 addresses
it found for a node:

  IP addresses found: [u'192.168.153.10', u'2001:db8::100', u'10.0.2.15']

The resulting ceph.conf will use IPv6 addresses for the Monitors:

  ms_bind_ipv6 = true
  mon_host = [2001:db8::100],[2001:db8::101],[2001:db8::102]

Signed-off-by: Wido den Hollander <wido@42on.com>

[RM-7505] docs: indicate archlinux support

[RM-7505] tests: add for archlinux

[RM-7505] add support for archlinux

hosts: add arch based on fedora and add detection for distro.
util: add pacman package manager and archlinux default package.
install: add distro detection and package selection

[RM-7505] bootstrap: support archlinux

2.0.0

Merge pull request #459 from psukys/master

[RM-22712] Use recursive dir creation

Merge pull request #460 from ceph/RM-22315

bump to version 2.0.0

[RM-22315] docs: update changelog

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22712] Use recursive dir creation

[RM-22315] bump to 2.0.0

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Add epliog help text

Users may be confused by 'ceph-deploy --help' not having the info they
need, add an epilog help text section that informs users of command
specific help texts

Signed-off-by: Caleb Boylan <caleb.boylan@ormuco.com>

Merge pull request #456 from ceph/RM-22324

enable debug mode for ceph-volume

[RM-22324] osd add the environ variables for debug mode in ceph-volume

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22324] osd add flags for ceph-volume debug mode

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #455 from ceph/RM-22118

Use ceph-volume for OSD operations

[RM-22118] tests: drop python 2.6 tox test support

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] osd: raise an error if no host is provided

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] setup.cfg needs new pytest group notation

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] tests: adapat tests to new API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] test: use new fixture syntax for cli_new

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] test: use new pytest fixture syntax

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] tests: remove test_osd, modules no longer exist

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] tests: update osd disk tests for API change

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] docs: update osd usage with new API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-22118] osd: update documentation for --help

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #453 from SUSE/wip-fix-18164

Use /etc/os-release if platform.linux_distribution() empty

[RM-18164] Use /etc/os-release if platform.linux_distribution() empty

On systems with only /etc/os-release (rather than distro-specific
release files), platform.linux_distribution() returns ('', '', '').
In this case, fall back to parsing /etc/os-release instead.

It would better to flip the ordering, and use /etc/os-release first,
with platform.linux_distribution() as a fallback.  There's tests for
seven different distros' os-release files already, but we may want
more before flipping this around.

(It would be better still to just use the distro.linux_distribution()
function, especially since platform.linux_distribution() is
deprecated, but I don't know that there's a way of ensuring that
module is present in advance on all the remote hosts.)

Fixes: http://tracker.ceph.com/issues/18164
Signed-off-by: Tim Serong <tserong@suse.com>

Merge pull request #454 from ceph/wip-tracker-16399

remove python-distribute dependency

[RM-16399] python-distribute was merged back into python-setuptools,
so there should be no reason to require both.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

1.5.39

Merge pull request #452 from ceph/RM-21213

Rm 21213