Merge pull request #365 from ceph/wip-13000-activate

do not udevadm trigger, ceph-disk does it

Reviewed-by: Sage Weil <sage@redhat.com>

do not udevadm trigger, ceph-disk does it

There is no need for osd create to call udevadm trigger action=add. By
running all actions associated with add for all block devices, it may
also trigger some race conditions. For instance, the following happens
about 10% of the time, when using dmcrypt:

 * ceph-disk prepare --dmcrypt /dev/vdb
 * /dev/vdb1 starts activating via udev
 * ceph-deploy triggers action=add
 * /dev/vdb2 udev chown root /dev/vdb2
 * /dev/vdb1 activate fails because of permission denied on /dev/vdb2
 * /dev/vdb2 udev action chown ceph /dev/vdb2

http://tracker.ceph.com/issues/13299 Fixes: #13299

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #364 from ceph/wip-https

no https for gitbuidler.ceph.com

Reviewed-by: Dan Mick <dmick@redhat.com>

hosts/debian/install: gitbuilder.ceph.com does not do https

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #357 from ceph/wip-https

download.ceph.com has https now

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #359 from SUSE/wip_dry_uninstall_purge

install: functions "uninstall" and "purge" merged to function "remove"

Reviewed-by: Travis Rhoden <trhoden@redhat.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>

https for download.ceph.com

Signed-off-by: Sage Weil <sage@redhat.com>

hosts/debian/install: install apt-transport-https

Signed-off-by: Sage Weil <sage@redhat.com>

install: functions "uninstall" and "purge" merged to function "remove"

Before this patch functions "uninstall" and "purge" are almost identical.
Since the only difference is the logging messages, and when the
distro.uninstall() function is called a boolean parameter set both these
functions are merged into a single command "remove" with the parameter
purge.

Signed-off-by: Owen Synge <osynge@suse.com>
foo

Merge pull request #360 from ceph/RM-13230

[RM-13230] fix broken unit test, py.test issue

[RM-13230] fix broken unit test, py.test issue

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #358 from trhoden/git-cleanup

vendor from git.ceph.com

[git-cleanup] vendor from git.ceph.com

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #356 from ceph/wip-download

install: go direct to download.ceph.com

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

install: go direct to download.ceph.com

Ceph.com does redirects, but this is faster.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #353 from ceph/wip-jessie

jessie support

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

debian/ubuntu: add systemd support

Prefer systemd over upstart if present (for newer ubuntu)

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #352 from trhoden/RM-12999

[RM-12999] remove bootstrap-rgw key via forgetkeys

[RM-12999] remove bootstrap-rgw key via forgetkeys

Fixes: #12999
Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #351 from ceph/wip-osd-create

osd: enable ceph on osd create

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

osd: enable ceph on osd create

Fixes: #12557
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #350 from ceph/wip-test

install: add --test install option to install ceph-test package

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Travis Rhoden <trhoden@redhat.com>

install: add --test install option to install ceph-test package

We need this for the teuthology tests.

Don't include it in --all, since any normal person does not want it.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #348 from ceph/wip-dev-commit

install: add support for --dev-commit <sha1>

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

install: add support for --dev-commit <sha1>

Adjusted centos, debian, fedora.

suse and rhel don't seem to pay attention to version_kind... :/

Signed-off-by: Sage Weil <sage@redhat.com>

1.5.28

Bump version

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Update changelog

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #347 from trhoden/RM-12699

use hosts.get() instead of get_connection for mon create-initial

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

[RM-12699] formatting tweak

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12699] Use hosts.get() in mon_create_initial()

That way we can pass callbacks

Fixes: #12699
Signed-off-by: Travis Rhoden <trhoden@redhat.com>
Reported-by: Bill Lubanovic <blubanovic@penguincomputing.com>

Merge pull request #345 from ceph/RM-11115

check if ceph is installed

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

[RM-11115] allow a list of callbacks when creating a connection

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-11115] tests for the Ceph package module

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-11115] prevent osd actions if ceph is not installed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-11115] check if ceph is installed before mon actions

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-11115] use the new class for normalized versions

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-11115] make a class for normalized versions

Signed-off-by: Alfredo Deza <adeza@redhat.com>

[RM-11115] add a callback for checking if ceph is installed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #341 from trhoden/RM-12649

mon add: start new mon without calling 'ceph mon add'

[RM-12649] No need to call "ceph mon add"

ceph mon add is not needed - merely starting the ceph-mon
daemon will cause it to join the cluster when all the other
steps have been done properly.

Calling "ceph mon add" as we were doing leads to hangs when
moving from 1 to 2 monitors.

Fixes: #12649
Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #344 from mbroz/systemd

Detect and support both systemd and sysvinit on Fedora, RHEL and CentOS

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Travis Rhoden <trhoden@redhat.com>

[RM-11115] initial take on a Ceph package object

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #343 from trhoden/RM-12663

use 'rpm --import', not 'rpmkeys --import'

Detect and support both systemd and sysvinit on Fedora, RHEL and CentOS

To properly install systemd-enabled and old (sysvinit) Ceph packages
we need to properly detect when systemd target is used.

This cannot be done just by checking distro version, it depends
on Ceph package content (sysvinit can be used on systemd distro as well).

Let's check ceph.target existence and enable systemd only in this case.

Signed-off-by: Milan Broz <mbroz@redhat.com>

[RM-12663] use 'rpm --import', not 'rpmkeys --import'

for EL6 compatibility

Fixes: #12663
Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #342 from trhoden/RM-12644

Remove duplicate package management code

[RM-12644] Kill duplicate pkg mgmt code

Ah, payoff!  Feels nice.

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12644] Kill TestRPM

pkg_managers.rpm() is unused in the codebase.

There are places that *could* use it, but I'd rather roll that into
pkg_managers.RPMBaseManager at some point

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12644] Add tests for DNF package manager

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12644] Convert Yum/Apt/Zypper tests to use new classes

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12644] Use distro.packager in 'calamari connect'

Refs: #12644

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12644] Use distro.packager for "ceph-deploy pkg"

Refs: #12644

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #339 from mbroz/systemd

Do not enable non-existing ceph service on systemd managed EL distros.

Reviewed-By: Travis Rhoden <trhoden@redhat.com>

Merge pull request #340 from ceph/RM-12631

[RM-12631] catch syntax errors in tox runs

Do not enable non-existing ceph service on systemd managed distros.

Once systemd integration is ready, "systemctl enable ceph" fails
because there is no longer such service (OSD units arte generated).
Enable ceph.target instead.

Signed-off-by: Milan Broz <mbroz@redhat.com>

[RM-12631] catch syntax errors in tox runs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

1.5.27

Merge pull request #338 from trhoden/RM-12626

new release prep

[RM-12626] Bump version number

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12626] Add docs for repo command

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12626] Update changelog

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #337 from trhoden/RM-12480

Allow package upgrades with DNF

[RM-12480] debian: use extra_remove_flags instead of purge flag

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12480] Allow kwargs and extra_remove_flags for remove()

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12480] debian: Pass extra install args consistently

I should be using **kw more to handle these optional items.
Make Apt consistent with RPM now.

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12480] Use "dnf install --best" so that upgrades happen

Fixes: #12480
Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12480] Allow kwargs and extra_install_flags for install()

Refs: #12480

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12480] fedora: don't set repo priority twice

For dev mode installs, fedora install() calls centos.mirror_install(),
and both these methods were setting yum repo priorities.

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #336 from trhoden/RM-12477

Only install priorities plugin when using Yum

[RM-12477] kill install_priorities_plugin()

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12477] centos: more selective install of yum-plugin-priorities

Only install plugin if using Yum for repo_install and mirror_install.

This is needed because Fedora re-uses these methods

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12477] fedora: priorities plugin only on Yum

Fixes: #12477
Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12477] Add 'name' attribute to pkg manager classes

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #335 from trhoden/RM-12553

Add "ceph-deploy repo" command

[RM-12553] remote write_file - remove file first if it exists

This way a new file mode can be applied if it has changed.

Since we are always writing the whole file (mode 'w') rather than
appending, we aren't losing anything by doing this.

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Apt repo file mode 0600 when URL has pw

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Allow a file mode when writing apt repo

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] repo: Allow URLs to be passed by env var

This is more secure if the repo URL contains a user:pass combo

Refs: #12553

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Clarify comments when writing repo files

These comments get printed to the console, and were a bit
misleading/ambiguous.

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Add Apt package pinning after repo add

Refs: #12553

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Remove beginning newline from Yum repo template

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Call add_repo() to create repo file

Refs: #12553

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] RPM: write out repo file

Refs: #12553

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12553] Add ability to delete a repo file

Refs: #12553

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

Merge pull request #332 from ceph/wip-systemd

systemd changes for F22

Reviewed-By: Travis Rhoden <trhoden@redhat.com>

Merge pull request #334 from trhoden/RM-12439

Use package manager classes for remaining distros

[RM-12439] suse: Use Zypper Class pkg manager

Refs: #12439

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12439] Add Zypper Class for pkg management

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12439] debian: use Apt Class pkg manager

Refs: #12439

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12439] Add Apt Class for pkg management

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12439] rhel: use Yum Class package manager

Refs: #12439

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12439] centos: use Yum Class package manager

Refs: #12439

Merge pull request #333 from trhoden/RM-12543

Only install requested packages for Debian, CentOS, Fedora

[RM-12543] suse: use common map_components()

Update the SUSE tests to use the right pieces as well.

Removed the "invalid" test because the common map_components()
does not have a whitelist of packages (though it could).  It
doesn't police what package names go through it, it just modifies
specific ones that you ask it to.

Refs: #12543

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12543] fedora: only install requested packages

Refs: #12543

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12543] centos: only install requested packages

Refs: #12543

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12543] debian: only install requested packages

Refs: #12543

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

[RM-12543] Add map_components() for sorting out split pkgs

Refs: #12543

Signed-off-by: Travis Rhoden <trhoden@redhat.com>

rgw: fix systemd creation

Analogous changes to mds create.

Signed-off-by: Sage Weil <sage@redhat.com>