Merge pull request #264 from ceph/wip-16615

Don't use a shallow copy of keys.git

Don't use a shallow copy of keys.git

http://tracker.ceph.com/issues/16615
Fixes: 16615
Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #263 from ceph/wip-cpan

testnodes: Install perl-CPAN on yum systems

testnodes: Install perl-CPAN on yum systems

perl-CPAN is required to install Amazon::S3 using the 'cpan' command

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #262 from ceph/wip-become

More Ansible v2 fixes

Bracket bare variables for Ansible v2

Signed-off-by: David Galloway <dgallowa@redhat.com>

Add missing 'become' directive to a few more roles

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #261 from ceph/wip-rclocal-msg

cobbler: Output message indicating Ansible is running after firstboot

Reviewed-by: Dan Mick <dmick@redhat.com>

cobbler: Output message indicating Ansible is running after firstboot

Fixes: http://tracker.ceph.com/issues/14297
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #260 from ceph/wip-downstream-fixes

downstream_setup role fixes

downstream_setup: Ensure role is only run on RHEL or CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

downstream_setup: Add 'become' privilege escalation directive

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #259 from ceph/wip-entitlements-bools

common: Fix boolean expressions

Fix boolean expressions

Signed-off-by: Zack Cerza <zack@redhat.com>

Revert "Use ansible_user instead of ansible_ssh_user"

This reverts commit 7cc43cf253fc0dceea381ff11ed1d3e546f70ff8.

Merge pull request #258 from ceph/wip-pip

Add missing pip.yml

Add missing pip.yml

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #255 from ceph/wip-ansible-2

DNM: Move to ansible 2

Merge pull request #257 from ceph/wip-disable-firewalld

testnodes: Disable firewalld service after reboot on RPM-based distros

Reviewed-by: Dan Mick <dmick@redhat.com>

testnodes: Disable firewalld service after reboot on RPM-based distros

Fixes: http://tracker.ceph.com/issues/16455
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #256 from ceph/wip-global-cpan

testnodes: Configure cpan and install Amazon::S3 on all OSes

Disable become for repo cloning (2.x method)

Signed-off-by: Zack Cerza <zack@redhat.com>

Remove sudo role; replace with 'become' setting

The old method of setting the default behavior for become/sudo has
changed in 2.x; fortunately the new way is a bit more elegant

Signed-off-by: Zack Cerza <zack@redhat.com>

Quote variables used by with_items

Signed-off-by: Zack Cerza <zack@redhat.com>

cobbler: Install ansible from PyPI

The distros we're using don't ship ansible 2.

Signed-off-by: Zack Cerza <zack@redhat.com>

Locate templates properly

See https://github.com/ansible/ansible/issues/14161

Signed-off-by: Zack Cerza <zack@redhat.com>

Use ansible_user instead of ansible_ssh_user

The option was renamed in 2.0

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #249 from ceph/wip-gw-networking

Network configuration for gateway role

Reviewed-by: Dan Mick <dmick@redhat.com>

gateway: Add logrotate functionality

Signed-off-by: David Galloway <dgallowa@redhat.com>

gateway: Add README documentation for networking, firewall, fail2ban

Signed-off-by: David Galloway <dgallowa@redhat.com>

gateway: Add fail2ban support

Signed-off-by: David Galloway <dgallowa@redhat.com>

gateway: Configure firewalld

Signed-off-by: David Galloway <dgallowa@redhat.com>

gateway: Enable server network config

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #252 from ceph/wip-cblr-wget

cobbler: testnode post-install rc.local fixes

Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Zack Cerza <zack@redhat.com>

testnodes: Configure cpan and install Amazon::S3 on all OSes

Fixes: http://tracker.ceph.com/issues/15316
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #254 from ceph/wip-clone-once

Only clone the keys repo once per execution

Reviewed-by: Dan Mick <dmick@redhat.com>

Only clone the keys repo once per execution

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #253 from ceph/wip-fast-keys

users: Greatly speed up ssh pubkey deployment

Reviewed-by: Dan Mick <dmick@redhat.com>

Put the keys repo in ~/.cache/src/ by default

To avoid multiple invocations by different users on the same host
stepping on each other.

Signed-off-by: Zack Cerza <zack@redhat.com>

Remove unnecessary retry

Since each key isn't being fetched from a remote server any longer, we
can drop the retries.

Signed-off-by: Zack Cerza <zack@redhat.com>

Speed up key deployment by using the git repo

Instead of downloading each key over HTTPS from github.com, we can
simply clone the entire repo (with depth 1) and lookup each key using
the username.

On my laptop, execution time went from 2m49s to 29s.

Signed-off-by: Zack Cerza <zack@redhat.com>

users: Add defaults for keys_repo

Signed-off-by: Zack Cerza <zack@redhat.com>

users: split tasks/main.yml into separate files

Signed-off-by: Zack Cerza <zack@redhat.com>

cobbler: testnode post-install rc.local fixes

- Instead of sleeping for 30 secs and hoping network is up, wait until we can
reliably ping the Cobbler host.
- Give ansible more time to run before wget's built-in 15min timeout is reached.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #251 from ceph/wip-edeploy

users: Set UID_MIN to 1001

Reviewed-by: Dan Mick <dmick@redhat.com>

users: Set UID_MIN to 1001

When building images with edeploy, UID 1000 was being taken by a
"normal" user; we need to reserve this for the teuthology user.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #250 from ceph/wip-no-lsb

Don't rely on LSB when testing for distro version

Reviewed-by: Dan Mick <dmick@redhat.com>

Don't rely on LSB when testing for distro version

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #248 from ceph/wip-xenial

testnodes: Fix resolvconf issues on xenial

Improve network interface discovery

Signed-off-by: Zack Cerza <zack@redhat.com>

Always bounce the main interface on xenial

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #247 from ceph/wip-16119

pcp: Don't fail when setting permissions

pcp: Don't fail when setting permissions

http://tracker.ceph.com/issues/16119
Fixes: 16119
Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #246 from dmick/master

smart.sh: default rc to 0 (saw false UNKNOWNs with non-raid)

smart.sh: default rc to 0 (saw false UNKNOWNs with non-raid)

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #245 from ceph/wip-newsmart

testnode: Replace old smart.pl with rewritten smart.sh script

Reviewed-by: Dan Mick <dmick@redhat.com>

testnode: Replace old smart.pl with rewritten smart.sh script

Fixes: http://tracker.ceph.com/issues/14682
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #244 from cooboos/centos

testnode: replace hardcoded 'gitbuilder.ceph.com' with {{ gitbuilder_host }}

testnode: replace hardcoded 'gitbuilder.ceph.com' with {{ gitbuilder_host }}

Signed-off-by: wangsongbo <wangsongbo@unitedstack.com>

Merge pull request #243 from ceph/wip-sam-ansible

testnode/tasks/apt/packages.yml: just force everything

Merge pull request #241 from ceph/wip-pcp-settings

pcp: update upstream packages

Reviewed-by: Dan Mick <dmick@redhat.com>

pcp: update upstream packages

PCP's upstream doesn't version its dependencies in all cases. This leads
to situations where, when setting upstream_repo to True, a system ends
up with some old and some new packages. This results in a potentially
broken installation.

This commit causes all installed pcp packages to be upgraded when
upstream_repo is True.

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode/tasks/apt/packages.yml: just force everything

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #239 from ceph/wip-pcp-settings

pcp: retention settings for managers

Make pmlogmerge_reduce configurable

Signed-off-by: Zack Cerza <zack@redhat.com>

Make pmlogmerge_retain configurable

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #240 from ceph/wip-nrpe-load-limits

testnode: Update nagios CPU load thresholds to be less strict

testnode: Update nagios CPU load thresholds to be less strict

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #238 from ceph/wip-pcp-js

pcp: A dynamic dashboard with host- and time-selection

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #237 from ceph/wip-check4-selinux

testnode: Skip NRPE selinux setup if selinux disabled

index.js

testnode: Skip NRPE selinux setup if selinux disabled

Fixes: http://tracker.ceph.com/issues/15675
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #236 from ceph/wip-xenial-nicnames

cobbler: Prevent systemd from renaming NICs

Reviewed-by: Dan Mick <dmick@redhat.com>

cobbler: Prevent systemd from renaming NICs

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #235 from ceph/wip-no-getty

testnode: Remove manual configuration of getty

Reviewed-by: Dan Mick <dmick@redhat.com>

testnode: Remove manual configuration of getty

Manual configuration of the getty service is no longer required for
Trusty or later.  The system-specific "console=ttySX" parameter in
/proc/cmdline is enough to configure the SOL tty during Ubuntu
installation.

See http://tracker.ceph.com/issues/15269 for further explanation.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #234 from ceph/wip-preseed-bootdev

cobbler: Only set bootdev in kickstart if installing Xenial.

Reviewed-by: Dan Mick <dmick@redhat.com>

cobbler: Only set bootdev in kickstart if installing Xenial.

"bootdev string default" is only supported in Xenial.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #233 from ceph/wip-preseed-bootdev

cobbler: Only set bootdev in kickstart if installing Xenial.

cobbler: Only set bootdev in kickstart if installing Xenial.

"bootdev string default" is only supported in Xenial.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #232 from ceph/wip-xenial

Add support for Ubuntu 16.04 Xenial

cobbler: Make Ubuntu kickstart compatible with Xenial

linux-firmware-nonfree package is not available in Xenial

Installer was also stopping after package install asking for
GRUB install destination.  Adding the 'bootdev string default'
line bypasses the message and is already the lab default so
shouldn't affect other distro versions.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Add Xenial-specific packages

Used roles/testnode/vars/ubuntu_14.yml as template.  Differences are:
 - libboost-thread1.54.0 updated to libboost-thread1.58.0
 - libcrypto++9 updated to libcrypto++9v5
 - libssl0.9.8 updated to libssl1.0.0
 - mpich2, libmpich2-dev, and dmapi not available in Xenial

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #229 from ceph/wip-nameserver

A role for an internal master nameserver

Reviewed-by: Dan Mick <dmick@redhat.com>

testnode: Add sshd config for Ubuntu 16.04

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Add Ubuntu 16.04 (Xenial Xerus)

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #231 from ceph/wip-nrpe-selinux

testnode: Update SELinux policy when configuring NRPE

testnode: Update SELinux policy when configuring NRPE

The 'nagios_run_sudo' boolean was added after RHEL7.1 GA.

https://rhn.redhat.com/errata/RHBA-2015-1140.html

Attempting to set the boolean when it's not present causes ansible
to fail.  NRPE will cause SELinux failures in test jobs unless set
so the only other option would be to disable NRPE on
RHEL/CentOS <= 7.1

This change ensures the testnode has the latest version of SELinux
policy installed, and thus, ensuring the boolean exists.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #230 from ceph/wip-pcp-perms

pcp: Correct /var/log/pcp permissions for collectors

Correct /var/log/pcp permissions for collectors

Some hosts were getting a /var/log/pcp/pmmgr that was owned by root:root
for some reason.

Fixes: http://tracker.ceph.com/issues/15575
Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #227 from ceph/wip-pcpweb-deb

Add pcp-webapi on ubuntu upstream setups; set pmcd connect timeout for pmmgr

nameserver: Add check for ansible_version.major >= 2

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add README

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add ability to set named daemon options

The variable in defaults/main.yml will leave /etc/sysconfig/named
empty which is the package default.  We want IPv4 only however.
This is set in the secrets repo.

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Configure firewalld to allow DNS traffic

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add configuration task for named service

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add named service handlers

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add records task

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add packages task

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Initial role structure creation

Signed-off-by: David Galloway <dgallowa@redhat.com>