nameserver: Enable ntpd

Required for dynamic DNS updates to work

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Configure SELinux for dynamic DNS support

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Support dynamic DNS in named config

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Support dynamic DNS zone in records task

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #295 from ceph/wip-dhcp-cleanup

Cleanup cobbler network setup stuff for Ubuntu testnodes

Reviewed-by: Dan Mick <dmick@redhat.com>

cobbler_profile: Concede to systemd NIC naming methods

Setting biosdevname=0 was causing issues with NICs being renamed after
cobbler reimage.  The system would reimage/install fine but the NIC would have a
different name on firstboot.

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Remove cephlab_ubuntu_network snippet

Just cruft at this point.  It hasn't been used since
05267fe001432d326c30262d4b07d1775a2ad0d4

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #294 from ceph/wip-18067

testnode: Install libtool-bin for building xfstests

testnode: Install libtool-bin for building xfstests

Fixes: http://tracker.ceph.com/issues/18067
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #293 from ceph/wip-zap-disks

Zap all non-root disks on testnodes

cobbler: Install gdisk for use with testnodes zap ansible tag

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: zap disks after cobbler reimage

Added to first line to make sure it's run when using -stock profiles

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Zap GPT and MBR on all disks but root

Fixes: http://tracker.ceph.com/issues/15951
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #292 from ceph/wip-dns-recurse

nameserver: Add support for enabling/disabling recursion

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #291 from ceph/wip-17922

Updates to downstream_setup role

Reviewed-by: Dan Mick <dmick@redhat.com>

downstream_setup: Dynamically evaluate when statements in main.yml

See https://github.com/ansible/ansible/issues/18483

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add support for enabling/disabling recursion

Signed-off-by: David Galloway <dgallowa@redhat.com>

downstream-setup: define empty var for repos_to_remove

This var got missed when working on
https://github.com/ceph/ceph-cm-ansible/pull/287

Fixes: http://tracker.ceph.com/issues/17922
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #290 from ceph/wip-firmware

New role for updating firmware

Reviewed-by: Dan Mick <dmick@redhat.com>

firmware: Add README for role

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add NVMe firmware update support for smithi

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add BMC update support for smithi

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add Areca RAID controller support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #287 from ceph/wip-ansible22

testnode: Define a few empty variables for ansible v2.2 compatibility

firmware: New role.  Adding BIOS and BMC support for mira

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #289 from ceph/wip-rhel73

Add RHEL7.3 support

Reviewed-by: Dan Mick <dmick@redhat.com>

Add RHEL7.3 support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #288 from ceph/wip-nrpe-rhel

common: Install a few additional packages for NRPE

common: Install a few additional packages for NRPE

check_load nagios plugin needs to be installed on RHEL and CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Define a few empty variables for ansible v2.2 compatibility

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #286 from ceph/wip-users-become

Use "become: true" for users role

Use "become: true" for users role

This is needed if the users role is called manually.  Typically it's
called via the common role and "become: true" is inherited.

But in the case of just needing to update update the teuthology_user's pubkeys with @all.pub, just calling the users role manually is quicker.  sudo access is obviously required to modify users and groups.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #285 from ceph/wip-beta2

common: Change method of detecting beta distro

common: Change method of detecting beta distro

It was recently discovered that Release Candidate ISOs of RHEL don't output "Beta" or
"Alpha" in `lsb_release` output.  Therefore, RHEL RC Distros were
registering with CDN and not putting beta_repos in place.

This new method registers every RHEL system with CDN, checks if there are
any available matching repos based on ansible_distribution_version, and
either:
  - Unregisters from CDN and runs beta_distros.yml if there are no CDN repos
  - Continues with setting up desired rhsm_repos

I also added some additional working to task descriptions to hopefully
claer up what's going on in this playbook since there are a lot of when
and if statements.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #283 from ceph/wip-common-updates

Updates to common role

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Add nagios check_mem command

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Create nagios_allowed_hosts var for lab-specific nagios IPs

Signed-off-by: David Galloway <dgallowa@redhat.com>

Add common.yml playbook file

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #282 from ceph/wip-vmlist

Add vmhosts to vmlist.py and run virsh in read-only mode

Reviewed-by: Dan Mick <dmick@redhat.com>

Add vmhosts to vmlist.py and run virsh in read-only mode

'virsh -r' allows vmlist.py to work with RHEV hypervisor hosts

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #280 from ceph/wip-ubuntu-groups

users: Leave managed_admin_users' other group memberships alone

Reviewed-by: Dan Mick <dmick@redhat.com>

users: Leave managed_admin_users' other group memberships alone

This change is mainly so the users role can be run on vps_hosts.

Previously, in order to update the ubuntu user's authorized_keys on
vps_hosts, the testnodes role had to be run which caused ubuntu to be
removed from the libvirtd group.

The ubuntu user is in managed_admin_users on vps_hosts so this will
ensure the user is added to sudo and left in the libvirtd group.

managed_users, on the other hand, we want to make sure are only in
groups we specify so the "Create all users without sudo access." task is
left as-is (without append: yes).

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #279 from ceph/wip-beta-repos

defaults: beta_repos must be a dict

defaults: beta_repos must be a dict

This causes ceph-cm-ansible to fail every teuthology job due to
the bad default: 'with_dict expects a dict'

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #278 from ceph/wip-beta-distros

Add support for testing RHEL beta distros using internal repos

cobbler: redhat-lsb-core package is required for ansible_lsb variables

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnodes: Add support for internal RHEL beta repos

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #277 from ceph/wip-teuthology

teuthology role updates

Provide a default for teuthology_yaml_extra

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #272 from ceph/wip-teuth-kill

teuthology: Create tkill group and grant tkill_users right to run `kill`

teuthology: Create test-admins group and grant test_admins right to run `kill`

Fixes: http://tracker.ceph.com/issues/16614
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #276 from ceph/wip-teuth-fixes

A couple fixes to teuthology role

Merge pull request #274 from ceph/wip-profile-tasks

Use the profile_tasks plugin

Use the profile_tasks plugin

This will cause ansible to display timing information for tasks,
allowing us to see what's slow and potentially improve speed.

I've been using this locally for a while now. It's nice.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #275 from ceph/wip-ssh-retries

Retry SSH connections five times

Merge pull request #273 from ceph/wip-strategy-free

Use strategy: free on some playbooks

Retry SSH connections five times

This may help with some of the problems we've been seeing.

Related to http://tracker.ceph.com/issues/16826
Inspired by
https://github.com/ansible/ansible/issues/13401#issuecomment-216768025

Signed-off-by: Zack Cerza <zack@redhat.com>

Use strategy: free on some playbooks

See http://docs.ansible.com/ansible/playbooks_strategies.html#strategies

This could potentially improve performance.

Signed-off-by: Zack Cerza <zack@redhat.com>

teuthology: Ignore any errors when disabling apache2

Signed-off-by: David Galloway <dgallowa@redhat.com>

teuthology: Additional packages needed to run bootstrap now

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #271 from ceph/wip-no-fw

testnode: Disable firewalld and iptables regardless of OS version

testnode: Disable firewalld and iptables regardless of OS version

iptables was recently found installed and running on a RHEL7 system.
Previous testnode playbook runs wouldn't catch this since it shouldn't
be installed in the first place.  This change ensures firewalld and
iptables are stopped on all RPM-based distros.

Fixes: http://tracker.ceph.com/issues/16809
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #270 from ceph/wip-keys-retry

Add a retry when cloning the keys repo

Add a retry when cloning the keys repo

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #269 from ceph/wip-cobbler-gitrace

Use flock to avoid race conditions with git

Use flock to avoid race conditions with git

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #265 from ceph/wip-nagios-common

Move NRPE setup to common role

Merge pull request #267 from ceph/wip-no-gperftools-devel

testnode: drop gperftools-devel

Merge pull request #268 from ceph/wip-failure-log-debug

If a YAML error is hit, log the raw object

Reviewed-by: Dan Mick <dmick@redhat.com>

If a YAML error is hit, log the raw object

We are seeing: "RepresenterError: cannot represent an object: pcp"

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: drop gperftools-devel

Stop installing the gperftools-devel package on testnodes, for the
following reasons:

1. Ceph does not require gperftools-devel at runtime, so installing it
   unnecessarily just slows everything down at this point.

2. When we want to test newer builds of gperftools (say, from RHEL 7.3),
   if the corresponding "gperftools-devel" package is not available on
   the test node, then yum will fail the transaction.

(Additionally, gperftools-devel is no longer in EPEL 7, and it has moved to
RHEL 7 Optional in RHEL 7.2 (https://bugzilla.redhat.com/1213879,
https://access.redhat.com/errata/RHEA-2015:2293). The "epel" list is no
longer the correct list for this package on redhat_7 and centos_7.)

Merge pull request #266 from ceph/wip-timeout

use 120s instead of default 12s for cmd timeout

common: Update nrpe SELinux policy

This should've been done when smart.sh replaced smart.pl.
I just didn't notice smart.sh was getting denied by SELinux until I
started monitoring disks in Octo.  Evidently the new script requires
much more permission to run.

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Create README

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Install some ansible dependencies during kickstart

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Combine some nrpe-selinux package installations

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Always install disk_monitoring scripts when nagios tag is called

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Move smartmontools to disk_monitoring task

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Enable nrpe installation without epel repo on RHEL/CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Move nrpe package install to common role

Signed-off-by: David Galloway <dgallowa@redhat.com>

Move NRPE setup to common role

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Configure firewalld (when enabled) for NRPE

Signed-off-by: David Galloway <dgallowa@redhat.com>

use 120s instead of default 12s for cmd timeout

Increase timeout from 12s to 120s for ansible cmds

Signed-off-by: Vasu Kulkarni vasu@redhat.com

Merge pull request #264 from ceph/wip-16615

Don't use a shallow copy of keys.git

Don't use a shallow copy of keys.git

http://tracker.ceph.com/issues/16615
Fixes: 16615
Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #263 from ceph/wip-cpan

testnodes: Install perl-CPAN on yum systems

testnodes: Install perl-CPAN on yum systems

perl-CPAN is required to install Amazon::S3 using the 'cpan' command

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #262 from ceph/wip-become

More Ansible v2 fixes

Bracket bare variables for Ansible v2

Signed-off-by: David Galloway <dgallowa@redhat.com>

Add missing 'become' directive to a few more roles

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #261 from ceph/wip-rclocal-msg

cobbler: Output message indicating Ansible is running after firstboot

Reviewed-by: Dan Mick <dmick@redhat.com>

cobbler: Output message indicating Ansible is running after firstboot

Fixes: http://tracker.ceph.com/issues/14297
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #260 from ceph/wip-downstream-fixes

downstream_setup role fixes

downstream_setup: Ensure role is only run on RHEL or CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

downstream_setup: Add 'become' privilege escalation directive

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #259 from ceph/wip-entitlements-bools

common: Fix boolean expressions

Fix boolean expressions

Signed-off-by: Zack Cerza <zack@redhat.com>

Revert "Use ansible_user instead of ansible_ssh_user"

This reverts commit 7cc43cf253fc0dceea381ff11ed1d3e546f70ff8.

Merge pull request #258 from ceph/wip-pip

Add missing pip.yml

Add missing pip.yml

Signed-off-by: Zack Cerza <zack@redhat.com>