common: Retry unregister beta distro from CDN

Seeing intermittent `subscription-manager unregister` failures in Octo.
Since the register task has retries, I see no reason unregistering
can't.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #314 from ceph/wip-www-cron

public_facing: Add cronjobs for www.ceph.com

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #315 from ceph/wip-new-ansible

common: Workaround for ansible bug conditional evaluation

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Workaround for new ansible conditional evaluation bug

Prior to ansible v2.2.2.0, if the first conditional was false, the second
conditional wasn't checked.

This change makes sure nrpe-selinux.yml is only included on RHEL/CentOS
which are the only OSes that will have stdout for the selinux_status
var.

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add cronjobs for www.ceph.com

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #313 from ceph/wip-fix-312

common: Fix a bug in PR #312

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Fix a bug in PR #312

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #312 from ceph/wip-15439

common: Clean apt cache before updating it

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Clean apt cache before updating it

This is the first apt transaction that gets run in the common role.

Fixes: http://tracker.ceph.com/issues/15439
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #307 from ceph/wip-public-facing

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #311 from ceph/wip-vps-replace

tools: Replace mira091 w mira005 and add missing hv03

Reviewed-by: Dan Mick <dmick@redhat.com>

tools: Replace mira091 w mira005 and add missing hv03

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #310 from ceph/wip-19126

common: Reinstall selinux-policy-targeted if needed

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Reinstall selinux-policy-targeted if needed

This ensures module file integrity so we can build the nrpe selinux
module in the proceeding tasks.

Fixes: http://tracker.ceph.com/issues/19126
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #309 from ceph/wip-19126

common: Delete leftover SELinux policy modules

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Delete leftover SELinux policy modules

Jobs were occasionally failing due to
/etc/selinux/targeted/active/modules/400/mod_fastcgi/lang_ext being
corrupt.  mod_fastcgi is removed and reinstalled with every
testnodes.yml run anyway so this just makes sure valid SELinux policy
modules are put in place.

Fixes: http://tracker.ceph.com/issues/19126
Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Disable PasswordAuthentication in sshd config

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add status.sepia.ceph.com-specific tasks

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add download.ceph.com-specific tasks

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add fail2ban support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #308 from dmick/master

Reduce 'internal_poll_interval' to stem the CPU usage tide

Reduce 'internal_poll_interval' to stem the CPU usage tide

See https://github.com/ansible/ansible/pull/16560 and
https://github.com/ansible/ansible/issues/14219

Signed-off-by: Dan Mick <dan.mick@redhat.com>

public_facing: Enable ufw support

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Create base role config

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #299 from ceph/wip-nsupdate

Add role for nsupdate_web

Add role for nsupdate_web

See https://github.com/zmc/nsupdate-web/

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #306 from ceph/wip-lsbrelease

nameserver: Install redhat-lsb-core for `lsb_release`

Reviewed-by: Dan Mick <dmick@redhat.com>

nameserver: Install redhat-lsb-core for `lsb_release`

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #305 from dmick/master

testnode/tasks/ntp: remove '/etc/network/if-up.d/ntpdate' on Xenial

testnode/tasks/ntp: remove '/etc/network/if-up.d/ntpdate' on Xenial

It's buggy (see comment in code) and we don't need it, because
teuthology does what it would do anyway.  Supposed to be fixed in
a later version of the Debian package which is in Yakkety.

Fixes: http://tracker.ceph.com/issues/18837
Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #281 from rjfd/wip-opensuse-upstream-pr

Support for running teuthology suites in OpenSUSE Leap images

Merge pull request #303 from ceph/wip-teuth-mime

teuthology: Correct MIME type spec for log files

teuthology: Correct MIME type spec for log files

Gzipped files were being served as text/plain. Instead of applying text/plain to everythincg, extend the default MIME configuration to serve *.log as text/plain.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #302 from ceph/wip-named-chown

nameserver: Fix permissions on /var/named/zones

nameserver: Fix permissions on /var/named/zones

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #301 from ceph/wip-cloud-dns

Ensure search domain and domain are set properly in resolv.conf

Ensure domain is set in resolv.conf

Signed-off-by: Zack Cerza <zack@redhat.com>

Ensure search domain is set in resolv.conf

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #300 from ceph/wip-dns-slave

nameserver: Add support for BIND slave nameservers

Reviewed-by: Dan Mick <dmick@redhat.com>

nameserver: Add support for BIND slave nameservers

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #298 from ceph/wip-centos73

Add CentOS 7.3 to Cobbler

Add CentOS 7.3 to Cobbler

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #297 from ceph/wip-ddns-in-front

nameserver: Dynamic DNS support

Reviewed-by: Dan Mick <dmick@redhat.com>

nameserver: Enable ntpd

Required for dynamic DNS updates to work

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Configure SELinux for dynamic DNS support

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Support dynamic DNS in named config

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Support dynamic DNS zone in records task

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #295 from ceph/wip-dhcp-cleanup

Cleanup cobbler network setup stuff for Ubuntu testnodes

Reviewed-by: Dan Mick <dmick@redhat.com>

roles: testnode: Support for openSUSE Leap

Signed-off-by: Ricardo Dias <rdias@suse.com>

roles: common: Support for openSUSE Leap

Signed-off-by: Ricardo Dias <rdias@suse.com>

testnode: do not configure Nagios on zypper-based systems

Nagios is only used in the Sepia lab. For zypper-based systems we are currently
targeting OpenStack only.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Add sshd_config template for openSUSE Leap

Signed-off-by: Nathan Cutler <ncutler@suse.com>

cleanup: remove fullstops in tasks/ssh.yml

Signed-off-by: Nathan Cutler <ncutler@suse.com>

testnode/templates/ssh: unify permissions to 644

Signed-off-by: Nathan Cutler <ncutler@suse.com>

testnode/tasks/main.yml: support openSUSE

Signed-off-by: Nathan Cutler <ncutler@suse.com>

tasks/main.yml: convert comments into names

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Add zypper_systems.yml (straight copy from yum_systems.yml)

cobbler_profile: Concede to systemd NIC naming methods

Setting biosdevname=0 was causing issues with NICs being renamed after
cobbler reimage.  The system would reimage/install fine but the NIC would have a
different name on firstboot.

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Remove cephlab_ubuntu_network snippet

Just cruft at this point.  It hasn't been used since
05267fe001432d326c30262d4b07d1775a2ad0d4

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #294 from ceph/wip-18067

testnode: Install libtool-bin for building xfstests

testnode: Install libtool-bin for building xfstests

Fixes: http://tracker.ceph.com/issues/18067
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #293 from ceph/wip-zap-disks

Zap all non-root disks on testnodes

cobbler: Install gdisk for use with testnodes zap ansible tag

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: zap disks after cobbler reimage

Added to first line to make sure it's run when using -stock profiles

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Zap GPT and MBR on all disks but root

Fixes: http://tracker.ceph.com/issues/15951
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #292 from ceph/wip-dns-recurse

nameserver: Add support for enabling/disabling recursion

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #291 from ceph/wip-17922

Updates to downstream_setup role

Reviewed-by: Dan Mick <dmick@redhat.com>

downstream_setup: Dynamically evaluate when statements in main.yml

See https://github.com/ansible/ansible/issues/18483

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add support for enabling/disabling recursion

Signed-off-by: David Galloway <dgallowa@redhat.com>

downstream-setup: define empty var for repos_to_remove

This var got missed when working on
https://github.com/ceph/ceph-cm-ansible/pull/287

Fixes: http://tracker.ceph.com/issues/17922
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #290 from ceph/wip-firmware

New role for updating firmware

Reviewed-by: Dan Mick <dmick@redhat.com>

firmware: Add README for role

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add NVMe firmware update support for smithi

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add BMC update support for smithi

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add Areca RAID controller support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #287 from ceph/wip-ansible22

testnode: Define a few empty variables for ansible v2.2 compatibility

firmware: New role.  Adding BIOS and BMC support for mira

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #289 from ceph/wip-rhel73

Add RHEL7.3 support

Reviewed-by: Dan Mick <dmick@redhat.com>

Add RHEL7.3 support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #288 from ceph/wip-nrpe-rhel

common: Install a few additional packages for NRPE

common: Install a few additional packages for NRPE

check_load nagios plugin needs to be installed on RHEL and CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Define a few empty variables for ansible v2.2 compatibility

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #286 from ceph/wip-users-become

Use "become: true" for users role

Use "become: true" for users role

This is needed if the users role is called manually.  Typically it's
called via the common role and "become: true" is inherited.

But in the case of just needing to update update the teuthology_user's pubkeys with @all.pub, just calling the users role manually is quicker.  sudo access is obviously required to modify users and groups.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #285 from ceph/wip-beta2

common: Change method of detecting beta distro

common: Change method of detecting beta distro

It was recently discovered that Release Candidate ISOs of RHEL don't output "Beta" or
"Alpha" in `lsb_release` output.  Therefore, RHEL RC Distros were
registering with CDN and not putting beta_repos in place.

This new method registers every RHEL system with CDN, checks if there are
any available matching repos based on ansible_distribution_version, and
either:
  - Unregisters from CDN and runs beta_distros.yml if there are no CDN repos
  - Continues with setting up desired rhsm_repos

I also added some additional working to task descriptions to hopefully
claer up what's going on in this playbook since there are a lot of when
and if statements.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #283 from ceph/wip-common-updates

Updates to common role

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Add nagios check_mem command

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Create nagios_allowed_hosts var for lab-specific nagios IPs

Signed-off-by: David Galloway <dgallowa@redhat.com>

Add common.yml playbook file

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #282 from ceph/wip-vmlist

Add vmhosts to vmlist.py and run virsh in read-only mode

Reviewed-by: Dan Mick <dmick@redhat.com>

Add vmhosts to vmlist.py and run virsh in read-only mode

'virsh -r' allows vmlist.py to work with RHEV hypervisor hosts

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #280 from ceph/wip-ubuntu-groups

users: Leave managed_admin_users' other group memberships alone

Reviewed-by: Dan Mick <dmick@redhat.com>

users: Leave managed_admin_users' other group memberships alone

This change is mainly so the users role can be run on vps_hosts.

Previously, in order to update the ubuntu user's authorized_keys on
vps_hosts, the testnodes role had to be run which caused ubuntu to be
removed from the libvirtd group.

The ubuntu user is in managed_admin_users on vps_hosts so this will
ensure the user is added to sudo and left in the libvirtd group.

managed_users, on the other hand, we want to make sure are only in
groups we specify so the "Create all users without sudo access." task is
left as-is (without append: yes).

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #279 from ceph/wip-beta-repos

defaults: beta_repos must be a dict

defaults: beta_repos must be a dict

This causes ceph-cm-ansible to fail every teuthology job due to
the bad default: 'with_dict expects a dict'

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #278 from ceph/wip-beta-distros

Add support for testing RHEL beta distros using internal repos

cobbler: redhat-lsb-core package is required for ansible_lsb variables

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnodes: Add support for internal RHEL beta repos

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #277 from ceph/wip-teuthology

teuthology role updates