testnode: Retry zapping disk if sgdisk fails the first time

I've seen `sgdisk -Z` fail the first time on RMA replacement drives from HGST but succeed on re-running it.

@alfredodeza recommended we add a retry.  Can't hurt.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Shred any leftover ceph osd metadata on non-root partitions

Fixes: http://tracker.ceph.com/issues/20533
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #322 from ceph/wip-www

public_facing: Create separate task yml for letsencrypt/nginx/ipv6 hosts

public_facing: Create separate task yml for letsencrypt/nginx/ipv6 hosts

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #321 from ceph/wip-download

public_facing: Changes to download.ceph.com crontab

public_facing: Changes to download.ceph.com crontab

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #320 from ceph/wip-rhel74

cobbler: Add RHEL 7.4

Merge pull request #319 from ceph/wip-18126

Repo changes for Ubuntu testnodes

testnode: Only install custom fastcgi repo on Trusty testnodes

Now that we're running apt/repos.yml tasks on Xenial, we can move
the fastcgi repo to ubuntu_14.yml since it's exclusive to that distro
version.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Permanently disable/remove custom blkin repo

See https://github.com/ceph/ceph-cm-ansible/pull/156

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Perform repo tasks on all Ubuntu testnodes

Just realized apt/repos.yml hasn't been getting run on Xenial testnodes.
There are some important tasks in there that should be run (e.g., Removing custom repos from
/etc/apt/sources.list.d).

We aren't using apt-mirror for Xenial so I've limited writing the master
sources.list to Trusty and earlier.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Add custom repo to Xenial to provide newer version of valgrind

Fixes: http://tracker.ceph.com/issues/18126#note-11
Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Add RHEL 7.4

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #317 from ceph/wip-13522

Update libgoogle-perftools4 on Xenial

Update libgoogle-perftools4 on Xenial

Fixes: http://tracker.ceph.com/issues/13522#note-51
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #316 from ceph/wip-retry-unregister

common: Retry unregister beta distro from CDN

common: Retry unregister beta distro from CDN

Seeing intermittent `subscription-manager unregister` failures in Octo.
Since the register task has retries, I see no reason unregistering
can't.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #314 from ceph/wip-www-cron

public_facing: Add cronjobs for www.ceph.com

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #315 from ceph/wip-new-ansible

common: Workaround for ansible bug conditional evaluation

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Workaround for new ansible conditional evaluation bug

Prior to ansible v2.2.2.0, if the first conditional was false, the second
conditional wasn't checked.

This change makes sure nrpe-selinux.yml is only included on RHEL/CentOS
which are the only OSes that will have stdout for the selinux_status
var.

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add cronjobs for www.ceph.com

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #313 from ceph/wip-fix-312

common: Fix a bug in PR #312

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Fix a bug in PR #312

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #312 from ceph/wip-15439

common: Clean apt cache before updating it

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Clean apt cache before updating it

This is the first apt transaction that gets run in the common role.

Fixes: http://tracker.ceph.com/issues/15439
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #307 from ceph/wip-public-facing

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #311 from ceph/wip-vps-replace

tools: Replace mira091 w mira005 and add missing hv03

Reviewed-by: Dan Mick <dmick@redhat.com>

tools: Replace mira091 w mira005 and add missing hv03

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #310 from ceph/wip-19126

common: Reinstall selinux-policy-targeted if needed

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Reinstall selinux-policy-targeted if needed

This ensures module file integrity so we can build the nrpe selinux
module in the proceeding tasks.

Fixes: http://tracker.ceph.com/issues/19126
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #309 from ceph/wip-19126

common: Delete leftover SELinux policy modules

Reviewed-by: Dan Mick <dmick@redhat.com>

common: Delete leftover SELinux policy modules

Jobs were occasionally failing due to
/etc/selinux/targeted/active/modules/400/mod_fastcgi/lang_ext being
corrupt.  mod_fastcgi is removed and reinstalled with every
testnodes.yml run anyway so this just makes sure valid SELinux policy
modules are put in place.

Fixes: http://tracker.ceph.com/issues/19126
Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Disable PasswordAuthentication in sshd config

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add status.sepia.ceph.com-specific tasks

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add download.ceph.com-specific tasks

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Add fail2ban support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #308 from dmick/master

Reduce 'internal_poll_interval' to stem the CPU usage tide

Reduce 'internal_poll_interval' to stem the CPU usage tide

See https://github.com/ansible/ansible/pull/16560 and
https://github.com/ansible/ansible/issues/14219

Signed-off-by: Dan Mick <dan.mick@redhat.com>

public_facing: Enable ufw support

Signed-off-by: David Galloway <dgallowa@redhat.com>

public_facing: Create base role config

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #299 from ceph/wip-nsupdate

Add role for nsupdate_web

Add role for nsupdate_web

See https://github.com/zmc/nsupdate-web/

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #306 from ceph/wip-lsbrelease

nameserver: Install redhat-lsb-core for `lsb_release`

Reviewed-by: Dan Mick <dmick@redhat.com>

nameserver: Install redhat-lsb-core for `lsb_release`

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #305 from dmick/master

testnode/tasks/ntp: remove '/etc/network/if-up.d/ntpdate' on Xenial

testnode/tasks/ntp: remove '/etc/network/if-up.d/ntpdate' on Xenial

It's buggy (see comment in code) and we don't need it, because
teuthology does what it would do anyway.  Supposed to be fixed in
a later version of the Debian package which is in Yakkety.

Fixes: http://tracker.ceph.com/issues/18837
Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #281 from rjfd/wip-opensuse-upstream-pr

Support for running teuthology suites in OpenSUSE Leap images

Merge pull request #303 from ceph/wip-teuth-mime

teuthology: Correct MIME type spec for log files

teuthology: Correct MIME type spec for log files

Gzipped files were being served as text/plain. Instead of applying text/plain to everythincg, extend the default MIME configuration to serve *.log as text/plain.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #302 from ceph/wip-named-chown

nameserver: Fix permissions on /var/named/zones

nameserver: Fix permissions on /var/named/zones

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #301 from ceph/wip-cloud-dns

Ensure search domain and domain are set properly in resolv.conf

Ensure domain is set in resolv.conf

Signed-off-by: Zack Cerza <zack@redhat.com>

Ensure search domain is set in resolv.conf

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #300 from ceph/wip-dns-slave

nameserver: Add support for BIND slave nameservers

Reviewed-by: Dan Mick <dmick@redhat.com>

nameserver: Add support for BIND slave nameservers

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #298 from ceph/wip-centos73

Add CentOS 7.3 to Cobbler

Add CentOS 7.3 to Cobbler

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #297 from ceph/wip-ddns-in-front

nameserver: Dynamic DNS support

Reviewed-by: Dan Mick <dmick@redhat.com>

nameserver: Enable ntpd

Required for dynamic DNS updates to work

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Configure SELinux for dynamic DNS support

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Support dynamic DNS in named config

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Support dynamic DNS zone in records task

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #295 from ceph/wip-dhcp-cleanup

Cleanup cobbler network setup stuff for Ubuntu testnodes

Reviewed-by: Dan Mick <dmick@redhat.com>

roles: testnode: Support for openSUSE Leap

Signed-off-by: Ricardo Dias <rdias@suse.com>

roles: common: Support for openSUSE Leap

Signed-off-by: Ricardo Dias <rdias@suse.com>

testnode: do not configure Nagios on zypper-based systems

Nagios is only used in the Sepia lab. For zypper-based systems we are currently
targeting OpenStack only.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Add sshd_config template for openSUSE Leap

Signed-off-by: Nathan Cutler <ncutler@suse.com>

cleanup: remove fullstops in tasks/ssh.yml

Signed-off-by: Nathan Cutler <ncutler@suse.com>

testnode/templates/ssh: unify permissions to 644

Signed-off-by: Nathan Cutler <ncutler@suse.com>

testnode/tasks/main.yml: support openSUSE

Signed-off-by: Nathan Cutler <ncutler@suse.com>

tasks/main.yml: convert comments into names

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Add zypper_systems.yml (straight copy from yum_systems.yml)

cobbler_profile: Concede to systemd NIC naming methods

Setting biosdevname=0 was causing issues with NICs being renamed after
cobbler reimage.  The system would reimage/install fine but the NIC would have a
different name on firstboot.

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Remove cephlab_ubuntu_network snippet

Just cruft at this point.  It hasn't been used since
05267fe001432d326c30262d4b07d1775a2ad0d4

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #294 from ceph/wip-18067

testnode: Install libtool-bin for building xfstests

testnode: Install libtool-bin for building xfstests

Fixes: http://tracker.ceph.com/issues/18067
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #293 from ceph/wip-zap-disks

Zap all non-root disks on testnodes

cobbler: Install gdisk for use with testnodes zap ansible tag

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: zap disks after cobbler reimage

Added to first line to make sure it's run when using -stock profiles

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Zap GPT and MBR on all disks but root

Fixes: http://tracker.ceph.com/issues/15951
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #292 from ceph/wip-dns-recurse

nameserver: Add support for enabling/disabling recursion

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #291 from ceph/wip-17922

Updates to downstream_setup role

Reviewed-by: Dan Mick <dmick@redhat.com>

downstream_setup: Dynamically evaluate when statements in main.yml

See https://github.com/ansible/ansible/issues/18483

Signed-off-by: David Galloway <dgallowa@redhat.com>

nameserver: Add support for enabling/disabling recursion

Signed-off-by: David Galloway <dgallowa@redhat.com>

downstream-setup: define empty var for repos_to_remove

This var got missed when working on
https://github.com/ceph/ceph-cm-ansible/pull/287

Fixes: http://tracker.ceph.com/issues/17922
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #290 from ceph/wip-firmware

New role for updating firmware

Reviewed-by: Dan Mick <dmick@redhat.com>

firmware: Add README for role

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add NVMe firmware update support for smithi

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add BMC update support for smithi

Signed-off-by: David Galloway <dgallowa@redhat.com>

firmware: Add Areca RAID controller support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #287 from ceph/wip-ansible22

testnode: Define a few empty variables for ansible v2.2 compatibility

firmware: New role.  Adding BIOS and BMC support for mira

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #289 from ceph/wip-rhel73

Add RHEL7.3 support

Reviewed-by: Dan Mick <dmick@redhat.com>

Add RHEL7.3 support

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #288 from ceph/wip-nrpe-rhel

common: Install a few additional packages for NRPE

common: Install a few additional packages for NRPE

check_load nagios plugin needs to be installed on RHEL and CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Define a few empty variables for ansible v2.2 compatibility

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #286 from ceph/wip-users-become

Use "become: true" for users role

Use "become: true" for users role

This is needed if the users role is called manually.  Typically it's
called via the common role and "become: true" is inherited.

But in the case of just needing to update update the teuthology_user's pubkeys with @all.pub, just calling the users role manually is quicker.  sudo access is obviously required to modify users and groups.

Signed-off-by: David Galloway <dgallowa@redhat.com>