Create /root/.ssh before putting keys there

Signed-off-by: Zack Cerza <zack@redhat.com>

Move cobbler system population to new role

This creates the new cobbler_systems role, which is run after the
cobbler and cobbler_profile roles

Signed-off-by: Zack Cerza <zack@redhat.com>

Set the server by editing /etc/cobbler/settings

Otherwise, using 'cobbler setting edit' might not work

Signed-off-by: Zack Cerza <zack@redhat.com>

Always include package-type vars

Signed-off-by: Zack Cerza <zack@redhat.com>

Set pxe_just_once to 1

Otherwise we re-provision on every boot

Signed-off-by: Zack Cerza <zack@redhat.com>

Tell ansible to ignore host keys

Signed-off-by: Zack Cerza <zack@redhat.com>

Symlink /etc/ansible/{hosts,secrets}

Signed-off-by: Zack Cerza <zack@redhat.com>

cephlab_preseed_late: exit with status 0

Signed-off-by: Zack Cerza <zack@redhat.com>

Install gawk

For snippets/cephlab_post_install_kernel_options

Signed-off-by: Zack Cerza <zack@redhat.com>

After restarting cobbler, wait for it to start

Signed-off-by: Zack Cerza <zack@redhat.com>

Add virtualenv to .gitignore

Signed-off-by: Zack Cerza <zack@redhat.com>

Add a 'settings' tag

Signed-off-by: Zack Cerza <zack@redhat.com>

Use nmap instead of ncat for port scanning

netcat is apparently unavailable on RHEL7

Signed-off-by: Zack Cerza <zack@redhat.com>

Install extra cobbler packages for yum/apt systems

syslinux is for bootloaders; pykickstart is for kickstart file
generation; fence-agents is for IPMI etc. support; nmap is for port
scanning.

Signed-off-by: Zack Cerza <zack@redhat.com>

Make the cobbler role pull in the secrets role

Signed-off-by: Zack Cerza <zack@redhat.com>

Run cobbler sync and cobbler check

Signed-off-by: Zack Cerza <zack@redhat.com>

Enable tftpd

Signed-off-by: Zack Cerza <zack@redhat.com>

Set server, next_server and signature_url

Signed-off-by: Zack Cerza <zack@redhat.com>

Ensure cobbler and httpd are started *and* enabled

Signed-off-by: Zack Cerza <zack@redhat.com>

Deep-merge distros and extra_distros

So that we can override e.g. a mirror URL and keep all the other key/value
pairs

Signed-off-by: Zack Cerza <zack@redhat.com>

Add and use SHA256 when downloading ISOs

Signed-off-by: Zack Cerza <zack@redhat.com>

Populate systems

Disable netboot by default, so we don't accidentally reimage systems
unintentionally

Signed-off-by: Zack Cerza <zack@redhat.com>

Add cobbler SSH keys from secrets repo

Signed-off-by: Zack Cerza <zack@redhat.com>

Add tasks for yum and apt systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Add vars for yum and apt systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Upload etc_files

Signed-off-by: Zack Cerza <zack@redhat.com>

Add tasks to update settings

Signed-off-by: Zack Cerza <zack@redhat.com>

Add .gitignore

Signed-off-by: Zack Cerza <zack@redhat.com>

Add etc_files and settings

Signed-off-by: Zack Cerza <zack@redhat.com>

Add /etc/cobbler/users.digest

This sets the cobbler password

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #60 from ceph/wip-ansible-user-ssh-keys

Change 'ssh_keys' to 'ansible_user_ssh_keys' to clarify usage

Change 'ssh_keys' to 'ansible_user_ssh_keys' to clarify usage

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Use |sort instead of .sort()

The latter does an in-place sort, which meant we were comparing '' to
''. Whoops.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #57 from ceph/wip-fix-ubuntu-repos

testnode: fixes a bug keeping apt repos from being added

testnode: fixes a bug keeping apt repos from being added

I needed to cast ansible_distribution_major_version to an int for the
comparsion to work.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #55 from ceph/wip-downstream-check-repos

downstream-setup: ignore errors when disabling or enabling repos

downstream-setup: ignore errors when disabling or enabling repos

The lineinfile module fails if dest doesn't exist. We want this to fail
silently instead. The ansible output still does a good job of letting
you know a task failed without failing the entire playbook.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #54 from ceph/wip-precise-support

testnode: do not start rpcbind on precise

testnode: do not start rpcbind on precise

rpcbind does not provide a way to be managed with upstart on precise.
This creates a var we can use to toggle this task on and off per distro
as the other distros we support are ok with starting and enabling rpcbind.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #53 from ceph/wip-precise-sudo

cobbler: set the mode to 0440 on /etc/sudoers.d/cephlab_sudo

cobbler: set the mode to 0440 on /etc/sudoers.d/cephlab_sudo

Apparently most other distros default anything in /etc/sudoers.d to
0440 except precise. Precise, by default, sets the mode of
/etc/sudoers.d/cephlab_sudo to 0664 which completely breaks sudo usage.
This makes cobbler explicitly set the mode to 0440.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #49 from ceph/wip-vivid-support

Support for ubuntu vivid

Merge pull request #52 from ceph/wip-disable-repo

downstream-setup: add tasks to disable and enable yum repos.

downstream-setup: add tasks to disable and enable yum repos.

This works similar to downloading yum_repos. You can specific a repo
file to disable using 'disable_yum_repos' and enable them by using
'enable_yum_repos'. If you use 'disable_yum_repos' with 'cleanup' it
will enable the repos listed in 'disable_yum_repos' - this feature is
used with teuthology and the Ansible task.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #51 from ceph/wip-downstream-cleanup

downstream-setup: use 'cleanup' instead of 'teardown'

downstream-setup: use 'cleanup' instead of 'teardown'

We want this change because using 'teardown' within teuthology was
confusing because we already have a method called 'teardown' on
class-based tasks.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: enable nfs-server on rhel 7.x

In the port from ceph-qa-chef I decided to enable nfs-server by default
on all distros even though chef only enabled it for rhel 7.x. We've
since discovered that enabling it on vivid causes errors, so we're not
enabling it for all distros anymore. This makes sure we enable it still
on rhel 7.x.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: restart nfs-kernel-server and don't enable it.

We found an issue where ansible would fail to enable nfs-kernel-server
on vivid. It's already enabled by default anyway, so let's remove that
to avoid the error.

Also, ceph-qa-chef used to only restart nfs-kernel-server for ubuntu and
didn't enable so let's go back to that functionality.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: do not provide custom repos or sources.list for vivid

We'll be using distro provided packages for vivid so skip over defining
our custom packages for vivid.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: keep cobbler from messing with sources.list

We want this because on vivid we want to use the distro provided sources
and when we use the cobbler snippet it wipes out those values in
sources.list. On the other versions of ubuntu we use the testnodes
playbook to provide our own sources and repos because we are currently
building packages for those, but don't want that burden for vivid.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: add a var file for ubuntu trusty

There are some packages listed here that we install on other versions of
ubuntu but can't on trusty.  I'm unsure if these are actually needed
though or if they're just cruft.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: remove mencoder from package install list for ubuntu systems

It was decided this was not needed any further, so let's stop installing
it.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: Add ubuntu vivid sshd_config

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #47 from ceph/rhel-6-xfsprogs

Intelligently enable repo sets

Intelligently enable repo sets

Before this, once we were subscribed, we never care *what* we were
subscribed to.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #50 from ceph/wip-selinux

Enable SELinux on yum systems

Enable SELinux on yum systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #46 from ceph/wip-ubuntu-network-snippet

cobbler: adds cephlab_ubuntu_network snippet

Merge pull request #48 from ceph/wip-downstream-teardown

downstream-setup: make yum_repos clean up after itself on teardown

downstream-setup: make yum_repos clean up after itself on teardown

This lets us pass a teardown==True var to downstream-setup with the
yum_repos var defined and it will instead remove the repos defined in
yum_repos instead of downloading them.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: adds cephlab_ubuntu_network snippet

This is used to set the network connectivity for ubuntu nodes after
imaging using DHCP.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Add rhel-scalefs-for-rhel-6-server-rpms

For xfsprogs

Signed-off-by: Zack Cerza <zack@redhat.com>

Include relevant vars in entitlements tag

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #45 from ceph/wip-rhel-hostname

Also correct hostnames on RHEL6

Also correct hostnames on RHEL6

Fix them if they are 'localhost' as well.

Signed-off-by: Zack Cerza <zack@redhat.com>

Re-add --size to part line

RHEL6 needs it and RHEL7 doesn't seem to mind.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #44 from ceph/wip-fix-kernel-logging

Fix typo in kernel_logging.sh

Fix typo in kernel_logging.sh

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #43 from ceph/wip-11825

Use all of /dev/sda for /

Use all of /dev/sda for /

http://tracker.ceph.com/issues/11825

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #41 from ceph/wip-tag-kernel-logging

Add kernel_logging tag

Merge pull request #42 from ceph/wip-user-shell

Set all created users' shells to /bin/bash

Set all created users' shells to /bin/bash

They were ending up with sh, which is horrible

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #40 from ceph/wip-cobbler-iso-path

Set iso_name and iso_path when not downloading

Add kernel_logging tag

So that we can easily run just those actions against testnodes

Signed-off-by: Zack Cerza <zack@redhat.com>

Bump pre-ansible sleep to 30s

Signed-off-by: Zack Cerza <zack@redhat.com>

Set iso_name and iso_path when not downloading

Otherwise we bail when trying to clear the mount point

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #39 from ceph/wip-cobbler-repos

Manage CM repos in cobbler role

Merge pull request #38 from ceph/wip-chef-typica

Port serial console grub work

Reviewed-by: Dan Mick <dmick@redhat.com>

Manage CM repos in cobbler role

These are used by cobbler after reimaging

Signed-off-by: Zack Cerza <zack@redhat.com>

Port serial console grub work

https://github.com/ceph/ceph-qa-chef/commit/22c21baafa562bd003d5a3102d44afdcf1d97a5b

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #10 from ceph/downstream-setup

Adds a new downstream_setup.yml playbook.

Merge pull request #37 from ceph/wip-qa-ready

Testnode: touch /ceph-qa-ready

Testnode: touch /ceph-qa-ready

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #30 from ceph/wip-epel-11628

Adds the ability to opt-out of enabling epel in the common role.

Merge pull request #36 from ceph/cobbler-wget-no-retry

Don't hit the post-install trigger multiple times

Merge pull request #35 from ceph/cobbler-ubuntu-vivid

cobbler: one ubuntu preseed for trusty, precise and vivid

Don't hit the post-install trigger multiple times

Signed-off-by: Zack Cerza <zack@redhat.com>

cobbler: remove the cephlab_trusty.preseed kickstart

This has been obsoleted by cephlab_ubuntu.preseed.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler_profile: add the ability to set kernel options.

We can now provide custom kernel_options and kernel_options_post when
creating a profile. Updating the kernel_options are not idempotent
however as some kernel options are always return from the distro.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler_profile: move kickstart updating tasks into their own yml file.

This also introduce a var, profile_found, which we can reuse for
updating other parts of a profile like kernel options.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: add tags to cobbler_profile roles in cobbler.yml

This allows us to target each profile individually instead of running
the entire playbook to edit one profile.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler_profile: use the mount module instead of command to mount isos

The mount module is idempotent, so we should use that instead.  Also,
clear the mount point each time so that if the playbook fails on the
next run it'll actually remount and complete the rest of the tasks
instead of skipping them because the iso is already mounted.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler_profile: add profiles for ubuntu precise, trusty and vivid.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: add new ubuntu preseed and kernel snippet to defaults/main.yml

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: adds a snippet to create post install kernel options.

This snippet is used by the cephlab_preseed_late script to set the
GRUB_CMDLINE_LINUX value in /etc/defaults/grub to what's defined by
the system, profile or distro that's currently being imaged.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: adds a ubuntu preseed that can be used for multiple versions.

This uses the os_version cobbler variable to decide which version of
ubuntu it's using. This variable is set on the distro that is currently
using the cephlab_ubuntu preseed.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #34 from ceph/wip-distill-updates

puddle: use distill configs from rcm-metadata.git

puddle: skip some cleanup in ceph-distill

The ceph-distill script was deleting some files that distill doesn't
create any more (because we now set "skip_phase = createiso"). Stop
attempting to delete these.

puddle: distill uses "compose" tag

See RT #345524