Help users locate cobbler's web UI

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #66 from ceph/wip-puddle-updates

Puddle updates

puddle: add ceph 1.3 async

Add a configuration file to do Puddle generation for ceph 1.3 async.

puddle: update rh-common errata

Update Puddle's configuration for the latest RH-COMMON errata currently
in progress.

puddle: update URL variable conventions

1) Remove "_z" from the RHEL repository variables. There's no point in
distinguishing "RHEL 7 z" from "RHEL 7".

2) Add "_server" to distinguish the RHEL Server variant from the
Workstation/Client/ComputeNode variants.

Merge pull request #65 from ceph/wip-yum-tx

Remove saved yum transactions

Remove saved yum transactions

Signed-off-by: Zack Cerza <zack@redhat.com>

Don't try to remove a missing package

My previous commit had a bug. First, check if ceph-debuginfo is present.
If it's not, don't try to remove it.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #64 from ceph/wip-bz-1234967

Work around BZ#1234967

Work around BZ#1234967

We have some corrupt ceph-debuginfo packages that are causing yum to die
with a UnicodeDecodeError. Use rpm to remove them for now.

https://bugzilla.redhat.com/show_bug.cgi?id=1234967

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #63 from ceph/wip-skip-entitlements

Gracefully skip registration

Merge pull request #62 from ceph/wip-usermod

Don't modify the teuthology_user if it is in use

Gracefully skip registration

If entitlements.yml is not found, don't attempt to register

Signed-off-by: Zack Cerza <zack@redhat.com>

Don't modify the teuthology_user if it is in use

This is to work around cases where the user exists, with a different
uid, and we are currently logged in as that user:

msg: usermod: user ubuntu is currently logged in

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #61 from ceph/wip-user-filter

users: add a 'users' var to act as a filter

users: add a 'users' var to act as a filter

If 'users' is provided it will filter 'managed_users'
and 'managed_admin_users' by the usernames provided in 'users'.

'users' must be a list of usernames as strings.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #59 from ceph/wip-readme-updates

readme updates explaining the use of a separate secrets repo

Merge pull request #58 from ceph/wip-user-docs

users: add documentation for the users role

Merge pull request #56 from ceph/wip-cobbler-complete

Fully deploy a cobbler node

Format multiline tasks more nicely

Signed-off-by: Zack Cerza <zack@redhat.com>

Format multiline tasks more nicely

Signed-off-by: Zack Cerza <zack@redhat.com>

Format multiline tasks more nicely

Signed-off-by: Zack Cerza <zack@redhat.com>

Run cobbler sync at the end of cobbler_systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Create /root/.ssh before putting keys there

Signed-off-by: Zack Cerza <zack@redhat.com>

Move cobbler system population to new role

This creates the new cobbler_systems role, which is run after the
cobbler and cobbler_profile roles

Signed-off-by: Zack Cerza <zack@redhat.com>

Set the server by editing /etc/cobbler/settings

Otherwise, using 'cobbler setting edit' might not work

Signed-off-by: Zack Cerza <zack@redhat.com>

Always include package-type vars

Signed-off-by: Zack Cerza <zack@redhat.com>

Set pxe_just_once to 1

Otherwise we re-provision on every boot

Signed-off-by: Zack Cerza <zack@redhat.com>

Tell ansible to ignore host keys

Signed-off-by: Zack Cerza <zack@redhat.com>

Symlink /etc/ansible/{hosts,secrets}

Signed-off-by: Zack Cerza <zack@redhat.com>

cephlab_preseed_late: exit with status 0

Signed-off-by: Zack Cerza <zack@redhat.com>

Install gawk

For snippets/cephlab_post_install_kernel_options

Signed-off-by: Zack Cerza <zack@redhat.com>

After restarting cobbler, wait for it to start

Signed-off-by: Zack Cerza <zack@redhat.com>

Add virtualenv to .gitignore

Signed-off-by: Zack Cerza <zack@redhat.com>

Add a 'settings' tag

Signed-off-by: Zack Cerza <zack@redhat.com>

Use nmap instead of ncat for port scanning

netcat is apparently unavailable on RHEL7

Signed-off-by: Zack Cerza <zack@redhat.com>

Install extra cobbler packages for yum/apt systems

syslinux is for bootloaders; pykickstart is for kickstart file
generation; fence-agents is for IPMI etc. support; nmap is for port
scanning.

Signed-off-by: Zack Cerza <zack@redhat.com>

Make the cobbler role pull in the secrets role

Signed-off-by: Zack Cerza <zack@redhat.com>

Run cobbler sync and cobbler check

Signed-off-by: Zack Cerza <zack@redhat.com>

Enable tftpd

Signed-off-by: Zack Cerza <zack@redhat.com>

Set server, next_server and signature_url

Signed-off-by: Zack Cerza <zack@redhat.com>

Ensure cobbler and httpd are started *and* enabled

Signed-off-by: Zack Cerza <zack@redhat.com>

Deep-merge distros and extra_distros

So that we can override e.g. a mirror URL and keep all the other key/value
pairs

Signed-off-by: Zack Cerza <zack@redhat.com>

Add and use SHA256 when downloading ISOs

Signed-off-by: Zack Cerza <zack@redhat.com>

Populate systems

Disable netboot by default, so we don't accidentally reimage systems
unintentionally

Signed-off-by: Zack Cerza <zack@redhat.com>

Add cobbler SSH keys from secrets repo

Signed-off-by: Zack Cerza <zack@redhat.com>

Add tasks for yum and apt systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Add vars for yum and apt systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Upload etc_files

Signed-off-by: Zack Cerza <zack@redhat.com>

Add tasks to update settings

Signed-off-by: Zack Cerza <zack@redhat.com>

Add .gitignore

Signed-off-by: Zack Cerza <zack@redhat.com>

Add etc_files and settings

Signed-off-by: Zack Cerza <zack@redhat.com>

Add /etc/cobbler/users.digest

This sets the cobbler password

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #60 from ceph/wip-ansible-user-ssh-keys

Change 'ssh_keys' to 'ansible_user_ssh_keys' to clarify usage

Change 'ssh_keys' to 'ansible_user_ssh_keys' to clarify usage

Signed-off-by: Dan Mick <dan.mick@redhat.com>

users: add documentation for the users role

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

readme updates explaining the use of a separate secrets repo

We store everything related to our inventory in a repo separate from
this one. This commit explains that a bit better and the reasoning
behind it.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Use |sort instead of .sort()

The latter does an in-place sort, which meant we were comparing '' to
''. Whoops.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #57 from ceph/wip-fix-ubuntu-repos

testnode: fixes a bug keeping apt repos from being added

testnode: fixes a bug keeping apt repos from being added

I needed to cast ansible_distribution_major_version to an int for the
comparsion to work.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #55 from ceph/wip-downstream-check-repos

downstream-setup: ignore errors when disabling or enabling repos

downstream-setup: ignore errors when disabling or enabling repos

The lineinfile module fails if dest doesn't exist. We want this to fail
silently instead. The ansible output still does a good job of letting
you know a task failed without failing the entire playbook.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #54 from ceph/wip-precise-support

testnode: do not start rpcbind on precise

testnode: do not start rpcbind on precise

rpcbind does not provide a way to be managed with upstart on precise.
This creates a var we can use to toggle this task on and off per distro
as the other distros we support are ok with starting and enabling rpcbind.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #53 from ceph/wip-precise-sudo

cobbler: set the mode to 0440 on /etc/sudoers.d/cephlab_sudo

cobbler: set the mode to 0440 on /etc/sudoers.d/cephlab_sudo

Apparently most other distros default anything in /etc/sudoers.d to
0440 except precise. Precise, by default, sets the mode of
/etc/sudoers.d/cephlab_sudo to 0664 which completely breaks sudo usage.
This makes cobbler explicitly set the mode to 0440.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #49 from ceph/wip-vivid-support

Support for ubuntu vivid

Merge pull request #52 from ceph/wip-disable-repo

downstream-setup: add tasks to disable and enable yum repos.

downstream-setup: add tasks to disable and enable yum repos.

This works similar to downloading yum_repos. You can specific a repo
file to disable using 'disable_yum_repos' and enable them by using
'enable_yum_repos'. If you use 'disable_yum_repos' with 'cleanup' it
will enable the repos listed in 'disable_yum_repos' - this feature is
used with teuthology and the Ansible task.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #51 from ceph/wip-downstream-cleanup

downstream-setup: use 'cleanup' instead of 'teardown'

downstream-setup: use 'cleanup' instead of 'teardown'

We want this change because using 'teardown' within teuthology was
confusing because we already have a method called 'teardown' on
class-based tasks.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: enable nfs-server on rhel 7.x

In the port from ceph-qa-chef I decided to enable nfs-server by default
on all distros even though chef only enabled it for rhel 7.x. We've
since discovered that enabling it on vivid causes errors, so we're not
enabling it for all distros anymore. This makes sure we enable it still
on rhel 7.x.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: restart nfs-kernel-server and don't enable it.

We found an issue where ansible would fail to enable nfs-kernel-server
on vivid. It's already enabled by default anyway, so let's remove that
to avoid the error.

Also, ceph-qa-chef used to only restart nfs-kernel-server for ubuntu and
didn't enable so let's go back to that functionality.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: do not provide custom repos or sources.list for vivid

We'll be using distro provided packages for vivid so skip over defining
our custom packages for vivid.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: keep cobbler from messing with sources.list

We want this because on vivid we want to use the distro provided sources
and when we use the cobbler snippet it wipes out those values in
sources.list. On the other versions of ubuntu we use the testnodes
playbook to provide our own sources and repos because we are currently
building packages for those, but don't want that burden for vivid.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: add a var file for ubuntu trusty

There are some packages listed here that we install on other versions of
ubuntu but can't on trusty.  I'm unsure if these are actually needed
though or if they're just cruft.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: remove mencoder from package install list for ubuntu systems

It was decided this was not needed any further, so let's stop installing
it.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

testnode: Add ubuntu vivid sshd_config

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #47 from ceph/rhel-6-xfsprogs

Intelligently enable repo sets

Intelligently enable repo sets

Before this, once we were subscribed, we never care *what* we were
subscribed to.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #50 from ceph/wip-selinux

Enable SELinux on yum systems

Enable SELinux on yum systems

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #46 from ceph/wip-ubuntu-network-snippet

cobbler: adds cephlab_ubuntu_network snippet

Merge pull request #48 from ceph/wip-downstream-teardown

downstream-setup: make yum_repos clean up after itself on teardown

downstream-setup: make yum_repos clean up after itself on teardown

This lets us pass a teardown==True var to downstream-setup with the
yum_repos var defined and it will instead remove the repos defined in
yum_repos instead of downloading them.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

cobbler: adds cephlab_ubuntu_network snippet

This is used to set the network connectivity for ubuntu nodes after
imaging using DHCP.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Add rhel-scalefs-for-rhel-6-server-rpms

For xfsprogs

Signed-off-by: Zack Cerza <zack@redhat.com>

Include relevant vars in entitlements tag

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #45 from ceph/wip-rhel-hostname

Also correct hostnames on RHEL6

Also correct hostnames on RHEL6

Fix them if they are 'localhost' as well.

Signed-off-by: Zack Cerza <zack@redhat.com>

Re-add --size to part line

RHEL6 needs it and RHEL7 doesn't seem to mind.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #44 from ceph/wip-fix-kernel-logging

Fix typo in kernel_logging.sh

Fix typo in kernel_logging.sh

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #43 from ceph/wip-11825

Use all of /dev/sda for /

Use all of /dev/sda for /

http://tracker.ceph.com/issues/11825

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #41 from ceph/wip-tag-kernel-logging

Add kernel_logging tag

Merge pull request #42 from ceph/wip-user-shell

Set all created users' shells to /bin/bash

Set all created users' shells to /bin/bash

They were ending up with sh, which is horrible

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #40 from ceph/wip-cobbler-iso-path

Set iso_name and iso_path when not downloading

Add kernel_logging tag

So that we can easily run just those actions against testnodes

Signed-off-by: Zack Cerza <zack@redhat.com>