nsupdate_web: use .conf extention for opensuse nginx

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
(cherry picked from commit cbb0a82a0380038d33d1b59eb65eed9622ec61d6)

nsupdate_web: copy keys from secrets dir if present

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
(cherry picked from commit bac5f08eca5fa018adb16be9db4457cb42c73039)

Merge pull request #607 from ceph/wip-rhel8-package-list-change

Adding redhat-lsb, firewalld and wget to rhel8 testnodes

Adding redhat-lsb, firewalld and wget to rhel8 testnodes

Fixes: https://tracker.ceph.com/issues/48767
Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #606 from ceph/wip-focal-nosleep

common: Disable sleeping on Ubuntu 20.04 and later

common: Disable sleeping on Ubuntu 20.04 and later

Fixes: https://tracker.ceph.com/issues/49152
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #605 from ceph/wip-keys-branch

users: Support defining different branch

users: Support defining different branch

This will allow one to run the users role prior to a PR being merged.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #604 from ceph/wip-rook-master-update

Creating a new tag for updating the master os - master-update

Creating a new tag for updating the master os - master-update

And also doing changes to the rook-recovery role

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #603 from kshtsk/pulpito-py3

teuthology: py3 for pulpito and paddles

teuthology: ensure scheduler user bin exists

Before copying crontab script we need to ensure the bin directory
exists for scheduler user.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: add opensuse 15.2 specific deps

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: use python3 dependencies

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: py3 for pulpito and paddles

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

Merge pull request #602 from ceph/wip-bothplaces

container-host: Install mirror cert in both podman and docker paths

container-host: Install mirror cert in both podman and docker paths

Fixes: https://tracker.ceph.com/issues/48715
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #601 from ceph/wip-make

testnode: Install make on el8

testnode: Install make on el8

This package isn't included in the cloud image that the Octo PSI nodes use.

Fixes: https://tracker.ceph.com/issues/48751
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #600 from ceph/wip-container-js

container-host: let me skip registries-conf-ctl tasks

container-host: Create tag for registries-conf-ctl

This will let us skip those tasks when we don't want to run them (like on a Jenkins builder)

Signed-off-by: David Galloway <dgallowa@redhat.com>

container-host: Configure Jenkins builders too

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #599 from ceph/wip-ignore-errorsrue

container-host: Ignore service restart error on new kernel

container-host: Ignore service restart error on new kernel

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #598 from ceph/wip-tab

container-host: Fix service restart syntax

container-host: Fix service restart syntax

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #597 from guits/guits-restart-docker

container-host: restart docker service

container-host: restart docker service

Once the mirror has been added in `/etc/docker/daemon.json`
we need to restart the daemon.

This is not very elegant but it's a workaround for now.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #596 from guits/guits-quick_enhancement

container-host: quick improvement in container_mirror code

container-host: quick improvement in container_mirror code

Let's get rid of these consecutives `set_fact`.
We can inject `PATH` variable on the task calling `registries-conf-ctl`
instead.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #595 from ceph/wip-containers

Move container tasks to separate role

Move container tasks to separate role

I would've liked to keep all this in common but there's a chicken and egg situation.

docker and/or podman get installed during the testnode role.  The testnode role can only be run after the common role.  The testnode role is also where some repos are added.

So we need to install docker/podman and configure it after the testnodes role runs.  Since we also want to be able to configure docker/podman on other systems, I couldn't put these tasks in the testnode role.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #594 from ceph/wip-reload

testnode: Restart cachefilesd in new kernel

testnode: Restart cachefilesd in new kernel

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #593 from ceph/wip-fscache

testnode: Install and configure cachefilesd

Merge pull request #592 from ceph/wip-fs

testnode: Basic filesystem and mountpoint support

testnode: Install and configure cachefilesd

Fixes: https://tracker.ceph.com/issues/6373
Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Basic filesystem and mountpoint support

Fixes: https://tracker.ceph.com/issues/6373
This will really only be useful is `drives_to_partition` or `logical_volumes` gets overridden in ansible.cephlab overrides in teuthology yaml.  e.g.,

```
overrides:
  ansible.cephlab:
    vars:
      drives_to_partition:
        nvme0n1:
          device: "/dev/nvme0n1"
          unit: "GB"
          sizes:
            - "0 80"
            - "80 160"
            - "160 240"
            - "240 320"
            - "320 340"
            - "340 400"
          scratch_devs:
            - p1
            - p2
            - p3
            - p4
      filesystems:
        nvme0n1p6:
          device: "/dev/nvme0n1p6"
          fstype: xfs
          mountpoint: "/var/cache/fscache"
```

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #590 from ceph/wip-smart-bruuni

smart.sh enhancements for totally failed drives

common: smart.sh - print serial numbers of bad drives

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: smart.sh - sort failure messages

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Support smart.sh report failed drive

The SSDs in the bruuni, specifically, have mostly catastrophically failed.  There are no details about sectors in the SMART output.  Just obvious failure.  `smart.sh` wasn't capable of detecting that.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #589 from ceph/wip-trust-dockermirror

common: Support for container mirror CA certs

common: Support for container mirror CA certs

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #588 from ceph/wip-chrony-step

Modify playbook to function with chrony

Modify playbook to function with chrony

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #587 from ceph/wip-rhel83

Add RHEL8.3

Add RHEL8.3

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #586 from ceph/wip-rhel79-centos82-cobbler

Adding RHEL7.9 and Centos8.2 to Sepia & Octo

Adding RHEL7.9 and Centos8.2 to Sepia & Octo

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #585 from ceph/wip-lvm2

testnode: Install lvm2 on RHEL8 machines

testnode: Install lvm2 on RHEL8 machines

The PSI nodes downstream don't have lvm2 pre-installed like the baremetal ISO image.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #584 from ceph/wip-centos7-aarch64

Adding Centos-7.8-aarch64 to cobbler

Adding Centos-7.8-aarch64 to cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #583 from dmick/master

teuthology nginx: add gzip_ variables to allow compressed responses

teuthology nginx: add gzip_ variables to allow compressed responses

in particular, gzip_static on allows the server to return file.gz
(if compression is allowable) for files that are requested as "file".
This handles the teuthology.log.gz files that are still referred to as
teuthology.log from pulpito pages.

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #582 from kshtsk/wip-libvirt-zap

testnode: don't zap 'sr' devices

testnode: don't zap 'sr' devices

We don't need zapping of libvirt dvd devices

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

Merge pull request #581 from ceph/wip-option-hostname

dhcp-server: Support for `option host-name` declaration

dhcp-server: Support for `option host-name` declaration

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #580 from ceph/wip-cephkernelugh

all: Ignore more warnings about systemd failing to control init scripts

Merge pull request #579 from ceph/wip-no-copr

testnode: Stop using Ken's copr repo

all: Ignore more warnings about systemd failing to control init scripts

Follow-up to https://github.com/ceph/ceph-cm-ansible/pull/578

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Stop using Ken's copr repo

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #578 from ceph/wip-systemd-init

all: Ignore warnings about systemd failing to control init scripts

all: Ignore warnings about systemd failing to control init scripts

Using the systemd ansible module doesn't help either

https://github.com/ansible/ansible/issues/36585
https://github.com/ansible/ansible/issues/22171

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #577 from ceph/wip-fix-gen

generate-fog-csv: Only print a line if the MAC is defined

generate-fog-csv: Only print a line if the MAC is defined

There's some hosts that are "cobbler_managed" but don't have a MAC and don't need a MAC.  Ansible doesn't help us out any here and print WHICH host doesn't have a MAC.  Just throws an error.

Also, there's no need to gather facts on localhost so I set that to `false`

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #576 from ceph/wip-abrt

testnode: Configure ABRT

testnode: Configure ABRT

Rachana requested this.

Fixes: https://tracker.ceph.com/issues/45824
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #575 from ceph/wip-fw-whoops

dhcp-server: firewalld_cmd.msg has to be defined to be evaluated

dhcp-server: firewalld_cmd.msg has to be defined to be evaluated

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #574 from ceph/wip-nofw-is-fine

dhcp-server: Skip configuring firewalld if not installed

dhcp-server: Skip configuring firewalld if not installed

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #573 from ceph/wip-rc-time

cobbler: Print the date during rc.local

cobbler: Print the date during rc.local

This would have been particularly useful before https://tracker.ceph.com/issues/45341 got fixed so I could say *definitively* that the NIC bouncing was to blame for job failures but it can't hurt to have it now.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #572 from ceph/wip-fk

common: Retry registering for 2 minutes

common: Retry registering for 2 minutes

Satellite, you make me very sad.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #571 from ceph/wip-no-base

testnode: Don't attempt to install base or core

testnode: Don't attempt to install base or core

These groups are already taken care of during Cobbler installation.  We're hitting https://bugzilla.redhat.com/show_bug.cgi?id=1782899 in RHEL8 so let's not bother trying to reinstall during ceph-cm-ansible.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #570 from ceph/wip-release-register

Streamline RHSM transactions

common: Streamline RHEL repo registration

Same thing here as the last commit.  Satellite has slowed down significantly so the first repo would get enabled successfully but the Satellite DB hadn't caught up yet so subsequent repo enablements would throw 500 errors.  This enables all the appropriate repos at the same time reducing the number of times we have to interact with Satellite.

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Set release when registering

Because we're running Satellite in a VM in RHV on Gluster, we get really slow I/O performance.  Sadly *well* below the recommended performance: https://access.redhat.com/solutions/3397771

When attempting to set the release in a task later in this tasklist, Satellite would throw 500 errors because it was busy still trying to let the postgres DB know the system had been registered.

Setting the release during registration will save minutes per registration.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #569 from ceph/wip-retry

common: Retry setting release for 2 minutes

common: Retry setting release for 2 minutes

Getting really REALLY sick of workarounds for ~*~Satellite~*~

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #568 from ceph/wip-retry

common: Retries does nothing without until

common: Retries does nothing without until

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #567 from ceph/wip-retry

common: Retry setting rhsm release

common: Retry setting rhsm release

Why is this even necessary, Satellite?!

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #566 from ceph/wip-set-release

common: Define release with subscription-manager

common: Define release with subscription-manager

See comment

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #565 from ceph/wip-c8

testnode: Fix CentOS repo mirrorlists

testnode: Fix CentOS repo mirrorlists

I think there used to be individual directories with the ansible_lsb.release in the path but now there only seems to be "8" and "8.1.1911" so we'll just use 8.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #564 from ceph/wip-fix-c8

testnode: Fix pip vars for CentOS/RHEL8

testnode: Fix pip vars for CentOS/RHEL8

Apparently ansible is smart enough to figure this out on CentOS/RHEL8 (python3 distros) but not Ubuntu Focal.  So when I manually set the vars for a python3 distro and only included Fossa, it broke CentOS8.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #563 from ceph/wip-focal

Focal Fossa

testnode: Update pip tasks to support pip3

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Shuffle package lists around to support Ubuntu 20.04

It appears Focal doesn't come with python2 anything so the python2 packages are no longer "common" across all Ubuntu distros.

I moved them out of `common_packages` and added them to the appropriate package lists for each distro_majorversion.yml back to Xenial.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: SSH config for Ubuntu 20.04

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Add Ubuntu 20.04 support

Signed-off-by: David Galloway <dgallowa@redhat.com>