testnode: Ensure fuse, kvm and disk groups exist.

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip more kernel tasks in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip static IP setup in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip perl user_xattr stuff in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

common: Don't use systemd in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

users: Skip role if keys_repo is undefined

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip certain actions in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #668 from ceph/fix-failure-log

failure_log: Use a default YAML representer

Merge pull request #670 from ceph/osrelease

testnode: Alternate method of detecting Stream (for Openstack instances)

testnode: Install lvm2 on CentOS 8 Stream

This package is missing from the vanilla Openstack instance image.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Alternate method of detecting Stream

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #669 from kshtsk/wip-supervisord-protect-home

roles/paddles: do not ProtectHome=true for supervisord

roles/paddles: do not ProtectHome=true for supervisord

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

failure_log: Use a default YAML representer

Before, we looked recursively for a certain Ansible type in the values
of the dict; this broke when another type was added in Ansible, but was
made worse by the type being used in _keys_, not just values.

This is a better method.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #667 from cbodley/wip-arrow-revert

Revert "testnode: Add Apache Arrow repo"

Revert "testnode: Add Apache Arrow repo"

This reverts commit 3f960fe1b6957bdfb551bd4e53ad275d0d446855.

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #665 from ceph/wip-dns-collision

nameserver: Check for and print IP collisions

nameserver: Check for and print IP collisions

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #664 from ceph/downstream-podman

container-host: distro-specific secrets file

container-host: distro-specific secrets file

`container_packages` was getting set to `podman` for all downstream distros.  That won't work for Ubuntu so we'll use distro-specific secrets overrides.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #663 from ceph/fix-epel

common: Fix epel repo template

common: Fix epel repo template

:(

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #661 from ceph/epel9

common: Enable epel9

common: Enable epel9

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #660 from ceph/wip-cobbler-update

cobbler: Run yum update during CentOS Stream install

Merge pull request #659 from ceph/wip-tags

dhcp-server: Add a packages tag so I can skip the task

cobbler: Run yum update during CentOS Stream install

It occurred to me that the CentOS 8 Stream ISO is probably always going to be outdated so we can just run 'yum update' during kickstart.  We *don't* want to do this for non-Stream distro because it'll update a RHEL8.4 image to RHEL8.5, for example.

Signed-off-by: David Galloway <dgallowa@redhat.com>

dhcp-server: Add a packages tag so I can skip the task

Takes forever on store01

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #658 from ceph/wip-setuptools

container-host: Install python dependencies

container-host: Install python dependencies

I need this role for Jenkins builders.  They don't get setuptools or pip installed during the common role.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #657 from ceph/wip-cobbler-rhel85

Adding rhel8.5 to sepia cobbler

Adding rhel8.5 to sepia cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #649 from ceph/wip-suse-nrpe

common: Add nrpe support to zypper systems

Merge pull request #655 from ceph/wip-systemd-update

Adding systemd to the list of packages to upgrade in centos stream version 8

Adding systemd to the list of packages to upgrade in centos_8

Fixes: https://tracker.ceph.com/issues/52923
Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #654 from ceph/wip-arrow

testnode: Add Apache Arrow repo

Merge pull request #653 from kshtsk/wip-pulpito-pull

roles/pulpito: support github pull branches to checkout

pulpito/README: add info about variables

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

paddles: add info about pull request branches

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: add leap 15.3 vars

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/paddls: fix 'Set the alembic revision' step

Addresses error:
    sqlalchemy.exc.ArgumentError: Could not parse rfc1738 URL from string '/bin/sh: pecan: command not found'

Fixes: ceph/paddles@925aff2
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/paddles: support github pull branches to checkout

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/pulpito: support github pull branches to checkout

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

Merge pull request #648 from ceph/wip-paddles-container

paddles: Enable containerized deployment

paddles: Update README

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Add Apache Arrow repo

Some changes to Rados GW will require some dependencies in this repo.  See https://github.com/ceph/ceph/pull/40802

Signed-off-by: David Galloway <dgallowa@redhat.com>

users: Add a missing pubkeys tag

paddles: Use gzip compression

Signed-off-by: Zack Cerza <zack@redhat.com>

paddles: Enable containerized deployment

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #650 from ceph/wip-libgnutls30

testnode: Install libgnutls30 on Ubuntu systems

testnode: Install libgnutls30 on Ubuntu systems

Fixes: https://twitter.com/letsencrypt/status/1443621997288767491
Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Add nrpe support to zypper systems

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #647 from ceph/wip-fsid

lrc: Have logrotate cronjob optionally run the cephadm-created conf

lrc: Have logrotate cronjob optionally run the cephadm-created conf

cephadm manages a different logrotate file.  That file's name is the cluster FSID.

So I'll defined lrc_fsid in the secrets repo and this task will change the cronjob to run that logrotate file instead of the ceph-common one (that wasn't doing anything useful anyway).

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #644 from ceph/wip-jenkins-restore-playbook

Adding jenkins ocp4 jobs restore playbook

Adding jenkins ocp4 jobs restore playbook

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #643 from tchaikov/wip-venv

roles/testnode/vars/ubuntu_20: add python3-venv to packages

roles/testnode/vars/ubuntu_20: add python3-venv to packages

since we are going to replace virtualenv with "python3 -m venv",
let's add python3-venv.

keep python3-virtualenv around for a while just in case.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #642 from tchaikov/wip-add-python3-asyncssh

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

python3-asyncssh is not included by EPEL8 yet, but mgr-cephadm requires
it. see also https://tracker.ceph.com/issues/44676

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #641 from ceph/wip-fix-indentation

Fixed indentation on rook-os-update.yml

Fixed indentation on rook-os-update.yml

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #640 from ceph/wip-revert

Revert "Merge pull request #635 from ceph/wip-python-pip"

Revert "Merge pull request #635 from ceph/wip-python-pip"

This reverts commit 623931530c8b8928635fc3b151df1f985d2e12e0, reversing
changes made to 91da996a7045d0029340af7f0bcb7bb7650105e7.

Merge pull request #635 from ceph/wip-python-pip

container-host: Install pip too

Merge pull request #634 from ceph/wip-rook-jenkins-update

Adding the rook-jenkins-update.yml and rearranging the role

Adding the rook-jenkins-update.yml and rearranging the role

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #639 from ceph/wip-powertools2

testnode: Install PowerTools repo on CentOS non-stream too

testnode: Install PowerTools repo on CentOS non-stream too

Fixes: https://tracker.ceph.com/issues/51638#note-5
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #638 from ceph/wip-powertools

Add PowerTools repo to CentOS 8 Stream

testnode: Delete correct Stream repos

This was taking AppStream repos with it on non-Stream distros.  I don't think it was causing issues but it was deleting the wrong files nonetheless.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Define addl CentOS8 Stream repo

Fixes: https://tracker.ceph.com/issues/51638
Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Move stream-specific tasks to separate task list

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #637 from ceph/wip-lsb

testnode: Install redhat-lsb-core

testnode: Install redhat-lsb-core

This usually gets installed via Cobbler during FOG image capturing.  That doesn't do us any good when FOG isn't being used.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #636 from ceph/wip-fromhosts

public_facing: Support defining a src port for UFW rules

public_facing: Support defining a src port for UFW rules

Signed-off-by: David Galloway <dgallowa@redhat.com>

container-host: Install pip too

This was needed on CentOS8 and Ubuntu Focal Jenkins builders.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #632 from ceph/wip-git

container-host: Ensure git is installed

container-host: Ensure git is installed

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #631 from ceph/wip-notin

cobbler: Fix ansible conditional

Merge pull request #630 from ceph/wip-centos84

Add CentOS 8.4

cobbler: Fix ansible conditional

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #629 from ceph/wip-rhel84

RHEL 8.4

Add CentOS 8.4

Signed-off-by: David Galloway <dgallowa@redhat.com>

RHEL 8.4

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #628 from ceph/wip-anybody

We can use this for any system

We can use this for any system

But the ipmi group makes more sense

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #627 from ceph/wip-comma

testnode: Always ifup the secondary NIC

testnode: Always ifup the secondary NIC

If the NIC was already down, `ifdown` causes the playbook to fail.  We want to always (at least attempt to) take the NIC down, then bring it back up.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #626 from ceph/wip-move-sentinel

testnode: Write sentinel file after container-host role

testnode: Write sentinel file after container-host role

Now that we're running the entire cephlab.yml playbook during Cobbler kickstart, the sentinel file is getting touched while the container-host playbook is still running.

This change will still write the /ceph-qa-ready sentinel file during the testnodes role if the testnodes role got called directly

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #625 from ceph/wip-cephlabnottestnodes

cobbler: Run all available playbooks during postinstall

cobbler: Run all available playbooks during postinstall

Not just testnodes playbook

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #624 from ceph/wip-klbahsr

Allow defining an alternate container_packages var

container-host: Try to import an alternate {{ container_packages }}

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Do not install podman-docker here

We will install it in the container-host role if we need it.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #609 from ceph/wip-ignore-snap

common: Ignore /snap mountpoints when checking disk usage

Merge pull request #622 from ceph/wip-c9stream

Add CentOS 9 Stream

Add CentOS 9 Stream

Signed-off-by: David Galloway <dgallowa@redhat.com>