testnode: Add missing parenthesis to conditional

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #682 from ceph/rhel86

cobbler: RHEL8.6

Merge pull request #681 from ceph/true2

cobbler: RHEL8.6

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Fix jinja2 conditional

https://docs.ansible.com/ansible/latest/dev_guide/testing/sanity/no-tests-as-filters.html

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #680 from ceph/wip-adding-rhel9

Adding rhel9 to sepia cobbler

Adding rhel9 to sepia cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #679 from ceph/inclusive-language

Inclusive language update

Inclusive language update

Issues not addressed here:
- FOG still uses master
- lots of gitbuilder URLs in yaml files and docs referencing master
- named uses 'master zones'

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #678 from ceph/mirrorsbroken

Work around rare CentOS infra mirror mismatch

testnode: Work around rare CentOS infra mirror mismatch

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Fix BaseOS repo name

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #677 from ceph/nginx-yaml

teuthology: Serve yaml files as text/plain

teuthology: Serve yaml files as text/plain

So browers display them rather than download.

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #676 from ceph/dedupe

testnode: Remove duplicated common_yum_repos

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

testnode: make it clearer that centos_8.yml and centos_8_stream.yml get combined

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

testnode: Remove duplicated common_yum_repos

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #675 from ceph/gcc-stream

testnode: Fix CentOS 8 Stream packages list

testnode: Fix CentOS 8 Stream packages list

I guess we were relying on a bug for the past few months. What would happen is centos_8.yml would get pulled in and the `packages` list got populated. Then later when we detect this is CentOS Stream, centos_8_stream.yml would get pulled in which overrode the original `packages` list.

Fixes: https://tracker.ceph.com/issues/55177
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #674 from ceph/failover

common: failovermethod is deprecated

common: failovermethod is deprecated

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #672 from ceph/containerized-nodes

Moving toward supporting containerized testnodes

testnode: Ensure fuse, kvm and disk groups exist.

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip more kernel tasks in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip static IP setup in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip perl user_xattr stuff in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

common: Don't use systemd in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

users: Skip role if keys_repo is undefined

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #671 from ceph/no-umount-var-log

testnode: Filter ansible_mounts with regex

Merge pull request #666 from ceph/strea

Fix non-stream to stream conversion

testnode: Filter ansible_mounts with regex

This catches cases where e.g. /var is on the root volume but /var/log is
not.

Signed-off-by: Zack Cerza <zack@redhat.com>

cobbler: Change the way we convert non-stream to stream

The old method doesn't work since the non-stream repos have moved.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #662 from ceph/ubuntu2004

cobbler_profile: Update Ubuntu 20.04 image URL

testnode: Skip certain actions in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #668 from ceph/fix-failure-log

failure_log: Use a default YAML representer

Merge pull request #670 from ceph/osrelease

testnode: Alternate method of detecting Stream (for Openstack instances)

testnode: Install lvm2 on CentOS 8 Stream

This package is missing from the vanilla Openstack instance image.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Alternate method of detecting Stream

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #669 from kshtsk/wip-supervisord-protect-home

roles/paddles: do not ProtectHome=true for supervisord

roles/paddles: do not ProtectHome=true for supervisord

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

failure_log: Use a default YAML representer

Before, we looked recursively for a certain Ansible type in the values
of the dict; this broke when another type was added in Ansible, but was
made worse by the type being used in _keys_, not just values.

This is a better method.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #667 from cbodley/wip-arrow-revert

Revert "testnode: Add Apache Arrow repo"

Revert "testnode: Add Apache Arrow repo"

This reverts commit 3f960fe1b6957bdfb551bd4e53ad275d0d446855.

Signed-off-by: Casey Bodley <cbodley@redhat.com>

cobbler_profile: Modernize dict combination

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #665 from ceph/wip-dns-collision

nameserver: Check for and print IP collisions

nameserver: Check for and print IP collisions

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #664 from ceph/downstream-podman

container-host: distro-specific secrets file

container-host: distro-specific secrets file

`container_packages` was getting set to `podman` for all downstream distros.  That won't work for Ubuntu so we'll use distro-specific secrets overrides.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #663 from ceph/fix-epel

common: Fix epel repo template

common: Fix epel repo template

:(

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler_profile: Update Ubuntu 20.04 image URL

Old one 404s

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #661 from ceph/epel9

common: Enable epel9

common: Enable epel9

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #660 from ceph/wip-cobbler-update

cobbler: Run yum update during CentOS Stream install

Merge pull request #659 from ceph/wip-tags

dhcp-server: Add a packages tag so I can skip the task

cobbler: Run yum update during CentOS Stream install

It occurred to me that the CentOS 8 Stream ISO is probably always going to be outdated so we can just run 'yum update' during kickstart.  We *don't* want to do this for non-Stream distro because it'll update a RHEL8.4 image to RHEL8.5, for example.

Signed-off-by: David Galloway <dgallowa@redhat.com>

dhcp-server: Add a packages tag so I can skip the task

Takes forever on store01

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #658 from ceph/wip-setuptools

container-host: Install python dependencies

container-host: Install python dependencies

I need this role for Jenkins builders.  They don't get setuptools or pip installed during the common role.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #657 from ceph/wip-cobbler-rhel85

Adding rhel8.5 to sepia cobbler

Adding rhel8.5 to sepia cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #649 from ceph/wip-suse-nrpe

common: Add nrpe support to zypper systems

Merge pull request #655 from ceph/wip-systemd-update

Adding systemd to the list of packages to upgrade in centos stream version 8

Adding systemd to the list of packages to upgrade in centos_8

Fixes: https://tracker.ceph.com/issues/52923
Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #654 from ceph/wip-arrow

testnode: Add Apache Arrow repo

Merge pull request #653 from kshtsk/wip-pulpito-pull

roles/pulpito: support github pull branches to checkout

pulpito/README: add info about variables

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

paddles: add info about pull request branches

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: add leap 15.3 vars

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/paddls: fix 'Set the alembic revision' step

Addresses error:
    sqlalchemy.exc.ArgumentError: Could not parse rfc1738 URL from string '/bin/sh: pecan: command not found'

Fixes: ceph/paddles@925aff2
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/paddles: support github pull branches to checkout

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/pulpito: support github pull branches to checkout

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

Merge pull request #648 from ceph/wip-paddles-container

paddles: Enable containerized deployment

paddles: Update README

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Add Apache Arrow repo

Some changes to Rados GW will require some dependencies in this repo.  See https://github.com/ceph/ceph/pull/40802

Signed-off-by: David Galloway <dgallowa@redhat.com>

users: Add a missing pubkeys tag

paddles: Use gzip compression

Signed-off-by: Zack Cerza <zack@redhat.com>

paddles: Enable containerized deployment

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #650 from ceph/wip-libgnutls30

testnode: Install libgnutls30 on Ubuntu systems

testnode: Install libgnutls30 on Ubuntu systems

Fixes: https://twitter.com/letsencrypt/status/1443621997288767491
Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Add nrpe support to zypper systems

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #647 from ceph/wip-fsid

lrc: Have logrotate cronjob optionally run the cephadm-created conf

lrc: Have logrotate cronjob optionally run the cephadm-created conf

cephadm manages a different logrotate file.  That file's name is the cluster FSID.

So I'll defined lrc_fsid in the secrets repo and this task will change the cronjob to run that logrotate file instead of the ceph-common one (that wasn't doing anything useful anyway).

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #644 from ceph/wip-jenkins-restore-playbook

Adding jenkins ocp4 jobs restore playbook

Adding jenkins ocp4 jobs restore playbook

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #643 from tchaikov/wip-venv

roles/testnode/vars/ubuntu_20: add python3-venv to packages

roles/testnode/vars/ubuntu_20: add python3-venv to packages

since we are going to replace virtualenv with "python3 -m venv",
let's add python3-venv.

keep python3-virtualenv around for a while just in case.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #642 from tchaikov/wip-add-python3-asyncssh

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

python3-asyncssh is not included by EPEL8 yet, but mgr-cephadm requires
it. see also https://tracker.ceph.com/issues/44676

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #641 from ceph/wip-fix-indentation

Fixed indentation on rook-os-update.yml

Fixed indentation on rook-os-update.yml

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #640 from ceph/wip-revert

Revert "Merge pull request #635 from ceph/wip-python-pip"

Revert "Merge pull request #635 from ceph/wip-python-pip"

This reverts commit 623931530c8b8928635fc3b151df1f985d2e12e0, reversing
changes made to 91da996a7045d0029340af7f0bcb7bb7650105e7.

Merge pull request #635 from ceph/wip-python-pip

container-host: Install pip too

Merge pull request #634 from ceph/wip-rook-jenkins-update

Adding the rook-jenkins-update.yml and rearranging the role

Adding the rook-jenkins-update.yml and rearranging the role

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #639 from ceph/wip-powertools2

testnode: Install PowerTools repo on CentOS non-stream too

testnode: Install PowerTools repo on CentOS non-stream too

Fixes: https://tracker.ceph.com/issues/51638#note-5
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #638 from ceph/wip-powertools

Add PowerTools repo to CentOS 8 Stream

testnode: Delete correct Stream repos

This was taking AppStream repos with it on non-Stream distros.  I don't think it was causing issues but it was deleting the wrong files nonetheless.

Signed-off-by: David Galloway <dgallowa@redhat.com>