README: Make doc more specific/clear

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #687 from ceph/zap-rhel

testnode: No pkg tasks before repos are set up

Newer versions of RHEL8 don't like having yum called if they don't have repos setup.

When a RHEL8 machine gets provisioned via Cobbler, we zap the disks before we register the server to Satellite (or CDN).

We don't really need to check if gdisk and device-mapper are installed during a Cobbler install because we know they're installed in https://github.com/ceph/ceph-cm-ansible/blob/main/roles/cobbler/templates/snippets/cephlab_packages_rhel

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #685 from ceph/curl

common: Install Satellite RPM via rpm command

Merge pull request #686 from ceph/scripts

tools: Add a couple workstation scripts

tools: Add a couple workstation scripts

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Install Satellite RPM via rpm command

Seriously... https://access.redhat.com/solutions/6438061

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #683 from ceph/zap_disks_paren

testnode: Add missing parenthesis to conditional

Merge pull request #684 from ceph/fqdn

common: RHSM register w/ full hostname

common: RHSM register w/ full hostname

For some reason, sometimes hosts try to register with their short hostname.  Sometimes with the FQDN.

As of Satellite 6.5, the service won't let you register two different hostnames with the same UUID (https://access.redhat.com/solutions/4207781).

This change makes sure all hosts register with the FQDN so there's no more conflicts.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Add missing parenthesis to conditional

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #682 from ceph/rhel86

cobbler: RHEL8.6

Merge pull request #681 from ceph/true2

cobbler: RHEL8.6

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Fix jinja2 conditional

https://docs.ansible.com/ansible/latest/dev_guide/testing/sanity/no-tests-as-filters.html

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #680 from ceph/wip-adding-rhel9

Adding rhel9 to sepia cobbler

Adding rhel9 to sepia cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #679 from ceph/inclusive-language

Inclusive language update

Inclusive language update

Issues not addressed here:
- FOG still uses master
- lots of gitbuilder URLs in yaml files and docs referencing master
- named uses 'master zones'

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #678 from ceph/mirrorsbroken

Work around rare CentOS infra mirror mismatch

testnode: Work around rare CentOS infra mirror mismatch

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Fix BaseOS repo name

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #677 from ceph/nginx-yaml

teuthology: Serve yaml files as text/plain

teuthology: Serve yaml files as text/plain

So browers display them rather than download.

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #676 from ceph/dedupe

testnode: Remove duplicated common_yum_repos

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

testnode: make it clearer that centos_8.yml and centos_8_stream.yml get combined

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

testnode: Remove duplicated common_yum_repos

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #675 from ceph/gcc-stream

testnode: Fix CentOS 8 Stream packages list

testnode: Fix CentOS 8 Stream packages list

I guess we were relying on a bug for the past few months. What would happen is centos_8.yml would get pulled in and the `packages` list got populated. Then later when we detect this is CentOS Stream, centos_8_stream.yml would get pulled in which overrode the original `packages` list.

Fixes: https://tracker.ceph.com/issues/55177
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #674 from ceph/failover

common: failovermethod is deprecated

common: failovermethod is deprecated

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #672 from ceph/containerized-nodes

Moving toward supporting containerized testnodes

testnode: Ensure fuse, kvm and disk groups exist.

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip more kernel tasks in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip static IP setup in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip perl user_xattr stuff in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

common: Don't use systemd in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

users: Skip role if keys_repo is undefined

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #671 from ceph/no-umount-var-log

testnode: Filter ansible_mounts with regex

Merge pull request #666 from ceph/strea

Fix non-stream to stream conversion

testnode: Filter ansible_mounts with regex

This catches cases where e.g. /var is on the root volume but /var/log is
not.

Signed-off-by: Zack Cerza <zack@redhat.com>

cobbler: Change the way we convert non-stream to stream

The old method doesn't work since the non-stream repos have moved.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #662 from ceph/ubuntu2004

cobbler_profile: Update Ubuntu 20.04 image URL

testnode: Skip certain actions in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #668 from ceph/fix-failure-log

failure_log: Use a default YAML representer

Merge pull request #670 from ceph/osrelease

testnode: Alternate method of detecting Stream (for Openstack instances)

testnode: Install lvm2 on CentOS 8 Stream

This package is missing from the vanilla Openstack instance image.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Alternate method of detecting Stream

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #669 from kshtsk/wip-supervisord-protect-home

roles/paddles: do not ProtectHome=true for supervisord

roles/paddles: do not ProtectHome=true for supervisord

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

failure_log: Use a default YAML representer

Before, we looked recursively for a certain Ansible type in the values
of the dict; this broke when another type was added in Ansible, but was
made worse by the type being used in _keys_, not just values.

This is a better method.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #667 from cbodley/wip-arrow-revert

Revert "testnode: Add Apache Arrow repo"

Revert "testnode: Add Apache Arrow repo"

This reverts commit 3f960fe1b6957bdfb551bd4e53ad275d0d446855.

Signed-off-by: Casey Bodley <cbodley@redhat.com>

cobbler_profile: Modernize dict combination

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #665 from ceph/wip-dns-collision

nameserver: Check for and print IP collisions

nameserver: Check for and print IP collisions

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #664 from ceph/downstream-podman

container-host: distro-specific secrets file

container-host: distro-specific secrets file

`container_packages` was getting set to `podman` for all downstream distros.  That won't work for Ubuntu so we'll use distro-specific secrets overrides.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #663 from ceph/fix-epel

common: Fix epel repo template

common: Fix epel repo template

:(

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler_profile: Update Ubuntu 20.04 image URL

Old one 404s

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #661 from ceph/epel9

common: Enable epel9

common: Enable epel9

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #660 from ceph/wip-cobbler-update

cobbler: Run yum update during CentOS Stream install

Merge pull request #659 from ceph/wip-tags

dhcp-server: Add a packages tag so I can skip the task

cobbler: Run yum update during CentOS Stream install

It occurred to me that the CentOS 8 Stream ISO is probably always going to be outdated so we can just run 'yum update' during kickstart.  We *don't* want to do this for non-Stream distro because it'll update a RHEL8.4 image to RHEL8.5, for example.

Signed-off-by: David Galloway <dgallowa@redhat.com>

dhcp-server: Add a packages tag so I can skip the task

Takes forever on store01

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #658 from ceph/wip-setuptools

container-host: Install python dependencies

container-host: Install python dependencies

I need this role for Jenkins builders.  They don't get setuptools or pip installed during the common role.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #657 from ceph/wip-cobbler-rhel85

Adding rhel8.5 to sepia cobbler

Adding rhel8.5 to sepia cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #649 from ceph/wip-suse-nrpe

common: Add nrpe support to zypper systems

Merge pull request #655 from ceph/wip-systemd-update

Adding systemd to the list of packages to upgrade in centos stream version 8

Adding systemd to the list of packages to upgrade in centos_8

Fixes: https://tracker.ceph.com/issues/52923
Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #654 from ceph/wip-arrow

testnode: Add Apache Arrow repo

Merge pull request #653 from kshtsk/wip-pulpito-pull

roles/pulpito: support github pull branches to checkout

pulpito/README: add info about variables

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

paddles: add info about pull request branches

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: add leap 15.3 vars

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/paddls: fix 'Set the alembic revision' step

Addresses error:
    sqlalchemy.exc.ArgumentError: Could not parse rfc1738 URL from string '/bin/sh: pecan: command not found'

Fixes: ceph/paddles@925aff2
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/paddles: support github pull branches to checkout

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

roles/pulpito: support github pull branches to checkout

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>

Merge pull request #648 from ceph/wip-paddles-container

paddles: Enable containerized deployment

paddles: Update README

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Add Apache Arrow repo

Some changes to Rados GW will require some dependencies in this repo.  See https://github.com/ceph/ceph/pull/40802

Signed-off-by: David Galloway <dgallowa@redhat.com>

users: Add a missing pubkeys tag

paddles: Use gzip compression

Signed-off-by: Zack Cerza <zack@redhat.com>

paddles: Enable containerized deployment

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #650 from ceph/wip-libgnutls30

testnode: Install libgnutls30 on Ubuntu systems

testnode: Install libgnutls30 on Ubuntu systems

Fixes: https://twitter.com/letsencrypt/status/1443621997288767491
Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Add nrpe support to zypper systems

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #647 from ceph/wip-fsid

lrc: Have logrotate cronjob optionally run the cephadm-created conf

lrc: Have logrotate cronjob optionally run the cephadm-created conf

cephadm manages a different logrotate file.  That file's name is the cluster FSID.

So I'll defined lrc_fsid in the secrets repo and this task will change the cronjob to run that logrotate file instead of the ceph-common one (that wasn't doing anything useful anyway).

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #644 from ceph/wip-jenkins-restore-playbook

Adding jenkins ocp4 jobs restore playbook

Adding jenkins ocp4 jobs restore playbook

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #643 from tchaikov/wip-venv

roles/testnode/vars/ubuntu_20: add python3-venv to packages

roles/testnode/vars/ubuntu_20: add python3-venv to packages

since we are going to replace virtualenv with "python3 -m venv",
let's add python3-venv.

keep python3-virtualenv around for a while just in case.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #642 from tchaikov/wip-add-python3-asyncssh

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

python3-asyncssh is not included by EPEL8 yet, but mgr-cephadm requires
it. see also https://tracker.ceph.com/issues/44676

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #641 from ceph/wip-fix-indentation

Fixed indentation on rook-os-update.yml