cobbler: Put CentOS9 Stream repos in place during kickstart

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #700 from ceph/el9

testnode: RHEL9 ceph_dependency_packages_to_remove

testnode: Modify ceph_deps_pkgs_to_remove

Removing python-requests removed subscription-manager which understandably causes a massive problem.

This task/list of packages may not even be necessary anyway since it's a relic from the days we didn't reimage testnodes before every job.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #699 from ceph/cobbler-module

Fixes to support Cobbler 3

cobbler: Install ansible from epel on RHEL9

This used to be in pip_packages but the distro-provided one is new enough

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Fix conditional

Not always defined

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Define a ks_dir

Cobbler2: /var/lib/cobbler/kickstarts
Cobbler3: /var/lib/cobbler/templates

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Define autoinstall flag based on version

Cobbler2: --kickstart
Cobbler3: --autoinstall

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Define kernel options flag based on version

Cobbler2: --kopts
Cobbler3: --kernel-options

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Convert var to int

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Define settings file path based on version

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Support RHEL8 when importing tasks and vars

Signed-off-by: David Galloway <dgallowa@redhat.com>

cobbler: Enable Cobbler 3 Stream on RHEL8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #698 from ceph/wip-ifupdown

ifup and ifdown has been deprecated replaced by ip link set $device u…

Adding the NetworkManager-initscripts-updown package to rhel9

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #697 from ceph/el9

RHEL9 support

testnode: RHEL9 vars/templates

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: No more lsb!

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: vars for rhel9

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #696 from ceph/jammy-pdev

testnode: Move python-dev to distro-specific vars files

testnode: Move python-dev to distro-specific vars files

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #695 from ceph/sdc

cobbler: Install on sdc for cali systems

cobbler: Install on sdc for cali systems

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #694 from ceph/seriously

cobbler_systems: Set default_profile to a newer distro

cobbler_systems: Set default_profile to a newer distro

I just chose RHEL8.6 because it's available in both Sepia and Octo labs.  Ubuntu and CentOS aren't.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #693 from ceph/jammy2

testnode: Ubuntu Jammy vars

testnode: Ubuntu Jammy vars

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #692 from ceph/incerta

tools: Playbook to configure incerta back NIC

tools: Playbook to configure incerta back NIC

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #673 from ceph/secondary-nic

Move secondary NIC tasks to common role

Merge pull request #691 from ceph/containerized-testnodes

testnode: Skip stopping apache2 in containers

testnode: Skip stopping apache2 in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #690 from ceph/irvingi

container-host: s/slaves/builders

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #689 from ceph/fix-satellite

Reinstall Satellite CA Cert

common: Remove, clean up, and reinstall Satellite CA cert

This reverts commit ed59d0bb3f6470ecf62fc6af19663d0f674dd84e.

This was originally added because if one upgrades the Satellite server, the katello-ca-consumer-latest RPM actually gets an incremented version number and conflicts with an already installed katello-ca RPM.  `rpm --reinstall` was not sufficient to "upgrade" the package.

We won't ever be upgrading the Satellite server again and the proper way to "reinstall" the Satellite's CA Cert is to remove it, subscription-manager clean, then reinstall as per https://access.redhat.com/solutions/3336921.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #688 from ceph/fix-docs

README: Make doc more specific/clear

README: Make doc more specific/clear

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #687 from ceph/zap-rhel

testnode: No pkg tasks before repos are set up

Newer versions of RHEL8 don't like having yum called if they don't have repos setup.

When a RHEL8 machine gets provisioned via Cobbler, we zap the disks before we register the server to Satellite (or CDN).

We don't really need to check if gdisk and device-mapper are installed during a Cobbler install because we know they're installed in https://github.com/ceph/ceph-cm-ansible/blob/main/roles/cobbler/templates/snippets/cephlab_packages_rhel

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #685 from ceph/curl

common: Install Satellite RPM via rpm command

Merge pull request #686 from ceph/scripts

tools: Add a couple workstation scripts

tools: Add a couple workstation scripts

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Install Satellite RPM via rpm command

Seriously... https://access.redhat.com/solutions/6438061

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #683 from ceph/zap_disks_paren

testnode: Add missing parenthesis to conditional

Merge pull request #684 from ceph/fqdn

common: RHSM register w/ full hostname

common: RHSM register w/ full hostname

For some reason, sometimes hosts try to register with their short hostname.  Sometimes with the FQDN.

As of Satellite 6.5, the service won't let you register two different hostnames with the same UUID (https://access.redhat.com/solutions/4207781).

This change makes sure all hosts register with the FQDN so there's no more conflicts.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Add missing parenthesis to conditional

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #682 from ceph/rhel86

cobbler: RHEL8.6

Merge pull request #681 from ceph/true2

cobbler: RHEL8.6

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Fix jinja2 conditional

https://docs.ansible.com/ansible/latest/dev_guide/testing/sanity/no-tests-as-filters.html

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #680 from ceph/wip-adding-rhel9

Adding rhel9 to sepia cobbler

Adding rhel9 to sepia cobbler

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #679 from ceph/inclusive-language

Inclusive language update

Inclusive language update

Issues not addressed here:
- FOG still uses master
- lots of gitbuilder URLs in yaml files and docs referencing master
- named uses 'master zones'

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #678 from ceph/mirrorsbroken

Work around rare CentOS infra mirror mismatch

testnode: Work around rare CentOS infra mirror mismatch

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Fix BaseOS repo name

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #677 from ceph/nginx-yaml

teuthology: Serve yaml files as text/plain

teuthology: Serve yaml files as text/plain

So browers display them rather than download.

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #676 from ceph/dedupe

testnode: Remove duplicated common_yum_repos

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

testnode: make it clearer that centos_8.yml and centos_8_stream.yml get combined

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

testnode: Remove duplicated common_yum_repos

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #675 from ceph/gcc-stream

testnode: Fix CentOS 8 Stream packages list

testnode: Fix CentOS 8 Stream packages list

I guess we were relying on a bug for the past few months. What would happen is centos_8.yml would get pulled in and the `packages` list got populated. Then later when we detect this is CentOS Stream, centos_8_stream.yml would get pulled in which overrode the original `packages` list.

Fixes: https://tracker.ceph.com/issues/55177
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #674 from ceph/failover

common: failovermethod is deprecated

common: failovermethod is deprecated

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Document secondary_nic_mtu var

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Refactor MTU setting

This allows us to define an 'mtu' per machine type in group_vars.

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Split out ethtool install so we can enable epel on CentOS

Signed-off-by: David Galloway <dgallowa@redhat.com>

Move secondary-nic tag to common role

So I can use it for LRC hosts

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #672 from ceph/containerized-nodes

Moving toward supporting containerized testnodes

testnode: Ensure fuse, kvm and disk groups exist.

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip more kernel tasks in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip static IP setup in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

testnode: Skip perl user_xattr stuff in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

common: Don't use systemd in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

users: Skip role if keys_repo is undefined

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #671 from ceph/no-umount-var-log

testnode: Filter ansible_mounts with regex

Merge pull request #666 from ceph/strea

Fix non-stream to stream conversion

testnode: Filter ansible_mounts with regex

This catches cases where e.g. /var is on the root volume but /var/log is
not.

Signed-off-by: Zack Cerza <zack@redhat.com>

cobbler: Change the way we convert non-stream to stream

The old method doesn't work since the non-stream repos have moved.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #662 from ceph/ubuntu2004

cobbler_profile: Update Ubuntu 20.04 image URL

testnode: Skip certain actions in containers

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #668 from ceph/fix-failure-log

failure_log: Use a default YAML representer

Merge pull request #670 from ceph/osrelease

testnode: Alternate method of detecting Stream (for Openstack instances)

testnode: Install lvm2 on CentOS 8 Stream

This package is missing from the vanilla Openstack instance image.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Alternate method of detecting Stream

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #669 from kshtsk/wip-supervisord-protect-home

roles/paddles: do not ProtectHome=true for supervisord

roles/paddles: do not ProtectHome=true for supervisord

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

failure_log: Use a default YAML representer

Before, we looked recursively for a certain Ansible type in the values
of the dict; this broke when another type was added in Ansible, but was
made worse by the type being used in _keys_, not just values.

This is a better method.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #667 from cbodley/wip-arrow-revert

Revert "testnode: Add Apache Arrow repo"

Revert "testnode: Add Apache Arrow repo"

This reverts commit 3f960fe1b6957bdfb551bd4e53ad275d0d446855.

Signed-off-by: Casey Bodley <cbodley@redhat.com>

cobbler_profile: Modernize dict combination

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #665 from ceph/wip-dns-collision

nameserver: Check for and print IP collisions

nameserver: Check for and print IP collisions

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #664 from ceph/downstream-podman

container-host: distro-specific secrets file

container-host: distro-specific secrets file

`container_packages` was getting set to `podman` for all downstream distros.  That won't work for Ubuntu so we'll use distro-specific secrets overrides.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #663 from ceph/fix-epel

common: Fix epel repo template