paddles: Use gzip compression

Signed-off-by: Zack Cerza <zack@redhat.com>

paddles: Enable containerized deployment

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #647 from ceph/wip-fsid

lrc: Have logrotate cronjob optionally run the cephadm-created conf

lrc: Have logrotate cronjob optionally run the cephadm-created conf

cephadm manages a different logrotate file.  That file's name is the cluster FSID.

So I'll defined lrc_fsid in the secrets repo and this task will change the cronjob to run that logrotate file instead of the ceph-common one (that wasn't doing anything useful anyway).

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #644 from ceph/wip-jenkins-restore-playbook

Adding jenkins ocp4 jobs restore playbook

Adding jenkins ocp4 jobs restore playbook

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #643 from tchaikov/wip-venv

roles/testnode/vars/ubuntu_20: add python3-venv to packages

roles/testnode/vars/ubuntu_20: add python3-venv to packages

since we are going to replace virtualenv with "python3 -m venv",
let's add python3-venv.

keep python3-virtualenv around for a while just in case.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #642 from tchaikov/wip-add-python3-asyncssh

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

roles/testnode/vars: add ceph/python3-asyncssh to copr_repos

python3-asyncssh is not included by EPEL8 yet, but mgr-cephadm requires
it. see also https://tracker.ceph.com/issues/44676

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #641 from ceph/wip-fix-indentation

Fixed indentation on rook-os-update.yml

Fixed indentation on rook-os-update.yml

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #640 from ceph/wip-revert

Revert "Merge pull request #635 from ceph/wip-python-pip"

Revert "Merge pull request #635 from ceph/wip-python-pip"

This reverts commit 623931530c8b8928635fc3b151df1f985d2e12e0, reversing
changes made to 91da996a7045d0029340af7f0bcb7bb7650105e7.

Merge pull request #635 from ceph/wip-python-pip

container-host: Install pip too

Merge pull request #634 from ceph/wip-rook-jenkins-update

Adding the rook-jenkins-update.yml and rearranging the role

Adding the rook-jenkins-update.yml and rearranging the role

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #639 from ceph/wip-powertools2

testnode: Install PowerTools repo on CentOS non-stream too

testnode: Install PowerTools repo on CentOS non-stream too

Fixes: https://tracker.ceph.com/issues/51638#note-5
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #638 from ceph/wip-powertools

Add PowerTools repo to CentOS 8 Stream

testnode: Delete correct Stream repos

This was taking AppStream repos with it on non-Stream distros.  I don't think it was causing issues but it was deleting the wrong files nonetheless.

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Define addl CentOS8 Stream repo

Fixes: https://tracker.ceph.com/issues/51638
Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Move stream-specific tasks to separate task list

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #637 from ceph/wip-lsb

testnode: Install redhat-lsb-core

testnode: Install redhat-lsb-core

This usually gets installed via Cobbler during FOG image capturing.  That doesn't do us any good when FOG isn't being used.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #636 from ceph/wip-fromhosts

public_facing: Support defining a src port for UFW rules

public_facing: Support defining a src port for UFW rules

Signed-off-by: David Galloway <dgallowa@redhat.com>

container-host: Install pip too

This was needed on CentOS8 and Ubuntu Focal Jenkins builders.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #632 from ceph/wip-git

container-host: Ensure git is installed

container-host: Ensure git is installed

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #631 from ceph/wip-notin

cobbler: Fix ansible conditional

Merge pull request #630 from ceph/wip-centos84

Add CentOS 8.4

cobbler: Fix ansible conditional

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #629 from ceph/wip-rhel84

RHEL 8.4

Add CentOS 8.4

Signed-off-by: David Galloway <dgallowa@redhat.com>

RHEL 8.4

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #628 from ceph/wip-anybody

We can use this for any system

We can use this for any system

But the ipmi group makes more sense

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #627 from ceph/wip-comma

testnode: Always ifup the secondary NIC

testnode: Always ifup the secondary NIC

If the NIC was already down, `ifdown` causes the playbook to fail.  We want to always (at least attempt to) take the NIC down, then bring it back up.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #626 from ceph/wip-move-sentinel

testnode: Write sentinel file after container-host role

testnode: Write sentinel file after container-host role

Now that we're running the entire cephlab.yml playbook during Cobbler kickstart, the sentinel file is getting touched while the container-host playbook is still running.

This change will still write the /ceph-qa-ready sentinel file during the testnodes role if the testnodes role got called directly

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #625 from ceph/wip-cephlabnottestnodes

cobbler: Run all available playbooks during postinstall

cobbler: Run all available playbooks during postinstall

Not just testnodes playbook

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #624 from ceph/wip-klbahsr

Allow defining an alternate container_packages var

container-host: Try to import an alternate {{ container_packages }}

Signed-off-by: David Galloway <dgallowa@redhat.com>

testnode: Do not install podman-docker here

We will install it in the container-host role if we need it.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #609 from ceph/wip-ignore-snap

common: Ignore /snap mountpoints when checking disk usage

Merge pull request #622 from ceph/wip-c9stream

Add CentOS 9 Stream

Add CentOS 9 Stream

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #621 from ceph/wip-cstream

cobbler: Support CentOS Stream

cobbler: Support CentOS Stream

"But David, why aren't we just using the CentOS 8 Stream ISO?"

Thank you for asking.
1) The vmlinuz and initrd that are baked into the CentOS 8 Stream ISO as of this writing are not compatible.  Filed https://bugs.centos.org/view.php?id=18188
2) Even if I take the vmlinuz and initrd from CentOS 8.3, after firstboot, the system still bizarrely boots as CentOS 8.3.  That's right, when using the CentOS 8 Stream ISO and we kickstart using Cobbler, you end up with CentOS 8.3.  I'm sure it has something to do with our kickstarts and snippets but nothing obvious stood out to me.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #620 from ceph/wip-gw-routes

gateway: Support writing addl routes

gateway: Support writing addl routes

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #618 from ceph/wip-releasever-sooner

common: Set releasever on testnodes sooner

common: Set releasever on testnodes sooner

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #611 from ceph/wip-centos83

Add CentOS 8.3

Merge pull request #617 from ceph/wip-releasevar-yum

Adding the releasever variable to rhel7.9 testnodes

Adding the releasever varible to rhel7.9 testnodes

Fixes: https://tracker.ceph.com/issues/49771
Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #616 from ceph/wip-centos79

Add CentOS 7.9

Add CentOS 7.9

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #615 from ceph/wip-cobbler-imported

cobbler_profile: s/import/imported

cobbler_profile: s/import/imported

I guess something changed in ansible so that it doesn't like 'import' as the variable name.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #613 from ceph/wip-norecommends

testnode: Install collectl without recommended packages

testnode: Install collectl without recommended packages

collectl has a bunch of Gnome Desktop Environment packages that are recommended.  So on Ubuntu 20.04 at least, a desktop environment was getting installed and would eventually go to sleep.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #612 from ceph/wip-fix-centos8-qemu

testnode: libgcrypt needs to be updated to match QEMU build

testnode: libgcrypt needs to be updated to match QEMU build

See https://bugzilla.redhat.com/show_bug.cgi?id=1828681

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Add CentOS 8.3

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #610 from ceph/wip-lz4

paddles: Install lz4 for backups

paddles: Install lz4 for backups

Signed-off-by: David Galloway <dgallowa@redhat.com>

common: Ignore /snap mountpoints when checking disk usage

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #608 from kshtsk/wip-nsupdate_web-opensuse

nsupdate web opensuse

nsupdate_web: use .conf extention for opensuse nginx

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
(cherry picked from commit cbb0a82a0380038d33d1b59eb65eed9622ec61d6)

nsupdate_web: copy keys from secrets dir if present

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
(cherry picked from commit bac5f08eca5fa018adb16be9db4457cb42c73039)

Merge pull request #607 from ceph/wip-rhel8-package-list-change

Adding redhat-lsb, firewalld and wget to rhel8 testnodes

Adding redhat-lsb, firewalld and wget to rhel8 testnodes

Fixes: https://tracker.ceph.com/issues/48767
Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #606 from ceph/wip-focal-nosleep

common: Disable sleeping on Ubuntu 20.04 and later

common: Disable sleeping on Ubuntu 20.04 and later

Fixes: https://tracker.ceph.com/issues/49152
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #605 from ceph/wip-keys-branch

users: Support defining different branch

users: Support defining different branch

This will allow one to run the users role prior to a PR being merged.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #604 from ceph/wip-rook-master-update

Creating a new tag for updating the master os - master-update

Creating a new tag for updating the master os - master-update

And also doing changes to the rook-recovery role

Signed-off-by: Adam Kraitman <akraitma@redhat.com>

Merge pull request #603 from kshtsk/pulpito-py3

teuthology: py3 for pulpito and paddles

teuthology: ensure scheduler user bin exists

Before copying crontab script we need to ensure the bin directory
exists for scheduler user.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: add opensuse 15.2 specific deps

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: use python3 dependencies

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

teuthology: py3 for pulpito and paddles

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

Merge pull request #602 from ceph/wip-bothplaces

container-host: Install mirror cert in both podman and docker paths

container-host: Install mirror cert in both podman and docker paths

Fixes: https://tracker.ceph.com/issues/48715
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #601 from ceph/wip-make

testnode: Install make on el8

testnode: Install make on el8

This package isn't included in the cloud image that the Octo PSI nodes use.

Fixes: https://tracker.ceph.com/issues/48751
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #600 from ceph/wip-container-js

container-host: let me skip registries-conf-ctl tasks

container-host: Create tag for registries-conf-ctl

This will let us skip those tasks when we don't want to run them (like on a Jenkins builder)

Signed-off-by: David Galloway <dgallowa@redhat.com>

container-host: Configure Jenkins builders too

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #599 from ceph/wip-ignore-errorsrue

container-host: Ignore service restart error on new kernel

container-host: Ignore service restart error on new kernel

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #598 from ceph/wip-tab

container-host: Fix service restart syntax

container-host: Fix service restart syntax

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #597 from guits/guits-restart-docker

container-host: restart docker service

container-host: restart docker service

Once the mirror has been added in `/etc/docker/daemon.json`
we need to restart the daemon.

This is not very elegant but it's a workaround for now.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>