ceph-dev-new-trigger: stop building focal packages on main

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #2216 from ceph/wip-squid

Add squid to ceph-dev-cron and other jobs (except for ceph-volume)

Reviewed-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #2214 from dmick/wip-add-arm64-centos9

ceph-dev-new-build: allow arm64 builds of centos9

Merge pull request #2206 from cbodley/wip-quincy-on-jammy

ceph-dev-new-trigger: start building quincy packages on jammy

Merge pull request #2215 from Svelar/arm_ci

ceph-pull-requests-arm64: make publishers same as ceph-pull-requests

Merge pull request #2217 from Svelar/zbd

ceph-pull-requests: remove WITH_ZBD

Merge pull request #2218 from Svelar/arm64_RWL

ceph-pull-requests-arm64: enable RWL mode on arm64

ceph-pull-requests-arm64: enable RWL mode on arm64

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

ceph-pull-requests: remove WITH_ZBD

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

Update releases - add squid, remove pacific and older

... with the exception of ceph-volume jobs.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

ceph-dev-trigger: fix a typo a regex for reef

It should be .*reef.*, not .*main.*.  This was introduced in commit
a19480349163 ("Update releases - add reef, remove octopus and older"),
but didn't really affect anything because the build matrix happens to
be the same.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

ceph-pull-requests-arm64: add kill tests when aborted to arm64

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

ceph-pull-requests-arm64: add publishers to fix ci result inaccuracy

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

Merge pull request #2213 from clwluvw/collect-logs

build_utils: move collect lgos playbook into the root dir

ceph-dev-new-build: allow arm64 builds of centos9

Signed-off-by: Dan Mick <dmick@redhat.com>

build_utils: move collect lgos playbook into the root dir

The playbook needs to be in the root directory so it can discover the roles

Signed-off-by: Seena Fallah <seenafallah@gmail.com>

Merge pull request #2212 from clwluvw/ceph-ansible-collect-logs

build_utils: use custom playbook for collect_ceph_logs

build_utils: use custom playbook for collect_ceph_logs

If provided, use the custom playbook to collect logs.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>

Merge pull request #2191 from baum/centos8_build_deps

centos8: add yum Configs for  ceph/grpc copr https://copr.fedorainfracloud.org/coprs/ceph/grpc/

Merge pull request #2211 from ceph/update-sync-images3

sync-images: address permission denied issue

sync-images: address permission denied issue

adding `--security-opt label=disable` to workaround the following error:

```
time="2024-02-29T12:04:24Z" level=fatal msg="open /sync.yml: permission denied"
```

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2210 from ceph/update-sync-images2

sync-images: write sync.yml in workspace

sync-images: write sync.yml in workspace

I might be lacking JJB expertise but this is the only
way I could figure out in order to get `sync.yml` in the
workspace.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2209 from ceph/update-sync-images

sync-images: fix the inclusion section

sync-images: fix the inclusion section

according to the documentation [1], my understanding is that
`!include-raw` should be used instead of `!include-raw-escape`.

[1] https://jenkins-job-builder.readthedocs.io/en/latest/definition.html#inclusion-tags

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2208 from ceph/sync-images

Add sync-images job

Add sync-images job

This adds a nightly job in order to mirror some container
images (grafana image only for now) from docker.io to quay.io

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2207 from ceph/wip-bpf-cgroup

kernel: enable CONFIG_CGROUP_BPF

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #2202 from ceph/ceph-devstack

ceph-devstack: Add more parameters, and a trigger

kernel: enable CONFIG_CGROUP_BPF

It's required by podman.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #2204 from ceph/wip-rpm-bpf-syscall

kernel: enable CONFIG_BPF_SYSCALL for rpm

Reviewed-by: Xiubo Li <xiubli@redhat.com>

ceph-dev-new-trigger: start building quincy packages on jammy

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #2203 from ceph/wip-include-to-include-tasks

ansible: replace include: by include_tasks: and undo pin of ansible version

Unpin ansible-core in ceph-build-pull-requests too

Signed-off-by: Dan Mick <dmick@redhat.com>

ceph-setup, ceph-tag: undo ansible pin to <9

ansible roles used by these jobs have had include: changed to
include_tasks:, which was the reason the pin had been done in the
first place

Signed-off-by: Dan Mick <dmick@redhat.com>

ansible: stop using deprecated include:

Signed-off-by: Dan Mick <dmick@redhat.com>

centos8: grpc-devel

  - see https://copr.fedorainfracloud.org/coprs/ceph/grpc/

Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>

kernel: enable CONFIG_BPF_SYSCALL for rpm

It's already enabled for deb and is required by podman.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #2200 from ceph/whitelist-squid

build: whitelist squid branch for pr tests

Merge pull request #2201 from rkachach/fix_issue_deps_script

ceph-build: fixing dependencies script

ceph-build: fixing dependencies script

Signed-off-by: Redouane Kachach <rkachach@redhat.com>

build: whitelist squid branch for pr tests

saw that some tests were not getting triggered in my squid PR
https://github.com/ceph/ceph/pull/55685

Signed-off-by: Nizamudeen A <nia@redhat.com>

ceph-devstack: Add more parameters, and a trigger

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #2190 from rosinL/wip-pr-arm64

ceph-pull-requests-arm64: set test jobs number equal to build jobs number

Merge pull request #2197 from Matan-B/wip-matanb-crimson-remove-c8-revert

Revert "ceph-dev*: remove centos8 crimson builds"

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #2198 from petrutlucian94/libvirt

windows: restart libvirtd.socket if the socket is missing

windows: restart libvirtd.socket if the socket is missing

The Windows job is failing because of libvirt failures, specifically
the libvirt unix socket is missing.

After some trial and error, looks like the libvirtd.socket service
needs to be restarted.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

Revert "ceph-dev*: remove centos8 crimson builds"

This reverts commit 1984464b9a80f6857877aac0620737cbc40fd67c.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #2196 from ceph/ceph-container-ceph-base-prerelease

ceph-container: set PRERELEASE env var

ceph-container: set PRERELEASE env var

otherwise, the build-ceph-base.sh script complains because this
variable has no default value.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2195 from petrutlucian94/libvirt

windows: explicitly enable libvirtd and install qemu-kvm

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

windows: explicitly enable libvirtd and install qemu-kvm

Libvirt is still not available after installing the libvirt-daemon-system
package.

We'll explicitly enable the libvirtd service and install qemu-kvm.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

Merge pull request #2194 from petrutlucian94/libvirt

windows: install libvirt

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

windows: install libvirt

The Windows jobs use Libvirt VMs to build Ceph and run the tests.

The issue is that we're assuming Libvirt to be preinstalled, which
isn't necessarily the case.

This change will explicitly install Libvirt.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

Merge pull request #2192 from dmick/wip-builder

Update builder to work better on centos7: local xml parser, python3 on centos7

Merge pull request #2193 from dmick/wip-pin-jjb

ceph-build-pull-requests: pin jenkins-job-builder to <6.0.0

ceph-build-pull-requests: pin jenkins-job-builder to <6.0.0

Something's happened in the new release of jjb that breaks our
yml templates.  There are hints here, perhaps.

https://groups.google.com/g/jenkins-job-builder/c/FQOIorLgi9g

For now, 5.1.0 seems to work.

Also pin it in jenkins-job-builder.

Signed-off-by: Dan Mick <dmick@redhat.com>

examples/builder.yml: Add 'update-ca-trust" step for CentOS 7

get_url to update agent.jar was failing with a cert error,
but jenkins.ceph.com's cert was fine; on a hunch I updated the
dynamic ca trust database and that resolved the error.  I can't
see that it would do any damage to do so unconditionally.

Signed-off-by: Dan Mick <dmick@redhat.com>

library/jenkins_node: Allow to work on centos7 by adding xml parser

xmltodict is exactly what I needed, but it's too hard to dig up
for centos7 (and overkill anyway).  Supply an implementation that
allows jenkins XML parsing and use it instead.

Also, use python3 on centos7, and tweak the packages a bit in
examples/builder.yml

Signed-off-by: Dan Mick <dmick@redhat.com>

ansible.cfg: Help debugging by setting logger

Signed-off-by: Dan Mick <dmick@redhat.com>

ceph-pull-requests-arm64: set test jobs number equal to build jobs number

On arm nodes confusa*, there are enough memory to run `nproc` build jobs,
but the test jobs number `$(nproc) / 4` are too small, and make check test run pretty
slow.

Signed-off-by: luo rixin <luorixin@huawei.com>

Merge pull request #2186 from rkachach/fix_issue_64013

project config: adding logic to create kvm default network

ceph-build: behave is now installed as part of run-tests script

Signed-off-by: Redouane Kachach <rkachach@redhat.com>

project config: improving deps installation script stability
Fixes: https://tracker.ceph.com/issues/64013
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #2189 from dmick/wip-ceph-iscsi-stable-centos9

ceph-iscsi-stable: make centos9 work

ceph-iscsi-stable: make centos9 work

also remove centos7 builds

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2188 from dmick/wip-remove-debugsolver

build_utils.sh: remove --debugsolver

build_utils.sh: remove --debugsolver

It leaves root-owned files around which causes cleanup issues

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2178 from cbodley/wip-unblock-c9-containers

enable centos9 builds for ceph-iscsi, tcmu-runner

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Dan Mick <dan.mick@redhat.com>

tcmu-runner: disable glfs for lack of glusterfs-api-devel

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #2185 from Matan-B/wip-matanb-crimson-remove-c8

ceph-dev*: remove centos8 crimson builds

ceph-dev*: remove centos8 crimson builds

remove any quincy crimson buils (not a supported release)
remove reef c8 builds
remove main c8 builds

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #2184 from dmick/wip-debug-solver

build_utils.sh: try using dnf, adding debug, and using dnf clean all

build_utils.sh Add "dnf clean all" as a Big Hammer

There's no reason this should be necessary, but maybe it
works around the mysterious issue of "Problem: cannot install
both python3-devel-3.9.18-1.el9.x86_64 from appstream and
python3-devel-3.9.18-1.el9.x86_64 from @System"

Signed-off-by: Dan Mick <dmick@redhat.com>

build_utils.sh: try using dnf, adding -d 10 --debugsolver for more info

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2183 from dmick/wip-verbose-builddep

Add verbosity to yum-builddep to try to get more info about failure

Add verbosity to yum-builddep to try to get more info about failure

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2182 from dmick/wip-ceph-container-prerelease-build

Add ceph-container-prerelease-build

Add ceph-container-prerelease-build

Based on ceph-container-build-ceph-base-push-imgs, but
for building containers for testing before the release is
validated and committed.  Differences:

1) pulls packages from download.ceph.com/prerelease
2) does not attempt to build aarch64
3) pushes built container to quay.ceph.io:ceph/prerelease

The prerelease directories are password-protected to avoid any
early exposure to in-progress builds.

This requires corresponding changes to ceph-container.git.

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2181 from dmick/wip-release-tools

sync-push: "staging" -> "prerelease", and allow specifying releasename-version

Allow specifying '<release>-<version>' to sync only one version

Signed-off-by: Dan Mick <dmick@redhat.com>

Change from "staging" to "prerelease"

ceph-container already uses the word "staging" for a specific
function; avoid confusion by standardizing on "prerelease" here

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2180 from ceph/wip-pin-ansible

ceph-setup, ceph-tag: pin ansible to < 9

ceph-setup, ceph-tag: pin ansible to < 9

This is a temporary hack until we have time to properly test
changing include to include_tasks, required by ansible 9 (include
has been deprecated for some time, and now it's officially gone)

Signed-off-by: Dan Mick <dmick@redhat.com>

Merge pull request #2179 from rhcs-dashboard/upgrade-grafana-9.4.12

ceph-grafana-trigger: update the grafana version to 9.4.12

ceph-grafana-trigger: update the grafana version to 9.4.12

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #2160 from rzarzynski/wip-kickoff-squid

kickoff v19 squid

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

tcmu-runner: enable centos9

Signed-off-by: Casey Bodley <cbodley@redhat.com>

ceph-iscsi: enable centos9

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #2170 from ceph/wip-kernel-trigger-timeout

kernel-trigger: increase clone timeout

Reviewed-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #2169 from ceph/wip-kernel-rpmbuild-fix

kernel: unbreak RPM builds

Reviewed-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #2177 from ceph/teuth-pr-disable

Remove teuthology-pull-requests

Remove teuthology-pull-requests

This job represents a small subset of what we test with GitHub Actions. It's
also unreliable, for reasons including - but not limited to - the fact that
it's not possible to request an agent with a particular OS version.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #2175 from dmick/wip-ceph-build-pull-requests

ceph-build-pull-requests: rather than ansible, pin ansible-core

Merge pull request #2176 from tserlin/wip-tserlin-pin-to-V5.7

nfs-ganesha: pin the daily build to V5.7

nfs-ganesha: pin the daily build to V5.7

The latest upstream nfs-ganesha 5 tag was released. Bump from
V5.5 to V5.7.

Merge pull request #2166 from rkachach/fix_issue_63019

project config: adding rook orchestrator e2e testing job

ceph-build: adding quincy, pacific and octopus to blacklist

Signed-off-by: Redouane Kachach <rkachach@redhat.com>

test: changing trigger-phrase

Signed-off-by: Redouane Kachach <rkachach@redhat.com>

project config: adding rook orchestrator e2e testing job
Fixes: https://tracker.ceph.com/issues/63019
Signed-off-by: Redouane Kachach <rkachach@redhat.com>