Dan Mick [Tue, 25 Mar 2025 23:58:02 +0000 (16:58 -0700)]
Add ceph-release-containers job
Builds prerelease versions of ceph container images: two arch-specific
images and one 'manifest-list' image. Pushed all to quay.ceph.io/ceph,
in a private set of repos (prerelease-amd64, prerelease-arm64, and
prerelease) for testing and signoff. Once moved, the script
container/make-manifest-list.py can be used with the --promote flag to
promote them from quay.ceph.io to quay.io for public release.
Dan Mick [Thu, 20 Mar 2025 23:45:17 +0000 (16:45 -0700)]
ceph-build: remove container build
The container must be built from signed packages, and signing
is not part of the Jenkins build. So we'll create two new jobs
to build the prerelease containers (so that builders don't have
to have access to both amd64 and arm64 build hosts).
David Galloway [Fri, 28 Feb 2025 18:55:16 +0000 (13:55 -0500)]
ansible: Fixes to podman subuid/subgid checks
I think this was working during my testing because sub{u,g}id_check.rc /wasn't/ 0. I had manually modified the system so it wasn't in the same state as a fresh cloud instance.
I manually ran this playbook on an instance and confirmed it gets past the podman setup now.
Signed-off-by: David Galloway <david.galloway@ibm.com>
Matan Breizman [Tue, 25 Feb 2025 12:27:42 +0000 (14:27 +0200)]
ceph-dev*: intermediate transition to WITH_CRIMSON
See: https://github.com/ceph/ceph/pull/61672
This PR changes any WITH_SEASTAR / --with-seastar to WITH_CRIMSON /
--with crimson respectively. We should let our builders add the new flags
and once the PR is merged we could clean up the unused WITH_SEASTAR.
John Mulligan [Wed, 19 Feb 2025 16:10:11 +0000 (11:10 -0500)]
scripts: add build-with-container.py and friends to container_only_pr
Add the build-with-container.py script and the helper shell script and
Dockerfile that support the builder image to the container_only_pr
patterns in build_utils.sh. This should save time and resources when
contributing patches to only these files in the ceph/ceph repo.
Signed-off-by: John Mulligan <jmulligan@redhat.com>
David Galloway [Tue, 18 Feb 2025 03:13:09 +0000 (22:13 -0500)]
ansible: Add tag to python interpreter var setting tasks
I'm working on a combination of terraform and ansible to quickly
spin up instances in IBM Cloud so they can join Jenkins as builders.
Part of this process involves creating a virtualenv and running ansible
from it. python-jenkins needs to be installed in the virtualenv and
setting the python interpreters inside the playbook breaks that.
This PR will let me `--skip-tags interpreter`
Signed-off-by: David Galloway <david.galloway@ibm.com>
Dan Mick [Fri, 14 Feb 2025 03:28:46 +0000 (19:28 -0800)]
jenkins-job-builder,ceph-build-pull-requests: fetch and use jjb 6
currently it's actually a custom version of jjb6, to add
new choosing-strategy: ancestry, to be able to use
maximum-age in days to choose a branch to build. This will
change to 6.5 once that branch is released.
Dan Mick [Fri, 14 Feb 2025 03:11:49 +0000 (19:11 -0800)]
Update all jobs with ${VAR} syntax to ${{VAR}} for jjb6 compatibility
jenkins-job-builder 6 changed the interpretation of {var} to *always*
refer to a jjb macro; this is true even for ${VAR}, which we use in a
lot of place for Jenkins variable expansion (although not all; it's
unclear whether the {} are or ever were necessary, or in what exact
contexts). So far, we've pinned jjb to <6, but we need new
functionality.
In any event, rather than changing all of them to the same {}-less style
that might work, change the ${} style to ${{}} and leave $ alone.
Zack Cerza [Thu, 23 Jan 2025 21:21:43 +0000 (14:21 -0700)]
Add ceph-dev-pipeline-trigger
This job serves to trigger ceph-dev-pipeline via webhook payloads, but is
opt-in. This implementation initially targets only GitHub push event payloads.
On each push, it will inspect the head commit for [git trailers][0]. The trailer
required to opt in is "CI-PIPELINE: true". If that trailer is found, the job
looks for these others:
Adam Kraitman [Sun, 2 Feb 2025 16:08:21 +0000 (18:08 +0200)]
Updating java openjdk to version 17 on rhel and debian builders, I have added the update-alternatives command to make sure we set the OS to use the new java version
Signed-off-by: Adam Kraitman <akraitma@li-8b09b2cc-35b7-11b2-a85c-cd1dbade58f9.ibm.com>
This section allows three people to bypass the org restriction.
However, zdover23 is already part of the org, and the other two
were originally contractors who are no longer involved with
the project.
Laura Flores [Wed, 11 Dec 2024 18:15:46 +0000 (12:15 -0600)]
ceph-website-prs/config/definitions: remove org filter for site compile check
These filters block anyone outside the ceph org from having the site compile
check run on their PRs. We do want people from outside the org to be able to
raise PRs, so removing these filters will allow that check to run.
Dan Mick [Tue, 3 Dec 2024 22:05:24 +0000 (14:05 -0800)]
scripts/get-tarballs.sh: pull to prerelease area
I've got a bunch of doc work to do to the release process;
this is one of them. Maybe we should also add this, and
its copy, to the ceph-cm-ansible role for d.c.c
Dan Mick [Tue, 3 Dec 2024 19:13:35 +0000 (11:13 -0800)]
Keep track of extra script get-tarballs.sh
This is used by sync-pull to fetch the tarballs when
constructing a release, but needs modification for the
prerelease/ directory structure. It's invoked by ssh
to download.ceph.com to run from /home/signer/bin, because
it needs to copy large files from chacra to download.ceph.com
and doing that on download.ceph.com is much more efficient.
Zack Cerza [Mon, 25 Nov 2024 21:49:05 +0000 (14:49 -0700)]
ceph-dev-new-setup: Keep more builds
I've seen ceph builds fail because they took so long to claim a build node
that the artifacts created by their ceph-dev-new-setup build was
garbage-collected.
Artifacts for a given build of this job use less than 1G; we should keep more
artifacts around. Metadata for builds of this job are negligible; we should
keep far more sets of metadata around.
projects / ceph-build.git / log