]> git.apps.os.sepia.ceph.com Git - ceph-build.git/log
ceph-build.git
3 months agobuilder.yml: fix jenkins ssh key and github.com host key code 2379/head
Dan Mick [Thu, 12 Jun 2025 02:24:13 +0000 (19:24 -0700)]
builder.yml: fix jenkins ssh key and github.com host key code

Previous code was just wrong; 'first_found' can fail, and does
not return file contents; default(URL) just doesn't work

Signed-off-by: Dan Mick <dan.mick@redhat.com>
3 months agobuilder.yml: fix comments, note importance of invocation path
Dan Mick [Thu, 12 Jun 2025 02:21:22 +0000 (19:21 -0700)]
builder.yml: fix comments, note importance of invocation path

Signed-off-by: Dan Mick <dan.mick@redhat.com>
3 months agoMerge pull request #2370 from clwluvw/vagrant-libvirt
Guillaume Abrioux [Tue, 27 May 2025 19:13:23 +0000 (21:13 +0200)]
Merge pull request #2370 from clwluvw/vagrant-libvirt

vagrant-libvirt: install the latest version

3 months agovagrant-libvirt: install the latest version 2370/head
Seena Fallah [Tue, 27 May 2025 19:03:00 +0000 (21:03 +0200)]
vagrant-libvirt: install the latest version

The pinned version is already too old and is failing in CI due to:
```
Error message given during initialization: Unable to resolve dependency:
user requested 'vagrant-libvirt (= 0.12.2)'
```

Let's try the latest and see if the reason for pinning the old one
still exists.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
4 months agoMerge pull request #2368 from dmick/ceph-build-no-containers
David Galloway [Mon, 19 May 2025 21:01:26 +0000 (17:01 -0400)]
Merge pull request #2368 from dmick/ceph-build-no-containers

ceph-build: remove container build step

4 months agoceph-build: remove container build step 2368/head
Dan Mick [Mon, 19 May 2025 20:42:51 +0000 (13:42 -0700)]
ceph-build: remove container build step

This was removed from build_rpm, but then when a reorg happened
to separate the function into a separate script, the fact that
ceph-build doesn't do container builds anymore was missed.

Release container builds now happen after the manual signing
step using job ceph-release-containers

Signed-off-by: Dan Mick <dan.mick@redhat.com>
4 months agoMerge pull request #2367 from Matan-B/wip-matanb-crimson-remove-debug
Matan Breizman [Mon, 19 May 2025 07:10:43 +0000 (10:10 +0300)]
Merge pull request #2367 from Matan-B/wip-matanb-crimson-remove-debug

scripts/build_utils: remove Debug build from Crimson

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
4 months agoscripts/build_utils: remove Debug build from Crimson 2367/head
Matan Breizman [Sun, 18 May 2025 08:40:52 +0000 (11:40 +0300)]
scripts/build_utils: remove Debug build from Crimson

See: https://github.com/ceph/ceph-build/pull/2167/files
Builds should be set to Debug only when ending in "-debug".

https://github.com/ceph/ceph-build/pull/1805 set Crimson to always use Debug.
That made sense in earlier development phases.
However, today we should align with Classical builds and use Debug only when needed.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
4 months agoMerge pull request #2365 from ceph/builder-ansible
David Galloway [Thu, 15 May 2025 13:37:23 +0000 (09:37 -0400)]
Merge pull request #2365 from ceph/builder-ansible

FIx up builder.yml

4 months agoexamples/builder.yml: update comments with new usage info 2365/head
Dan Mick [Thu, 15 May 2025 02:11:07 +0000 (19:11 -0700)]
examples/builder.yml: update comments with new usage info

Signed-off-by: Dan Mick <dan.mick@redhat.com>
4 months agoslave.yml: remove old symlink
Dan Mick [Thu, 15 May 2025 02:08:15 +0000 (19:08 -0700)]
slave.yml: remove old symlink

Signed-off-by: Dan Mick <dan.mick@redhat.com>
4 months agoexamples/builder.yml: set api token based on api_uri
Dan Mick [Wed, 14 May 2025 00:35:03 +0000 (17:35 -0700)]
examples/builder.yml: set api token based on api_uri

This is really the ceph-jenkins ssh user's password, but they're
now stored in ceph-sepia-secrets so they don't have to be found
and entered on the cmdline here

This keeps 'one ansible-vault encrypt output' in one file, and
should be easier to edit/view/etc.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
4 months agoexamples/builder.yml: fix up subuid/subgid handling code
Dan Mick [Wed, 14 May 2025 00:36:34 +0000 (17:36 -0700)]
examples/builder.yml: fix up subuid/subgid handling code

1) not necessary to make 'find highest uid' conditional (and the
   check was checking 0 instead of !0 anyway)
2) fix up choice of "calculated or default" using "| default()"

Signed-off-by: Dan Mick <dan.mick@redhat.com>
4 months agoMerge pull request #2363 from ceph/pipeline-container
Zack Cerza [Fri, 9 May 2025 18:12:11 +0000 (12:12 -0600)]
Merge pull request #2363 from ceph/pipeline-container

ceph-dev-pipeline: Build in containers

4 months agoceph-dev-pipeline: Fix extract/upload of cephadm 2363/head
Zack Cerza [Wed, 7 May 2025 18:02:41 +0000 (12:02 -0600)]
ceph-dev-pipeline: Fix extract/upload of cephadm

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: chown without sudo
Zack Cerza [Wed, 30 Apr 2025 19:21:17 +0000 (13:21 -0600)]
ceph-dev-pipeline: chown without sudo

And also at the very end of the job.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Store sccache logs
Zack Cerza [Thu, 6 Mar 2025 23:34:25 +0000 (16:34 -0700)]
ceph-dev-pipeline: Store sccache logs

There is an issue where invocations of archiveArtifacts in parallel branches of
the pipeline overwrite each other.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Build the builder less often
Zack Cerza [Mon, 21 Apr 2025 17:52:38 +0000 (11:52 -0600)]
ceph-dev-pipeline: Build the builder less often

To build the builder image less often, we can:

1. When building, use two tags: branch.os.arch, and sha1.branch.os.arch
2. After building, push both tags
3. Before building, pull both tags

As a result, we can avoid building entirely if that exact image has already been
pushed, and avoid building at least some layers if the branch had been built
somewhat recently.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Split upload stage from build
Zack Cerza [Mon, 5 May 2025 19:01:53 +0000 (13:01 -0600)]
ceph-dev-pipeline: Split upload stage from build

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Re-narrow node label
Zack Cerza [Tue, 29 Apr 2025 23:10:21 +0000 (17:10 -0600)]
ceph-dev-pipeline: Re-narrow node label

smithis take far too long.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Add and use update_shaman.sh
Zack Cerza [Tue, 29 Apr 2025 00:05:04 +0000 (18:05 -0600)]
ceph-dev-pipeline: Add and use update_shaman.sh

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Build release RPM
Zack Cerza [Mon, 28 Apr 2025 23:31:44 +0000 (17:31 -0600)]
ceph-dev-pipeline: Build release RPM

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agosetup_container_runtime.sh: Prune more images
Zack Cerza [Tue, 22 Apr 2025 16:19:23 +0000 (10:19 -0600)]
setup_container_runtime.sh: Prune more images

Only leave one weeks' worth.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Fix CI_COMPILE
Zack Cerza [Wed, 16 Apr 2025 20:49:27 +0000 (14:49 -0600)]
ceph-dev-pipeline: Fix CI_COMPILE

Setting an environment variable affects all matrix branches; this approach keeps
them isolated.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Copy even less artifacts
Zack Cerza [Mon, 5 May 2025 20:46:48 +0000 (14:46 -0600)]
ceph-dev-pipeline: Copy even less artifacts

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Use ceph-source-dist by default
Zack Cerza [Tue, 15 Apr 2025 01:47:30 +0000 (19:47 -0600)]
ceph-dev-pipeline: Use ceph-source-dist by default

But continue to offer ceph-dev-new-setup as an option.

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoceph-dev-pipeline: Use setup_container_runtime.sh
Zack Cerza [Tue, 15 Apr 2025 18:12:47 +0000 (12:12 -0600)]
ceph-dev-pipeline: Use setup_container_runtime.sh

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoMerge pull request #2357 from ceph/ceph-source-dist
Zack Cerza [Wed, 7 May 2025 22:45:56 +0000 (16:45 -0600)]
Merge pull request #2357 from ceph/ceph-source-dist

Add ceph-source-dist job

4 months agoAdd ceph-source-dist job 2357/head
Zack Cerza [Mon, 14 Apr 2025 19:48:18 +0000 (13:48 -0600)]
Add ceph-source-dist job

Signed-off-by: Zack Cerza <zack@cerza.org>
4 months agoMerge pull request #2360 from cbodley/wip-doc-PendingReleaseNotes
Dan Mick [Wed, 23 Apr 2025 20:25:20 +0000 (13:25 -0700)]
Merge pull request #2360 from cbodley/wip-doc-PendingReleaseNotes

scripts: docs_pr_only() considers PendingReleaseNotes

4 months agoscripts: docs_pr_only() considers PendingReleaseNotes 2360/head
Casey Bodley [Wed, 23 Apr 2025 19:42:58 +0000 (15:42 -0400)]
scripts: docs_pr_only() considers PendingReleaseNotes

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 months agoceph-dev-pipeline: Fix syntax error
Zack Cerza [Tue, 22 Apr 2025 15:55:28 +0000 (09:55 -0600)]
ceph-dev-pipeline: Fix syntax error

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoMerge pull request #2358 from ceph/fixapt
Zack Cerza [Mon, 21 Apr 2025 23:03:17 +0000 (17:03 -0600)]
Merge pull request #2358 from ceph/fixapt

setup_container_runtime.sh: Add missing sudo

5 months agosetup_container_runtime.sh: Add missing sudo 2358/head
Zack Cerza [Mon, 21 Apr 2025 22:59:17 +0000 (16:59 -0600)]
setup_container_runtime.sh: Add missing sudo

... to the apt update invocation.

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoMerge pull request #2356 from ceph/setup-containers
Zack Cerza [Mon, 21 Apr 2025 17:43:52 +0000 (11:43 -0600)]
Merge pull request #2356 from ceph/setup-containers

Add scripts/setup_container_runtime.sh

5 months agoceph-dev-new-setup: Use setup_container_runtime.sh 2356/head
Zack Cerza [Thu, 17 Apr 2025 18:35:38 +0000 (12:35 -0600)]
ceph-dev-new-setup: Use setup_container_runtime.sh

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoAdd scripts/setup_container_runtime.sh
Zack Cerza [Thu, 17 Apr 2025 18:13:09 +0000 (12:13 -0600)]
Add scripts/setup_container_runtime.sh

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoMerge pull request #2355 from ceph/cdp-containerize
Zack Cerza [Fri, 18 Apr 2025 18:55:36 +0000 (12:55 -0600)]
Merge pull request #2355 from ceph/cdp-containerize

ceph-dev-pipeline: Build in containers

5 months agoceph-dev-pipeline: Use uv to set up chacractl 2355/head
Zack Cerza [Tue, 15 Apr 2025 17:21:34 +0000 (11:21 -0600)]
ceph-dev-pipeline: Use uv to set up chacractl

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Relax node labels
Zack Cerza [Tue, 15 Apr 2025 16:48:10 +0000 (10:48 -0600)]
ceph-dev-pipeline: Relax node labels

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline-trigger: CEPH_BUILD_BRANCH
Zack Cerza [Mon, 14 Apr 2025 19:47:48 +0000 (13:47 -0600)]
ceph-dev-pipeline-trigger: CEPH_BUILD_BRANCH

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Add CEPH_REPO param
Zack Cerza [Mon, 14 Apr 2025 19:47:22 +0000 (13:47 -0600)]
ceph-dev-pipeline: Add CEPH_REPO param

So that we can build release branches from ceph.git

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-new-setup: Only use podman if >= v4
Zack Cerza [Mon, 10 Mar 2025 18:19:36 +0000 (12:19 -0600)]
ceph-dev-new-setup: Only use podman if >= v4

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Use centos9 hosts
Zack Cerza [Thu, 6 Mar 2025 21:52:03 +0000 (14:52 -0700)]
ceph-dev-pipeline: Use centos9 hosts

We want to do containerized builds with recent podman versions.

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Avoid docker.io rate limits
Zack Cerza [Fri, 28 Feb 2025 21:40:27 +0000 (14:40 -0700)]
ceph-dev-pipeline: Avoid docker.io rate limits

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Copy less artifacts
Zack Cerza [Thu, 27 Feb 2025 18:15:22 +0000 (11:15 -0700)]
ceph-dev-pipeline: Copy less artifacts

This is purely to save time.

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Extract less from source dist
Zack Cerza [Thu, 27 Feb 2025 20:27:32 +0000 (13:27 -0700)]
ceph-dev-pipeline: Extract less from source dist

Only what we need to build the builder container.

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Build in containers
Zack Cerza [Mon, 10 Feb 2025 19:58:34 +0000 (12:58 -0700)]
ceph-dev-pipeline: Build in containers

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoMerge pull request #2343 from ceph/new-pip
Dan Mick [Fri, 18 Apr 2025 05:55:11 +0000 (22:55 -0700)]
Merge pull request #2343 from ceph/new-pip

build_utils: Use pip 24.0 by default

5 months agobuild_container: Look for pipeline's source dir
Zack Cerza [Tue, 25 Feb 2025 19:43:41 +0000 (12:43 -0700)]
build_container: Look for pipeline's source dir

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Use ceph-build branch param
Zack Cerza [Fri, 14 Feb 2025 05:23:56 +0000 (22:23 -0700)]
ceph-dev-pipeline: Use ceph-build branch param

I missed this when filing #2323

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoceph-dev-pipeline: Fix indentation
Zack Cerza [Tue, 11 Feb 2025 21:01:18 +0000 (14:01 -0700)]
ceph-dev-pipeline: Fix indentation

Signed-off-by: Zack Cerza <zack@cerza.org>
5 months agoMerge pull request #2348 from Matan-B/wip-matanb-cleanup-crimson-builds
Matan Breizman [Tue, 8 Apr 2025 07:28:13 +0000 (10:28 +0300)]
Merge pull request #2348 from Matan-B/wip-matanb-cleanup-crimson-builds

ceph-dev*: Remove Crimson unsupported builds

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
5 months agoceph-dev*: Remove Crimson un-supported builds 2348/head
Matan Breizman [Sun, 6 Apr 2025 10:54:04 +0000 (13:54 +0300)]
ceph-dev*: Remove Crimson un-supported builds

Crimson should be built only for main and T.
Remove R and S builds.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
5 months agoMerge pull request #2346 from Matan-B/wip-matanb-clean-with-seastar
Matan Breizman [Sun, 6 Apr 2025 08:16:49 +0000 (11:16 +0300)]
Merge pull request #2346 from Matan-B/wip-matanb-clean-with-seastar

ceph-dev*: final transition to WITH_CRIMSON

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
5 months agoMerge pull request #2345 from dmick/ceph-release-containers-defaults
Dan Mick [Fri, 4 Apr 2025 18:44:04 +0000 (11:44 -0700)]
Merge pull request #2345 from dmick/ceph-release-containers-defaults

ceph-release-containers: tweak the parameter defaults

5 months agoceph-dev*: final transition to WITH_CRIMSON 2346/head
Matan Breizman [Thu, 3 Apr 2025 12:36:22 +0000 (15:36 +0300)]
ceph-dev*: final transition to WITH_CRIMSON

Follow up to: https://github.com/ceph/ceph-build/pull/2329
Now that https://github.com/ceph/ceph/pull/62325 is merged.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
5 months agobuild_utils: Use pip 24.0 by default 2343/head
David Galloway [Tue, 1 Apr 2025 20:29:05 +0000 (16:29 -0400)]
build_utils: Use pip 24.0 by default

distutils is removed from python 3.12 so pip 20.3.4 is incompatible with systems running python3.12.

Ubuntu Noble is our new target Jenkins builder OS so let's bump to 24.0 (the latest as of this PR)

https://stackoverflow.com/questions/69919970/no-module-named-distutils-util-but-distutils-is-installed

Signed-off-by: David Galloway <david.galloway@ibm.com>
5 months agoceph-release-containers: tweak the parameter defaults 2345/head
Dan Mick [Tue, 1 Apr 2025 22:51:27 +0000 (15:51 -0700)]
ceph-release-containers: tweak the parameter defaults

Signed-off-by: Dan Mick <dan.mick@redhat.com>
5 months agoMerge pull request #2344 from dmick/fix-include-raw
Dan Mick [Tue, 1 Apr 2025 21:30:32 +0000 (14:30 -0700)]
Merge pull request #2344 from dmick/fix-include-raw

PR 2315 added back in an 'include-raw' which is deprecated

5 months agoPR 2315 added 'include-raw' which is deprecated 2344/head
Dan Mick [Tue, 1 Apr 2025 20:33:10 +0000 (13:33 -0700)]
PR 2315 added 'include-raw' which is deprecated

should use include-raw-verbatim.  Also, {} must be doubled.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
5 months agoMerge pull request #2342 from ceph/add-ceph-release-containers
Zack Cerza [Tue, 1 Apr 2025 17:26:34 +0000 (11:26 -0600)]
Merge pull request #2342 from ceph/add-ceph-release-containers

Add ceph-release-containers job

5 months agoMerge pull request #2315 from batrick/tentacle-kickoff
Radoslaw Zarzynski [Mon, 31 Mar 2025 18:10:23 +0000 (20:10 +0200)]
Merge pull request #2315 from batrick/tentacle-kickoff

Tentacle kickoff!

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 months agoAdd ceph-release-containers job 2342/head
Dan Mick [Tue, 25 Mar 2025 23:58:02 +0000 (16:58 -0700)]
Add ceph-release-containers job

Builds prerelease versions of ceph container images: two arch-specific
images and one 'manifest-list' image.  Pushed all to quay.ceph.io/ceph,
in a private set of repos (prerelease-amd64, prerelease-arm64, and
prerelease) for testing and signoff.  Once moved, the script
container/make-manifest-list.py can be used with the --promote flag to
promote them from quay.ceph.io to quay.io for public release.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
5 months agoMerge pull request #2341 from dmick/remove-container-build-from-ceph-build
Zack Cerza [Wed, 26 Mar 2025 21:41:03 +0000 (15:41 -0600)]
Merge pull request #2341 from dmick/remove-container-build-from-ceph-build

ceph-build: remove container build

5 months ago*: update relevant scripts and triggers for tentacle 2315/head
Patrick Donnelly [Fri, 10 Jan 2025 16:50:37 +0000 (11:50 -0500)]
*: update relevant scripts and triggers for tentacle

Signed-off-by: Patrick Donnelly <batrick@batbytes.com>
5 months agoscripts: add tentacle
Patrick Donnelly [Fri, 10 Jan 2025 16:33:41 +0000 (11:33 -0500)]
scripts: add tentacle

Signed-off-by: Patrick Donnelly <batrick@batbytes.com>
6 months agoMerge pull request #2340 from ceph/sepia-fog-fixes
David Galloway [Fri, 21 Mar 2025 16:16:59 +0000 (12:16 -0400)]
Merge pull request #2340 from ceph/sepia-fog-fixes

sepia-fog-images: Mark down systems we borrow instead of lock

6 months agoceph-build: remove container build 2341/head
Dan Mick [Thu, 20 Mar 2025 23:45:17 +0000 (16:45 -0700)]
ceph-build: remove container build

The container must be built from signed packages, and signing
is not part of the Jenkins build.  So we'll create two new jobs
to build the prerelease containers (so that builders don't have
to have access to both amd64 and arm64 build hosts).

Signed-off-by: Dan Mick <dan.mick@redhat.com>
6 months agosepia-fog-images: Mark down systems we borrow instead of lock 2340/head
David Galloway [Thu, 20 Mar 2025 22:09:14 +0000 (18:09 -0400)]
sepia-fog-images: Mark down systems we borrow instead of lock

Signed-off-by: David Galloway <david.galloway@ibm.com>
6 months agoMerge pull request #2333 from ceph/no-setup-arm64
Dan Mick [Tue, 11 Mar 2025 18:49:47 +0000 (11:49 -0700)]
Merge pull request #2333 from ceph/no-setup-arm64

ceph*setup: Do not run on arm64 builders

6 months agoMerge pull request #2329 from Matan-B/wip-matanb-add-with-crimson
Matan Breizman [Tue, 11 Mar 2025 09:49:23 +0000 (11:49 +0200)]
Merge pull request #2329 from Matan-B/wip-matanb-add-with-crimson

ceph-dev*: intermediate transition to WITH_CRIMSON

6 months agoceph*setup: Do not run on arm64 builders 2333/head
David Galloway [Tue, 4 Mar 2025 15:21:22 +0000 (10:21 -0500)]
ceph*setup: Do not run on arm64 builders

We're already low on ARM builders.  This is a waste of resources.

Signed-off-by: David Galloway <david.galloway@ibm.com>
6 months agoMerge pull request #2332 from ceph/tf-fixes
Dan Mick [Fri, 28 Feb 2025 19:13:58 +0000 (11:13 -0800)]
Merge pull request #2332 from ceph/tf-fixes

ansible: Fixes to podman subuid/subgid checks

6 months agoansible: Fixes to podman subuid/subgid checks 2332/head
David Galloway [Fri, 28 Feb 2025 18:55:16 +0000 (13:55 -0500)]
ansible: Fixes to podman subuid/subgid checks

I think this was working during my testing because sub{u,g}id_check.rc /wasn't/ 0.  I had manually modified the system so it wasn't in the same state as a fresh cloud instance.

I manually ran this playbook on an instance and confirmed it gets past the podman setup now.

Signed-off-by: David Galloway <david.galloway@ibm.com>
6 months agoMerge pull request #2331 from ceph/2284-followup
Dan Mick [Thu, 27 Feb 2025 07:41:03 +0000 (23:41 -0800)]
Merge pull request #2331 from ceph/2284-followup

Install and configure podman on Ubuntu builders

6 months agoansible: Install and configure podman on Ubuntu builders 2331/head
David Galloway [Thu, 27 Feb 2025 00:01:54 +0000 (19:01 -0500)]
ansible: Install and configure podman on Ubuntu builders

Signed-off-by: David Galloway <david.galloway@ibm.com>
6 months agoansible: Remove ceph-docs deps from builder playbook
David Galloway [Wed, 26 Feb 2025 14:39:07 +0000 (09:39 -0500)]
ansible: Remove ceph-docs deps from builder playbook

We're building docs in readthedocs.org infra now.

Signed-off-by: David Galloway <david.galloway@ibm.com>
6 months agoMerge pull request #2328 from phlogistonjohn/jjm-bwc-container_only_pr
Dan Mick [Wed, 26 Feb 2025 20:58:25 +0000 (12:58 -0800)]
Merge pull request #2328 from phlogistonjohn/jjm-bwc-container_only_pr

scripts: add build-with-container.py and friends to container_only_pr

6 months agoceph-dev*: intermediate transition to WITH_CRIMSON 2329/head
Matan Breizman [Tue, 25 Feb 2025 12:27:42 +0000 (14:27 +0200)]
ceph-dev*: intermediate transition to WITH_CRIMSON

See: https://github.com/ceph/ceph/pull/61672
This PR changes any WITH_SEASTAR / --with-seastar to WITH_CRIMSON /
--with crimson respectively. We should let our builders add the new flags
and once the PR is merged we could clean up the unused WITH_SEASTAR.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
7 months agoscripts: add build-with-container.py and friends to container_only_pr 2328/head
John Mulligan [Wed, 19 Feb 2025 16:10:11 +0000 (11:10 -0500)]
scripts: add build-with-container.py and friends to container_only_pr

Add the build-with-container.py script and the helper shell script and
Dockerfile that support the builder image to the container_only_pr
patterns in build_utils.sh.  This should save time and resources when
contributing patches to only these files in the ceph/ceph repo.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
7 months agoMerge pull request #2326 from dmick/pr-only-for
David Galloway [Tue, 18 Feb 2025 04:07:10 +0000 (23:07 -0500)]
Merge pull request #2326 from dmick/pr-only-for

Rework changed-files test (doc-only, container-only)

7 months agoMerge pull request #2327 from ceph/wip-skip-interp
David Galloway [Tue, 18 Feb 2025 03:56:26 +0000 (22:56 -0500)]
Merge pull request #2327 from ceph/wip-skip-interp

ansible: Add tag to python interpreter var setting tasks

7 months agoansible: Add tag to python interpreter var setting tasks 2327/head
David Galloway [Tue, 18 Feb 2025 03:13:09 +0000 (22:13 -0500)]
ansible: Add tag to python interpreter var setting tasks

I'm working on a combination of terraform and ansible to quickly
spin up instances in IBM Cloud so they can join Jenkins as builders.

Part of this process involves creating a virtualenv and running ansible
from it.  python-jenkins needs to be installed in the virtualenv and
setting the python interpreters inside the playbook breaks that.

This PR will let me `--skip-tags interpreter`

Signed-off-by: David Galloway <david.galloway@ibm.com>
7 months agoRework changed-files test (doc-only, container-only) 2326/head
Dan Mick [Sat, 15 Feb 2025 02:02:57 +0000 (18:02 -0800)]
Rework changed-files test (doc-only, container-only)

Take an array of patterns to compare each changed file against.
For docs, use the current suggestions from
https://tracker.ceph.com/issues/69650

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 months agoMerge pull request #2325 from dmick/ceph-dev-new-trigger-7-days
Dan Mick [Sat, 15 Feb 2025 02:25:29 +0000 (18:25 -0800)]
Merge pull request #2325 from dmick/ceph-dev-new-trigger-7-days

ceph-dev-new-trigger: use new feature, 7-day-old or newer branches

7 months agoceph-dev-new-trigger: use new feature, 7-day-old or newer branches 2325/head
Dan Mick [Sat, 15 Feb 2025 01:40:01 +0000 (17:40 -0800)]
ceph-dev-new-trigger: use new feature, 7-day-old or newer branches

Actually modify the trigger job to use choosing-strategy: ancestry and
maximum-age: 7, so that only branches newer than 7 days old get built.

Also set build-name to the branch being triggered, for clarity.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 months agoMerge pull request #2324 from dmick/jjb6
Dan Mick [Sat, 15 Feb 2025 00:31:44 +0000 (16:31 -0800)]
Merge pull request #2324 from dmick/jjb6

update all jobs to jenkins-job-builder v6; add 'choose from 7 days old' to ceph-dev-new-trigger

7 months agojenkins-job-builder,ceph-build-pull-requests: fetch and use jjb 6 2324/head
Dan Mick [Fri, 14 Feb 2025 03:28:46 +0000 (19:28 -0800)]
jenkins-job-builder,ceph-build-pull-requests: fetch and use jjb 6

currently it's actually a custom version of jjb6, to add
new choosing-strategy: ancestry, to be able to use
maximum-age in days to choose a branch to build.  This will
change to 6.5 once that branch is released.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
sq

7 months agoUpdate all jobs with ${VAR} syntax to ${{VAR}} for jjb6 compatibility
Dan Mick [Fri, 14 Feb 2025 03:11:49 +0000 (19:11 -0800)]
Update all jobs with ${VAR} syntax to ${{VAR}} for jjb6 compatibility

jenkins-job-builder 6 changed the interpretation of {var} to *always*
refer to a jjb macro; this is true even for ${VAR}, which we use in a
lot of place for Jenkins variable expansion (although not all; it's
unclear whether the {} are or ever were necessary, or in what exact
contexts).  So far, we've pinned jjb to <6, but we need new
functionality.

In any event, rather than changing all of them to the same {}-less style
that might work, change the ${} style to ${{}} and leave $ alone.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 months agoUpdate all jobs for jjb6: !include-raw -> !include-raw-verbatim
Dan Mick [Fri, 14 Feb 2025 04:10:06 +0000 (20:10 -0800)]
Update all jobs for jjb6: !include-raw -> !include-raw-verbatim

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 months agoMerge pull request #2323 from ceph/pipeline-branch
Dan Mick [Wed, 12 Feb 2025 22:59:46 +0000 (14:59 -0800)]
Merge pull request #2323 from ceph/pipeline-branch

ceph-dev-pipeline: Add CEPH_BUILD_BRANCH param

7 months agoceph-dev-pipeline: Add CEPH_BUILD_BRANCH param 2323/head
Zack Cerza [Fri, 7 Feb 2025 21:58:55 +0000 (14:58 -0700)]
ceph-dev-pipeline: Add CEPH_BUILD_BRANCH param

So that we can easily test in-development changes to this pipeline.

Signed-off-by: Zack Cerza <zack@cerza.org>
7 months agoMerge pull request #2320 from rhcs-dashboard/node-install-for-windows-test
Dan Mick [Wed, 12 Feb 2025 18:43:44 +0000 (10:43 -0800)]
Merge pull request #2320 from rhcs-dashboard/node-install-for-windows-test

ceph-website: setup nodejs for building the website

7 months agoceph-website: setup nodejs for building the website 2320/head
Nizamudeen A [Mon, 3 Feb 2025 09:04:36 +0000 (14:34 +0530)]
ceph-website: setup nodejs for building the website

Signed-off-by: Nizamudeen A <nia@redhat.com>
7 months agoMerge pull request #2322 from dmick/wip-quiet-submodule-update
David Galloway [Fri, 7 Feb 2025 18:20:58 +0000 (13:20 -0500)]
Merge pull request #2322 from dmick/wip-quiet-submodule-update

ceph-{dev-,}setup: Make git submodule operations much quieter.

7 months agoceph-{dev-,}setup: Make git submodule operations much quieter. 2322/head
Dan Mick [Fri, 7 Feb 2025 02:05:35 +0000 (18:05 -0800)]
ceph-{dev-,}setup: Make git submodule operations much quieter.

After f381e3f05fcb08a7b1a3a1aa8f86e066bd4718ba, which is quite the
win for ceph-dev-new-setup, credit to zack@redhat.com

Signed-off-by: Dan Mick <dan.mick@redhat.com>
7 months agoMerge pull request #2321 from ceph/pipeline-branch
Dan Mick [Fri, 7 Feb 2025 00:12:33 +0000 (16:12 -0800)]
Merge pull request #2321 from ceph/pipeline-branch

Correct ceph-dev-pipeline branch

7 months agoCorrect ceph-dev-pipeline branch 2321/head
Zack Cerza [Thu, 6 Feb 2025 23:58:55 +0000 (16:58 -0700)]
Correct ceph-dev-pipeline branch

Signed-off-by: Zack Cerza <zack@cerza.org>
7 months agoMerge pull request #2310 from ceph/jenkinsfile
Zack Cerza [Thu, 6 Feb 2025 23:42:46 +0000 (16:42 -0700)]
Merge pull request #2310 from ceph/jenkinsfile

Add ceph-dev-pipeline