ceph-dev-cron: ls-remote failure is not fatal

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2551 from ceph/stupid

sign-rpms: extra \n

sign-rpms: extra \n

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2550 from ceph/get

sync-pull: Check the actual repo readiness

sync-pull: Check the actual repo readiness

This has been broken for.. possibly ever.

--head results in 405 Method Not Allowed

Just a GET results in 200 no matter what, whether the repo exists or not.

```
++ curl -fsSo - --connect-timeout 5 --max-time 10 https://shaman.ceph.com/api/repos/ceph/reef/efac5a54607c13fa50d4822e50242b86e6e446df/rocky/10/flavors/default/
++ jq -r '.[].status // empty'
+ status=
+ '[' '' = ready ']'
+ echo 'Shaman repo for rocky/10 is not ready (status: unknown). Skipping.'
Shaman repo for rocky/10 is not ready (status: unknown). Skipping.
```

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2540 from ceph/sign-256

sign-rpms: Sign using SHA256 algo

Merge pull request #2549 from ceph/branch-name

Make get-tarballs.sh executable

Make get-tarballs.sh executable

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2499 from jamiepryde/umbrella-release

Umbrella kickoff!

Merge pull request #2546 from shraddhaag/wip-shraddhaag-improve-ci-for-docs

disable CI checks for PRs with only docs/QA changes

disable CI checks for PRs with only docs/QA changes

Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #2548 from dmick/add-arm64-c9-main

Add centos9/arm64 to main builds

Add centos9/arm64 to main builds

Signed-off-by: Dan Mick <dan.mick@redhat.com>

ceph-dev-cron: Add umbrella to Jenkinsfile

Signed-off-by: Jamie Pryde <jamiepry@uk.ibm.com>

*: Update scripts and triggers for Umbrella

Signed-off-by: Jamie Pryde <jamiepry@uk.ibm.com>

Merge pull request #2547 from ceph/wip-revert-make-check-qa-only

ceph-pull-requests: don't skip qa-only PRs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

ceph-pull-requests: don't skip qa-only PRs

This is a partial revert of commit 78849bdf7d0d ("ceph-pull-requests:
Skip qa-only PRs").  Unfortunately "make check" needs to be run even on
qa-only PRs at least once to get linter coverage for files under qa/.

Revert to running "make check" on qa-only PRs for ceph-pull-requests
but continue skipping it for ceph-pull-requests-arm64.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #2545 from ceph/cb-small

ceph-build-pull-requests fixes

Merge pull request #2543 from ceph/arm64

ceph-dev-cron: Build main for arm64

ceph-build-pull-requests: setuptools for pkg_resources

Signed-off-by: David Galloway <david.galloway@ibm.com>

ceph-build-pull-requests: Don't reuse previous venv

If we add a pkg to pkgs[@], it won't actually get installed in a reused venv if one exists

Signed-off-by: David Galloway <david.galloway@ibm.com>

ceph-build-pull-requests: Run on small

Signed-off-by: David Galloway <david.galloway@ibm.com>

ceph-dev-cron: Comment explaining cfg

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2544 from ceph/csd-noarch

ceph-source-dist: Run on any architecture

ceph-source-dist: Run on any architecture

Signed-off-by: Zack Cerza <zack@cerza.org>

ceph-dev-cron: Build main for arm64

Signed-off-by: David Galloway <david.galloway@ibm.com>

scripts/build_utils: Update for Umbrella

Signed-off-by: Jamie Pryde <jamiepry@uk.ibm.com>

Merge pull request #2541 from ceph/cron-poll

ceph-dev-cron: Use straight cron/timed trigger

ceph-dev-cron: Use straight cron/timed trigger

PollSCM was polling ceph-build.git for changes instead of ceph.git.

Signed-off-by: David Galloway <david.galloway@ibm.com>

sign-rpms: Sign using SHA256 algo

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2538 from ceph/api

ceph-api: Use modern label. They've been running on Noble for weeks.

Merge pull request #2533 from ceph/cron-pipe

ceph-dev-cron: Convert to groovy, trigger ceph-dev-pipeline instead

ceph-api: Use modern label. They've been running on Noble for weeks.

Signed-off-by: David Galloway <david.galloway@ibm.com>

ceph-dev-cron: Convert to groovy, trigger ceph-dev-pipeline instead

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2537 from ceph/pipx

builder.yml: Install pipx

builder.yml: Install pipx

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2536 from ceph/fix-uv-installs

setup_chacractl.sh: Use setup_uv.sh

setup_uv.sh: Do not fail needlessly on apt systems

Signed-off-by: Zack Cerza <zack@cerza.org>

setup_chacractl.sh: Use setup_uv.sh

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2535 from rhcs-dashboard/qa-not-ignore

ceph-pr-api: don't ignore qa/ folder changes

ceph-pr-api: don't ignore qa/ folder changes

API tests are run from qa/ folder so let's not ignore those changes

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #2534 from ceph/fix-rebuild

ceph-tag: Fix condition for RCs

ceph-tag: Fix condition for RCs

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2532 from ceph/trixie

Add Trixie

Add Trixie

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2531 from Matan-B/wip-matanb-debug-container-prune

quay-pruner/build/util.py: handle debug tag suffix

quay-pruner/build/util.py: handle debug tag suffix

Follow-up to: https://github.com/ceph/ceph/pull/67041

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #2530 from rhcs-dashboard/sync-images-revert-fix

sync-images: fix build script

sync-images: fix build script

i accidentally merged the last PR but forgot to push my local changes to
the PR before doing it. I was testing things locally and thought I
pushed it. So adding the fix that were in my local.

I added GODEBUG=http2client=0  to fix the http client related timeouts
that were happening frequently. And also added a retry so that it won't
fail immediately.

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #2524 from rhcs-dashboard/sync-image-fix

sync-images: failing due to ratelimiting in dockerhub

Merge pull request #2529 from ceph/libvirt-restart

scripts: Refactor restart_libvirt_services

scripts: Refactor restart_libvirt_services

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2528 from ceph/cephadm-ansible-py3.12

cephadm-ansible-prs: do not pin to pip 22.4.0

cephadm-ansible-prs: do not pin to pip 22.4.0

given that the builder is now using py3.12, we can't pin to 22.4.0 as it
depends on distutils that was dropped from py3.12

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2527 from ceph/cephadm2

cephadm-ansible-prs: Set !centos9 on both labels

cephadm-ansible-prs: Set !centos9 on both labels

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2526 from ceph/cephadm-prs-update

cephadm-ansible-prs: Don't run on centos9

cephadm-ansible-prs: Don't run on centos9

95% of the builders are Ubuntu Noble and most of them have vagrant & vagrant-libvirt installed

Signed-off-by: David Galloway <david.galloway@ibm.com>

sync-images: failing due to ratelimiting in dockerhub

So trying to authenticate which might increase the ratelimit

https://jenkins.ceph.com/job/sync-images/651/console
```
Copying image sha256:a99b7d9812dbb7527eab8161807e879c3e66951ddccf21c5302061a651289da6 (15/16)
time="2025-12-25T20:16:10Z" level=fatal msg="Error copying ref \"docker://nginx:1.27.4\": copying image 15/16 from manifest list: determining manifest MIME type for docker://nginx:1.27.4: reading manifest sha256:a99b7d9812dbb7527eab8161807e879c3e66951ddccf21c5302061a651289da6 in docker.io/library/nginx: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit"
Build step 'Execute shell' marked build as failure
```

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #2523 from ceph/migrate-cephadm-ansible-jenkins

migrate cephadm-ansible to the main jenkins

migrate cephadm-ansible to the main jenkins

This commit removes this file in order to make cephadm-ansible CI jobs
use the main jenkins.

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #2520 from ceph/wip-kernel-ice

kernel: compile ice.ko module

kernel: compile ice.ko module

This driver is needed for

01:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-XXV for SFP (rev 02)
01:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-XXV for SFP (rev 02)

on the new trial nodes.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #2519 from ceph/no-centos-make-cehck

ceph-pull-request: Don't run make check on CentOS9

ceph-pull-request: Don't run make check on CentOS9

Not ideal but easiest for stabilization for now

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2518 from ceph/fix-withcrimson

ceph-dev-pipeline: fix withCrimson def

ceph-dev-pipeline: fix withCrimson def

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2516 from ceph/withcrimson

ceph-dev-pipeline: Still send with_crimson=true for main and wip

ceph-dev-pipeline: Still send with_crimson=true

The replacement of crimson builds with debug builds is still half baked.  ceph.spec and install-deps are still expecting with_crimson to be set if the crimson dependency packages should be installed.

See https://github.com/ceph/ceph/blame/main/ceph.spec.in#L367-L384 for the dependencies that will never get installed.

This is manifesting in:
```
+ rpmbuild --rebuild '-D_topdir /ceph/rpmbuild' --with=sccache --without=dwz --with=tcmalloc /ceph/ceph-20.3.0-4645.gcfa448da.el9.src.rpm
error: Failed build dependencies:
cryptopp-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
gcc-toolset-13-gcc-plugin-annobin is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
gcc-toolset-13-libasan-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
gcc-toolset-13-libubsan-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
gnutls-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
hwloc-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
libasan is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
libpciaccess-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
libubsan is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
lksctp-tools-devel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
ragel is needed by ceph-2:20.3.0-4645.gcfa448da.el9.x86_64
Installing /ceph/ceph-20.3.0-4645.gcfa448da.el9.src.rpm
2025-12-22 17:48:10,148: INFO: step done: rpm failed in 00:00:27
```

Nothing will ever tell build-with-container.py or install-deps.sh to pull those dependencies in because we're no longer setting WITH_CRIMSON due to this removal https://github.com/ceph/ceph-build/commit/0f0e4fd7dea0c06d855b93581e5b13cc0bf4c350#diff-d34216471695ce2f36f9cf1550524392c85b94d0566b3bc6d591383411b91f25R218-L381.

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2513 from ceph/apt-mirror-cwi

ceph-windows: Update qcow2 image location. Bump VM spec.

Merge pull request #2514 from ceph/fix-ceph-api

ceph-pr-api: Fix parameter

ceph-pr-api: Fix parameter

It's actually impossible to manually trigger this job right now without this

Signed-off-by: David Galloway <david.galloway@ibm.com>

ceph-windows: Update qcow2 image location. Bump VM spec.

The previous one was living on the LRC and served via reverse proxy.  The RDU lab was shut down earlier and I neglected to back the qcow2 image up.  Who knows when the old LRC will be brought back online so the image has been rebuilt.

Also bumping the VM resources.

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2512 from ceph/locale

builder.yaml: Ensure locales are installed

Revert "ceph-build-pull-requests: set UTF-8 for ansible-galaxy"

This reverts commit 1f500f1d47dd1ddb463489b7061fab3576c913d6.

Ensure locales are installed. Set correct format.

I guess Ubuntu just tolerated the incorrect spelling.  Or used to?  Anyway..

```
root@toko07:~# grep PRETTY_NAME /etc/os-release
PRETTY_NAME="Ubuntu 24.04.3 LTS"
root@toko07:~# locale -a | grep -i en_us
en_US.utf8

[root@toko08 ~]# grep PRETTY_NAME /etc/os-release
PRETTY_NAME="CentOS Stream 9"
[root@toko08 ~]# locale -a | grep -i en_us
en_US
en_US.iso885915
en_US.utf8
```

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2497 from Matan-B/wip-matanb-crimson-cleanup

build flavors: Cleanup "crimson", introduce "debug"

Merge pull request #2508 from ceph/newvagrant

builder.yaml: CentOS version-specific chacra repo for vagrant

Merge pull request #2509 from ceph/cwpr

ceph-windows fixes

ceph-windows-PRs: Fix virt-install command

Behavior changed in newer virt-install.

`--import` says boot the prebuilt qcow2.  Older virt-install versions tolerated `--boot hd` without `--import` but now `--import` is required in this scenario and `--boot hd` is redundant.

Signed-off-by: David Galloway <david.galloway@ibm.com>

ceph-windows-image-build: Typo

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2507 from ceph/no-chgrp

No chgrp

builder.yaml: CentOS version-specific chacra repo for vagrant

We know X version works on CentOS 7.  We need a newer version for CentOS 9.  We should have a per major version repo.

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2506 from dmick/remove-virtualenv

quay-pruner: virtualenv is no more, use python3 -mvenv

ceph-dev-new-setup/build: Introduce crimson-tentacle builds

See the following comment:
```
Tentacle is the last release that needs dedicated Crimson builds,
Later releases are able to use Crimson with the default build.
As the "Crimson flavor" is no longer available, we need a *temporary* way
to be able build Crimson for tentacle.
Note: This could be removed once Crimson we have Umbrella release builds.
```

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Cleanup "crimson" flavor

With https://github.com/ceph/ceph/pull/66229 merged,
Crimson is now included (though not used) by default in our RPM builds.
This means the existing default flavor can also be used for Crimson testing
by selecting Crimson as the default OSD package.

Notes:

* The previous workaround related to DWITH_STATIC_LIBSTDCXX is no longer
  relevant for Crimson (it was tied to older compiler issues).

* The crimson-only branch name selection is also cleaned up,
  as centos9-only can now be used instead.

* This change breaks Crimson Tentacle CI builds:
  The packaging update that includes Crimson in RPM builds was not backported to Tentacle.
  Tentacle builds would still require a dedicated flavor that enables WITH_CRIMSON
  However, since Crimson changes have not been backported to Tentacle (since the first RCA),
  there is no strong reason to keep building and testing the same Crimson HEAD.
  So we can use this opprtuinity to stop nightly Crimson/Tentacle builds and tests.

  See last Crimson tentacle run, (which is not expected to change):
  https://pulpito.ceph.com/teuthology-2025-11-22_22:56:11-crimson-rados-tentacle-distro-crimson-debug-smithi/

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #2498 from ceph/no-more-nice-guy

All: Limit PR checks to Ceph org

setup_container_runtime: Move rm -f ceph_build after perms fix

We need to fix permissions first then delete the container if there were root-owned layers left over

Signed-off-by: David Galloway <david.galloway@ibm.com>

setup_container_runtime: Proper permission handling

On fresh installs on Noble, `groups` returns `users`; not jenkins-build.

```
jenkins-build@toko01:~$ podman system reset --force
podman system info
WARN[0000] Found incomplete layer "92e4beace908310dc4c6a279e3a4cb7391da53fc9a8d3cce99402fdebe6b67da", deleting it
ERRO[0002] 23 errors occurred:
* unlinkat /home/jenkins-build/.local/share/containers/storage/overlay/0ec3f2ca3bf6a1641caed388c53e76b63e9840354c473412e3deb7d00a510448/diff/usr: permission denied
* unlinkat /home/jenkins-build/.local/share/containers/storage/overlay/8a5ece4bcb661d397bb30a79c74d26e202c4536bf12d07bcf351d6c2fab65790/diff/usr: permission denied
* unlinkat /home/jenkins-build/.local/share/containers/storage/overlay/ee5a1067f3e86d31a3bf233c0c60c6087b2bd39e9e9b3cb5cd8feea92f1e3692/diff/run: permission denied
```

Signed-off-by: David Galloway <david.galloway@ibm.com>

quay-pruner: virtualenv is no more, use python3 -mvenv

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #2505 from ceph/nodename

builder: Fix and combine Sepia-specific tasks

builder: Fix and combine Sepia-specific tasks

Forgot to add 10.20 to the nodename task

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2502 from ceph/needsrestart

builder: Configure (disable) needrestart

Merge pull request #2503 from ceph/no-sudo-templates

builder.yml: Do not use sudo locally

Merge pull request #2504 from dmick/utf8

ceph-build-pull-requests: set UTF-8 for ansible-galaxy

Merge pull request #2501 from ceph/dgalloway-toko

builder.yml: Add POK

ceph-build-pull-requests: set UTF-8 for ansible-galaxy

Signed-off-by: Dan Mick <dan.mick@redhat.com>

builder.yml: Do not use sudo locally

Signed-off-by: David Galloway <david.galloway@ibm.com>

builder: Configure (disable) needrestart

Signed-off-by: David Galloway <david.galloway@ibm.com>

builder.yml: Add POK

Signed-off-by: David Galloway <david.galloway@ibm.com>