pyproject: set minimum python3.12 as requirement

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Merge pull request #2226 from vamahaja/packaging-rocky-version

packaging: use major version for Pulp `distro_version` label

packaging: use major version for Pulp `distro_version` label

`PulpProject._search()` was sending the full `os_version` in the `distro_version`
Pulp label, while repo paths and Shaman use the major version. Derive
`distro_version` from `_get_distro()` so RPM distros search by major release
and deb distros still use codename.

Signed-off-by: Vaibhav Mahajan <vamahaja@redhat.com>

Merge pull request #2224 from ceph/fix-nc

list_locks: Fix query when machine_type is None

Merge pull request #2219 from ceph/uv-updates

Small packaging and dependency updates

Merge pull request #2225 from kshtsk/wip-update-os-versions

update os versions

Move tests to tests/

This has more or less become the standard. It is also the best way for us to
avoid shipping tests in the wheel, because of setuptools' behavior when using
pyproject.toml. For more information, see:
https://github.com/pypa/setuptools/issues/3260

Signed-off-by: Zack Cerza <zack@cerza.org>

orchestra/opsys: add rocky 9.8 and 10.2

Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>

orchestra/opsys: add Ubuntu LTS 26.04 (Resolute Raccoon)

Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>

orchestra/opsys: add sle16

Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>

orchestra/opsys: opensuse issued Leap 16.1 Alpha

Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>

orchestra/opsys: add trixie

Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>

orchestra/opsys: add alma 9.8, 10.2

Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>

pyproject.toml: Absorb pytest config

Signed-off-by: Zack Cerza <zack@cerza.org>

uv audit --upgrade

This updates a few of our dependencies to address security vulnerabilities: It
uses uv's new audit feature: https://astral.sh/blog/uv-audit

Signed-off-by: Zack Cerza <zack@cerza.org>

pyproject.toml: Exclude docs from wheel

This fixes the following warning:

  _Warning: Package 'docs.docker-compose.testnode' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'docs.docker-compose.testnode' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'docs.docker-compose.testnode' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'docs.docker-compose.testnode' to be distributed and are
          already explicitly excluding 'docs.docker-compose.testnode' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

Signed-off-by: Zack Cerza <zack@cerza.org>

pyproject.toml: Fix deprecations

Signed-off-by: Zack Cerza <zack@cerza.org>

list_locks: Fix query when machine_type is None

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2222 from ceph/dependabot/uv/cryptography-48.0.1

build(deps): bump cryptography from 48.0.0 to 48.0.1

Merge pull request #2214 from ceph/scripts-tests

scripts/tests: Speed up tests with importlib

build(deps): bump cryptography from 48.0.0 to 48.0.1

Bumps [cryptography](https://github.com/pyca/cryptography) from 48.0.0 to 48.0.1.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/48.0.0...48.0.1)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-version: 48.0.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #2217 from ceph/ci-devstack

integration: Use ceph-devstack

Merge pull request #2157 from batrick/remove-ceph-deploy

teuthology: remove ceph-deploy

teuthology: remove ceph-deploy

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

integration: Use ceph-devstack

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2163 from vamahaja/pulp-project

feature: add `PulpProject` class for Pulp-based package repository support

feature: add `PulpProject` class for Pulp-based package repository support

Add a `PulpProject` subclass of `GitbuilderProject` so teuthology can use
Pulp-hosted package repos when `config.package_source` is `pulp`, alongside
the existing `Gitbuilder` and `Shaman` artifact backends.

Signed-off-by: Vaibhav Mahajan <vamahaja@redhat.com>

Merge pull request #2201 from ceph/wip-73843

task/install/deb: Add'l debugging info for held apt lock

Merge pull request #2216 from ceph/wip-76775

report.try_delete_jobs(): Do not fail on 404

report.try_delete_jobs(): Do not fail on 404

Signed-off-by: Zack Cerza <zack@cerza.org>

scripts/tests: Speed up tests with importlib

These take one second instead of 31.

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2213 from batrick/fetchhead

teuthology/repo_utils: update shallow references

teuthology/repo_utils: update shallow references

If the remote itself is shallow, otherwise the fetch will fail:

    batrick@menzoberranzan ~/trash/test$ git fetch https://git.ceph.com/ceph-cm-ansible.git main
    remote: Enumerating objects: 11626, done.
    remote: Counting objects: 100% (11626/11626), done.
    remote: Compressing objects: 100% (4150/4150), done.
    remote: Total 11626 (delta 7278), reused 10977 (delta 6899), pack-reused 0 (from 0)
    Receiving objects: 100% (11626/11626), 3.20 MiB | 40.43 MiB/s, done.
    Resolving deltas: 100% (7278/7278), done.
    warning: rejected refs/heads/main because shallow roots are not allowed to be updated

Fixes: https://tracker.ceph.com/issues/77076
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge PR #2209 into main

* refs/pull/2209/head:
teuthology/task/kernel: use sudo to examine grub.cfg

Merge pull request #2210 from ceph/dev-container

containers/teuthology-dev: Skip epel during ansible

containers/teuthology-dev: Skip epel during ansible

This may have been broken by https://github.com/ceph/ceph-sepia-secrets/pull/1132

Signed-off-by: Zack Cerza <zack@cerza.org>

teuthology/task/kernel: use sudo to examine grub.cfg

Ubuntu 24.04 apparently protects this:

    2026-05-24T09:00:23.747 DEBUG:teuthology.orchestra.run:got remote process result: 2
    2026-05-24T09:00:23.747 INFO:teuthology.orchestra.run.trial136.stderr:grep: /boot/grub/grub.cfg: Permission denied

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #2208 from ceph/dev-container

containers/teuthology-dev: Use cm user

Merge pull request #2204 from ceph/nc-logging

node-cleanup: Improve verbose logging and add machine type filter

Merge pull request #2173 from ceph/dispatcher-killmode

systemd: Use SIGTERM to stop

Merge pull request #2207 from batrick/clone-once

teuthology/repo_utils: optimize repository cloning via bare repositories and worktrees

Merge pull request #2206 from batrick/cephadm-podman

teuthology/orchestra/daemon/cephadmunit: lookup container runtime

containers/teuthology-dev: Lower watchdog interval

Signed-off-by: Zack Cerza <zack@cerza.org>

containers/teuthology-dev: Use cm user

Signed-off-by: Zack Cerza <zack@cerza.org>

teuthology/repo_utils: Optimize repository cloning via bare repositories and worktrees

Repeatedly performing full clones of the QA suite and other repositories
for different commits or branches slows down testing iterations and
consumes excess disk space and I/O.

This commit introduces an optimization that initializes a single bare
clone of a target repository. It subsequently utilizes git worktree to
provision lightweight, isolated workspaces for requested commits. This
reduces redundant network fetches and significantly accelerates
repository checkout operations.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

teuthology/repo_utils: strip only .git suffix

Previous code with strip any trailing letters in .git.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

teuthology/orchestra/daemon/cephadmunit: lookup container runtime

Fixes: https://tracker.ceph.com/issues/76926
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

Merge pull request #2205 from batrick/lupa-2.8

lupa: update to 2.8 and use lua 5.4

lupa: update to 2.8 and use lua 5.4

Do not incidentally upgrade Lua to 5.5.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>

node-cleanup: List total lock count in verbose

node-cleanup: Optionally filter by machine type

node-cleanup: Log a message when nothing stale

task/install/deb: Add'l debugging info for held apt lock

For https://tracker.ceph.com/issues/73843

Signed-off-by: David Galloway <david.galloway@ibm.com>

Merge pull request #2202 from Adarsha1999/fix/deb-apt-key-https

task/install/deb: fix apt key fetch hanging when http is blocked

task/install/deb: fix apt key fetch hanging when http is blocked

Signed-off-by: Adarsha Dinda <adarshadinda@Adarshas-MacBook-Pro.local>

Merge pull request #2198 from ceph/wip-55347

task/selinux: allowlist iptables changes

Merge pull request #2200 from ceph/update-deps

Update urllib3

Merge pull request #2199 from ceph/quiet-bootstrap

bootstrap: Make dependency install less verbose

Merge pull request #2194 from ceph/dependabot/uv/jinja2-3.1.6

build(deps): bump jinja2 from 3.1.5 to 3.1.6

Update urllib3

Signed-off-by: Zack Cerza <zack@cerza.org>

bootstrap: Make dependency install less verbose

Signed-off-by: Zack Cerza <zack@cerza.org>

dispatcher: Use SIGTERM to stop

The sentinel file method was a "quick hack" that lasted years

Signed-off-by: Zack Cerza <zack@cerza.org>

systemd: Set dispatcher KillMode to 'process'

So that job process don't die when the dispatcher restarts.

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2196 from kshtsk/wip-interruptable-dispatcher

Cleanup dispatcher code

task/selinux: allowlist iptables changes

Fixes: https://tracker.ceph.com/issues/55347
Signed-off-by: David Galloway <david.galloway@ibm.com>

dispatcher: save initial config as 'orig.config.yaml' again

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Merge pull request #2195 from ceph/update-deps

uv.lock --upgrade

dispatcher: save default job config to a separate file

In order to still make it possible to reuse original config
from the queue, don't be confused by 'orig.config.yaml',
which is used in teuthology.run after joining arguments.

So we save it to 'default.config.yaml', and later can
be used like:

```
teuthology path/to/default.config.yaml path/to/targets.yaml
```

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

dispatcher/test: fix config arg

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

supervisor: reuse provided config path to run a job

The supervisor just ignored --job-config argument when
it came to run a job and provided hard coded 'orig.config.yaml'

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

dispatcher: cleanup create_job_archive

Get rid of create_job_archive and other cleanups.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

dispatcher: do not fetch main teuthology and qa

Because each run have can have own branch and sha1,
no need to fetch main for teuthology.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

dispatcher: cleanup from result_proc

The teuthology-results is not run in dispatcher anymore,
instead it is started in from the supervisor.

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Remove a few unuse dependencies

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock --upgrade

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2188 from ceph/update-deps

Update greenlet

build(deps): bump jinja2 from 3.1.5 to 3.1.6

Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.5 to 3.1.6.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.5...3.1.6)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-version: 3.1.6
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #2189 from ceph/proj-cleanup

Remove requirements.txt and MANIFEST.in

Merge pull request #2187 from kshtsk/wip-overrides-order

Fix overrides order

Remove MANIFEST.in

Signed-off-by: Zack Cerza <zack@cerza.org>

Remove requirements.txt

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade greenlet

Signed-off-by: Zack Cerza <zack@cerza.org>

provision/downburst: preinstall bindutils for rocky to

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

suite: fix order of yaml files overriding

For correct overrides which can be provided in extra yaml arguments
to teuthology-suites the joined yaml of job_config from suite directory
must go first in order.

Fixes: 96f38f2136dd2a4f64cc741919b85dc65a9df536
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>

Merge pull request #2184 from ceph/uv-updates

uv.lock: Update dependencies

Merge pull request #2186 from ceph/rm-ci-workaround

workflows/dependencies: Remove workaround

workflows/dependencies: Remove workaround

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade pytest

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade lxml

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade pyopenssl

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade pygments

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade pyasn1

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade pyjwt

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade cryptography

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Upgrade requests

Signed-off-by: Zack Cerza <zack@cerza.org>

uv.lock: Update to revision 3

This was done by running 'uv lock'.

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #2185 from ceph/fix-ci

Fix dependencies CI

workflows/dependencies: Install pkgs explicitly

This is to temporarily work around quoting bug in bootstrap, since we run main's
copy first.

Signed-off-by: Zack Cerza <zack@cerza.org>

bootstrap: Install debs quietly

Signed-off-by: Zack Cerza <zack@cerza.org>

bootstrap: Fix quoting

Signed-off-by: Zack Cerza <zack@cerza.org>