]>
git.apps.os.sepia.ceph.com Git - teuthology.git/log
Patrick Donnelly [Mon, 21 Jul 2025 15:49:32 +0000 (11:49 -0400)]
task/internal/syslog: parallelize and debugify gzip of syslogs
To match what we do for the ceph task.
Looks like:
2025-07-21T17:04:25.354 INFO:teuthology.task.internal.syslog:Compressing syslogs...
2025-07-21T17:04:25.354 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose --
2025-07-21T17:04:25.357 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose --
2025-07-21T17:04:25.359 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose --
2025-07-21T17:04:25.380 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2025-07-21T17:04:25.380 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2025-07-21T17:04:25.380 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log
2025-07-21T17:04:25.381 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2025-07-21T17:04:25.381 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log
2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2025-07-21T17:04:25.386 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log
2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2025-07-21T17:04:25.423 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz
2025-07-21T17:04:25.426 INFO:teuthology.orchestra.run.smithi186.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz
2025-07-21T17:04:25.502 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 21 Jul 2025 13:42:36 +0000 (09:42 -0400)]
task/internal/syslog: gzip journal along with everything else
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 21 Jul 2025 13:39:03 +0000 (09:39 -0400)]
tasks/internal/syslog: gather all journald entries
Soemtimes a machine crashes during tests and log entries around that time are
not persisted because we're only looking at this boot.
(This choice seem odd since the lifetime of these operating system images is
the same as the teuthology run.)
Now looks like:
2025-07-21T15:01:22.249 INFO:teuthology.task.internal.syslog:Gathering journactl...
2025-07-21T15:01:22.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log
2025-07-21T15:01:22.254 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log
2025-07-21T15:01:22.256 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log
From: /teuthology/pdonnell-2025-07-21_14:01:58-fs-main-distro-default-smithi/
8399938 /teuthology.log
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Zack Cerza [Wed, 16 Jul 2025 16:19:55 +0000 (10:19 -0600)]
Merge pull request #2066 from deepssin/issue-72055
Add openstack dependencies in docs/requirements
deepssin [Wed, 16 Jul 2025 10:49:17 +0000 (06:49 -0400)]
Add openstack dependencies in docs/requirements
Signed-off-by: deepssin <deepssin@redhat.com>
Zack Cerza [Mon, 14 Jul 2025 22:59:29 +0000 (16:59 -0600)]
Merge pull request #2065 from ceph/job-flavor
Add flavor to job yaml (at Job creation)
Zack Cerza [Mon, 14 Jul 2025 22:57:32 +0000 (16:57 -0600)]
Merge pull request #2064 from ceph/run-dev-container-ci
ci: run dev_container build for PRs
Vallari Agrawal [Thu, 10 Jul 2025 06:30:08 +0000 (12:00 +0530)]
ci: run dev_container build for PRs
Build the image for PRs but do not push.
For pushes to main branch, push to registery.
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
Vallari Agrawal [Fri, 11 Jul 2025 14:16:22 +0000 (19:46 +0530)]
Add flavor to job yaml (at Job creation)
Currently, when creating jobs, paddles
does not get Job.flavor information.
This leads to "flavor" getting set only
after the job is completed.
This commit adds "flavor" to job yaml config
so Job.flavor is set when creating jobs.
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
Vallari Agrawal [Fri, 11 Jul 2025 03:32:49 +0000 (09:02 +0530)]
Merge pull request #2063 from deepssin/issue-72055
Add jq and curl to teuthology-dev Dockerfile
deepssin [Thu, 10 Jul 2025 05:58:46 +0000 (01:58 -0400)]
Add jq and curl to teuthology-dev Dockerfile
Signed-off-by: deepssin <deepssin@redhat.com>
Zack Cerza [Wed, 9 Jul 2025 17:58:46 +0000 (11:58 -0600)]
Merge pull request #2062 from VallariAg/fix-container-image
containers: set image as ceph.containers.image
Vallari Agrawal [Wed, 9 Jul 2025 17:15:24 +0000 (22:45 +0530)]
containers: set image as ceph.containers.image
instead of ceph.image
As cephadm task overrides from here: https://github.com/ceph/ceph/blob/
ef15ecb8821fd79e24b046d2812696bd290c8489 /qa/tasks/cephadm.py#L2301
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
David Galloway [Wed, 2 Jul 2025 18:15:44 +0000 (14:15 -0400)]
Merge pull request #2061 from ceph/wip-rocky10
opsys.py: Add Rocky 10
Vallari Agrawal [Wed, 2 Jul 2025 16:43:41 +0000 (22:13 +0530)]
Merge pull request #2060 from ceph/wip-base-config-fix
Fix wrong os-type issue
Zack Cerza [Wed, 2 Jul 2025 16:36:05 +0000 (10:36 -0600)]
Merge pull request #2050 from deepssin/enable-teuthology-openstack
Revive teuthology-openstack
Vallari Agrawal [Tue, 1 Jul 2025 15:12:53 +0000 (20:42 +0530)]
tests: add unit test test_update_key and test_sha1
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
Zack Cerza [Mon, 30 Jun 2025 21:02:11 +0000 (15:02 -0600)]
suite: Add reproducer for issue 71911
See: https://tracker.ceph.com/issues/71911
Signed-off-by: Zack Cerza <zack@cerza.org>
(cherry picked from commit
be1d157d5a27e5eaaa791f674ee34e25d718ff61 )
Vallari Agrawal [Tue, 1 Jul 2025 14:10:01 +0000 (19:40 +0530)]
suite/run.py: update sha1 from basic_config to parsed_yaml
This is because during backtracking to find
build when using --newest, the new build/suite
sha is updated on basic_config. And job's parsed_yaml
is never updated with new sha.
Fixes: https://tracker.ceph.com/issues/71612
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
David Galloway [Tue, 1 Jul 2025 14:50:51 +0000 (10:50 -0400)]
opsys.py: Add Rocky 10
Signed-off-by: David Galloway <david.galloway@ibm.com>
Vallari Agrawal [Tue, 1 Jul 2025 12:26:10 +0000 (17:56 +0530)]
Revert "teuthology/schedule.py: update parsed_yaml with base_config"
This reverts commit
6c356472c37fc4334749d744738ff1ed4ebb031c .
This commit caused a regression: https://tracker.ceph.com/issues/71911
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
deepssin [Thu, 26 Jun 2025 11:12:41 +0000 (07:12 -0400)]
Add jq and curl in docker-compose Dockerfile
Signed-off-by: deepssin <deepssin@redhat.com>
Zack Cerza [Wed, 18 Jun 2025 21:33:56 +0000 (15:33 -0600)]
Merge pull request #2055 from kamoltat/wip-ksirivad-fix-71612
suite/run.py: suite_hash should use backtracked sha1
deepssin [Mon, 16 Jun 2025 13:55:21 +0000 (09:55 -0400)]
Revive teuthology-openstack
Signed-off-by: deepssin <deepssin@redhat.com>
Kamoltat Sirivadhna [Thu, 12 Jun 2025 21:03:59 +0000 (17:03 -0400)]
suite/test/test_run.py: Add tests for SHA1 handling with --newest
Added two test cases to verify SHA1 handling when using --newest backtracking:
1. test_newest_success_same_branch_same_repo: Tests when ceph_branch and
suite_branch are the same. Verifies that both ceph_hash and suite_hash
are updated to the backtracked working SHA1.
2. test_newest_success_diff_branch_diff_repo: Tests when ceph_branch and
suite_branch differ. Verifies that only ceph_hash is updated to the
working SHA1, while suite_hash remains as the original suite_sha1.
Both tests verify the complete flow through collect_jobs() and
schedule_suite(), ensuring the YAML files generated for each job
contain the correct SHA1 references.
Fixes: https://tracker.ceph.com/issues/71668
Signed-off-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
Kamoltat Sirivadhna [Thu, 12 Jun 2025 19:29:33 +0000 (15:29 -0400)]
suite/run.py: suite_hash should use backtracked sha1
In schedule_suite() we only try to find backtracked sha1
for ceph sha1 when --newest is provided and packages are
not found in shaman. However, what about suite_sha1?
Currently, we do not use the backtracked sha1 for suite_sha1.
This commit will make sure that suite_sha1 is using
the backtracked sha1 when ceph_branch and suite_branch are the same and
ceph_repo and suite_repo are the same. This ensures that suite_sha1
only use the backtracked sha1 when the user clearly expects
shaman to not have the latest sha1 and want to use the --newest sha1
for both the ceph code base and suite qa code base.
Fixes: https://tracker.ceph.com/issues/71668
Signed-off-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
Zack Cerza [Thu, 12 Jun 2025 20:02:24 +0000 (14:02 -0600)]
Merge pull request #2054 from ceph/wip-base_config-sha-fix
teuthology/schedule.py: update parsed_yaml with base_config
Vallari Agrawal [Thu, 12 Jun 2025 14:13:57 +0000 (19:43 +0530)]
teuthology/schedule.py: update parsed_yaml with base_config
In `schedule_suite` method,
`self.base_config` gets updated many times while backtracking
when using "--newest" flag. These changes were never updated
to `parsed_yaml` (job yaml) in `configs`.
As `configs` is intialised before backtracking.
Before, we used to write base_config to a tmp
file and pass that to teuthology-schedule
which used to take care of updates to base_config.
But this logic was removed in https://github.com/ceph/teuthology/pull/2008/files
so the updates to base_config then never make
it to job yaml anymore.
Fixes: https://tracker.ceph.com/issues/71612
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
kyr [Sun, 18 May 2025 09:22:35 +0000 (11:22 +0200)]
Merge pull request #1931 from NitzanMordhai/wip-nitzan-scrapy-decode-gzip-backtrace
scrape: searching backtrace with gzip
nmordech@redhat.com [Sun, 31 Mar 2024 11:49:03 +0000 (11:49 +0000)]
scrape: searching backtrace with gzip
Scrape script that trying to find backtrace in gzip log files
can hit TypeError: a bytes-like object is required, not 'str' error
and fail to collect results. the gzip file need to be decoded.
Fixes: https://tracker.ceph.com/issues/64402
Signed-off-by: Nitzan Mordechai <nmordec@redhat.com>
Zack Cerza [Mon, 12 May 2025 22:28:54 +0000 (16:28 -0600)]
Merge pull request #2047 from ceph/drop2004
ci: Drop Ubuntu 20.04
Zack Cerza [Mon, 12 May 2025 21:57:30 +0000 (15:57 -0600)]
ci: Drop Ubuntu 20.04
GitHub doesn't provide the image anymore.
Signed-off-by: Zack Cerza <zack@cerza.org>
kyr [Wed, 7 May 2025 16:00:35 +0000 (18:00 +0200)]
Merge pull request #2045 from kshtsk/wip-packages-duplication
Fix packages duplication when extra system packages requested
Kyr Shatskyy [Wed, 16 Apr 2025 14:41:54 +0000 (16:41 +0200)]
task/install/rpm: drop code duplication for extra_system_packages
After introducing install_ceph_packages option there is added
new extra_system_packages list append instruction which made
adding the packages twice if the option is set to False.
So we just drop the first attempt to update install package list.
Fixes: 0177823
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Wed, 16 Apr 2025 14:02:12 +0000 (16:02 +0200)]
task/install: do not duplicate package names
Get rid of package names duplication when extra_system_packages provided
for rpm.
For example, when it is requested 'bzip2' and 'perl-Test-Harness' to be
installed as extra system packages, there can be observed 5 times
mentioning of the packages, see the log excerpt:
2025-04-09T12:30:08.360 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, bzip2, perl-Test-Harness, bzip2, perl-Test-Harness, bzip2, perl-Test-Harness, bzip2, perl-Test-Harness on remote rpm x86_64
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Zack Cerza [Wed, 9 Apr 2025 15:23:24 +0000 (09:23 -0600)]
Merge pull request #2042 from kshtsk/wip-downburst-timesync
When downburst used, command cloud-init to install ntp or chrony for time sync
Kyr Shatskyy [Sat, 5 Apr 2025 18:25:14 +0000 (20:25 +0200)]
provision/downburst: drop redhat-lsb-core requirement for centos
This package cannot be found, and in fact it's not required,
because better use /etc/os-release
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Thu, 3 Apr 2025 10:35:52 +0000 (12:35 +0200)]
provision/downburst: add ntp or chrony to cloud-init packages
Since downburst may use default cloud images which mostly
miss ntp by default, make sure we preinstall ntp or chrony
required for ceph cluster to sync the date time, otherwise
osd self scrub check will fail.
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
kyr [Thu, 3 Apr 2025 10:50:04 +0000 (12:50 +0200)]
Merge pull request #2039 from ceph/dependabot/pip/jinja2-3.1.6
build(deps): bump jinja2 from 3.1.5 to 3.1.6
Zack Cerza [Wed, 2 Apr 2025 19:55:55 +0000 (13:55 -0600)]
Merge pull request #2035 from VallariAg/ci-integration-logs-archive
ci: save integration logs artifacts
Vallari Agrawal [Fri, 7 Mar 2025 06:39:32 +0000 (12:09 +0530)]
ci: save intergation logs artifacts
Mount volume for archive_dir and then
upload it's logfiles as GA artifacts,
so we can use download-artifacts action
to download logs.
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
dependabot[bot] [Fri, 21 Mar 2025 18:20:29 +0000 (18:20 +0000)]
build(deps): bump jinja2 from 3.1.5 to 3.1.6
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.5 to 3.1.6.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.5...3.1.6)
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
David Galloway [Fri, 21 Mar 2025 18:19:25 +0000 (14:19 -0400)]
Merge pull request #2038 from ceph/actions-pinning
workflows/dev_container: Pin docker actions
Zack Cerza [Fri, 21 Mar 2025 18:02:06 +0000 (12:02 -0600)]
workflows/dev_container: Pin docker actions
These are the most recent releases for these actions.
Signed-off-by: Zack Cerza <zack@cerza.org>
kyr [Fri, 21 Mar 2025 10:52:03 +0000 (11:52 +0100)]
Merge pull request #2026 from badone/main
task/internal/__init__.py: Revisit core program extraction regex
Brad Hubbard [Tue, 18 Feb 2025 03:56:18 +0000 (13:56 +1000)]
task/internal/__init__.py: Revisit core program extraction regex
Fixes: https://tracker.ceph.com/issues/61586
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
Ilya Dryomov [Fri, 7 Mar 2025 17:12:37 +0000 (18:12 +0100)]
Merge pull request #1773 from batrick/1772-revert
Revert "Merge PR #1772 into master"
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
Zack Cerza [Thu, 6 Mar 2025 16:25:52 +0000 (09:25 -0700)]
Merge pull request #2034 from VallariAg/fix-locked-grace-period
lock/query.py: add grace_time param to node_active_job()
Vallari Agrawal [Thu, 6 Mar 2025 13:38:29 +0000 (19:08 +0530)]
lock/query.py: add grace_time param to node_active_job()
This is because we only want this grace period
when looking for stale jobs. Not when jobs are
being unlocked by the supervisor by unlock_one_safe().
Fixes: https://github.com/ceph/teuthology/pull/2033#issuecomment-2703733380
Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
Zack Cerza [Wed, 5 Mar 2025 16:50:39 +0000 (09:50 -0700)]
Merge pull request #2033 from ceph/node-cleanup-grace
node-cleanup: Grace period for inactive jobs
Zack Cerza [Tue, 4 Mar 2025 23:37:53 +0000 (16:37 -0700)]
node-cleanup: Grace period for inactive jobs
Once a job is marked finished, the supervisor may still be waiting to unlock its
nodes. Give jobs five minutes to clean up nodes before we consider them "stale".
Signed-off-by: Zack Cerza <zack@cerza.org>
Zack Cerza [Tue, 4 Mar 2025 23:09:30 +0000 (16:09 -0700)]
node-cleanup: Use plain log format
Signed-off-by: Zack Cerza <zack@cerza.org>
Zack Cerza [Tue, 4 Mar 2025 21:43:59 +0000 (14:43 -0700)]
node-cleanup: Provide link to job
Instead of just the raw description.
Signed-off-by: Zack Cerza <zack@cerza.org>
Patrick Donnelly [Thu, 23 Jun 2022 14:18:47 +0000 (10:18 -0400)]
Revert "Merge PR #1772 into master"
This reverts commit
082ae7ef4302fa54665ed0a2535e8e254118dcfd , reversing
changes made to
31a356e0c737f1781079045bb8dc366982be8713 .
The original
ea170935d4b1c78dc6fd6beae6b3fda65b296f57 removed a method that had
been moved to ceph.git but that broke upgrade tests from releases up to Octopus
where get_valgrind_args had not been backported. So a revert was done until all
upgrade paths have the method.
Now that Quincy is EOL, we can revert the revert.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Zack Cerza [Thu, 27 Feb 2025 21:09:29 +0000 (14:09 -0700)]
Merge pull request #2030 from jmundack/add_codeowners
Add CODEOWNERS file
Joseph Mundackal [Thu, 27 Feb 2025 00:15:10 +0000 (19:15 -0500)]
Add CODEOWNERS file
kyr [Thu, 27 Feb 2025 00:13:31 +0000 (01:13 +0100)]
Merge pull request #2020 from ceph/dependabot/pip/virtualenv-20.26.6
build(deps): bump virtualenv from 20.25.0 to 20.26.6
Zack Cerza [Wed, 26 Feb 2025 21:12:56 +0000 (14:12 -0700)]
Merge pull request #2028 from kshtsk/wip-docs-laptop-dispatcher
docs/laptop: replace workers with dispatcher
Zack Cerza [Wed, 26 Feb 2025 21:09:59 +0000 (14:09 -0700)]
Merge pull request #2027 from kshtsk/wip-almarocky
opsys: add AlmaLinux and RockyLinux and Tumbleweed to distro codename map
Kyrylo Shatskyy [Wed, 26 Feb 2025 18:42:05 +0000 (19:42 +0100)]
orchestra/opsys: add tumbleweed version to the distro version map
openSUSE Tumbleweed is a rolling release, so it has fixed version number
and changable version id is represented by a date of snapshot,
example of vm image:
openSUSE-Tumbleweed-Minimal-VM.x86_64-1.0.0-Cloud-Snapshot20250224.qcow2
In comparison, openSUSE Leap has regular release, incremental version, for example:
15.0, 15.1, ..., 15.6, etc., and recently introduced 16.0 alpha.
Because there is no sense to stick to the date, it is changing almost daily,
it is suggested to fix Tumbleweed version to 1.0 to distinguish from Leap.
As a side effect, once Teuthology locks a node with imaged Tumbleweed
it updates os version correctly to date of release in paddles, and
pulpito display it interface correspondingly as the date.
Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Wed, 19 Feb 2025 22:50:39 +0000 (23:50 +0100)]
orchestra/opsys: add 'alma' and 'rocky' to default os map
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Tue, 11 Feb 2025 14:47:56 +0000 (15:47 +0100)]
orchestra/opsys: add almalinux versions
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Wed, 5 Feb 2025 17:28:32 +0000 (18:28 +0100)]
orchestra/opsys: add 'rocky' to DISTRO_CODENAME_MAP
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Tue, 25 Feb 2025 15:59:16 +0000 (16:59 +0100)]
docs/laptop: replace workers with dispatcher
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
Zack Cerza [Thu, 13 Feb 2025 21:57:30 +0000 (14:57 -0700)]
Merge pull request #2025 from ceph/nuke-unlock
supervisor: Unlock nodes after reimage failure
Zack Cerza [Mon, 3 Feb 2025 21:17:32 +0000 (14:17 -0700)]
node_active_job: Improve http error handling
Signed-off-by: Zack Cerza <zack1@ibm.com>
Zack Cerza [Mon, 3 Feb 2025 21:12:10 +0000 (14:12 -0700)]
node_cleanup: Log owner when query fails
Signed-off-by: Zack Cerza <zack1@ibm.com>
Zack Cerza [Mon, 3 Feb 2025 21:06:57 +0000 (14:06 -0700)]
supervisor: Unlock nodes after reimage failure
Signed-off-by: Zack Cerza <zack1@ibm.com>
Zack Cerza [Mon, 3 Feb 2025 21:04:11 +0000 (14:04 -0700)]
node_cleanup: Log a summary of what was done
Signed-off-by: Zack Cerza <zack1@ibm.com>
Zack Cerza [Thu, 30 Jan 2025 22:28:35 +0000 (15:28 -0700)]
Merge pull request #2024 from kshtsk/wip-64452
Zack Cerza [Thu, 30 Jan 2025 22:27:13 +0000 (15:27 -0700)]
Merge pull request #1984 from kshtsk/wip-laptop-dispatcher
Kyr Shatskyy [Thu, 30 Jan 2025 11:18:24 +0000 (12:18 +0100)]
orchestra/run: better handle weird args
If one of the command args in remote.run is None then there is exception
occurs while trying to qoute argument list:
TypeError: expected string or bytes-like object
This fix addresses the issue and gives user better idea what is
happening, and how to fix the error.
Fixes: https://tracker.ceph.com/issues/64452
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
kyr [Thu, 30 Jan 2025 12:42:01 +0000 (13:42 +0100)]
Merge pull request #2022 from kshtsk/wip-stuck-on-vm-create-fail
teuthology lock is stuck if vm create failed
Kyr Shatskyy [Mon, 29 Jul 2024 11:47:32 +0000 (13:47 +0200)]
docs/laptop: update localhost setup instructions
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Fri, 10 Jan 2025 14:15:21 +0000 (15:15 +0100)]
provision/downburst: log multiline stderr on error
For better logs readability just log downburst's stderr
line-by-line.
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Thu, 16 Jan 2025 17:35:52 +0000 (18:35 +0100)]
lock/ops: don't misguide user while waiting for vms up
The message "virtual machine is still unavailable" is mistakenly
shown to user, when vms are actually available.
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Kyr Shatskyy [Fri, 10 Jan 2025 14:09:24 +0000 (15:09 +0100)]
lock/cli: don't update inventory if failed to create a vm
If we were not able to create a vm we don't need to update machine's
inventory, because there is going to be an ssh connection established
to the host and teuthology gets stuck infinitely trying to connect to
the machine which does not exist.
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
Zack Cerza [Mon, 27 Jan 2025 18:52:35 +0000 (11:52 -0700)]
Merge pull request #2014 from ceph/wip-nitzan-add-timout-param-stop-type
Zack Cerza [Thu, 23 Jan 2025 19:38:46 +0000 (12:38 -0700)]
Merge pull request #2021 from kshtsk/wip-job-archive-in-supervisor
Kyr Shatskyy [Sat, 18 Jan 2025 00:24:51 +0000 (01:24 +0100)]
dispatcher/supervisor: use job config only to unlock targets
No need to use serializer, because everything needed to unlock
machines already present in job config.
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
dependabot[bot] [Mon, 13 Jan 2025 18:19:41 +0000 (18:19 +0000)]
build(deps): bump virtualenv from 20.25.0 to 20.26.6
Bumps [virtualenv](https://github.com/pypa/virtualenv) from 20.25.0 to 20.26.6.
- [Release notes](https://github.com/pypa/virtualenv/releases)
- [Changelog](https://github.com/pypa/virtualenv/blob/main/docs/changelog.rst)
- [Commits](https://github.com/pypa/virtualenv/compare/20.25.0...20.26.6)
---
updated-dependencies:
- dependency-name: virtualenv
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
kyr [Fri, 10 Jan 2025 23:13:24 +0000 (00:13 +0100)]
Merge pull request #2019 from ceph/dependabot/pip/jinja2-3.1.5
build(deps): bump jinja2 from 3.1.4 to 3.1.5
kyr [Fri, 10 Jan 2025 09:30:38 +0000 (10:30 +0100)]
Merge pull request #2017 from kshtsk/wip-drop-future-print
teuthology: drop __future__ import for print
dependabot[bot] [Wed, 8 Jan 2025 20:50:52 +0000 (20:50 +0000)]
build(deps): bump jinja2 from 3.1.4 to 3.1.5
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.4 to 3.1.5.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.4...3.1.5)
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
kyr [Tue, 7 Jan 2025 13:22:21 +0000 (14:22 +0100)]
Merge pull request #2010 from chrisphoffman/wip-dd-syncseek
teuthology: Add support for seek and sync in write_file
kyr [Tue, 7 Jan 2025 13:22:00 +0000 (14:22 +0100)]
Merge pull request #1998 from phlogistonjohn/jjm-config-alt-path
config: allow reading teuthology config from env var location
Zack Cerza [Mon, 6 Jan 2025 23:11:43 +0000 (16:11 -0700)]
Merge pull request #2018 from ceph/devcontainer-no-pat
Zack Cerza [Mon, 6 Jan 2025 22:33:08 +0000 (15:33 -0700)]
containers/teuthology-dev: Remove access token
This container is built and pushed via GitHub Actions. GHA likes to provision a
personal access token for each job that gives tightly-scoped access to the git
repository to the job. When we build our container, we end up including
`.git/config`, which contains the token. Later, in ceph-dev-stack's CI, an
`ls-remote` is run against ceph.git, which ends up causing git to prompt for
credentials even though the repo is public. Removing the token should allow
reading all the relevant repos from the built container image.
Signed-off-by: Zack Cerza <zack@redhat.com>
Christopher Hoffman [Mon, 6 Jan 2025 14:44:49 +0000 (14:44 +0000)]
teuthology: Add tests for seek and sync in write_file
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
Christopher Hoffman [Fri, 25 Oct 2024 15:50:59 +0000 (15:50 +0000)]
teuthology: Add support for seek and sync in write_file
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
John Mulligan [Fri, 9 Aug 2024 14:15:15 +0000 (10:15 -0400)]
config: allow reading teuthology config from env var location
Allow changing the default "user" location of the teuthology
configuration yaml using the (optional) TEUTHOLOGY_CONFIG environment
variable. This change aids my effort to run a customized local
teuthology environment.
Signed-off-by: John Mulligan <jmulligan@redhat.com>
kyr [Wed, 25 Dec 2024 20:11:21 +0000 (21:11 +0100)]
Merge pull request #2015 from thuvh/lab_setup_python3
doc: use python3 cause of deprecating of python on ubuntu
Hoai-Thu Vuong [Fri, 13 Dec 2024 04:06:06 +0000 (11:06 +0700)]
doc: use python3 cause of deprecating of python on ubuntu
Signed-off-by: Hoai-Thu Vuong <thuvh87@gmail.com>
kyr [Fri, 20 Dec 2024 22:57:37 +0000 (23:57 +0100)]
Merge pull request #2016 from ceph/dependabot/pip/configobj-5.0.9
build(deps): bump configobj from 5.0.8 to 5.0.9
Kyrylo Shatskyy [Fri, 20 Dec 2024 00:00:07 +0000 (01:00 +0100)]
teuthology: drop __future__ import for print
We don't need to support backward compatibility with python 2.
Signed-off-by: Kyrylo Shatskyy <kyrylo.shatskyy@gmail.com>
dependabot[bot] [Mon, 16 Dec 2024 22:51:42 +0000 (22:51 +0000)]
build(deps): bump configobj from 5.0.8 to 5.0.9
Bumps [configobj](https://github.com/DiffSK/configobj) from 5.0.8 to 5.0.9.
- [Release notes](https://github.com/DiffSK/configobj/releases)
- [Changelog](https://github.com/DiffSK/configobj/blob/release/CHANGES.rst)
- [Commits](https://github.com/DiffSK/configobj/compare/v5.0.8...v5.0.9)
---
updated-dependencies:
- dependency-name: configobj
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Nitzan Mordechai [Tue, 10 Dec 2024 06:12:00 +0000 (06:12 +0000)]
teuthology/misc: Add timeout parameter to stop_daemons_of_type for better flexibility
Updated stop_daemons_of_type to accept a timeout parameter,
allowing dynamic control over the timeout value passed to the
stop function of each daemon.
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
kyr [Wed, 4 Dec 2024 11:05:23 +0000 (12:05 +0100)]
Merge pull request #2013 from ceph/dependabot/pip/ansible-core-2.17.7
build(deps): bump ansible-core from 2.16.6 to 2.17.7
dependabot[bot] [Tue, 3 Dec 2024 22:03:51 +0000 (22:03 +0000)]
build(deps): bump ansible-core from 2.16.6 to 2.17.7
Bumps [ansible-core](https://github.com/ansible/ansible) from 2.16.6 to 2.17.7.
- [Release notes](https://github.com/ansible/ansible/releases)
- [Commits](https://github.com/ansible/ansible/compare/v2.16.6...v2.17.7)
---
updated-dependencies:
- dependency-name: ansible-core
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Zack Cerza [Tue, 19 Nov 2024 17:10:53 +0000 (10:10 -0700)]
Merge pull request #2009 from ceph/fog-image