]> git-server-git.apps.pok.os.sepia.ceph.com Git - teuthology.git/commit
teuthology: add lua based fragment merge scripting
authorPatrick Donnelly <pdonnell@redhat.com>
Tue, 28 Jun 2022 20:29:40 +0000 (16:29 -0400)
committerPatrick Donnelly <pdonnell@redhat.com>
Tue, 19 Jul 2022 01:29:27 +0000 (21:29 -0400)
commit96f38f2136dd2a4f64cc741919b85dc65a9df536
treefb68147121002bd01dc7b95d24d16fad1a6fe9ca
parent88e43448f7a807f56539e08b4848042771bf2e1b
teuthology: add lua based fragment merge scripting

As part of this change, there is a new generator design for producing
job configs. YAML fragments are memoized and merged manually to avoid
expensive and unnecessary parsing of the merged fragments. This provides
for a dramatic speedup in processing matrices with large numbers of
jobs. For rados suite with --subset 1/1000, this branch is 5x faster
(77s vs. 15s). (Note: the difference shrinks when there are fewer or
jobs or larger subsets are used due to cycling and the matrix generation
dominating runtime.)

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
scripts/schedule.py
setup.cfg
teuthology/describe_tests.py
teuthology/misc.py
teuthology/suite/fragment-merge.lua [new file with mode: 0644]
teuthology/suite/merge.py [new file with mode: 0644]
teuthology/suite/run.py
teuthology/suite/test/test_run_.py
teuthology/suite/util.py