]> git.apps.os.sepia.ceph.com Git - teuthology.git/commitdiff
task/internal/syslog: parallelize and debugify gzip of syslogs jouranlctl-all 2068/head
authorPatrick Donnelly <pdonnell@redhat.com>
Mon, 21 Jul 2025 15:49:32 +0000 (11:49 -0400)
committerPatrick Donnelly <pdonnell@redhat.com>
Mon, 21 Jul 2025 19:43:09 +0000 (15:43 -0400)
To match what we do for the ceph task.

Looks like:

    2025-07-21T17:04:25.354 INFO:teuthology.task.internal.syslog:Compressing syslogs...
    2025-07-21T17:04:25.354 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose --
    2025-07-21T17:04:25.357 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose --
    2025-07-21T17:04:25.359 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose --
    2025-07-21T17:04:25.380 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
    2025-07-21T17:04:25.380 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
    2025-07-21T17:04:25.380 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:   gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log
    2025-07-21T17:04:25.381 INFO:teuthology.orchestra.run.smithi117.stderr:  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
    2025-07-21T17:04:25.381 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:     0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
    2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
    2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
    2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:   gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log
    2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
    2025-07-21T17:04:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:     0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
    2025-07-21T17:04:25.386 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
    2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
    2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log
    2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:     0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
    2025-07-21T17:04:25.387 INFO:teuthology.orchestra.run.smithi186.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:     0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
    2025-07-21T17:04:25.423 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log:      88.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz
    2025-07-21T17:04:25.426 INFO:teuthology.orchestra.run.smithi186.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log:      88.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz
    2025-07-21T17:04:25.502 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log:      90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
teuthology/task/internal/syslog.py

index 39c1c251ae06e06451456e6d1d17d79a23737f5e..1e1cc3b5c3638bc85a3ed25bf3a02482bd48de62 100644 (file)
@@ -184,9 +184,14 @@ def syslog(ctx, config):
                     'sudo',
                     'xargs',
                     '-0',
+                    '--max-args=1',
+                    '--max-procs=0',
+                    '--verbose',
                     '--no-run-if-empty',
                     '--',
                     'gzip',
+                    '-5',
+                    '--verbose',
                     '--',
                 ],
                 wait=False,