From: Nizamudeen A <nia@redhat.com>
Date: Tue, 13 Jan 2026 09:00:38 +0000 (+0530)
Subject: sync-images: failing due to ratelimiting in dockerhub
X-Git-Url: http://git-server-git.apps.pok.os.sepia.ceph.com/?a=commitdiff_plain;h=a7e53b35c44e7f6b522be8ce2d466622886c5eee;p=ceph-build.git

sync-images: failing due to ratelimiting in dockerhub

So trying to authenticate which might increase the ratelimit

https://jenkins.ceph.com/job/sync-images/651/console
```
Copying image sha256:a99b7d9812dbb7527eab8161807e879c3e66951ddccf21c5302061a651289da6 (15/16)
time="2025-12-25T20:16:10Z" level=fatal msg="Error copying ref \"docker://nginx:1.27.4\": copying image 15/16 from manifest list: determining manifest MIME type for docker://nginx:1.27.4: reading manifest sha256:a99b7d9812dbb7527eab8161807e879c3e66951ddccf21c5302061a651289da6 in docker.io/library/nginx: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit"
Build step 'Execute shell' marked build as failure
```

Signed-off-by: Nizamudeen A <nia@redhat.com>
---

diff --git a/sync-images/build/build b/sync-images/build/build
index 89d108de..24f06893 100644
--- a/sync-images/build/build
+++ b/sync-images/build/build
@@ -15,4 +15,16 @@ docker.io:
 EOF
 # make sure we pull the last stable image
 podman pull quay.io/skopeo/stable
-podman run --rm --security-opt label=disable -v ./sync.yml:/sync.yml:ro quay.io/skopeo/stable sync --all --src yaml --dest docker /sync.yml "${DEST_REGISTRY}" --dest-username "${DEST_USERNAME}" --dest-password "${DEST_PASSWORD}"
+podman run --rm --security-opt label=disable \
+  -v ./sync.yml:/sync.yml:ro quay.io/skopeo/stable sync --all \
+  -e GODEBUG=http2client=0 \
+  --threads 4 \
+  --retry-times 5 \
+  --src yaml \
+  --src-username "${DOCKER_HUB_USERNAME}" \
+  --src-password "${DOCKER_HUB_PASSWORD}" \
+  --dest docker \
+  /sync.yml \
+  "${DEST_REGISTRY}" \
+  --dest-username "${DEST_USERNAME}" \
+  --dest-password "${DEST_PASSWORD}"
diff --git a/sync-images/config/definitions/sync-images.yml b/sync-images/config/definitions/sync-images.yml
index 3fdf7f7a..97e03a4b 100644
--- a/sync-images/config/definitions/sync-images.yml
+++ b/sync-images/config/definitions/sync-images.yml
@@ -38,4 +38,8 @@
           - username-password-separated:
               credential-id: sync-images-from-docker-to-quay
               username: DEST_USERNAME
-              password: DEST_PASSWORD
\ No newline at end of file
+              password: DEST_PASSWORD
+          - username-password-separated:
+              credential-id: nizamial09-dockerhub
+              username: DOCKER_HUB_USERNAME
+              password: DOCKER_HUB_PASSWORD