]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph-build.git/commitdiff
sync-images: failing due to ratelimiting in dockerhub 2524/head
authorNizamudeen A <nia@redhat.com>
Tue, 13 Jan 2026 09:00:38 +0000 (14:30 +0530)
committerNizamudeen A <nia@redhat.com>
Wed, 14 Jan 2026 11:58:53 +0000 (17:28 +0530)
So trying to authenticate which might increase the ratelimit

https://jenkins.ceph.com/job/sync-images/651/console
```
Copying image sha256:a99b7d9812dbb7527eab8161807e879c3e66951ddccf21c5302061a651289da6 (15/16)
time="2025-12-25T20:16:10Z" level=fatal msg="Error copying ref \"docker://nginx:1.27.4\": copying image 15/16 from manifest list: determining manifest MIME type for docker://nginx:1.27.4: reading manifest sha256:a99b7d9812dbb7527eab8161807e879c3e66951ddccf21c5302061a651289da6 in docker.io/library/nginx: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit"
Build step 'Execute shell' marked build as failure
```

Signed-off-by: Nizamudeen A <nia@redhat.com>
sync-images/build/build
sync-images/config/definitions/sync-images.yml

index 89d108de89cf581a26e14f9a07d541919a3c9dfc..24f06893abd020822264c7a5158ee768535cd631 100644 (file)
@@ -15,4 +15,16 @@ docker.io:
 EOF
 # make sure we pull the last stable image
 podman pull quay.io/skopeo/stable
-podman run --rm --security-opt label=disable -v ./sync.yml:/sync.yml:ro quay.io/skopeo/stable sync --all --src yaml --dest docker /sync.yml "${DEST_REGISTRY}" --dest-username "${DEST_USERNAME}" --dest-password "${DEST_PASSWORD}"
+podman run --rm --security-opt label=disable \
+  -v ./sync.yml:/sync.yml:ro quay.io/skopeo/stable sync --all \
+  -e GODEBUG=http2client=0 \
+  --threads 4 \
+  --retry-times 5 \
+  --src yaml \
+  --src-username "${DOCKER_HUB_USERNAME}" \
+  --src-password "${DOCKER_HUB_PASSWORD}" \
+  --dest docker \
+  /sync.yml \
+  "${DEST_REGISTRY}" \
+  --dest-username "${DEST_USERNAME}" \
+  --dest-password "${DEST_PASSWORD}"
index 3fdf7f7a8cdfdb949c59ee1f995b2553565bfdc2..97e03a4bf5364cc080229d1e4c760ba1298d177d 100644 (file)
@@ -38,4 +38,8 @@
           - username-password-separated:
               credential-id: sync-images-from-docker-to-quay
               username: DEST_USERNAME
-              password: DEST_PASSWORD
\ No newline at end of file
+              password: DEST_PASSWORD
+          - username-password-separated:
+              credential-id: nizamial09-dockerhub
+              username: DOCKER_HUB_USERNAME
+              password: DOCKER_HUB_PASSWORD