Skip to content

Track final HTTP outcomes and tolerate Docker Hub failures - #304

Merged
ericmj merged 2 commits into
mainfrom
tolerate-docker-hub-errors
Sep 5, 2026
Merged

ericmj merged 2 commits into
mainfrom
tolerate-docker-hub-errors

Conversation

@ericmj

@ericmj ericmj commented Sep 5, 2026 •

Copy link
Copy Markdown
Member

Route Docker Hub tag lookups through the shared rate limiter. When retries are exhausted or a response contains invalid JSON, return :unreadable so manifest generation preserves the existing image and the next checker run can retry.

Add Bob.HTTP.track_request/3 and the generic bob_prom_ex_outbound_http_request_final_total counter, labeled by host, method, and final status. Docker Hub, GitHub, Fastly, and Bob master requests record one outcome after their complete retry operation. Docker Hub's outer 429 retry loop is included. The existing Finch counters retain individual attempts, and telemetry excludes URLs, credentials, headers, and response bodies.

Deploy the new metric before https://github.com/hexpm/hexpm-ops/pull/317, which selects Docker Hub through the host label and configures its tolerance in the alert rule.

Validated locally on Elixir 1.20.3/OTP 29 with the formatter, compilation with warnings as errors, and the full test suite: 453 tests passed, with one GNU timeout test excluded because the binary isn't installed. Regression coverage includes final outcomes after retry recovery and exhaustion, metric export, manifest preservation, and re-enqueueing skipped manifests.

@ericmj ericmj changed the title Tolerate Docker Hub failures and report final request outcomes Track final HTTP outcomes and tolerate Docker Hub failures Sep 5, 2026
@ericmj
ericmj marked this pull request as ready for review September 5, 2026 10:14
@ericmj
ericmj merged commit 436707c into main Sep 5, 2026
4 checks passed
@ericmj
ericmj deleted the tolerate-docker-hub-errors branch September 5, 2026 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant