Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve precompiled downloads #94

Merged
merged 1 commit into from
Aug 14, 2024
Merged

Conversation

jonatanklosko
Copy link
Member

The following changes:

  1. Adds integrity checking with checksums. When running hex.publish, we now automatically generate a checksum.txt file and include it in the hex package. Then, when we download the archive, we compare the checksum.

  2. We use :httpc instead of relying on wget/curl being installed. IIRC we did that initially to have an efficient stream download, instead of downloading the whole binary into memory, but the :httpc implementation stream downloads also.

  3. We no longer query the GitHub API to list the release artifacts. Instead, we hard-code the list of precompiled targets in the module, so we know what's available upfront.

  4. I removed XLA_HTTP_HEADERS env var. The original purpose was to allow GitHub auth token, to avoid GitHub API rate limiting on CI (Fail to download pre-build dll for Intel Mac #52 (comment)). With 3. this should be no longer necessary, since we don't query that API.

Closes #92.

@jonatanklosko jonatanklosko merged commit 06bdfd3 into main Aug 14, 2024
@jonatanklosko jonatanklosko deleted the jk-download-improvements branch August 14, 2024 15:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Include precompiled metadata in release files
2 participants