Build wheels in CI #59
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
R2ZER0
force-pushed
the
build-wheels
branch
2 times, most recently
from
b43b4cf
to
81f6547
Compare
Using pypa's cibuildwheel package and their integration with Github Actions. See: https://github.com/pypa/cibuildwheel#example-setup
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
We've found ourselves needing to install this package in a minimal container environment with no access to build tools like Cython or gcc, where the usual
pip install -e ...isn't an option. So I've built pre-compiled binary wheels.I figured others might have a similar use case, so if you're interested in building wheels too, this PR has the CI setup I used to build the wheels.
I based this off upstream yt's setup for building wheels: https://github.com/yt-project/yt/blob/main/.github/workflows/wheels.yaml
but simplified to remove the upstream/yt-specific stuff, and updated to use PyPa's recommended pre-built action: https://cibuildwheel.readthedocs.io/en/stable/setup/#github-actions
The result is using PyPa's cibuildwheel package and their integration with Github Actions (every open source repo/user has 2000 free Actions minutes per month).
Currently it's configured to build Python 3.7 through to 3.10, on Win32/64, Linux and macOS, but note that so far I've only tested the Linux wheels, and I don't have access to a Mac to test the macOS wheels.
The resulting wheels are pretty small, less than 1M each! Here's the output from today: https://github.com/R2ZER0/yt_georaster/actions/runs/1553724929
I'd be happy to make changes, e.g. if you'd prefer to use CircleCI as you already do (but note that apparantly CircleCI can't build Windows wheels: https://cibuildwheel.readthedocs.io/en/stable/#usage), or if you'd like to build wheels for extra branches, or only certain tags etc.