-
Notifications
You must be signed in to change notification settings - Fork 4
CU-8699my5eg Add install bundles to releases #24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…ckwards compatibility
… toch bundle. Otherwise the dependencies are not able to be resolved. See comment in code for some more details
uv pip does not support a download command (at least not yet) so that cannot be used. And uv python doesn't support using -m, so can't use that either. So now just creating the env and using that instead
This reverts commit 8c670ed.
Previosuly the wheels download probably overwrote the bundles that were copied there.
|
Just a comment: Had to remove the GPU install bundle because it's too big. The limit is 2GiB and the cuda-enabled bundle is around 3GB. |
|
Commenting this so I can remember it, out of our slack talk
|
* CU-8699my5eg: Add workflow jobs/steps to create release bundles * CU-8699my5eg: Hopefully fix a path issue with release workflow * CU-8699my5eg: Add sanity check integration tests to release bundling job * CU-8699my5eg: Build wheel with lowest supported python version for backwards compatibility * CU-8699my5eg: [TEMP/TEST/TO_REMOVE] Make workflow run on pull request * CU-8699my5eg: [TEMP/TEST/TO_REMOVE] Fix/hardcode branch name * CU-8699my5eg: Allow unsafe index strategy for python 3.9 and cpu-only toch bundle. Otherwise the dependencies are not able to be resolved. See comment in code for some more details * CU-8699my5eg: Move to virtual environment when downloading wheels. uv pip does not support a download command (at least not yet) so that cannot be used. And uv python doesn't support using -m, so can't use that either. So now just creating the env and using that instead * CU-8699my5eg: Make sure there's a PIP to play with during bundling * CU-8699my5eg: Clear venv after usage * CU-8699my5eg: Fix typo regarding venv path * CU-8699my5eg: Fix usage of wrong extra parts or GPU-enabled bundle * CU-8699my5eg: Allow only binaries * CU-8699my5eg: Allow only binaries during compilaton time * CU-8699my5eg: Hopefully fix wheel artifact upload * CU-8699my5eg: Add .tar.gz to uploaded wheel artifact * CU-8699my5eg: Add kust oof donwnloaded artifacts as a step * CU-8699my5eg: Update debug / ls output * CU-8699my5eg: Update download artifact paths * Revert "CU-8699my5eg: Update debug / ls output" This reverts commit 8c670ed. * CU-8699my5eg: Make sure bundles get included in release. Previosuly the wheels download probably overwrote the bundles that were copied there. * CU-8699my5eg: Move .tar.gz to dist as wel * CU-8699my5eg: Add debug output after moving release bundles * CU-8699my5eg: Add debug output reguarding all artifacts before moving release bundles * CU-8699my5eg: Fix bundle upload path * CU-8699my5eg: Remove GPU install bundle * CU-8699my5eg: Include release version in bundle names * CU-8699my5eg: Fix extraction of version tag * CU-8699my5eg: Fix version tag in install bundle name * CU-8699my5eg: Add release bundle README * CU-8699my5eg: Add install bundle README to install bundles * CU-8699my5eg: Rename release bundle readme to install bundle readme * CU-8699my5eg: Rename release bundle readme to install bundle readme * CU-8699my5eg: Add requirements file to install bundle * Revert "CU-8699my5eg: [TEMP/TEST/TO_REMOVE] Fix/hardcode branch name" This reverts commit afb148f. * Revert "CU-8699my5eg: [TEMP/TEST/TO_REMOVE] Make workflow run on pull request" This reverts commit b9c76af.
This PR aims to add install bundles to releases.
The install bundles it will (hopefully) include:
rel-catmeta-catdeidspacyOne that allows GPU as well (torch-wise)(couldn't make it work as it was too big)So TLDR, there will be
84 total install bundles included.The README for the install bundles can be found here:
https://github.com/CogStack/cogstack-nlp/blob/CU-8699my5eg-add-release-bundles/medcat-v2/.release/install_bundle_readme.md
PS:
Currently, the workflow will run during a PR, but that will (somewhat obviously) need to be changed before mergingRemoved / fixed
EDIT:
Had to remove the GPU install bundle because it's too big. The limit is 2GiB and the cuda-enabled bundle is around 3GB.