Bump transformers, peft, and diffusers dependencies
#79
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
oOraph
approved these changes
Aug 9, 2024
It's not required and not compatible with `device_map="balanced"`
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
In order to support PyTorch inference over the recently released models the following dependencies have been bumped:
transformersbumped to https://github.com/huggingface/transformers/releases/tag/v4.44.0sentencepieceextra included as required by some models as e.g.black-forest-labs/FLUX.1-schnellpeftbumped to https://github.com/huggingface/peft/releases/tag/v0.12.0diffusersbumped to https://github.com/huggingface/diffusers/releases/tag/v0.30.0Additionally,
huggingface_hubwith the extrahf_transferhas also been included in order to support faster downloads usinghf-transferwhen setting theHF_HUB_ENABLE_HF_TRANSFER=1environment variable, useful when downloading large models such as most of the text generation and text to image models.Note
At the moment the dependencies are pinned within the
huggingface-inference-toolkitPython package dependencies. Something to discuss is whether we want those to be set to>=with the minimum supported versions, so that those are tweaked and bumped within theDockerfileimages that the cloud providers are managing; or just keep the current approach and pin those to==and then release a new version of the Python package with the bumped dependencies.