-
Notifications
You must be signed in to change notification settings - Fork 743
Manually cherry-pick "Pin huggingface_hub<1.0" #15667
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Manually cherry-pick "Pin huggingface_hub<1.0" #15667
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15667
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 New Failures, 1 Cancelled Job, 112 Pending, 3 Unrelated FailuresAs of commit 9afbe27 with merge base e0dda90 ( NEW FAILURES - The following jobs have failed:
CANCELLED JOB - The following job was cancelled. Please retry:
FLAKY - The following jobs failed but were likely due to flakiness present on trunk:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Trying to fix failing HF CI jobs. Looks like our transformers version requires huggingface_hub<1.0, but we're installing the latest 1.0 version which just released today. Until we bump transformers, I'll just pin our install of huggingface_hub to below 1.0. Note that we don't pin the transformers version the same way for pip install, so this should be a ci only issue (and hence ci only fix). Here's an example job failure: ``` transformers 4.56.1 requires huggingface-hub<1.0,>=0.34.0, but you have huggingface-hub 1.0.0 which is incompatible. ... /exec: line 13: huggingface-cli: command not found ``` (from https://github.com/pytorch/executorch/actions/runs/18851188516/job/53787937311) (cherry picked from commit 57f0dfd)
We need to pin huggingface_hub in CI to avoid an incompatibility with our pinned version of transformers. See pytorch#15399 for more context - I missed a few places on trunk jobs. Cleaning these up here. Running with ciflow/trunk. I verified that the test-huggingface-transformers-macos / * and gemma3-4b macos jobs pass on this PR. They are failing on trunk (see https://hud.pytorch.org/pytorch/executorch/commit/4c30da308ee811bdfa44fd4bea3bc439bfd303d4 for an example).
de78a29 to
8c64cc6
Compare
8c64cc6 to
a7f9ac3
Compare
|
Note to reviewers: there are more failing/flaky jobs. These are pre-existing and I will fix as a follow-up, as the cause is unrelated to this PR. |
| "$PIPBIN" install --upgrade pip | ||
| "$PIPBIN" install "$WHEEL_FILE" | ||
| "$PIPBIN" install torch=="2.9.0" | ||
| "$PIPBIN" install torch=="2.9.1" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this intended?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah - good question. It's not strictly part of the original pick but we want torch==2.9.1 for 1.0.1 and I was seeing a related issue on CI, so I stuck that fix in.
Summary
This is a manual cherry-pick of #15399 and #15403 to resolve CI failures caused by an incompatibility between the newly released huggingface_hub package and our pinned version of transformers. Due to differences between main and release/1.0, the automated cherry-pick failed, so I've reverted to a manual pick and some small manual edits to examples/models/llama/install_requirements.sh.
Test Plan
This PR is running trunk CI.