Skip to content

Remove SDPA workarounds for torch 2.4+#43754

Merged
vasqu merged 2 commits intohuggingface:mainfrom
cyyever:sdpa
Feb 5, 2026
Merged

Remove SDPA workarounds for torch 2.4+#43754
vasqu merged 2 commits intohuggingface:mainfrom
cyyever:sdpa

Conversation

@cyyever
Copy link
Contributor

@cyyever cyyever commented Feb 5, 2026

What does this PR do?

pytorch/pytorch#112577 was fixed in torch 2.2. Let's remove the workarounds and see what happen in the tests.

Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
@github-actions
Copy link
Contributor

github-actions bot commented Feb 5, 2026

[For maintainers] Suggested jobs to run (before merge)

run-slow: diffllama, falcon, kyutai_speech_to_text, mimi, moshi, nemotron

Copy link
Contributor

@vasqu vasqu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should have been removed earlier when we moved to 2.2.; good catch

@vasqu vasqu enabled auto-merge (squash) February 5, 2026 13:06
@vasqu vasqu merged commit cf76325 into huggingface:main Feb 5, 2026
19 checks passed
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

tarekziade pushed a commit that referenced this pull request Feb 5, 2026
Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
tarekziade pushed a commit that referenced this pull request Feb 5, 2026
Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
@cyyever cyyever deleted the sdpa branch February 5, 2026 14:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants