Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix/enable flex_attention #1906

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix/enable flex_attention #1906

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Update flex_attention.py
  • Loading branch information
@notlober
notlober authored Mar 5, 2025
commit c577d03b6e56f2ff9192fd31c8222f7efc0c2cab
2 changes: 1 addition & 1 deletion unsloth/kernels/flex_attention.py
View file
Original file line number Diff line number Diff line change
@@ -32,7 +32,7 @@
create_block_mask as _create_block_mask,
)
_flex_attention = torch.compile(_flex_attention, dynamic = True, options = torch_compile_options)
HAS_FLEX_ATTENTION = False
HAS_FLEX_ATTENTION = True
except:
HAS_FLEX_ATTENTION = False
pass