Skip to content

Flash-attention

Pre-release
Pre-release

Choose a tag to compare

View all tags
@wasd-tech wasd-tech released this 17 Jun 09:57
· 10 commits to main since this release
Flash-attention-ROCm6.4
4738ff4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Flash-attention for AMD ROCM 6.4

YOU MUST HAVE INSTALLED TRITON>=3.3.0

Commands used to build:
FLASH_ATTENTION_TRITON_AMD_ENABLE="TRUE" python setup.py bdist_wheel

Assets 3
Loading