Skip to content

Fork Release v1.6 (fa2.9.2)

Choose a tag to compare

View all tags
@ussoewwin ussoewwin released this 13 Jul 02:31
· 48 commits to main since this release
v1.6
99651e9

Summary: Fork release v1.6 / package flash_attn 2.9.2

  • Official merge of the split_align architecture.
  • Extracted the num_splits == 1 forward pass alignment kernels into 24 independent compilation units (flash_fwd_split_align_*.cu) to resolve NVIDIA ptxas compiler timeouts and serial compilation crashes.
  • To bypass the Windows MSVC 2GB linker limit (LNK1189) caused by compiling these massive object files, the build scripts were physically split into bat2 (Blackwell: 100;120;121) and bat3 (Ampere/Hopper: 80;89;90).
  • Dynamic runtime versioning implemented in __init__.py to correctly branch between 2.9.1 and 2.9.2.

Technical Specification: split_align_kernels_explanation.md

Assets 2
Loading