Skip to content

A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/Pallas/JAX).

License

Notifications You must be signed in to change notification settings

erfanzar/jax-flash-attn2

Error
Looks like something went wrong!

About

A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/Pallas/JAX).

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published