O(N·K) multi-head attention for PyTorch — a sparse drop-in replacement for dense scaled-dot-product attention.
machine-learning deep-learning pytorch lsh transformer attention-mechanism sparse-attention long-context efficient-computation
-
Updated
Jul 3, 2026 - Python