v3.0.1

Triformer

pip install -U triformer

TritonDropout (New! 🎉)

A fast and memory-efficient dropout implementation using Triton's parallel processing capabilities. Features deterministic dropout patterns with seed control and optimized memory usage through block processing. Benchmarks show comparable or better training convergence compared to PyTorch's native dropout implementation.

Example usage:

from triformer import TritonDropout

# Basic usage
output = TritonDropout.apply(x, p=0.5)

# With deterministic seed
output = TritonDropout.apply(x, p=0.5, seed=42)