Skip to content

Fast GPU ASR v0.1.0

Choose a tag to compare

@videodanchik videodanchik released this 13 Sep 16:24
· 7 commits to main since this release

Initial release of Fast GPU ASR: batched speech recognition with TensorRT and CUDA.

  • Zipformer Transducer/CTC and Parakeet TDT/CTC support.
  • GPU-native feature extraction and optimized CUDA plugins.
  • Device-resident beam search and CUDA graph replay.
  • FP32, FP16, and BF16 export.
  • Python API returning transcripts and word timestamps.
  • Benchmarks across A100, H200, and B300.

See the README for installation, model export, and usage.