Skip to content

Releases: SoundsGoodAI/fast-gpu-asr

Fast GPU ASR v0.2.0

Choose a tag to compare

@videodanchik videodanchik released this 07 Oct 08:59

Maintenance release improving decoding, concurrent inference stability, and test coverage.

  • Improve Parakeet TDT beam search with full-vocabulary and duration-aware hypothesis merging before pruning.
  • Fix cuFFT plan-readiness ordering in Parakeet and Zipformer feature plugins for concurrent execution.
  • Support feature-plugin workspaces larger than 2 GiB for larger batches and longer audio, while retaining overflow checks.
  • Reduce peak GPU memory during encoder context resizing by releasing the previous allocation before allocating its replacement.
  • Improve word-timestamp handling for SentencePiece unknown, control, and byte-fallback tokens.
  • Refine CUDA device and stream handling, with expanded runtime and plugin tests.
  • Reduce ONNX export logging noise while preserving warnings and errors.

The high-level ASR interface remains unchanged. Direct users of low-level encoder/decoder classes now pass a CuPy device object; postprocessing accepts audio durations instead of waveforms.

Full changelog: v0.1.0...v0.2.0

Fast GPU ASR v0.1.0

Choose a tag to compare

@videodanchik videodanchik released this 13 Sep 16:24

Initial release of Fast GPU ASR: batched speech recognition with TensorRT and CUDA.

  • Zipformer Transducer/CTC and Parakeet TDT/CTC support.
  • GPU-native feature extraction and optimized CUDA plugins.
  • Device-resident beam search and CUDA graph replay.
  • FP32, FP16, and BF16 export.
  • Python API returning transcripts and word timestamps.
  • Benchmarks across A100, H200, and B300.

See the README for installation, model export, and usage.