Skip to content

RealtimeVAD 0.0.4

Choose a tag to compare

@KoljaB KoljaB released this 12 Nov 00:00
· 66 commits to main since this release

First public release of RealtimeVAD: know that the speaker stopped, about 110 ms before Silero does.

pip install realtimevad

What it does

A voice assistant can't do anything until it knows the user has stopped talking. RealtimeVAD keeps Silero VAD to decide what is speech and adds a faster check: every 10 ms it compares the audio level with the room's noise. The moment the audio goes quiet, you get a pause event and can start speculative work (ASR finalization, the LLM call, TTS), then cancel it if speech continues.

  • Lead: speech-off a median 110 ms before Silero's probability drops, and 214 ms before Silero's VADIterator reports the end, measured on 3,238 real voice-assistant turns.
  • Price: it also fires in short gaps between words, about ten times as often as Silero. Use pause only for work you can cancel.
  • Events: start, pause, end, and optional onset.
  • Drop-in: from RealtimeVAD import VADIterator replaces Silero's VADIterator with the same constructor and results.
  • Runs on: one CPU thread. Needs only numpy and onnxruntime; the Silero model is bundled, no torch.

Also in the repository

  • A live demo that shows, on your own microphone, how much sooner RealtimeVAD knew you stopped than Silero alone.
  • SPEC.md with what the detector guarantees.
  • benchmarks/speech_off_lead.py to reproduce the measurement on your own recordings.

Status

Alpha. The API may still change. The numbers come from one speaker and one capture chain with noise suppression; see Limits.

Files

File SHA-256
realtimevad-0.0.4-py3-none-any.whl 8547c743b735a3a9e8aa80b6461a35f8dc85824898fc515d074cd7dc2bce8fbf
realtimevad-0.0.4.tar.gz c580f9742ec2d5fde083308c9e3235da2ab0a40f2edc521e1fdf8e4fc1a2a9cc