Skip to content

voxr 0.1.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 09 Oct 23:06
· 17 commits to main since this release
v0.1.0
c99b03a

First release of voxr and voxr-narrate.

Added

voxr

  • RIFF/WAVE read and write, including stream headers of unknown length.
  • Compressed-audio decode behind decode: FLAC, MP3, AAC-LC and ALAC in MP4/M4A/MOV, and Opus and Vorbis in Ogg/WebM/MKV, with ffmpeg-matched trims and downmix. Multichannel AAC, HE-AAC and Opus past two channels are refused.
  • Resamplers: a general polyphase resampler, and resamplers that match ffmpeg's default output, SciPy's resample_poly and librosa's default output.
  • A WSOLA tempo engine that matches ffmpeg's atempo output.
  • The reference-take enhancement chain: denoise, filters, loudness normalization and a limiter.
  • Pitch tracking, take quality, spectral distance, and word and character error rates.
  • Single-sound metrics and the sound review of the motion-video skill, with CLAP ranking behind clap.
  • English G2P: the misaki lexicon pipeline behind misaki, the spaCy en_core_web_sm tokenizer behind spacy-tokenizer, its tagger behind spacy-tagger, and a neural out-of-vocabulary fallback.
  • TtsEngine, TtsBundle and Voice behind tts.
  • Kokoro synthesis behind kokoro, loaded from a model directory.
  • VITS (MMS-TTS) synthesis behind vits, with uroman romanization for is_uroman checkpoints.
  • VoxCPM2 voice cloning behind voxcpm: reusable reference voices, continuation prompts, per-request guidance and steps, bad-take retry and batched requests.
  • Whisper transcription with word timings behind whisper.
  • Silero VAD segmentation behind vad.
  • Speech-corpus preparation behind corpus.
  • The TTS quality gate: signal statistics, pace, intelligibility and timbre.

voxr-narrate

  • Narration script, timed script and subtitle parsing, tags, and numbers read back from words and digits.
  • The speech check of a take against its script, and glitch detection and repair.
  • The voice polish chain, and reference-voice preparation for cloning.
  • The take loop: cache keys, seeds, take records, the pick of each part's best take, speaking pace and its verdict, anchor voices, timed placement and joins.
  • A whole VoxCPM2 run from script to voiceover, and a per-phrase run for every other engine.
  • Engine adapters for Kokoro, VITS and VoxCPM2, and Whisper as the hearing, behind features.
  • Time-stretch of the spoken track to a pace behind stretch.
  • The speak and transcribe commands of the motion-video skill: argument parsing, every printed line, file and exit code, and the video manifest's narration.

Tree: https://github.com/ml-rust/voxr/tree/v0.1.0

Assets 2
Loading