Skip to content

IS2AI/Persona_ASR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 

Repository files navigation

Persona-ASR

Bilingual Kazakh–English target-speaker ASR for overlapping speech.

Persona-ASR transcribes an enrolled target speaker from a multi-talker overlapping mixture and explicitly rejects utterances in which the target speaker is absent. It couples an enrollment-conditioned recognizer (a frozen ECAPA-TDNN speaker embedding modulating a WavLM-Base+ encoder through FiLM, with language-specific CTC heads) with a target-presence gate, and supports same- and cross-language enrollment.

Datasets and checkpoints (Hugging Face)

Resource Link
Model checkpoints (backbone + presence gate) https://huggingface.co/issai/Persona-ASR
KazMix-3 (Kazakh 3-speaker TS-ASR dataset) https://huggingface.co/datasets/issai/KazMix-3
PersonaMix (controlled bilingual benchmark) https://huggingface.co/datasets/issai/PersonaMix

KazMix-3 ships mixture manifests and generation scripts; the audio is regenerated from the Kazakh Speech Dataset (OpenSLR 140). PersonaMix provides the full controlled benchmark.

Code

Training and evaluation code will be released in this repository.

License

Released under CC BY 4.0.

About

Bilingual Kazakh–English target-speaker ASR for overlapping speech. Datasets and checkpoints on Hugging Face (issai).

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors