🎭 Lingolay 2.3: dubbing that matches the speaker's voice

[keremss7]

Lingolay v2.3.0 brings speaker-aware dubbing: when a woman speaks in your game or video, her line is dubbed with a female voice; when a man speaks, with a male voice.

How it works

• Lingolay listens to what you hear (your game, YouTube, a movie). It does not hear its own dubbing voice, and nothing is recorded.
• A small neural network decides within about 0.1 s whether a man or a woman is speaking. If it isn't sure, it keeps the previous speaker's voice or falls back to the default voice. It never guesses.
• It works for all 20 dubbed languages, fully offline after a one-time download (~60 MB model + the extra voices).

Try it

1. Download v2.3.0.
2. Turn on 🔊 Dubbing, then in Voice dubbing check Match the speaker's voice (experimental) and save.
3. Play a scene with both men and women talking.

Requires Windows 10 version 2004 or later. To check your setup, run Lingolay.exe --listen-test while a video is playing: it shows what Lingolay hears and who it thinks is speaking.

This is an experimental feature, so your feedback matters a lot. Did it pick the right voice? In which game or video? Please reply here or open an issue. 🙏