(RU)
Application for speech synthesis from text, speech recognition to text and create deepfake animation. One of the unique features of this application is the ability to create multi-dialogues with multiple voices, and the number of characters used is not limited, unlike similar web applications. You can also speak text in real time and the app will recognize it from the audio. This feature is great for dictating text instead of manually typing it.
All in all, this neural network desktop application is a handy and powerful tool for anyone who needs speech synthesis, voice-to-text recognition and create deepfake animation. Best of all, the app is free, installs locally, and is easy to use! And you can use it in the voice acting of commercials, books, games, etc.
Requirements 3.8 <= Python <=3.10 and ffmpeg.
Create venv and activate ones:
python -m venv venv
source venv/bin/activate
Install dependencies:
pip install -r requirements.txt
Attention! The first time you run video synthesis, models will be downloaded in .wunja/talker/checkpoints and .wunja/talker/gfpgan in size 5GB. This may take a long time.
Go to portable folder
cd portable
Run:
briefcase dev
Additionally, you can create a build:
briefcase build
Run build
briefcase run
Create install packet for your OS:
briefcase package
Read more in the documentation BeeWare
The functionality of the program can be supplemented by custom extensions. Extension example and format at link
Available list of extensions at link.
Ubuntu / Debian Extensions v1.3
// Requirement to create animation is ffmpeg
sudo apt install ffmpeg
// Install app
sudo dpkg -i wunjo_{vesrion}.deb
// Attention! The first time you run video synthesis, models will be downloaded in .wunja/talker/checkpoints and .wunja/talker/gfpgan in size 5GB. This may take a long time.
// Remove app
sudo dpkg -r wunjo
// Remove cache
rm -rf ~/.wunjo
// Requirement to create animation is ffmpeg
brew install ffmpeg
// Unzip app
unzip wunjo_macos_{vesrion}.zip
// Attention! The first time you run video synthesis, models will be downloaded in .wunja/talker/checkpoints and .wunja/talker/gfpgan in size 5GB. This may take a long time.
// Remove cache
rm -rf ~/.wunjo
// Requirement to create animation is ffmpeg, Install ffmpeg and add to Path env
setx PATH "%PATH%;C:\path\to\ffmpeg\bin"
// Install app
wunjo_{vesrion}.msi
// Important! How to set up deepfake for Windows. You need to give permission to read the neural network models in the gfpgan folder after the models are installed! Without this setting, the result of deepfake generation will be "Face not found".
icacls "%USERPROFILE%/.wunjo/deepfake/gfpgan/weights/*.pth" /grant:r "Users":(R,W)
// Attention! The first time you run video synthesis, models will be downloaded in .wunja/talker/checkpoints and .wunja/talker/gfpgan in size 5GB. This may take a long time.
//Remove cache
%USERPROFILE%/.wunjo
| Original | Move face + Enhancer | Fix face + Enhancer |
|---|---|---|
 |
 |
 |
Update 1.2.0
- Reduce application size
- Add download feature for models to choose from
- Add y-axis head rotation control (advanced options for creating animations)
- Add head rotation control on x axis (advanced options for creating animation)
- Add head rotation control in Z axis (advanced options for creating animation)
- Add background quality improvements (advanced options for creating animations)
- Add speaking facial expression control (advanced options for creating animations)
- Make builds
Update 1.3.2
- Added support for extensions (any developer can create extensions without opening the main code)
- Fix bugs
Owner: Wladislav Radchenko
Email: i@wladradchenko.ru
Project: https://github.com/wladradchenko/wunjo.wladradchenko.ru
Web site: wladradchenko.ru/wunjo
Wunjo comes from the ancient runic alphabet and represents joy and contentment, which could tie into the idea of using the application to create engaging and expressive speech. Vunyo (ᚹ) is the eighth rune of the Elder and Anglo-Saxon Futhark. Prior to the introduction of the letter W into the Latin alphabet, the letter Ƿynn (Ƿƿ) was used instead in English, derived from this rune.
- Tacatron 2 - https://github.com/NVIDIA/tacotron2
- Waveglow - https://github.com/NVIDIA/waveglow
- Flask UI - https://github.com/ClimenteA/flaskwebgui
- BeeWare - https://beeware.org/project/projects/tools/briefcase/
- Sad Talker - https://github.com/OpenTalker/SadTalker
- Face Utils - https://github.com/xinntao/facexlib
- Face Enhancement - https://github.com/TencentARC/GFPGAN
- Image/Video Enhancement - https://github.com/xinntao/Real-ESRGAN
(to top)