Skip to content
master
Go to file
Code

README.md

Blender Rhubarb Lip Sync

Rhubarb Lip Sync is a command-line tool created by Daniel S. Wolf that automatically creates mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.

Blender Rhubarb Lipsync is an addon for Blender that integrates Rhubarb Lip Sync and uses it to generate mouth-shape keyframes from a pose library.

For support using this addon in Blender, please report an issue at https://github.com/scaredyfish/blender-rhubarb-lipsync/issues

Example output

Example video

http://www.youtube.com/watch?v=azrpByrvw-o

and here's a tutorial video from Studio YogYog

Tutorial video

https://youtu.be/xfI94VIX6BA

Usage

Download a release from https://github.com/scaredyfish/blender-rhubarb-lipsync/releases

Use version 1.0.5 for Blender 2.79, version 2.0 onwards supports only Blender 2.80 and above.

Blender Rhubarb Lipsync includes the Rhubarb Lip Sync executable, but if you want to use a different executable, you can choose it in user preferences.

You can also set the recognizer here. PocketSphinx is recommended for English language, phonetic may give better results for other languages.

Preferences

Create a pose library with the mouth shapes described in the Rhubarb Lip Sync documentation. You can name your poses whatever you like.

Pose library

Match your poses with the Rhubarb Lip Sync names. Select your sound file, and dialog file (optional), and the start frame where your sound begins.

Options panel

In pose mode, select the bones you want to keyframe, then click the Rhubarb Lip Sync button and wait for the process to complete. The mouse cursor will change to a progress indicator, and your keyframes will appear when the process is complete.

Troubleshooting

In the event of problems, you can use the system console (Window->Toggle System Console on Windows, or start Blender from a command line on Mac/Linux) to get more info on progress and error messages. When reporting an issue, please include any errors reported here.

About

Blender Rhubarb Lipsync is an addon for Blender integrating Rhubarb Lip Sync to automatically generate mouth-shape keyframes from a pose library.

Resources

Packages

No packages published
You can’t perform that action at this time.