-
Notifications
You must be signed in to change notification settings - Fork 3
Emofilt is a program to simulate emotional arousal with speech synthesis based on the free-for-non-commercial-use MBROLA synthesis engine.
License
felixbur/Emofilt
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
Hello This is an emofilt distribution. You should get further information at http://emofilt.sourceforge.net/ The newest version of emofilt should always be available there via the git-repository. DESCRIPTION emoFilt is NOT a text-to-speech synthesizer, it's ONLY a filter between an MBROLA pho-file and the MBROLA-engine to "emotionalize" the speech. You NEED at least MBROLA in you path to use emofilt. DISTRIBUTION if you unpacked the distribution the following files should be there Readme.txt - this file emofilt_software_user_agreement.txt - license agreement emofilt.jar - program as jar-file configuration files: emofiltConfig.ini - main configuratio file, this needs DEFINITELY to be adapted before first use! languages.xml - voice-specification file emotions.xml - example emotion-specification file logConfig.xml - log4j-configuration taggergui.config - configuration file for the storytelling interface examples: sayEmo.sh - example script to run emofilt with Mary TTS emofilt.bat/emofilt.sh - example batch file to start Gui with button-click runTaggerGUI.sh/runTaggerGUI.bat - example files to start the storytelling interface scripts: makeLanguage.awk - script to generate new languages.xml entries directory test - several PHO-files for testing directory docs - web documentation directory src - source-files directory init - initilization files for the modification plugins, only needed for building INSTALL Emofilt needs Java 1.5 to be installed. Other versions might work, but I didn't try them. Unpack the zip-archive. All pathes are stored in the emofiltConfig.ini files, open it (or use one of the templates provided for your operating system) with a text-editor. The most important path you will have to configure (besides the paths to Mbrola-programs) is the workingDir (right on top of the file). Specify here the directory where the other configuration files (languages.xml, emotions.xml and loggerConfig.xml) are stored. Then either (if windows) click emoFilt.bat or type java -jar emofilt_fat.jar -useGui on a commandline in this emofilt- folder. You can run emofilt from anywhere if you specify the path to its configuration file with the -cf option. Some fixed values should be specified in this configuration file, but you can specify a different one with the -cf argument). In order to get acoustic output ("play-button") you must configure the paths in the configuration file and have MBROLA installed. The default configuration file is in English, but you can write your own for your language by translating the wordings. In order to have the "new utterance" command in the Gui-interface work, you have to have installed and configured (in the configuration-file) a text-to-phofile converter program, e.g. MARY TTS version 4, txt2pho or eSpeak. USAGE Because emofilt is a java program you need Java to run it. There are three interfaces: - 1. Emofilt Developer is a graphical interface (Gui) that lets you generate emotion-descriptions. You can call it with the option -useGui, so you would type on the commandline (from inside the program directory): java -jar emofilt_fat.jar -useGui and you should see a window popping up with the interface. First thing you might do then is loading an utterance via the utterance.load menu-items. Help is provided mainly by tooltips, which should pop up if you linger with the pointer over the panels. 2. The story tagger interface displays an editor that can be marked up with emotions. You can call it from the command-line by providing the path to its config-file, e.g.: java -cp emofilt/emofilt.jar; emofilt.storytagger.TaggerGUI taggergui.config - 3. the same program can be used as a commandline interface, if you want to use it as a filter between a text-to-phoneme converter program and Mbrola. here is the output if the program's usage message: $ java -jar emofilt_fat.jar -h emofilt version 0.94 Usage: program [-h ] [-version ] [-useGui ] [-mary ] [-if ] [-of ] [-e ] [-voc ] [-cf ] [-ef ] [-lf ] [-lcf ] [-lv ] -h 'print usage' Default: false -version 'print version' Default: false -useGui 'display the graphical developer interface' Default: false -mary 'send input to mary server for text-to-speech' Default: false -if 'specify input pho-file' Default: System.in -of 'specify output pho-file' Default: System.out -e 'specify emotion (must appear in emotions-description)' Default: untitled -voc 'specify voice' Default: -cf 'specify configuration-file' Default: emofiltConfig.ini -ef 'specify emotion-description xml-file' Default: emotions.xml -lf 'specify voice-description xml-file' Default: languages.xml -lcf 'specify logger configuration log4j-file' Default: logConfig.xml -lv 'specify log-level [debug warn error fatal off]' Default: debug -gr 'global rate: damp or amplify the modifications for graded emotions between -1 and 1' Default: 0 many of the required input files can be specified in the emofilt config-file. EXAMPLE Follows an example-script that utters a phrase emotionally, if you use the cygwin bash under windows and txt2pho $ cat sayEmotional.bat echo $2 > tmp.txt; echo "" > txt2pho.ini; txt2pho.exe tmp.txt tmp.pho; java -jar "D:\Work\emoFilt\emofilt\emofilt_fat.jar" -lv off -cf "D:\Work\emoFilt\emofilt\emofiltConfig.ini" -e $1 -if tmp.pho -of tmp_e.pho; PhoPlayer.exe database="D:\Programme\Mbrola\de6\de6" tmp_e.pho; or, if the Mary server is running: $ cat sayMary.sh echo $2 | java -jar emofilt_fat.jar -mary -voc us1 -e $1 -of tmp_e.pho; PhoPlayer.exe database="D:\Programme\Mbrola\us1\us1" tmp_e.pho; or, if you use espeak espeak -v mb-de2 -q --pho --phonout "test.pho" "das ist ein Testsatz" the same function as a bash-script under linux $ cat sayEmotional.sh echo $2 | txt2pho | java -jar /home/felixbur/emofilt/emofilt.jar -cf /home/felixbur/emofilt/emofiltConfig.ini -e $1 | mbrola /home/felixbur/de1/de1 - -.au | play -t au -; If you have the Mary text-to-speech server running, you could also omit txt2pho and pass orthography directly to emofilt like this: echo $2 | java -jar /home/felixbur/emofilt/emofilt.jar -mary -cf /home/felixbur/emofilt/emofiltConfig.ini -e $1 | mbrola /home/felixbur/de1/de1 - -.au | play -t au -; If I type now $ sayEmotional.sh happiness "am Wochenende scheint mal wieder die Sonne." I hear the sentence played in a happy mood ;-) enjoy! PS: If you should write new language, emotion or config files, e.g. for new voices/languages, I'll be happy to include them in future distributions. CHANGELOG TaggerGui 0.2 - added possibility to generate sound from text-pane directly. Emofilt: 1.2.1 - added output of MARY ACOUSTPARAMS file, this can be used to detect word boundaries 1.1 - fixed bug that allowed pitch to go below zero because pause length was used in descending pitch calcule. 1.0 - allowing zero duration for silence phoneme 0.99 - fixed bug that caused current directory to appear before path values - lines in tagger gui can now be selected by double click - fixed bug in storytagger that prevented proper synthesis - added tabbed pane to story tagger to show resulting xml code 0.98 24/02/11 - added first version of story tagger GUI - added some library interfaces to call pho-file creation from outside the package - replaced Mary phonetization server interface version 3.6 with version 4.3 - added us3 0.97 26/08/10 - added menu entries to create new emotion names and remove them. 0.96 12/07/10 - handle audio playback now with internal java audio library 0.95 04/02/08 - changed replacements of language descriptors for de[1,2,3,4,5] from 6-a: to a-a:. - enhanced readability of messages in GUI - changeLastSylContour now changes last syllable containing a voiced phoneme. - fixed bug in modelContour causing zero f0-values at utterance end. - added Dutch: nl2 0.94 28/01/08 - added global rate for graded emotion simulation: possibility to dampen or amplify all modifications by a single factor. 0.93 10/10/07 - make GUI geometry configurable - interpolate missing pitch contour description for voiced phonemes. - read and writes now also pitch information for unvoiced phonemes - added save PHO file functionality - removed the automatic modeling of f0-contours when reading in a PHO file - fixed some serious bugs concerning the modeling of f0-contours (still needed for jitter and wave-model) 0.91 26/9/07 - fixed bug: couldn't read in files starting with vowel - changed pitch interpolation to interpolate between phoneme borders 0.9 23/5/06 - migrated code to java 1.5.0 - added interface to Mary (http://mary.dfki.de/) Text-to-speech in the GUI. Start the Mary server and edit the PhoGenCmd section in the config.ini if you want to use it. You can call the Mary-server via the GUI (new utterance) or via the commandline (-mary option). - fixed bug: wave-model plugin caused zero-pitch values if utterance starts or ends with voiceless syllables. - fixed bug: globally descending f0-contour had no syllable-focus. - fixed bug: plugin lastSylContour didn't work on utterances with unvoiced last syllables. 0.8 10/9/05 - fixed bug: modifications were done repeatedly - new feature: can specify Colors by names (as specified at http://www.w3schools.com/html/html_colornames.asp) - fixed bug: rewritten Syllabelizer, many bugs fixed 0.7 29/8/05 - added plugin architecture for modifications (see extra docs on how to write own modifications) - changed almost all modification-names : old emotions.xml files won't work any more - fixed bug: change last sylcontour didn't work for English 0.6 28/2/05 - changed -v option to -version - fixed bug: -voc option wasn't settable - tested with Linux (Suse 9.0) - changed pathes to external commands in the config-file - renamed config-file extension from .dat to .ini 0.5 22/2/05 - changed rate-settings for jitter and pauses - configuration: removed paths to config-files and added workingDir - fixed bug: help-file wasn't readable from jar-file - added save-utterance button - showHelp didn't work with jar-file. - fixed bug: overlong error messages caused Gui-widgets to collaps - added menu icons - fixed bug: close window in GUI didn't exit program - added looks jgoodies look and feel - fixed bug: no tooltip for changeLastSylContour 0.4 15/2/05 - fixed bug: if reading emotion-descriptions from non-English denotations pitch-contours, vowel-targets and voice-effort were ignored - look and feel can now be set in config-file - fixed bug: starting a pho-file with pauses gave nullpointer in syllablelize - added defaultVoice to config-file - fixed bug: duration and time f0-values couldn't be specified as Doubles - Gui starts now also without initial utterance 0.3 27/1/05 - added German configuration file for distribution - added gender option for NLP-processor in the GUI. - Added tooltips. - Added description-element for emotions (shows as tooltip). - fixed bug: No error message appeared if NLP-program wasn't configured. - fixed bug: Foreground color in modification-label wasn't setable 0.2 12/1/05 - added command-line interface. 0.1 10/1/05 - very first alpha version, not yet tested.
About
Emofilt is a program to simulate emotional arousal with speech synthesis based on the free-for-non-commercial-use MBROLA synthesis engine.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published