Recaser trainer updated to support IRSTLM as well. #3
Conversation
By default, it will still use SRILM so that any previous use of this script from others won't be broken. To switch to IRSTLM training, simply add "-lm irslm" command line option. Also if build-lm.sh is not accessible from $PATH, the option "-build-lm /path/to/build-lm.sh" is also available.
|
great idea, I'm using irstlm for recasing as well, however, I thought the cheers, Toams On Fri, Nov 25, 2011 at 3:48 AM, Jehan <
|
|
+1, we use IRSTLM too so this will be very useful. |
Recaser trainer updated to support IRSTLM as well.
Recaser trainer updated to support IRSTLM as well.
Adding CBTM with additional feature scores
A per discussions on the mailing list, everyone who wants to use IRSTLM instead of SRILM for training the recaser was modifying train-recaser.perl. Rather than always doing this (and probably see other messages about this on the list), I thought it might be worth updating the script.
Note that by default, the script will still use SRILM, which prevent from breakage any existing script calling the current version of train-recaser.perl.
To use IRSTLM instead of SRILM, only adding "-lm irstlm" on the command line is enough.
In case build-lm.sh is not in $PATH, there is also a new option -build-lm which allows one to specify the given path of the script to use (with build-lm.sh command line syntax).
If anyone wants to add other language models (for instance KenLM would be great, after all default in Moses!), that will be easy using the -lm option.
Thanks.