Diagnostic Evaluation using Linguistic Checkpoints For Machine Translation
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
doc
evaluate
scripts
test
third
COPYING
README
delic4mt.png

README

/----------------------------------------------------------------------------\
|                                                                            |
|                               DELiC4MT                                     |
| Diagnostic Evaluation using Linguistic Checkpoints For Machine Translation |
|                                                                            |
\----------------------------------------------------------------------------/

VERSION 20130612


DELiC4MT is a piece of software that allows to perform diagnostic evaluation of Machine Translation systems over linguistic checkpoints, i.e. source-language lexical elements and grammatical constructions specified by the user. For more details see our paper in the Credits section.



CHANGELOG
---------
20130612 html output added to Java program (for web application)
20120809 bugfix in FileNGramMatcher.java
20120223 Penalty based on brevity added to Java program
20120207 Improved treetagger_preserving_tokens_and_lines.pl
20121215 Added tutorial
20111213 Added script for filtering checkpoints
20111129 Added scripts for statistical significance, script that wraps all the stages (delic4mt.sh) and a test folder with 3 use cases (English to Dutch, German and Italian)
20110724 First release



CONTENTS
--------

doc/		Documentation, including a tutorial and related papers
evaluate/	Java program that carries out the evaluation on linguistic checkpoints
scripts/	Support scripts
test/		Sample test data



CREDITS
-------

Code by Sudip Kumar Naskar and Antonio Toral
Logo by Pawel Plesniak


If you use DELiC4MT in your research please cite the following paper:

Antonio Toral, Sudip Kumar Naskar, Federico Gaspari, Declan Groves. DELiC4MT: A Tool for Diagnostic MT Evaluation over User-defined Linguistic Phenomena. The Prague Bulletin of Mathematical Linguistics No 98, 2012, pp. 121-131., ISSN 0032-6585, DOI: 10.2478/v10108-012-0014-9.

@Article{pbml-2012-delic4mt,
  author    = {Antonio Toral and Sudip Kumar Naskar and Federico Gaspari and Declan Groves},
  title     = {{DELiC4MT: A Tool for Diagnostic MT Evaluation over User-defined Linguistic Phenomena}},
  journal   = {The Prague Bulletin of Mathematical Linguistics},
  issue     = {98},
  publisher = {Springer Berlin/Heidelberg},
  issn      = {0032-6585},
  pages     = {121-132},
  year      = {2012}
}


CONTACT
-------

For any question or suggestion please contact:

Antonio Toral, Sudip Naskar
atoral, snaskar #-at-# computing dot dcu dot ie