An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group
Switch branches/tags
Nothing to show
Clone or download
Latest commit c372a53 Dec 3, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
docs add layer-wise relevance propagation Jul 26, 2018
thumt fix LRP bug on long sentences Sep 29, 2018
.gitignore add layer-wise relevance propagation Jul 26, 2018
LICENSE Updated Copyright. Jan 2, 2018
README.md Update README.md Dec 3, 2018
UserManual.pdf add layer-wise relevance propagation Jul 26, 2018

README.md

THUMT: An Open Source Toolkit for Neural Machine Translation

Contents

Introduction

Machine translation is a natural language processing task that aims to translate natural languages using computers automatically. Recent several years have witnessed the rapid development of end-to-end neural machine translation, which has become the new mainstream method in practical MT systems.

THUMT is an open-source toolkit for neural machine translation developed by the Natural Language Processing Group at Tsinghua University.

Implementations

THUMT has currently two main implementations:

The following table summarizes the features of two implementations:

Implementation Model Criterion Optimizer LRP
Theano RNNsearch MLE, MRT, SST SGD, AdaDelta, Adam RNNsearch
TensorFlow Seq2Seq, RNNsearch, Transformer MLE Adam RNNsearch, Transformer

We recommend using THUMT-TensorFlow, which delivers better translation performance than THUMT-Theano. We will keep adding new features to THUMT-TensorFlow.

License

The source code is dual licensed. Open source licensing is under the BSD-3-Clause, which allows free use for research purposes. For commercial licensing, please email thumt17@gmail.com.

Citation

Please cite the following paper:

Jiacheng Zhang, Yanzhuo Ding, Shiqi Shen, Yong Cheng, Maosong Sun, Huanbo Luan, Yang Liu. 2017. THUMT: An Open Source Toolkit for Neural Machine Translation. arXiv:1706.06415.

Development Team

Project leaders: Maosong Sun, Yang Liu, Huanbo Luan

Project members: Jiacheng Zhang, Yanzhuo Ding, Shiqi Shen, Yong Cheng

Contributors

Contact

If you have questions, suggestions and bug reports, please email thumt17@gmail.com.