Code for "Online and Linear Time Attention by Enforcing Monotonic Alignments"
Jupyter Notebook Python C++
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
benchmark
LICENSE
README.md
example_decoder.py
example_decoder_test.py

README.md

Online and Linear-Time Attention by Enforcing Monotonic Alignments

NOTE - A reference implementation of the monotonic attention mechanism is now built into TensorFlow in the tf.contrib.seq2seq module. See here for documentation.

This repository contains an example implementation of the monotonic alignment decoder proposed in "Online and Linear-Time Attention by Enforcing Monotonic Alignments", by Colin Raffel, Minh-Thang Luong, Peter J. Liu, Ron J. Weiss, and Douglas Eck (arXiv:1704.00784).

It also contains (in the benchmark folder) the synthetic benchmark used to compare the speed of the monotonic attention mechanism and standard softmax-based attention.