"Neural Turing Machine" in Tensorflow
Jupyter Notebook Python
Latest commit 76588d7 Nov 15, 2016 @carpedm20 committed on GitHub Merge pull request #18 from carpedm20/fix
Fix

README.md

Neural Turing Machine in Tensorflow

Tensorflow implementation of Neural Turing Machine. This implementation uses an LSTM controller. NTM models with multiple read/write heads are supported.

alt_tag

The referenced torch code can be found here.

Known issue: Loss sometimes goes to nan even with the gradient clipping (#2)

Prerequisites

Usage

To train a copy task:

$ python main.py --task copy --is_train True

To test a quick copy task:

$ python main.py --task copy --test_max_length 10

Results

More detailed results can be found here.

Copy task:

alt_tag alt_tag

Recall task:

(in progress)

Author

Taehoon Kim / @carpedm20