Synthetic Text Data Generation using Recurrent Neural Networks

Hack Session @ DataHack Summit 2019

Agenda:

• Why Generate handwriting
• Overall Setup
• IAM Handwriting Dataset
• Data Preparation
• Model Description
• Attention
• Experiements

---

References:

• Generating Sequences with RNNs, Alex Graves
• Neural Machine Translation by Jointly Learning to Align and Translate, Bengio et al
• Attention Is All You Need, Vaswani et al
• Handwriting Generation Demo
• Chapter3, Hands on Transfer Learning, Dipanjan Sarkar, Raghav Bali, et al
• LSTM, Chris' blog
• Four Experiments in Handwriting with a Neural Network, distlill.pub
• Mixture Density Networks, Hardmaru/Otoro's Blog
• Keras MDN
• Tensorflow Probability