Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
app
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Handwriting generation

This project is a web app (CopyMonkey) which uses machine learning to mimic your handwriting style like a monkey. Have fun generating handwriting in your own style!

Demo: https://youtu.be/Ghsb3w0QACI

The ML model is implemented from "Generating Sequences With Recurrent Neural Networks" by Alex Graves (https://arxiv.org/abs/1308.0850)

How to run the web app on your local machine

git clone https://github.com/swechhachoudhary/Handwriting-synthesis.git
cd Handwriting-synthesis
python3 -m venv hand_gen_env
source hand_gen_env/bin/activate
pip install -r requirements.txt
python main.py

How to train handwriting generation (synthesis) model

python train.py --n_epochs 120 --model synthesis --batch_size 64 --text_req

How to train handwriting prediction model

python train.py --n_epochs 120 --model prediction --batch_size 64

Data description:

There are 2 data files that you need to consider: data.npy and sentences.txt. data.npycontains 6000 sequences of points that correspond to handwritten sentences. sentences.txt contains the corresponding text sentences. You can see an example on how to load and plot an example sentence in example.ipynb. Each handwritten sentence is represented as a 2D array with T rows and 3 columns. T is the number of timesteps. The first column represents whether to interrupt the current stroke (i.e. when the pen is lifted off the paper). The second and third columns represent the relative coordinates of the new point with respect to the last point. Please have a look at the plot_stroke if you want to understand how to plot this sequence.

Unconditional generation.

Generated samples: alt text alt text Samples generated using priming:

  • Prime style text is "medical assistance", text after this is generated by model alt text
  • Prime style text is "something which he is passing on", text after this is generated by model alt text
  • Prime style text is "In Africa Jones hotels spring", text after this is generated by model alt text

Conditional generation.

Generated samples: alt text alt text alt text

About

Implementation of "Generating Sequences With Recurrent Neural Networks" https://arxiv.org/abs/1308.0850

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published