Use machine learning to generate rambling nonsense about arbitrary pictures.
Huge Orange Captions is based on two pre-existing deep-learning libraries:
- Karpathy's neuraltalk2, a combination CNN-RNN which has been trained on the MSCOCO image set
- word-rnn-tensorflow, an LSTM-RNN originally written in Lua by Lars Eidnes but which has been ported to Tensorflow
Also used was
- docker-neuraltalk2, a Docker container which simplifies obtaining all the dependencies necessary for neuraltalk2
Ensure you have docker installed, then run
docker pull jlave2/huge-orange-captions
docker run -dit -p 4000:4000 jlave2/huge-orange-captions
docker exec jlave2/huge-orange-captions 'cd root/huge-orange-captions && node index.js'
The page should then be accessible by visiting http://localhost:4000
in a browser. I ran into trouble hosting the app on a server with 1GB of RAM, so ensure you have at least 4GB.