Skip to content

Latest commit

 

History

History
 
 

image_captioning

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Image Captioning

The goal of image captioning is to convert a given input image into a natural language description. The encoder-decoder framework is widely used for this task. The image encoder is a convolutional neural network (CNN). In this tutorial, we used resnet-152 model pretrained on the ILSVRC-2012-CLS image classification dataset. The decoder is a long short-term memory (LSTM) network.

alt text

Usage

1. Download the COCO-2014 dataset

2. Preprocessing

python create_input_files

3. Train the model

python train.py    

4. Test the model

python sample.py --image='png/example.png'