Tasks

[b-feldmann]

• Resnet als feature extractor
• Inception als extractor
• LSTM/GRU + attention
• Data Loader + Preprocessing
• Vortrainiertes Modell für Tensorflow
• Coco Evaluator

[b-feldmann]

Paper

• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention https://arxiv.org/abs/1502.03044 (PDF: https://arxiv.org/pdf/1502.03044.pdf)
• http://openaccess.thecvf.com/content_cvpr_2017/papers/Lu_Knowing_When_to_CVPR_2017_paper.pdf - (implementation https://github.com/jiasenlu/AdaptiveAttention)

[b-feldmann]

Pretrained Models
CNN:

• Keras: https://keras.io/applications/#available-models
  Word Embedding:
• https://github.com/facebookresearch/fastText/blob/master/pretrained-vectors.md

[b-feldmann]

RestNet algorithm

• https://github.com/facebookresearch/Detectron

Keras Attention Layer Implementation

• https://gist.github.com/cbaziotis/7ef97ccf71cbc14366835198c09809d2

[VictorKuenstler]

Some References (for understanding):

• http://www.cs.nthu.edu.tw/~shwu/courses/ml/competitions/02_Image-Caption/02_Image-Caption.html
• https://www.oreilly.com/learning/caption-this-with-tensorflow
• https://github.com/amaiasalvador/imcap_keras
• https://medium.com/mlreview/multi-modal-methods-image-captioning-from-translation-to-attention-895b6444256e

Original Implementation:
https://github.com/jiasenlu/AdaptiveAttention

[sleighsoft]

First Try:

• Models: https://keras.io/applications/#available-models