Skip to content
Contrastive Learning for Image Captioning
Branch: master
Clone or download
Latest commit 9d77f5d Dec 3, 2017
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
adaptiveattention add basic codes Dec 1, 2017
misc add basic codes Dec 1, 2017
neuraltalk2 add basic codes Dec 1, 2017
.gitignore add basic codes Dec 1, 2017
LICENSE upload license Dec 1, 2017
README.md fix a typo Dec 2, 2017
cl_train_adaptiveattention.lua add basic codes Dec 1, 2017
cl_train_cross.lua add basic codes Dec 1, 2017

README.md

Code of Contrastive Learning for Image Captioning

Based on Neuraltalk2 and AdaptiveAttention. Special thanks to the authors!

Testing codes and related codes will be added gradually.

When training using contrastive learning, better pre-train both the target and the reference.

Brief Explanation

  • adaptive attention: model structure for adaptive attention
  • neuraltalk2: model structure for neuraltalk2
  • misc: codes for DataLoader, util functions, and codes related to contrastive learning
    • cl_adaptiveattention.lua: codes for using adaptiveattention as both target model and reference model
    • cl_cross.lua: codes for using adaptiveattention as reference model, and using neuraltalk2 as target model
  • cl_train_adaptiveattention.lua: codes for training adaptiveattention
  • cl_train_cross.lua: codes for training neuraltalk2, using adaptiveattention as reference model
You can’t perform that action at this time.