No description or website provided.
Jupyter Notebook Python
Latest commit 3f0fe9b Aug 30, 2016 @endernewton endernewton committed on GitHub Merge pull request #16 from iaalm/master
make sure kill the meteor.jar sprocess

Microsoft COCO Caption Evaluation

Evaluation codes for MS COCO caption generation.


  • java 1.8.0
  • python 2.7



  • (demo script)


  • captions_val2014.json (MS COCO 2014 caption validation set)
  • Visit MS COCO download page for more details.


  • captions_val2014_fakecap_results.json (an example of fake results for running demo)
  • Visit MS COCO format page for more details.

./pycocoevalcap: The folder where all evaluation codes are stored.

  • The file includes COCOEavlCap class that can be used to evaluate results on COCO.
  • tokenizer: Python wrapper of Stanford CoreNLP PTBTokenizer
  • bleu: Bleu evalutation codes
  • meteor: Meteor evaluation codes
  • rouge: Rouge-L evaluation codes
  • cider: CIDEr evaluation codes



  • Xinlei Chen (CMU)
  • Hao Fang (University of Washington)
  • Tsung-Yi Lin (Cornell)
  • Ramakrishna Vedantam (Virgina Tech)


  • David Chiang (University of Norte Dame)
  • Michael Denkowski (CMU)
  • Alexander Rush (Harvard University)