Lazy EMD

This repository contains a primary implementation of the Lazy Earth Mover's Distance (Lazy EMD).

Requirements

• python (==3.x)
• bert_score (>=0.2.2)
• POT (>=0.6.0)

Usage

Download our project and use our Scorer class (implemented bertscore, wmd and our proposed lazy_emd) defined in score.py. An example is in score.py.

If you find this repo useful, please cite:

@inproceedings{lazy-emd,
  title     = {Evaluating Natural Language Generation via Unbalanced Optimal Transport},
  author    = {Chen, Yimeng and Lan, Yanyan and Xiong, Ruibin and Pang, Liang and Ma, Zhiming and Cheng, Xueqi},
  booktitle = {Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, {IJCAI-20}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},             
  editor    = {Christian Bessiere}	
  pages     = {3730--3736},
  year      = {2020},
  month     = {7},
  note      = {Main track}
  doi       = {10.24963/ijcai.2020/516},
  url       = {https://doi.org/10.24963/ijcai.2020/516},
}

Acknowledgement

This repo benefits a lot from BERTScore and POT.