Fine-grained and Explanable Factuality Evaluation for Multimodal Summarization

If you find this repo useful, please cite:

@misc{zhang2025finegrainedexplainablefactualityevaluation,
      title={Fine-grained and Explainable Factuality Evaluation for Multimodal Summarization}, 
      author={Yue Zhang and Jingxuan Zuo and Liqiang Jing},
      year={2025},
      eprint={2402.11414},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2402.11414}, 
}

Running with a Command Line

Use question_generate.py to generate questions for evaluation based on answers

Use question_generate_free.py to generate questions for evaluation for the reference free situation

Use BLIP.py to generate answers for pictures to questions for the reference free situation