Skip to content

MultiMedEval 0.1.1

Latest
Compare
Choose a tag to compare
@corentin-ryr corentin-ryr released this 18 Mar 16:31
· 26 commits to main since this release
0f7cffe

New features:

  • Dynamic datasets: use any dataset formatted correctly and apply the metrics of a task "family" (QA, VQA, Report Comparison, Image Classification, and NLI). This feature adds more flexibility to MultiMedEval.
  • Added Diff-VQA [Paper] to the list of supported tasks.
  • Updated RadCliQ to reflect more closely the results in the [Paper]

In addition to the new features, we added a suite of unit tests and corrected some bugs.