meteor don't works with latest datasets

[leoleoasd]

datasets dropped python 3.7 support, so this line won't work anymore:

evaluate/metrics/meteor/meteor.py

Line 18 in af3c305

from datasets.config import importlib_metadata, version

[chintu619]

Faced the same issue and solved with pip install datasets==2.13.1.
Or probably, the evaluate library should replace the import of importlib_metadata with import importlib.metadata as importlib_metadata

[Div290]

I am still getting the same error. I can use other metrics like bleu and rouge. But when i tried to use Meteor. This was the error : ImportError: cannot import name 'importlib_metadata' from 'datasets.config'. I am not sure what is the issue?

[lvwerra]

Need to do a new release - can you install evaluate from source in the meantime?

[Advitya17]

Also getting the below error while trying evaluate.load('meteor') with python 3.8 and 3.9:

ImportError: cannot import name 'importlib_metadata' from 'datasets.config' (C:\Users\agemawat\Anaconda3\envs\raitext\lib\site-packages\datasets\config.py)

[jxmorris12]

Me too. This crashed my training code and I couldn't use meteor anymore. Here's a Colab reproduction: https://colab.research.google.com/drive/1JXVodEx5VRWA2GYzjk__FuyOIPauz6Ug?usp=sharing

And a traceback:

ImportError                               Traceback (most recent call last)
[<ipython-input-2-7fac65b59c62>](https://localhost:8080/#) in <cell line: 2>()
      1 import evaluate
----> 2 evaluate.load("meteor")

9 frames
[~/.cache/huggingface/modules/evaluate_modules/metrics/evaluate-metric--meteor/90426c9b4a2cf0bf10c6718aa8de221c7a50f46a694f4cc37bb3ee12fc9aa8c9/meteor.py](https://localhost:8080/#) in <module>
     16 import datasets
     17 import numpy as np
---> 18 from datasets.config import importlib_metadata, version
     19 from nltk.translate import meteor_score
     20 

ImportError: cannot import name 'importlib_metadata' from 'datasets.config' (/usr/local/lib/python3.10/dist-packages/datasets/config.py)

[amrsharaf]

I can replicate this issue too

[lwaekfjlk]

Also get this error too

[lvwerra]

Can you try to install evaluate from main?

[sijial430]

Faced the same issue and solved with pip install datasets==2.13.1. Or probably, the evaluate library should replace the import of importlib_metadata with import importlib.metadata as importlib_metadata

Fixed my issue with import importlib.metadata as importlib_metadata. Thanks!

[sadanyh]

Faced the same issue and solved with pip install datasets==2.13.1. Or probably, the evaluate library should replace the import of importlib_metadata with import importlib.metadata as importlib_metadata

Fixed my issue with import importlib.metadata as importlib_metadata. Thanks!

Could you please explain how fixed the issue this way? I installed importlib-metadata in my conda but still I cannot use the evaluate library with METEOR. Thanks

[lhoestq]

We just released a new version of evaluate, you can update evaluate it will work with recent datasets versions

pip install -U evaluate

[joehoover]

@lhoestq , I still get the error with datasets==2.14.5 and evaluate==0.4.1. However, downgrading to datasets==2.13.1 resolves it.

[nitzanbar29]

pip install -U evaluate
resolved it for me!

Thanks :)