ImportError: cannot import name 'SafeFunction' from 'joblib.parallel'

[FalsoMoralista]

It seems that it crashes for joblib (1.3.1).
Downgrading to 0.10.0 seemed to solve the issue (pescadores/pescador#26)

Sample code:

import gbif_dl

data_generator = gbif_dl.dwca.generate_urls(
    "10.15468/dl.pcxfa5", dwca_root_path="dwcas", label="speciesKey"
)
stats = gbif_dl.io.download(data_generator, root="my_dataset", retries=1000000)

Error:

Traceback (most recent call last):
  File "test.py", line 1, in <module>
    import gbif_dl
  File "/home/rtcalumby/miniconda3/envs/py38/lib/python3.8/site-packages/gbif_dl/__init__.py", line 15, in <module>
    from .generators import api
  File "/home/rtcalumby/miniconda3/envs/py38/lib/python3.8/site-packages/gbif_dl/generators/api.py", line 9, in <module>
    import pescador
  File "/home/rtcalumby/miniconda3/envs/py38/lib/python3.8/site-packages/pescador/__init__.py", line 8, in <module>
    from .zmq_stream import *
  File "/home/rtcalumby/miniconda3/envs/py38/lib/python3.8/site-packages/pescador/zmq_stream.py", line 33, in <module>
    from joblib._parallel_backends import SafeFunction
ImportError: cannot import name 'SafeFunction' from 'joblib._parallel_backends' (/home/rtcalumby/miniconda3/envs/py38/lib/python3.8/site-packages/joblib/_parallel_backends.py)

[faroit]

Thanks for the update. So we should update the requirements of joblib or pescador?

[FalsoMoralista]

Thanks for the update. So we should update the requirements of joblib or pescador?

I guess that updating the requirements, although I didn't tested for versions for joblib between 0.10 and 1.3.1 - perhaps there are a bunch of more recent versions other than 1.3.1 still working. Probably there's an incompatibility between pescador and joblib 1.3.1.