AttributeError: partially initialized module 'fsspec' has no attribute 'utils' (most likely due to a circular import)

[12rambau]

I'm don't really use fsspec directly but I use rioxarray that use your lib downstream. I try to run my tests in my lib and I get the following error:

AttributeError: partially initialized module 'fsspec' has no attribute 'utils' (most likely due to a circular import)

The full traceback can be found here:

tests/test_basemaps.py:3: in <module>
    from sepal_ui import mapping as sm
sepal_ui/mapping/__init__.py:9: in <module>
    from .sepal_map import *
sepal_ui/mapping/sepal_map.py:23: in <module>
    import rioxarray
../../.local/lib/python3.8/site-packages/rioxarray/__init__.py:5: in <module>
    import rioxarray.raster_array  # noqa
../../.local/lib/python3.8/site-packages/rioxarray/raster_array.py:49: in <module>
    from rioxarray.raster_writer import (
../../.local/lib/python3.8/site-packages/rioxarray/raster_writer.py:22: in <module>
    import dask.array
../../.local/lib/python3.8/site-packages/dask/array/__init__.py:2: in <module>
    from dask.array import backends, fft, lib, linalg, ma, overlap, random
../../.local/lib/python3.8/site-packages/dask/array/backends.py:18: in <module>
    from dask.array.percentile import _percentile
../../.local/lib/python3.8/site-packages/dask/array/percentile.py:9: in <module>
    from dask.array.core import Array
../../.local/lib/python3.8/site-packages/dask/array/core.py:30: in <module>
    from fsspec import get_mapper
../../.local/lib/python3.8/site-packages/fsspec/__init__.py:12: in <module>
    from .compression import available_compressions
../../.local/lib/python3.8/site-packages/fsspec/compression.py:70: in <module>
    register_compression("zip", unzip, "zip")
../../.local/lib/python3.8/site-packages/fsspec/compression.py:46: in register_compression
    if ext in fsspec.utils.compressions and not force:
E   AttributeError: partially initialized module 'fsspec' has no attribute 'utils' (most likely due to a circular import)

I'm using the last version of the lib and I don't understand why there would be a circular reference as fsspec.utils is imported at the beggining of the compression.py file.

Do you have any insight or is it a bug ?

PS:
I don't face this issue on a fresh build but my cloud computing platform has a strict policy on lib installation I cannot use conda or venv forcing me to deal with this sort of issues.

[martindurant]

I have not seen this elsewhere, so I doubt that its a bug with us. Please check your import paths carefully - even the cwd might make a difference. To mitigate, perhaps you can explicitly import fsspec[.utils] before reioxarray?

[12rambau]

I used your mitigation solution until I found what's going wrong. I tested it on a fresh env on my local computer and nothing appears so I think it's related to the platform env.

Thanks for the workaround !