Upgrade dependencies version support

[gmaze]

Will close #94

[gmaze]

as pointed by @quai20 in #63 (comment) a major change in fsspec occured after 0.8.3 that is a source of error for argopy caching functionalities:

Check out the output of the following code for different fsspec versions:

loader = ArgoDataFetcher(src='localftp', cache=True).float(2901623)
loader.load()

import pickle
fn = os.path.join(loader.fetcher.fs.fs.storage[-1], "cache")
cache = loader.fetcher.fs.fs.cached_files[-1]
if os.path.exists(fn):
    with open(fn, "rb") as f:
        cached_files = pickle.load(f)
else:
    cached_files = cache
print('cached_files keys:')    
[print("\t", k) for k in cached_files.keys()];

fsspec 0.8.3

This is the version currently supported by argopy:

cached_files keys:
	 file:///Users/gmaze/data/ARGO/ftp_current/dac/nmdis/2901623/2901623_prof.nc

fsspec 0.8.4 > fsspec 2021.08.1

Up to the last fsspec release, output is:

cached_files keys:
	 /Users/gmaze/data/ARGO/ftp_current/dac/nmdis/2901623/2901623_prof.nc

For some reasons fsspec does not prepend the path with the store protocol anymore, and this leads to CacheFileNotFound errors all over the place !
I could trace this change back to version fsspec 0.8.4

Fix

This is due to this peace of code being removed after 0.8.3 in fsspec/implementations/cached.py

if not path.startswith(self.target_protocol):
            store_path = self.target_protocol + "://" + path
else:
            store_path = path

This will be fixed by adding a test on fsspec version in our filesystems store_path method

[gmaze]

Despite improved understanding of what's going on (#96 ) using the erddap index fetcher is unstable ! :-(

Using my browser to fetch this region works, but it fails with the index fetcher.
Same thing with this float.

I just can't reproduce the error happening on the Github action tests ...

[gmaze]

to @quai20 for your review, this PR content:

Addressed incompatibility with last versions of dependencies

• in argo_index.py: seek index object safely, refactoring of methods name and position (most of search_* methods), fixed read_csv method to work with cache.
• skip erddap index fetcher tests because the server is not reliable
• in filesytems.py: new expand_path method to accommodate for the change of protocol management in fsspec after version 0.8.3, thus allowing to fix store_path and to make it work whatever the fsspec version
• in utilities.py: the collection import and fixed the linear_interpolation_remap function to work with recent xarray versions (change in apply_ufunc options name)
• lock dependencies versions in requirements.txt

Other changes

• fix all flake8/lint errors (hence a bunch of noqa) and run black on some of the files
• enforce uri to be a property not a class for all fetchers
• follow recommendations on some of the class abstracts (eg: raise an NotImplementedError instead of a pass in abstract methods)
• add a logger, mostly used in filesytems.py at this point.
• clean up of the code here and there (eg: fix the issue in data fetcher plot where a full index was required, forgotten from Improve plotting modules #56 )
• improved CI tests, add pytest.ini for logging, add tests for fetcher proto
• improved (erddap_ds_exists, isconnected, show_versions, clear_cache) and added new utilities.py functions (show_options)
• refactor xarray.py sub-method new_arrays into merge_arrays in the filter_data_mode method

[gmaze]

I don't know why we have toolz as a requirement, we should try to remove it

[quai20]

I don't know about toolz yet, but packaging seems to be missing from the requirements on my side.

[quai20]

indeed, toolz does not seems to be necessary.