Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI failure due to dependency conflict #8614

Open
fjetter opened this issue Apr 11, 2024 · 6 comments
Open

CI failure due to dependency conflict #8614

fjetter opened this issue Apr 11, 2024 · 6 comments
Labels
tests Unit tests and/or continuous integration

Comments

@fjetter
Copy link
Member

fjetter commented Apr 11, 2024

All our CI jobs with python>3.10 are failing due to a dependency resolution conflict

The conflict is caused by:
    The user requested fsspec 2024.3.2.dev5+g2dd9355 (from git+https://github.com/fsspec/filesystem_spec)
    dask 2024.4.1+4.gb2ec1e1a depends on fsspec>=2021.09.0
    s3fs 2024.3.1+2.g7ccc0a5 depends on fsspec==2024.3.1

cc @martindurant are you aware of anything that caused this hard pinning between s3fs and fsspec?

e.g. https://github.com/dask/distributed/actions/runs/8619396892/job/23704420478?pr=8610

@fjetter fjetter added tests Unit tests and/or continuous integration and removed needs triage labels Apr 11, 2024
@martindurant
Copy link
Member

Yes, s3fs (and gcsfs) are hard pinned to exactly the same version as fsspec, and have been for a long time. They are always released within hours of each other.

The latest release is 2024.3.1. I am thinking that the introduction of hatch in fsspec/filesystem_spec#1553 has caused the dev version to be called "2024.3.2.XXX" instead of "2024.3.1.XXX" as versioneer used to do. I am not sure how to change this convention.

@fjetter
Copy link
Member Author

fjetter commented Apr 11, 2024

OK, I don't want our entire CI to be blocked by this and opened #8615 to temporarily just run CI against stable versions until this is figured out

@martindurant
Copy link
Member

fsspec/filesystem_spec#1569 should fix this, if you care to try

@phofl
Copy link
Collaborator

phofl commented Apr 11, 2024

#8618 tries this

@martindurant
Copy link
Member

Please try again with main/master whenever you think the caches might have cleared.

@phofl
Copy link
Collaborator

phofl commented Apr 18, 2024

did that on my revert pr

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests Unit tests and/or continuous integration
Projects
None yet
Development

No branches or pull requests

3 participants