Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MNT] Update dask requirement from <2024.2.2 to <2024.4.2, add new required dataframe extra to pyproject.toml. #6282

Merged
merged 2 commits into from Apr 10, 2024

Conversation

yarnabrina
Copy link
Collaborator

@yarnabrina yarnabrina commented Apr 10, 2024

Fixes #6280 by updating dask to the newest version which fixes incompatibility with python 3.11.9

@yarnabrina yarnabrina marked this pull request as draft April 10, 2024 09:18
@fkiraly fkiraly added maintenance Continuous integration, unit testing & package distribution bugfix Fixes a known bug or removes unintended behavior labels Apr 10, 2024
@fkiraly fkiraly changed the title [MNT] fixes dask installation problems [MNT] Update dask requirement from <2024.2.2 to <2024.4.2, add new required dataframe extra to pyproject.toml. Apr 10, 2024
@fkiraly
Copy link
Collaborator

fkiraly commented Apr 10, 2024

Turns out we had the same idea, see #6255

Your fix does not work because your syntax is not PEP 508 compliant, you need to add extras as a PEP 508 marker.

Since you had the idea first, I've changd this PR so it works and credit goes to you, and will close the modified dependabot one.

Copy link
Collaborator

@fkiraly fkiraly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Idea works, I just had to update the syntax to be PEP 508 compliant, see above.

@fkiraly fkiraly merged commit bab0b84 into main Apr 10, 2024
4 of 5 checks passed
@fkiraly fkiraly deleted the fix-dask-bug branch April 10, 2024 14:05
fkiraly added a commit that referenced this pull request Apr 11, 2024
It seems the fix #6282 caused another issue - I believe the reason is
that `dask` removed `pyyaml` as a dependency.

Consequently, the `import yaml` statement in the mlflow module now
fails, post #6282. Unclear why the tests did not recognize this.

The fix should be this: import `yaml` only if `mlflow` is present.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix Fixes a known bug or removes unintended behavior maintenance Continuous integration, unit testing & package distribution
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] dask related failures, sporadic
2 participants