Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pandas type stubs #6635

Merged
merged 1 commit into from
Jun 27, 2022
Merged

pandas type stubs #6635

merged 1 commit into from
Jun 27, 2022

Conversation

crusaderky
Copy link
Collaborator

No description provided.

Copy link
Member

@hendrikmakait hendrikmakait left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! I didn't know this existed.

PANDAS_VERSION = parse_version(pd.__version__)
PANDAS_GT_100 = PANDAS_VERSION >= parse_version("1.0.0")

if PANDAS_GT_100:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I haven't found a declaration of the minimum version of pandas as 1.0.0 in dask/distributed, so I guess this is transitive through dask/dask (https://github.com/dask/dask/blob/main/setup.py#L17). Should we make this explicit in our own requirements.txt?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No: pandas is used in distributed only for shuffling. There isn't any distributed feature that would work stand alone without passing through dask[dataframe].

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From what I see, it's also used in the memory sampler, which should be independent of dask[dataframe] or am I mistaken?

@crusaderky crusaderky merged commit a8eb3b2 into dask:main Jun 27, 2022
@crusaderky crusaderky deleted the pandas_stubs branch June 27, 2022 15:47
@ian-r-rose
Copy link
Collaborator

Cool

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants