Skip to content

Fix groupby for future pandas#8151

Merged
jrbourbeau merged 2 commits intodask:mainfrom
jsignell:groupby
Sep 21, 2021
Merged

Fix groupby for future pandas#8151
jrbourbeau merged 2 commits intodask:mainfrom
jsignell:groupby

Conversation

@jsignell
Copy link
Copy Markdown
Member

Implementing @TomAugspurger's workaround from #8137 (comment)

@github-actions github-actions bot added dataframe dispatch Related to `Dispatch` extension objects labels Sep 15, 2021
@jsignell
Copy link
Copy Markdown
Member Author

jsignell commented Sep 15, 2021

I based this off of the int64index branch just to see if tests could pass. You can see the relevant changes at: https://github.com/dask/dask/pull/8151/files/57aabfe7081e16bfe647e58a26ba16332d734f33..03cc7f0a144aa0fb0473b47b7fbc99aa31181717

EDIT: I just rebased since #8144 merged

@jsignell
Copy link
Copy Markdown
Member Author

rerun tests

@github-actions github-actions bot removed the dispatch Related to `Dispatch` extension objects label Sep 16, 2021
def _drop_duplicates_rename(df):
# Avoid duplicate index labels in a groupby().apply() context
# https://github.com/dask/dask/issues/3039
# https://github.com/pandas-dev/pandas/pull/18882
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This refers to a version of pandas that is no longer supported.

@jsignell
Copy link
Copy Markdown
Member Author

@jrbourbeau this both removes the skip for the failing groupby test that was introduced in #8142 and fixes all the upstream test failures except for one last pesky little test. I think we should merge it before the release.

Copy link
Copy Markdown
Member

@jrbourbeau jrbourbeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just checking in here, @jsignell is this good to go?

@jsignell
Copy link
Copy Markdown
Member Author

Yes this is done :)

Copy link
Copy Markdown
Member

@jrbourbeau jrbourbeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, merging in then

@jrbourbeau jrbourbeau merged commit d4819b5 into dask:main Sep 21, 2021
@jsignell jsignell deleted the groupby branch September 22, 2021 16:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Test failure with pandas 1.3.3

2 participants