Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backport fastparquet 0.7 compat (PR #42954 and #42919) #42987

Merged
merged 4 commits into from
Aug 12, 2021

Conversation

lithomas1
Copy link
Member

@lithomas1 lithomas1 commented Aug 11, 2021

This is a non-trivial backport. Please first review changed files before merging. Thanks

@lithomas1 lithomas1 marked this pull request as draft August 11, 2021 19:06
@lithomas1
Copy link
Member Author

lithomas1 commented Aug 11, 2021

What? How is CI picking up fastparquet 0.7.0. This needs more investigation...

@simonjayhawkins simonjayhawkins added this to the 1.3.2 milestone Aug 11, 2021
@simonjayhawkins simonjayhawkins added Compat pandas objects compatability with Numpy or Python functions IO Parquet parquet, feather labels Aug 11, 2021
@lithomas1
Copy link
Member Author

Anyone on the core team want to restart just the database builds? I just want to confirm that this is not flaky.

# Still need to ensure that this raises in all versions below
import fastparquet as fp

monkeypatch.setattr(fp, "__version__", "0.4")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This monkeypatch actually shouldn't be needed?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep, forgot to revert this part. It's actually present in master too. Will do after this, so the bot can auto backport.

@jorisvandenbossche
Copy link
Member

Restarted, but it was indeed installing fastparquet 0.7.0 ...

@lithomas1
Copy link
Member Author

Ok figured it out. fastparquet decided to actually enforce numpy>1.18 in 0.7.1.

@lithomas1 lithomas1 marked this pull request as ready for review August 12, 2021 03:35
@jorisvandenbossche jorisvandenbossche changed the title Backport PR #42954 and #42919 on 1.3.x Backport fastparquet 0.7 compat (PR #42954 and #42919) Aug 12, 2021
@jorisvandenbossche jorisvandenbossche merged commit 255b796 into pandas-dev:1.3.x Aug 12, 2021
@jorisvandenbossche
Copy link
Member

Thanks! (and indeed, a follow-up PR for my comment is the easiest ;))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Compat pandas objects compatability with Numpy or Python functions IO Parquet parquet, feather
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants