Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix timezone metadata inference on parquet load #4655

Merged
merged 8 commits into from Apr 3, 2019

Conversation

@martindurant
Copy link
Member

@martindurant martindurant commented Mar 30, 2019

  • Tests added / passed
  • Passes flake8 dask

Will not pass until dask/fastparquet#411 is merged and released

Fixes #4640 (but not very elegantly!)

@martindurant
Copy link
Member Author

@martindurant martindurant commented Mar 30, 2019

Does anyone know in which version of pyarrow timezones were added to the metadata?

@martindurant
Copy link
Member Author

@martindurant martindurant commented Apr 1, 2019

NB the codecov diff check does not seem to be measuring this PR particularly ( @jrbourbeau )

@pentschev
Copy link
Member

@pentschev pentschev commented Apr 1, 2019

I believe this PR is fine from the codecov perspective. I'm still trying to understand what's going on with codecov, and I think it doesn't like PRs that don't have it's configuration file in it for some reason.

@martindurant would you mind merging current master in your branch so we can see if that solves codecov's complaints?

martindurant added 2 commits Apr 1, 2019
in http - not related to this PR, but picked up by coveralls
@pentschev
Copy link
Member

@pentschev pentschev commented Apr 2, 2019

It looks like Travis never returned its status here, it's been waiting for completion for about 12h now, but all tests have passed. Don't hold this due to that or codecov, go ahead and merge once reviewers are good ok with the changes.

@martindurant
Copy link
Member Author

@martindurant martindurant commented Apr 2, 2019

Would someone like to review this? I'll probably merge this evening if no one speaks.

@martindurant martindurant merged commit 3205dbd into dask:master Apr 3, 2019
1 of 2 checks passed
@martindurant martindurant deleted the parquet_tz branch Apr 3, 2019
supeni86
Copy link

supeni86 commented on 5d4a754 Apr 15, 2019

jorge-pessoa pushed a commit to jorge-pessoa/dask that referenced this issue May 14, 2019
* Fix timezone metadata inference on parquet load

* lint

* back compat

* compat correctly

* Skip tz test for older fastparquet

Allows this to be merged before next release of fp

* got it wrong...

* exclude coverage

in http - not related to this PR, but picked up by coveralls
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

3 participants