Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python] Missing bindings for existing_data_behavior makes it impossible to maintain old behavior #31202

Closed
asfimport opened this issue Feb 22, 2022 · 2 comments

Comments

@asfimport
Copy link

Shouldn't the missing bindings reported earlier in #11632 be propagated higher up here in the parquet.py module?
Passing **kwargs as is the case for write_table would do the trick I think.
I am finding myself stuck while using pandas.to_parquet with use_legacy_dataset=false and no way to set the existing_data_behavior flag to overwrite_or_ignore

 

Reporter: christophe bagot
Assignee: Alenka Frim / @AlenkaF

PRs and other links:

Note: This issue was originally created as ARROW-15757. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Joris Van den Bossche / @jorisvandenbossche:
Indeed, we should probably ensure users can pass that keyword in write_to_dataset as well. Currently, the **kwargs are passed to the ParquetFileFormat write options (for parquet specific write options).

Thanks for raising the issue!

@asfimport
Copy link
Author

Krisztian Szucs / @kszucs:
Issue resolved by pull request 12838
#12838

@raulcd raulcd modified the milestones: 7.0.2, 8.0.0 Jan 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants