Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Python] pandas roundtrip failing with decimal in column index #41502

Closed
jrversteegh opened this issue May 2, 2024 · 1 comment
Closed

[Python] pandas roundtrip failing with decimal in column index #41502

jrversteegh opened this issue May 2, 2024 · 1 comment
Assignees
@jrversteegh
Labels
Component: Python Type: bug
Milestone
17.0.0

Comments

@jrversteegh
Copy link
Contributor

jrversteegh commented May 2, 2024 •
edited

Describe the bug, including details regarding any error messages, version, and platform.

pd.DataFrame({Decimal(88): [88]}).to_parquet("test.parquet")
pd.read_parquet("test.parquet")

will fail with TypeError: data type 'decimal' not understood

Component(s)

Python
@jrversteegh jrversteegh mentioned this issue May 2, 2024
Merged
@jorisvandenbossche jorisvandenbossche changed the title pd.read_parquet failing with decimal in column index [Python] pandas roundtrip failing with decimal in column index May 7, 2024
jorisvandenbossche pushed a commit that referenced this issue Jun 5, 2024
@jrversteegh
GH-41502: [Python] Fix reading column index with decimal values (#41503)
0b5f0a2 
Fix for #41502 

Convert pandas "decimal" to "object" in numpy.
* GitHub Issue: #41502

Authored-by: Jaap Versteegh <j.r.versteegh@gmail.com>
Signed-off-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
vibhatha pushed a commit to vibhatha/arrow that referenced this issue Jun 5, 2024
@jrversteegh @vibhatha
apacheGH-41502: [Python] Fix reading column index with decimal values (…
543d4a8 
…apache#41503)

Fix for apache#41502 

Convert pandas "decimal" to "object" in numpy.
* GitHub Issue: apache#41502

Authored-by: Jaap Versteegh <j.r.versteegh@gmail.com>
Signed-off-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
@jorisvandenbossche jorisvandenbossche added this to the 17.0.0 milestone Jun 6, 2024
@jorisvandenbossche
Copy link
Member

Resolved by #41503

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jrversteegh jrversteegh

Labels
Component: Python Type: bug
Projects
None yet
Milestone
17.0.0
Development

No branches or pull requests
2 participants
@jorisvandenbossche @jrversteegh