New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

heap corruption in read_csv on 32-bit big-endian architectures #20785

Closed
ginggs opened this Issue Apr 22, 2018 · 1 comment

Comments

Projects
None yet
2 participants
@ginggs
Contributor

ginggs commented Apr 22, 2018

While building pandas 0.22.0 for 32-bit big-endian architectures, the test suite crashes in TestMultiLevel::test_unstack_odd_failure with various errors:

realloc(): invalid next size
malloc(): smallbin double linked list corrupted
Segmentation fault
corrupted double-linked list

This happened to be the first test that calls read_csv, and I could reproduce this in the REPL by simply doing:

import pandas as pd
df = pd.read_csv('data.csv')

I narrowed it down to 8d7d3fb and found #17063 describing a similar problem introduced by the same commit affecting other 32-bit architectures.

@jreback

This comment has been minimized.

Contributor

jreback commented Apr 22, 2018

you could submit a patch, but we have 0 support for big endian (no testing) and very little for 32-but arch (limited testing)

@jreback jreback closed this Apr 22, 2018

ginggs added a commit to ginggs/pandas that referenced this issue Apr 22, 2018

@ginggs ginggs referenced this issue Apr 22, 2018

Merged

BUG: Switch more size_t references to int64_t #20786

0 of 4 tasks complete

@jreback jreback added this to the 0.23.0 milestone Apr 22, 2018

jreback added a commit that referenced this issue Apr 24, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment