-
Notifications
You must be signed in to change notification settings - Fork 360
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
32-bit BoundsError #1978
Comments
Decided to do a little bit of digging in to this by looking at the DataFrames.jl/src/dataframerow/utils.jl Line 102 in b0d8a87
It looks like the |
@nalimilan - you probably have most experience with this part of code base (if you are not available please let me know and I will have a look at this issue). |
I spent some more time looking into this just now. I took this code from
The root cause of this is most likely in here: https://github.com/JuliaLang/julia/blob/master/base/hashing2.jl#L30 EDIT: In my example the first instance of this issue can be replicated with:
These both evaluate to |
Interesting. Yes, hash collisions are expected to happen, and the code is supposed to be able to handle them. Apparently, I broke that by moving this DataFrames.jl/src/dataframerow/utils.jl Line 135 in b0d8a87
Can you check whether #1979 fixes it? If so, we should try to add tests for that (hopefully that won't use too much memory for Travis/AppVeyor) |
Just tested #1979 this resolves the issue! |
I've run into an issue when trying to do a
join
with two large DataFrames. The CI runners for 32-bit versions for Julia1.0, 1.1, 1.2
all fail. The 64-bit versions work perfectly fine:Stacktrace from the CI:
I've been playing around in
VirtualBox
with anUbuntu 32-bit
instance. Below is an example of how I am usingDataFrames
. Note this example on my VirtualBox instance causes aSIGABRT
.After spending sometime and looking at
group_rows
I was able to create another example which forces the above stacktrace. It will always crash afterg_ix=57979
.The text was updated successfully, but these errors were encountered: