Mmap bus error #28245

quinnj · 2018-07-23T21:23:46Z

               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: https://docs.julialang.org
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.7.0-beta2.84 (2018-07-23 19:53 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 10002fcb5e* (0 days old master)
|__/                   |  x86_64-apple-darwin16.7.0

julia> using Mmap

julia> a = Mmap.mmap("foo2", Vector{NTuple{1, Int8}}, 1, 0)
1-element Array{Tuple{Int8},1}:
Bus error: 10

Also happens for simple structs like struct Wrapper; x::Int; end. I plan on taking a look at this to see what's going on, but if anyone else has any ideas, please share in the mean time.

The text was updated successfully, but these errors were encountered:

JeffBezanson · 2018-07-23T23:44:59Z

Works for me.

jpsamaroo · 2018-07-26T14:29:16Z

I also got a Bus error (on Linux, Julia Version 0.7.0-beta2.78), but that was because the file was empty. Adding 10M to the file with dd fixed it. If that doesn't work, you could try running under strace (or whatever the equivalent is on OSX, dtrace maybe?).

xgdgsc · 2020-01-09T09:23:27Z

I get bus error if specified shape larger than the file size. Julia would crash. Is it possible to make it not crash the session and only report an error? I think it could check filesize first.

xgdgsc · 2020-01-10T12:56:06Z

using Mmap
A = rand(1:0.5:20, 5, 30)
s = open("mmap.bin", "w+")
write(s, A)
close(s)
B = Mmap.mmap(open("mmap.bin"), Matrix{Float64}, (4096,30))

This would crash with Bus Error on Ubuntu 16.04 with julia 1.3.1 . While on Win 10 it only prints an error.

Moelf · 2022-02-25T07:37:07Z

Does this still crash for some people?

xgdgsc · 2022-02-25T09:44:11Z

The original poster code doesn' t crash. My code in the comment above still crashes in Ubuntu 20.04, julia 1.6 and 1.7.

vtjnash · 2022-02-25T17:12:39Z

As mentioned above #28245 (comment), there is a missing call to open(identity, "foo2", "w") in the MWE

davidbp · 2022-11-08T16:59:51Z

On 1.8 I still get weird errors. For example, depending on which position I access from the memmapped file the code crashes

julia> using Mmap

julia> data = Mmap.mmap("./test.mmap", Matrix{Float32}, (64, 2000_000));

julia> x = data[:,1_00]; #works fine

julia> y = data[:,1_000_000];

signal (10): Bus error: 10
in expression starting at REPL[4]:1
getindex at ./array.jl:925 [inlined]
macro expansion at ./multidimensional.jl:903 [inlined]
macro expansion at ./cartesian.jl:64 [inlined]
_unsafe_getindex! at ./multidimensional.jl:898 [inlined]
_unsafe_getindex at ./multidimensional.jl:889 [inlined]
_getindex at ./multidimensional.jl:875 [inlined]
getindex at ./abstractarray.jl:1241
unknown function (ip: 0x10851c1df)
ijl_apply_generic at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
do_call at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
eval_body at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
jl_interpret_toplevel_thunk at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
jl_toplevel_eval_flex at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
jl_toplevel_eval_flex at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
ijl_toplevel_eval_in at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
eval at ./boot.jl:368 [inlined]
eval_user_input at /Users/administrator/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-aarch64-1.0/build/default-macmini-aarch64-1-0/julialang/julia-release-1-dot-8/usr/share/julia/stdlib/v1.8/REPL/src/REPL.jl:151
repl_backend_loop at /Users/administrator/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-aarch64-1.0/build/default-macmini-aarch64-1-0/julialang/julia-release-1-dot-8/usr/share/julia/stdlib/v1.8/REPL/src/REPL.jl:247
start_repl_backend at /Users/administrator/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-aarch64-1.0/build/default-macmini-aarch64-1-0/julialang/julia-release-1-dot-8/usr/share/julia/stdlib/v1.8/REPL/src/REPL.jl:232
#run_repl#47 at /Users/administrator/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-aarch64-1.0/build/default-macmini-aarch64-1-0/julialang/julia-release-1-dot-8/usr/share/julia/stdlib/v1.8/REPL/src/REPL.jl:369
run_repl at /Users/administrator/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-aarch64-1.0/build/default-macmini-aarch64-1-0/julialang/julia-release-1-dot-8/usr/share/julia/stdlib/v1.8/REPL/src/REPL.jl:355
jfptr_run_repl_67919 at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/sys.dylib (unknown line)
ijl_apply_generic at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
#966 at ./client.jl:419
jfptr_YY.966_42132 at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/sys.dylib (unknown line)
ijl_apply_generic at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
jl_f__call_latest at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
#invokelatest#2 at ./essentials.jl:729 [inlined]
invokelatest at ./essentials.jl:726 [inlined]
run_main_repl at ./client.jl:404
exec_options at ./client.jl:318
_start at ./client.jl:522
jfptr__start_58825 at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/sys.dylib (unknown line)
ijl_apply_generic at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
true_main at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
jl_repl_entrypoint at /Applications/Julia-1.8.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.8.dylib (unknown line)
Allocations: 2906 (Pool: 2894; Big: 12); GC: 0
Bus error: 10

elextr · 2022-11-08T23:17:15Z

Just a note that the Linux mmap documentation says SIGBUS occurs when an attempt is made to access pages of the mapping beyond the size of the file.

Fixes: #28245 Co-authored-by: Jameson Nash <vtjnash@gmail.com> Co-authored-by: Stefan Karpinski <stefan@karpinski.org>

vtjnash · 2023-08-21T16:46:47Z

Still a bug on macOS

Fixes: #28245 Co-authored-by: Jameson Nash <vtjnash@gmail.com> Co-authored-by: Stefan Karpinski <stefan@karpinski.org> (cherry picked from commit ead627e)

JonasIsensee mentioned this issue Oct 11, 2020

Bus error on version 0.2.3 JuliaIO/JLD2.jl#246

Closed

ViralBShah added the mac Affects only macOS label Feb 25, 2022

ViralBShah closed this as completed Feb 25, 2022

vtjnash reopened this Feb 25, 2022

xgdgsc mentioned this issue Feb 26, 2022

🐛 fix bus error on smaller readonly file in unix #44354

Merged

vtjnash mentioned this issue Nov 8, 2022

Julia quitting when creating Mmap in OSX (bug) #47496

Closed

vtjnash added bug Indicates an unexpected problem or unintended behavior and removed mac Affects only macOS labels Nov 8, 2022

vtjnash closed this as completed in #44354 Aug 21, 2023

vtjnash added a commit that referenced this issue Aug 21, 2023

fix bus error on smaller readonly file in unix (#44354)

ead627e

Fixes: #28245 Co-authored-by: Jameson Nash <vtjnash@gmail.com> Co-authored-by: Stefan Karpinski <stefan@karpinski.org>

vtjnash reopened this Aug 21, 2023

KristofferC pushed a commit that referenced this issue Feb 6, 2024

fix bus error on smaller readonly file in unix (#44354)

6fcff37

Fixes: #28245 Co-authored-by: Jameson Nash <vtjnash@gmail.com> Co-authored-by: Stefan Karpinski <stefan@karpinski.org> (cherry picked from commit ead627e)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Mmap bus error #28245

Mmap bus error #28245

quinnj commented Jul 23, 2018

JeffBezanson commented Jul 23, 2018

jpsamaroo commented Jul 26, 2018

xgdgsc commented Jan 9, 2020

xgdgsc commented Jan 10, 2020 •

edited

Moelf commented Feb 25, 2022

xgdgsc commented Feb 25, 2022 •

edited

vtjnash commented Feb 25, 2022

davidbp commented Nov 8, 2022 •

edited

elextr commented Nov 8, 2022

vtjnash commented Aug 21, 2023

Mmap bus error #28245

Mmap bus error #28245

Comments

quinnj commented Jul 23, 2018

JeffBezanson commented Jul 23, 2018

jpsamaroo commented Jul 26, 2018

xgdgsc commented Jan 9, 2020

xgdgsc commented Jan 10, 2020 • edited

Moelf commented Feb 25, 2022

xgdgsc commented Feb 25, 2022 • edited

vtjnash commented Feb 25, 2022

davidbp commented Nov 8, 2022 • edited

elextr commented Nov 8, 2022

vtjnash commented Aug 21, 2023

xgdgsc commented Jan 10, 2020 •

edited

xgdgsc commented Feb 25, 2022 •

edited

davidbp commented Nov 8, 2022 •

edited