PANIC: unprotected error in call to Lua API (not enough memory) on select from large space

[anei]

Tarantool crashes on select from a large space:

In interactive mode run:

box.cfg{slab_alloc_arena = 4.0}                                                  
s = box.schema.space.create('t')                                             
s:create_index('ind', {parts = {1, 'num'}})                                                                                                               
i = 0
console = require('console')
console.delimiter('!')                                                             
while i < 50000000 do                                                            
    s:auto_increment{i}                                                          
    i = i + 1                                                                    
end!

#s:select{}

(I used hash to suppress output if Tarantool will not crash)
I got:

tarantool> #s:select{}
PANIC: unprotected error in call to Lua API (not enough memory)
2014-10-07 17:49:09.258 [59753] main/101/spawner I> Exiting: master shutdown

After restart I got same error, but Tarantool did'nt shutdown, it just stopped to react.

tarantool: version 1.6.3-341-gf82473f

[kostja]

Thank you for a bug report.

[rtsisyk]

1.6.3-487-gf4722a6

box.cfg{slab_alloc_arena = 0.2, wal_mode = 'none'}
...

2014-10-09 15:44:02.554 [26075] main/101/interactive small.h:281 E> ER_MEMORY_ISSUE: Failed to allocate 23 bytes in slab allocator for tuple
---
- error: Failed to allocate 23 bytes in slab allocator for tuple
...

tarantool> #s:select{}!
---
- 3401079
...

Probably you have broken build.
Did you use our official build from tarantool.org/dist/?

[anei]

Tarantool was installed from official debian repository (http://tarantool.org/dist/master/debian/ wheezy/main)

Try to set larger value for slab_alloc_arena, 4.0 will be fine.

[alyapunov]

It seems to be a luajit problem. Luajit crashes when someone creates a table with big amount of cdata objects with finalizers, tarantool tuples as an example.
We've delivered the problem to luajit team, and one day it'll be fixed.
http://www.freelists.org/post/luajit/PANIC-in-lj-cdata-setfin-on-out-of-memory
http://www.freelists.org/post/luajit/PANIC-in-lj-cdata-setfin-on-out-of-memory,1
Now we can only suggest avoiding huge (>10^5) tables with tuples. And I also think that huge tables with tuples is always a bad idea despite of this issue is solved or not.

[kostja]

Please add expect-fail test case to our test suite.

[nabihach]

One way to fix this is to install torch with Lua 5.2 instead of LuaJIT, as described here: http://torch.ch/docs/getting-started.html#_

[unera]

#0  0x4e68c9 in print_backtrace+9
#1  0x4ceb29 in tarantool_panic_handler+29
#2  0x500823 in lj_err_throw+73
#3  0x500a1b in lj_err_mem+3b
#4  0x500478 in lj_mem_realloc+48
#5  0x502d35 in lj_tab_resize+f5
#6  0x5030ad in rehashtab+1ad
#7  0x4fff5d in gc_onestep+59d
#8  0x500134 in lj_gc_step+54
#9  0x50d368 in lua_pushcclosure+e8
#10 0x4c0b63 in box_lua_call+43
#11 0x4bf249 in box_process_call+129
#12 0x410b42 in _ZL15tx_process_callP4cmsg+d2
#13 0x4e8194 in cmsg_deliver+14
#14 0x4e8d19 in fiber_pool_f+c9
#15 0x40e73c in _ZL16fiber_cxx_invokePFiP13__va_list_tagES0_+c
#16 0x4e3630 in fiber_loop+30
#17 0x613f3f in coro_init+3f
#18 (nil) in +3f
2018-03-24 06:08:56.351 [24160] main/134492/main C> not enough memory

• I don't select more than 150 tuples per select
• I don't use iproto select/insert/etc, only iproto lua call
• The application doesn't use any fibers.
• database size - 26 Mb, arena 6Gb, Host RAM - 10Gb

tuple example:

---
- - [1, '7637666', 'da4cebb246c8fe108ca0ff12c5a52a06', 1521021450, 37.657672, 55.823722,
    'cancelled_user']
  - [2, '7640375', 'ed5b3a4784628a6e5bde1479676db882', 1521021444, 37.523618, 55.773072,
    'cancelled_user']
...

before dead situation (box.runtime):

[igormunkin]

Should be finally fixed when LuaJIT/LuaJIT@d5bbf9c is backported.

[rtsisyk]

Wow, it's been a while. Thanks for fixing.

[igormunkin]

The issue is finally resolved in scope of tarantool/luajit@7b98314 and submodule is bumped in scope of fcb41bb.