core dump in V2.4.8 #861

Closed
garfee opened this Issue Jan 6, 2013 · 1 comment

3 participants

@garfee

I get a core dump after running redis about 3 months.
I find that in db.c:setkey,the key was set successfully,but dictFind cannot find it,and then a coredump raised.

Here are the message printed by redis-server:

[17551] 06 Jan 05:40:26 - 13 clients connected (0 slaves), 244651996136 bytes in use
[17551] 06 Jan 05:40:28 # === REDIS BUG REPORT START: Cut & paste starting from here ===
[17551] 06 Jan 05:40:28 # === ASSERTION FAILED ===
[17551] 06 Jan 05:40:28 # ==> db.c:444 'dictFind(db->dict,key->ptr) != NULL' is not true
[17551] 06 Jan 05:40:28 # (forcing SIGSEGV to print the bug report.)
[17551] 06 Jan 05:40:28 # Redis 2.4.8 crashed by signal: 11
[17551] 06 Jan 05:40:28 # Failed assertion: dictFind(db->dict,key->ptr) != NULL (db.c:444)
[17551] 06 Jan 05:40:28 # --- STACK TRACE
[17551] 06 Jan 05:40:28 # ./redis-server(_redisAssert+0x72) [0x42f282]
[17551] 06 Jan 05:40:28 # ./redis-server(_redisAssert+0x72) [0x42f282]
[17551] 06 Jan 05:40:28 # ./redis-server(removeExpire+0x5d) [0x41a44d]
[17551] 06 Jan 05:40:28 # ./redis-server(setKey+0x47) [0x41ae67]
[17551] 06 Jan 05:40:28 # ./redis-server(setGenericCommand+0x7e) [0x41ee5e]
[17551] 06 Jan 05:40:28 # ./redis-server(call+0x34) [0x40f1f4]
[17551] 06 Jan 05:40:28 # ./redis-server(processCommand+0x210) [0x40f4e0]
[17551] 06 Jan 05:40:28 # ./redis-server(processInputBuffer+0x49) [0x417ef9]
[17551] 06 Jan 05:40:28 # ./redis-server(readQueryFromClient+0x10f) [0x4187df]
[17551] 06 Jan 05:40:28 # ./redis-server(aeProcessEvents+0x173) [0x40bf33]
[17551] 06 Jan 05:40:28 # ./redis-server(aeMain+0x2e) [0x40c14e]
[17551] 06 Jan 05:40:28 # ./redis-server(main+0xf1) [0x411171]
[17551] 06 Jan 05:40:28 # /lib64/libc.so.6(__libc_start_main+0xf4) [0x3b11a1d974]
[17551] 06 Jan 05:40:28 # ./redis-server [0x40b509]
[17551] 06 Jan 05:40:28 # --- INFO OUTPUT
[17551] 06 Jan 05:40:28 # redis_version:2.4.8
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:17551
uptime_in_seconds:6980423
uptime_in_days:80
lru_clock:1524474
used_cpu_sys:43639.51
used_cpu_user:78606.65
used_cpu_sys_children:0.00
used_cpu_user_children:0.00
connected_clients:13
connected_slaves:0
client_longest_output_list:0
client_biggest_input_buf:10529
blocked_clients:0
used_memory:279022816872
used_memory_human:259.86G
used_memory_rss:259767263232
used_memory_peak:244662344248
used_memory_peak_human:227.86G
mem_fragmentation_ratio:0.93
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:11912336334
bgsave_in_progress:0
last_save_time:1350441605
bgrewriteaof_in_progress:0
total_connections_received:83551
total_commands_processed:13958384211
expired_keys:0
evicted_keys:0
keyspace_hits:1924101779
keyspace_misses:121946057
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
vm_enabled:0
role:master
db0:keys=2147483652,expires=0

[17551] 06 Jan 05:40:28 # --- CLIENT LIST OUTPUT
[17551] 06 Jan 05:40:28 # addr=192.168.3.122:47516 fd=5 idle=0 flags=N db=0 sub=0 psub=0 qbuf=10529 obl=2355 oll=0 events=rw cmd=set
addr=192.168.3.99:47058 fd=8 idle=4389013 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.99:47059 fd=14 idle=8 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.98:55862 fd=7 idle=4387932 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.99:40149 fd=17 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.99:40151 fd=18 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.99:40153 fd=19 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.70:26755 fd=6 idle=4272856 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=NULL
addr=192.168.3.70:26761 fd=9 idle=2318193 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.70:26772 fd=10 idle=2561931 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.70:26781 fd=11 idle=2546918 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.98:59159 fd=12 idle=1086633 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get
addr=192.168.3.98:59160 fd=13 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=get

[17551] 06 Jan 05:40:28 # --- CURRENT CLIENT INFO
[17551] 06 Jan 05:40:28 # client: addr=192.168.3.122:47516 fd=5 idle=0 flags=N db=0 sub=0 psub=0 qbuf=10529 obl=2355 oll=0 events=rw cmd=set
[17551] 06 Jan 05:40:28 # argv[0]: 'set'
[17551] 06 Jan 05:40:28 # argv[1]: 'lo1qT0Z9Y2M0'
[17551] 06 Jan 05:40:28 # argv[2]: ',,220,|,'
[17551] 06 Jan 05:40:28 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

Please report the crash opening an issue on github:
@jokea

Pretty weird assertion failure. Could you run memory test on the server to check if there's any hardware issue?
Seems you have a very big instance, you may need to run memtest for a bit longer.

@mattsta mattsta closed this May 30, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment