Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Loading…

Redis crash #1023

Closed
chaotian opened this Issue · 8 comments

5 participants

@chaotian

hi,

My redis crashed today. Here are the messages in the log file.

=== REDIS BUG REPORT START: Cut & paste starting from here ===
[14215] 26 Mar 14:35:34.515 # Redis 2.6.7 crashed by signal: 11
[14215] 26 Mar 14:35:34.515 # Failed assertion: (:0)
[14215] 26 Mar 14:35:34.515 # --- STACK TRACE

The redis run on a linux server with 2.6.18-274.12.1.el5 kernel

Thanks,
Chao

@charsyam

@chaotian Do you have any other logs?, what is the version of your redis?

@chaotian

@charsyam My Redis is 2.6.7 . I have opened the watch log.

@antirez
Owner

Hello, the bug report is mutilated :-) Please send the whole bug report if possible.

@chaotian

Hi @antirez here are the logs. I have started the watchdog. afte a while, i found the redis server down. The redis server process is gone. Then i restart the redis server process.

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x7b)[0x42636b]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x7b)[0x42636b]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x7b)[0x42636b]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x7b)[0x42636b]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

[14215] 26 Mar 14:34:55.681 * 10 changes in 60 seconds. Saving...
[14215] 26 Mar 14:34:55.712 * Background saving started by pid 5079
14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x73)[0x426363]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x73)[0x426363]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x7b)[0x4161ab]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x7b)[0x4161ab]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

[5079] 26 Mar 14:35:11.008 * DB saved on disk
[5079] 26 Mar 14:35:11.022 * RDB: 13 MB of memory used by copy-on-write
[14215] 26 Mar 14:35:11.045 * Background saving terminated with success
14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(dictNext+0x74)[0x4161a4]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(dictNext+0x74)[0x4161a4]
redis-server(keysCommand+0x5d)[0x42634d]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
redis-server(logStackTrace+0x54)[0x43ba04]
redis-server(keysCommand+0x77)[0x426367]
/lib64/libpthread.so.0[0x324860eca0]
redis-server(keysCommand+0x77)[0x426367]
redis-server(call+0x53)[0x418933]
redis-server(processCommand+0x376)[0x418e36]
redis-server(processInputBuffer+0x4b)[0x42339b]
redis-server(readQueryFromClient+0x16b)[0x42356b]
redis-server(aeProcessEvents+0x16a)[0x414dfa]
redis-server(aeMain+0x2b)[0x41503b]
redis-server(main+0x23a)[0x41b2ea]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3247e1d9c4]
redis-server[0x414469]
14215 | signal handler --------

14215 | signal handler
--- WATCHDOG TIMER EXPIRED ---
[14215] 26 Mar 14:35:34.515 #

=== REDIS BUG REPORT START: Cut & paste starting from here ===
[14215] 26 Mar 14:35:34.515 # Redis 2.6.7 crashed by signal: 11
[14215] 26 Mar 14:35:34.515 # Failed assertion: (:0)
[14215] 26 Mar 14:35:34.515 # --- STACK TRACE
.

.-``_ ''-._

.-`. `. ''-._ Redis 2.6.7 (00000000/0) 64 bit
.-.-.\/ _.,_ ''-._
( ' , .-` | `, ) Running in stand alone mode
|`-._`-...-` __...-.
-.|'_.-'| Port: 6379
|
-.
._ / _.-' | PID: 5573
-._ -._-./ .-' _.-'

|`-.
-._-..-' .-'.-'|

| -._-._ .-'.-' | http://redis.io

-._-._`-.
.-'.-' _.-'

|`-.
-._-..-' .-'.-'|

| -._-._ .-'.-' |

-._-._`-.
.-'.-' _.-'

`-.
-.__.-' _.-'
-._ .-'

`-._
.-'

[5573] 26 Mar 14:37:58.459 # Server started, Redis version 2.6.7
[5573] 26 Mar 14:38:09.851 * DB loaded from disk: 11.392 seconds
[5573] 26 Mar 14:38:09.851 * The server is now ready to accept connections on port 6379
[5573] 26 Mar 14:39:04.699 * 10 changes in 60 seconds. Saving...
[5573] 26 Mar 14:39:04.728 * Background saving started by pid 6088
[6088] 26 Mar 14:39:23.643 * DB saved on disk
[6088] 26 Mar 14:39:23.655 * RDB: 408 MB of memory used by copy-on-write

@antirez
Owner

Hello, it looks like the software watchdog is cause of that, probably because we call some signal unsafe function inside it, even if I don't remember doing such a silly thing, but I'll check again.

Unfortunately because the crash happened inside a signal handler, for some reason we did not get the bug report with register dumps and so forth. I'll try to reproduce this.

Is the box otherwise solid and memory looks fine? You can test it with Redis itself using ./redis-server --test-memory

Thanks for reporting.

@antirez antirez was assigned
@janus926

I'm not sure if @chaotian still has the environment, but:

- how long is the software watchdog period?
- the watch dog seems are all triggered from keysCommand, how many keys are there?

@chaotian

Hi @janus926 , i do not have this environment any more. It happens about 3 quarters ago. After that crash, i found the problem is that i used keysCommand with too many keys in my redis. there is about 2M keys. i found that redis instance's performance is extremely low, so i start the watchdog, then the redis crashed.

@antirez
Owner

Probably related to #1771.

@mattsta mattsta closed this
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.