redis 2.4.10 and 2.4.9 may crashed,but redis 2.4.6 looks up working normally #460

Closed
farmerluo opened this Issue Apr 17, 2012 · 10 comments

Projects

None yet

2 participants

@farmerluo

[4389] 12 Apr 23:24:27 * Server started, Redis version 2.4.10
[4389] 12 Apr 23:24:27 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
[4389] 12 Apr 23:24:27 * The server is now ready to accept connections on port 6379
[4389] 12 Apr 23:25:57 # User requested shutdown...
[4389] 12 Apr 23:25:57 * Saving the final RDB snapshot before exiting.
[4389] 12 Apr 23:25:57 * DB saved on disk
[4389] 12 Apr 23:25:57 * Removing the pid file.
[4389] 12 Apr 23:25:57 # Redis is now ready to exit, bye bye...
[4414] 12 Apr 23:25:57 * Server started, Redis version 2.4.10
[4414] 12 Apr 23:25:57 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
[4414] 12 Apr 23:25:57 * DB loaded from disk: 0 seconds
[4414] 12 Apr 23:25:57 * The server is now ready to accept connections on port 6379
[4414] 13 Apr 01:19:26 * Slave ask for synchronization
[4414] 13 Apr 01:19:26 * Starting BGSAVE for SYNC
[4414] 13 Apr 01:19:26 * Background saving started by pid 4859
[4859] 13 Apr 01:19:26 * DB saved on disk
[4414] 13 Apr 01:19:26 * Background saving terminated with success
[4414] 13 Apr 01:19:26 * Synchronization with slave succeeded
[4414] 13 Apr 02:01:41 # User requested shutdown...
[4414] 13 Apr 02:01:41 * Saving the final RDB snapshot before exiting.
[4414] 13 Apr 02:01:41 * DB saved on disk
[4414] 13 Apr 02:01:41 * Removing the pid file.
[4414] 13 Apr 02:01:41 # Redis is now ready to exit, bye bye...
[5141] 13 Apr 02:10:07 * Server started, Redis version 2.4.10
[5141] 13 Apr 02:10:07 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
[5141] 13 Apr 02:11:00 * DB loaded from disk: 53 seconds
[5141] 13 Apr 02:11:00 * The server is now ready to accept connections on port 6379
[5141] 13 Apr 02:11:18 * Slave ask for synchronization
[5141] 13 Apr 02:11:18 * Starting BGSAVE for SYNC
[5141] 13 Apr 02:11:19 * Background saving started by pid 5150
[5150] 13 Apr 02:11:58 * DB saved on disk
[5141] 13 Apr 02:11:58 * Background saving terminated with success
[5141] 13 Apr 02:12:20 * Synchronization with slave succeeded
[5141] 13 Apr 03:11:59 * 10000 changes in 3600 seconds. Saving...
[5141] 13 Apr 03:11:59 * Background saving started by pid 5353
[5353] 13 Apr 03:12:38 * DB saved on disk
[5141] 13 Apr 03:12:39 * Background saving terminated with success
[5141] 13 Apr 04:12:40 * 10000 changes in 3600 seconds. Saving...
[5141] 13 Apr 04:12:40 * Background saving started by pid 6117
[6117] 13 Apr 04:13:19 * DB saved on disk
[5141] 13 Apr 04:13:20 * Background saving terminated with success
[5141] 13 Apr 05:13:21 * 10000 changes in 3600 seconds. Saving...
[5141] 13 Apr 05:13:21 * Background saving started by pid 6310
[6310] 13 Apr 05:14:07 * DB saved on disk
[5141] 13 Apr 05:14:07 * Background saving terminated with success
[5141] 13 Apr 06:14:08 * 10000 changes in 3600 seconds. Saving...
[5141] 13 Apr 06:14:08 * Background saving started by pid 6510
[6510] 13 Apr 06:14:49 * DB saved on disk
[5141] 13 Apr 06:14:50 * Background saving terminated with success
[5141] 13 Apr 07:14:51 * 10000 changes in 3600 seconds. Saving...
[5141] 13 Apr 07:14:51 * Background saving started by pid 7057
[7057] 13 Apr 07:15:32 * DB saved on disk
[5141] 13 Apr 07:15:33 * Background saving terminated with success
[5141] 13 Apr 08:15:34 * 10000 changes in 3600 seconds. Saving...
[5141] 13 Apr 08:15:34 * Background saving started by pid 7641
[7641] 13 Apr 08:16:16 * DB saved on disk
[5141] 13 Apr 08:16:16 * Background saving terminated with success
[5141] 13 Apr 09:15:36 # === REDIS BUG REPORT START: Cut & paste starting from here ===
[5141] 13 Apr 09:15:36 # Redis 2.4.10 crashed by signal: 11
[5141] 13 Apr 09:15:36 # Failed assertion: (:0)
[5141] 13 Apr 09:15:36 # --- STACK TRACE
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server [0x4375b8]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server [0x4375b8]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(_addReplyObjectToList+0x75) [0x4183e5]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(addReplyBulk+0x24) [0x418734]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(replicationFeedSlaves+0xba) [0x41c46a]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(propagateExpire+0x54) [0x41a604]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(expireIfNeeded+0x85) [0x41acb5]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(lookupKeyRead+0x19) [0x41b3c9]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(lookupKeyByPattern+0x1f4) [0x430704]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(sortCommand+0x795) [0x430f55]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(call+0x34) [0x40f4f4]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(processCommand+0x210) [0x40f7e0]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(processInputBuffer+0x49) [0x418219]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(readQueryFromClient+0x10f) [0x418aff]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(aeProcessEvents+0x173) [0x40c223]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(aeMain+0x2e) [0x40c43e]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server(main+0x13f) [0x41140f]
[5141] 13 Apr 09:15:36 # /lib64/libc.so.6(__libc_start_main+0xf4) [0x2ad5ac94c994]
[5141] 13 Apr 09:15:36 # /data1/app/services/redis/bin/redis-server [0x40b7f9]
[5141] 13 Apr 09:15:36 # --- INFO OUTPUT
[5141] 13 Apr 09:15:36 # redis_version:2.4.10
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:5141
uptime_in_seconds:25529
uptime_in_days:0
lru_clock:1311717
used_cpu_sys:215.90
used_cpu_user:114.45
used_cpu_sys_children:43.33
used_cpu_user_children:229.32
connected_clients:1071
connected_slaves:1
client_longest_output_list:2
client_biggest_input_buf:0
blocked_clients:0
used_memory:5421127528
used_memory_human:5.05G
used_memory_rss:5540106240
used_memory_peak:5432230072
used_memory_peak_human:5.06G
mem_fragmentation_ratio:1.02
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:9351234
bgsave_in_progress:0
last_save_time:1334319376
bgrewriteaof_in_progress:0
total_connections_received:143897
total_commands_processed:91608486
expired_keys:63153
evicted_keys:0
keyspace_hits:35868623
keyspace_misses:1350411
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:900529
vm_enabled:0
role:master
slave0:10.160.107.76,41096,online
db0:keys=20224166,expires=20224114

[5141] 13 Apr 09:15:36 # --- CLIENT LIST OUTPUT
[5141] 13 Apr 09:15:36 # addr=10.160.107.76:41096 fd=5 idle=0 flags=S db=0 sub=0 psub=0 qbuf=0 obl=7480 oll=1 events=rw cmd=sync
addr=10.176.202.139:11838 fd=571 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:27951 fd=8 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:30113 fd=7 idle=8 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:30664 fd=21 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:31902 fd=29 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:38978 fd=50 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:46409 fd=53 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:46792 fd=27 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:39639 fd=64 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:47055 fd=68 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:39889 fd=70 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:40062 fd=83 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:48295 fd=97 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:48346 fd=112 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:41141 fd=119 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:48365 fd=120 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:41234 fd=122 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:41471 fd=123 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:48956 fd=126 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:42054 fd=172 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.177.21.27:49523 fd=185 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:49579 fd=188 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:49733 fd=137 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:49744 fd=194 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:42490 fd=198 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:49799 fd=202 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:42592 fd=204 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:49985 fd=205 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:50048 fd=207 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:48688 fd=88 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:50373 fd=229 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:43188 fd=38 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:5061 fd=256 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.215.197:48966 fd=259 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:50590 fd=263 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:49260 fd=147 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:43595 fd=266 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.215.197:49390 fd=272 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:50949 fd=279 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 o
[5141] 13 Apr 09:15:36 # --- CURRENT CLIENT INFO
[5141] 13 Apr 09:15:36 # client: addr=10.177.21.27:55703 fd=307 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=7477 oll=2 events=rw cmd=sort
[5141] 13 Apr 09:15:36 # argv[0]: 'SORT'
[5141] 13 Apr 09:15:36 # argv[1]: 'J7T:userfriends:S:uId:100000304513403'
[5141] 13 Apr 09:15:36 # argv[2]: 'asc'
[5141] 13 Apr 09:15:36 # argv[3]: 'GET'
[5141] 13 Apr 09:15:36 # argv[4]: 'J7T:userfriends:K:*'
[5141] 13 Apr 09:15:36 # key 'J7T:userfriends:S:uId:100000304513403' found in DB containing the following object:
[5141] 13 Apr 09:15:36 # Object type: 2
[5141] 13 Apr 09:15:36 # Object encoding: 2
[5141] 13 Apr 09:15:36 # Object refcount: 2
[5141] 13 Apr 09:15:36 # Set size: 237
[5141] 13 Apr 09:15:36 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report the crash opening an issue on github:

       http://github.com/antirez/redis/issues

Suspect RAM error? Use redis-server --test-memory to veryfy it.

[8540] 13 Apr 09:57:13 * Server started, Redis version 2.4.10
[8540] 13 Apr 09:58:11 * DB loaded from disk: 58 seconds
[8540] 13 Apr 09:58:11 * The server is now ready to accept connections on port 6379
[8540] 13 Apr 09:58:11 * Slave ask for synchronization
[8540] 13 Apr 09:58:11 * Starting BGSAVE for SYNC
[8540] 13 Apr 09:58:13 * Background saving started by pid 8553
[8553] 13 Apr 09:58:58 * DB saved on disk
[8540] 13 Apr 09:58:58 * Background saving terminated with success
[8540] 13 Apr 09:59:18 * Synchronization with slave succeeded
[8540] 13 Apr 10:00:09 # === REDIS BUG REPORT START: Cut & paste starting from here ===
[8540] 13 Apr 10:00:09 # Redis 2.4.10 crashed by signal: 11
[8540] 13 Apr 10:00:09 # Failed assertion: (:0)
[8540] 13 Apr 10:00:09 # --- STACK TRACE
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server [0x4375b8]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server [0x4375b8]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(_addReplyObjectToList+0x75) [0x4183e5]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(addReplyBulk+0x24) [0x418734]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(replicationFeedSlaves+0xba) [0x41c46a]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(propagateExpire+0x54) [0x41a604]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(expireIfNeeded+0x85) [0x41acb5]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(lookupKeyRead+0x19) [0x41b3c9]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(lookupKeyByPattern+0x1f4) [0x430704]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(sortCommand+0x795) [0x430f55]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(call+0x34) [0x40f4f4]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(processCommand+0x210) [0x40f7e0]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(processInputBuffer+0x49) [0x418219]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(readQueryFromClient+0x10f) [0x418aff]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(aeProcessEvents+0x173) [0x40c223]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(aeMain+0x2e) [0x40c43e]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server(main+0x13f) [0x41140f]
[8540] 13 Apr 10:00:09 # /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b4a80a42994]
[8540] 13 Apr 10:00:09 # /data1/app/services/redis/bin/redis-server [0x40b7f9]
[8540] 13 Apr 10:00:09 # --- INFO OUTPUT
[8540] 13 Apr 10:00:09 # redis_version:2.4.10
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:8540
uptime_in_seconds:176
uptime_in_days:0
lru_clock:1311984
used_cpu_sys:16.11
used_cpu_user:45.89
used_cpu_sys_children:9.29
used_cpu_user_children:34.32
connected_clients:963
connected_slaves:1
client_longest_output_list:4733
client_biggest_input_buf:0
blocked_clients:0
used_memory:5132906720
used_memory_human:4.78G
used_memory_rss:5154603008
used_memory_peak:5258456952
used_memory_peak_human:4.90G
mem_fragmentation_ratio:1.00
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:230475
bgsave_in_progress:0
last_save_time:1334325538
bgrewriteaof_in_progress:0
total_connections_received:6907
total_commands_processed:375464
expired_keys:19
evicted_keys:0
keyspace_hits:175169
keyspace_misses:5703
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:1210404
vm_enabled:0
role:master
slave0:10.160.107.76,26890,online
db0:keys=19783853,expires=19783799

[8540] 13 Apr 10:00:09 # --- CLIENT LIST OUTPUT
[8540] 13 Apr 10:00:09 # addr=10.166.241.118:44318 fd=6 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:18870 fd=7 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:62385 fd=8 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:28700 fd=9 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24913 fd=10 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:44319 fd=11 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:28701 fd=12 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:18871 fd=14 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:62388 fd=13 idle=8 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.177.21.27:24915 fd=15 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:28704 fd=16 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62390 fd=18 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24918 fd=19 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=expire
addr=10.176.215.197:18872 fd=20 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24920 fd=17 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:62392 fd=21 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:44322 fd=22 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:18874 fd=23 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62394 fd=24 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:18876 fd=25 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24924 fd=28 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24925 fd=26 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:44325 fd=27 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62396 fd=30 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24928 fd=29 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:62397 fd=31 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24930 fd=32 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.166.41.203:28708 fd=33 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:44327 fd=34 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24932 fd=35 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:28709 fd=37 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62400 fd=36 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:24934 fd=38 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:28710 fd=39 idle=9 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62401 fd=40 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.177.21.27:24936 fd=42 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:18878 fd=43 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:28713 fd=41 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62403 fd=44 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.215.197:18879 fd=45 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r c
[8540] 13 Apr 10:00:09 # --- CURRENT CLIENT INFO
[8540] 13 Apr 10:00:09 # client: addr=10.177.21.27:25050 fd=365 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=285 oll=0 events=rw cmd=sort
[8540] 13 Apr 10:00:09 # argv[0]: 'SORT'
[8540] 13 Apr 10:00:09 # argv[1]: 'J7T:userfriends:S:uId:100000512225489'
[8540] 13 Apr 10:00:09 # argv[2]: 'asc'
[8540] 13 Apr 10:00:09 # argv[3]: 'GET'
[8540] 13 Apr 10:00:09 # argv[4]: 'J7T:userfriends:K:*'
[8540] 13 Apr 10:00:09 # key 'J7T:userfriends:S:uId:100000512225489' found in DB containing the following object:
[8540] 13 Apr 10:00:09 # Object type: 2
[8540] 13 Apr 10:00:09 # Object encoding: 2
[8540] 13 Apr 10:00:09 # Object refcount: 2
[8540] 13 Apr 10:00:09 # Set size: 59
[8540] 13 Apr 10:00:09 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report the crash opening an issue on github:

       http://github.com/antirez/redis/issues

Suspect RAM error? Use redis-server --test-memory to veryfy it.

[10197] 13 Apr 10:11:39 * Server started, Redis version 2.4.9
[10197] 13 Apr 10:12:31 * DB loaded from disk: 52 seconds
[10197] 13 Apr 10:12:31 * The server is now ready to accept connections on port 6379
[10197] 13 Apr 10:12:32 * Slave ask for synchronization
[10197] 13 Apr 10:12:32 * Starting BGSAVE for SYNC
[10197] 13 Apr 10:12:33 * Background saving started by pid 10209
[10209] 13 Apr 10:13:14 * DB saved on disk
[10197] 13 Apr 10:13:15 * Background saving terminated with success
[10197] 13 Apr 10:13:34 * Synchronization with slave succeeded
[10197] 13 Apr 11:13:16 * 10000 changes in 3600 seconds. Saving...
[10197] 13 Apr 11:13:17 * Background saving started by pid 12234
[12234] 13 Apr 11:14:05 * DB saved on disk
[10197] 13 Apr 11:14:05 * Background saving terminated with success
[10197] 13 Apr 12:14:06 * 10000 changes in 3600 seconds. Saving...
[10197] 13 Apr 12:14:07 * Background saving started by pid 12718
[12718] 13 Apr 12:14:46 * DB saved on disk
[10197] 13 Apr 12:14:47 * Background saving terminated with success
[10197] 13 Apr 13:14:48 * 10000 changes in 3600 seconds. Saving...
[10197] 13 Apr 13:14:49 * Background saving started by pid 13190
[13190] 13 Apr 13:15:35 * DB saved on disk
[10197] 13 Apr 13:15:35 * Background saving terminated with success
[10197] 13 Apr 14:15:36 * 10000 changes in 3600 seconds. Saving...
[10197] 13 Apr 14:15:37 * Background saving started by pid 13662
[13662] 13 Apr 14:16:18 * DB saved on disk
[10197] 13 Apr 14:16:20 * Background saving terminated with success
[10197] 13 Apr 15:16:21 * 10000 changes in 3600 seconds. Saving...
[10197] 13 Apr 15:16:22 * Background saving started by pid 14134
[14134] 13 Apr 15:17:12 * DB saved on disk
[10197] 13 Apr 15:17:12 * Background saving terminated with success
[10197] 13 Apr 16:17:13 * 10000 changes in 3600 seconds. Saving...
[10197] 13 Apr 16:17:13 * Background saving started by pid 14602
[14602] 13 Apr 16:17:57 * DB saved on disk
[10197] 13 Apr 16:17:57 * Background saving terminated with success
[10197] 13 Apr 16:27:58 # === REDIS BUG REPORT START: Cut & paste starting from here ===
[10197] 13 Apr 16:27:58 # Redis 2.4.9 crashed by signal: 11
[10197] 13 Apr 16:27:58 # Failed assertion: (:0)
[10197] 13 Apr 16:27:58 # --- STACK TRACE
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server [0x437538]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server [0x437538]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(_addReplyObjectToList+0x75) [0x418405]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(addReplyBulk+0x24) [0x418754]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(replicationFeedSlaves+0xc2) [0x41c492]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(propagateExpire+0x54) [0x41a624]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(expireIfNeeded+0x85) [0x41acd5]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(lookupKeyRead+0x19) [0x41b3e9]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(lookupKeyByPattern+0x1f4) [0x430774]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(sortCommand+0x795) [0x430fc5]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(call+0x34) [0x40f494]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(processCommand+0x210) [0x40f780]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(processInputBuffer+0x49) [0x418239]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(readQueryFromClient+0x10f) [0x418b1f]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(aeProcessEvents+0x173) [0x40c1c3]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(aeMain+0x2e) [0x40c3de]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server(main+0x13f) [0x41145f]
[10197] 13 Apr 16:27:58 # /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b53c3fc4994]
[10197] 13 Apr 16:27:58 # /data1/app/services/redis/bin/redis-server [0x40b799]
[10197] 13 Apr 16:27:58 # --- INFO OUTPUT
[10197] 13 Apr 16:27:58 # redis_version:2.4.9
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:10197
uptime_in_seconds:22579
uptime_in_days:0
lru_clock:1314311
used_cpu_sys:241.18
used_cpu_user:125.84
used_cpu_sys_children:47.36
used_cpu_user_children:249.35
connected_clients:963
connected_slaves:1
client_longest_output_list:1
client_biggest_input_buf:0
blocked_clients:0
used_memory:5511255032
used_memory_human:5.13G
used_memory_rss:5629345792
used_memory_peak:5512047256
used_memory_peak_human:5.13G
mem_fragmentation_ratio:1.02
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:917680
bgsave_in_progress:0
last_save_time:1334348277
bgrewriteaof_in_progress:0
total_connections_received:386148
total_commands_processed:86762818
expired_keys:46543
evicted_keys:0
keyspace_hits:35746835
keyspace_misses:1215500
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:960135
vm_enabled:0
role:master
slave0:10.160.107.76,58110,online
db0:keys=21033461,expires=21033407

[10197] 13 Apr 16:27:58 # --- CLIENT LIST OUTPUT
[10197] 13 Apr 16:27:58 # addr=10.160.107.76:58110 fd=5 idle=0 flags=S db=0 sub=0 psub=0 qbuf=0 obl=7453 oll=1 events=rw cmd=sync
addr=10.176.215.197:22784 fd=91 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:31211 fd=643 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:32141 fd=478 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:53063 fd=373 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:59993 fd=414 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:36040 fd=694 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35883 fd=770 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:54347 fd=444 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:36322 fd=813 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:36733 fd=846 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:55109 fd=19 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:56025 fd=83 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:11556 fd=293 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:12095 fd=741 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:40766 fd=640 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:25618 fd=637 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:38635 fd=768 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:42525 fd=631 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:12299 fd=96 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:55471 fd=874 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:56766 fd=903 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:57400 fd=581 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:57918 fd=809 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:58022 fd=114 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:15895 fd=862 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:59053 fd=203 idle=6 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:31317 fd=742 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:53016 fd=389 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:59739 fd=880 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:18071 fd=501 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:32540 fd=905 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:18848 fd=246 idle=6 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:61445 fd=86 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:34011 fd=490 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:61653 fd=330 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=expire
addr=10.176.202.139:62052 fd=503 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:62702 fd=793 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:35592 fd=765 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:56712 fd=466 idle=0 flags=N db=0 su
[10197] 13 Apr 16:27:58 # --- CURRENT CLIENT INFO
[10197] 13 Apr 16:27:58 # client: addr=10.177.21.27:19585 fd=899 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=6669 oll=0 events=rw cmd=sort
[10197] 13 Apr 16:27:58 # argv[0]: 'SORT'
[10197] 13 Apr 16:27:58 # argv[1]: 'J7T:userfriends:S:uId:100003185572280'
[10197] 13 Apr 16:27:58 # argv[2]: 'asc'
[10197] 13 Apr 16:27:58 # argv[3]: 'GET'
[10197] 13 Apr 16:27:58 # argv[4]: 'J7T:userfriends:K:*'
[10197] 13 Apr 16:27:58 # key 'J7T:userfriends:S:uId:100003185572280' found in DB containing the following object:
[10197] 13 Apr 16:27:58 # Object type: 2
[10197] 13 Apr 16:27:58 # Object encoding: 2
[10197] 13 Apr 16:27:58 # Object refcount: 2
[10197] 13 Apr 16:27:58 # Set size: 180
[10197] 13 Apr 16:27:58 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report the crash opening an issue on github:

       http://github.com/antirez/redis/issues

Suspect RAM error? Use redis-server --test-memory to veryfy it.

[14887] 13 Apr 16:45:45 * Server started, Redis version 2.4.9
[14887] 13 Apr 16:46:49 * DB loaded from disk: 64 seconds
[14887] 13 Apr 16:46:49 * The server is now ready to accept connections on port 6379
[14887] 13 Apr 16:46:49 * Slave ask for synchronization
[14887] 13 Apr 16:46:49 * Starting BGSAVE for SYNC
[14887] 13 Apr 16:46:51 * Background saving started by pid 14898
[14887] 13 Apr 16:46:54 # === REDIS BUG REPORT START: Cut & paste starting from here ===
[14887] 13 Apr 16:46:54 # Redis 2.4.9 crashed by signal: 11
[14887] 13 Apr 16:46:54 # Failed assertion: (:0)
[14887] 13 Apr 16:46:54 # --- STACK TRACE
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server [0x437538]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server [0x437538]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(_addReplyObjectToList+0x75) [0x418405]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(addReplyBulk+0x24) [0x418754]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(replicationFeedSlaves+0xc2) [0x41c492]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(propagateExpire+0x54) [0x41a624]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(expireIfNeeded+0x85) [0x41acd5]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(lookupKeyRead+0x19) [0x41b3e9]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(lookupKeyByPattern+0x1f4) [0x430774]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(sortCommand+0x795) [0x430fc5]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(call+0x34) [0x40f494]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(processCommand+0x210) [0x40f780]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(processInputBuffer+0x49) [0x418239]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(readQueryFromClient+0x10f) [0x418b1f]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(aeProcessEvents+0x173) [0x40c1c3]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(aeMain+0x2e) [0x40c3de]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server(main+0x13f) [0x41145f]
[14887] 13 Apr 16:46:54 # /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b6f0b93b994]
[14887] 13 Apr 16:46:54 # /data1/app/services/redis/bin/redis-server [0x40b799]
[14887] 13 Apr 16:46:54 # --- INFO OUTPUT
[14887] 13 Apr 16:46:54 # redis_version:2.4.9
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:14887
uptime_in_seconds:69
uptime_in_days:0
lru_clock:1314425
used_cpu_sys:17.30
used_cpu_user:46.89
used_cpu_sys_children:0.00
used_cpu_user_children:0.00
connected_clients:963
connected_slaves:1
client_longest_output_list:113
client_biggest_input_buf:0
blocked_clients:0
used_memory:5493927520
used_memory_human:5.12G
used_memory_rss:5439815680
used_memory_peak:5493869848
used_memory_peak_human:5.12G
mem_fragmentation_ratio:0.99
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:3365
bgsave_in_progress:1
last_save_time:1334349945
bgrewriteaof_in_progress:0
total_connections_received:2897
total_commands_processed:5969
expired_keys:1
evicted_keys:0
keyspace_hits:5690
keyspace_misses:275
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:1371079
vm_enabled:0
role:master
slave0:10.160.107.76,29755,wait_bgsave
db0:keys=20898389,expires=20898332

[14887] 13 Apr 16:46:54 # --- CLIENT LIST OUTPUT
[14887] 13 Apr 16:46:54 # addr=10.177.21.27:57687 fd=6 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46917 fd=7 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62568 fd=8 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57688 fd=9 idle=7 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46918 fd=10 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:53717 fd=11 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62569 fd=12 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46919 fd=14 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62570 fd=15 idle=10 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57692 fd=13 idle=11 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57693 fd=16 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46921 fd=17 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:34513 fd=18 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62572 fd=19 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57696 fd=20 idle=6 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57697 fd=21 idle=7 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46923 fd=22 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:53719 fd=23 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.166.241.118:62574 fd=24 idle=10 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46925 fd=25 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:53721 fd=26 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.177.21.27:57700 fd=27 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62575 fd=28 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:34515 fd=29 idle=14 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.177.21.27:57701 fd=30 idle=7 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46926 fd=31 idle=16 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46927 fd=32 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57702 fd=33 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62577 fd=34 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46930 fd=36 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:34517 fd=37 idle=25 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:53723 fd=38 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46931 fd=35 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46932 fd=39 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57706 fd=40 idle=7 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57707 fd=41 idle=11 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62580 fd=42 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:53725 fd=43 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:46934 fd=44 idle=21 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:57710 fd=45 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=
[14887] 13 Apr 16:46:54 # --- CURRENT CLIENT INFO
[14887] 13 Apr 16:46:54 # client: addr=10.166.241.118:62599 fd=97 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=7392 oll=1 events=rw cmd=sort
[14887] 13 Apr 16:46:54 # argv[0]: 'SORT'
[14887] 13 Apr 16:46:54 # argv[1]: 'J7T:userfriends:S:uId:100000334656089'
[14887] 13 Apr 16:46:54 # argv[2]: 'asc'
[14887] 13 Apr 16:46:54 # argv[3]: 'GET'
[14887] 13 Apr 16:46:54 # argv[4]: 'J7T:userfriends:K:*'
[14887] 13 Apr 16:46:54 # key 'J7T:userfriends:S:uId:100000334656089' found in DB containing the following object:
[14887] 13 Apr 16:46:54 # Object type: 2
[14887] 13 Apr 16:46:54 # Object encoding: 2
[14887] 13 Apr 16:46:54 # Object refcount: 2
[14887] 13 Apr 16:46:54 # Set size: 268
[14887] 13 Apr 16:46:54 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report the crash opening an issue on github:

       http://github.com/antirez/redis/issues

Suspect RAM error? Use redis-server --test-memory to veryfy it.

[14898] 13 Apr 16:47:36 * DB saved on disk
[14926] 13 Apr 16:49:17 * Server started, Redis version 2.4.9
[14926] 13 Apr 16:50:15 * DB loaded from disk: 58 seconds
[14926] 13 Apr 16:50:15 * The server is now ready to accept connections on port 6379
[14926] 13 Apr 16:50:15 * Slave ask for synchronization
[14926] 13 Apr 16:50:15 * Starting BGSAVE for SYNC
[14926] 13 Apr 16:50:17 * Background saving started by pid 14950
[14950] 13 Apr 16:51:02 * DB saved on disk
[14926] 13 Apr 16:51:03 * Background saving terminated with success
[14926] 13 Apr 16:51:24 * Synchronization with slave succeeded
[14926] 13 Apr 16:52:45 # === REDIS BUG REPORT START: Cut & paste starting from here ===
[14926] 13 Apr 16:52:45 # Redis 2.4.9 crashed by signal: 11
[14926] 13 Apr 16:52:45 # Failed assertion: (:0)
[14926] 13 Apr 16:52:45 # --- STACK TRACE
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server [0x437538]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server [0x437538]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(_addReplyObjectToList+0x75) [0x418405]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(addReplyBulk+0x24) [0x418754]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(replicationFeedSlaves+0xc2) [0x41c492]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(propagateExpire+0x54) [0x41a624]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(expireIfNeeded+0x85) [0x41acd5]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(lookupKeyRead+0x19) [0x41b3e9]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(lookupKeyByPattern+0x1f4) [0x430774]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(sortCommand+0x795) [0x430fc5]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(call+0x34) [0x40f494]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(processCommand+0x210) [0x40f780]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(processInputBuffer+0x49) [0x418239]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(readQueryFromClient+0x10f) [0x418b1f]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(aeProcessEvents+0x173) [0x40c1c3]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(aeMain+0x2e) [0x40c3de]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server(main+0x13f) [0x41145f]
[14926] 13 Apr 16:52:45 # /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b8d2cfa9994]
[14926] 13 Apr 16:52:45 # /data1/app/services/redis/bin/redis-server [0x40b799]
[14926] 13 Apr 16:52:45 # --- INFO OUTPUT
[14926] 13 Apr 16:52:45 # redis_version:2.4.9
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:14926
uptime_in_seconds:208
uptime_in_days:0
lru_clock:1314460
used_cpu_sys:16.52
used_cpu_user:44.82
used_cpu_sys_children:7.76
used_cpu_user_children:36.44
connected_clients:1000
connected_slaves:1
client_longest_output_list:4472
client_biggest_input_buf:0
blocked_clients:0
used_memory:5421997256
used_memory_human:5.05G
used_memory_rss:5451579392
used_memory_peak:5522417312
used_memory_peak_human:5.14G
mem_fragmentation_ratio:1.01
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:181662
bgsave_in_progress:0
last_save_time:1334350263
bgrewriteaof_in_progress:0
total_connections_received:5476
total_commands_processed:316818
expired_keys:12
evicted_keys:0
keyspace_hits:144012
keyspace_misses:4481
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:1404505
vm_enabled:0
role:master
slave0:10.160.107.76,29913,online
db0:keys=20897204,expires=20897150

[14926] 13 Apr 16:52:45 # --- CLIENT LIST OUTPUT
[14926] 13 Apr 16:52:45 # addr=10.176.215.197:35476 fd=6 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:9990 fd=7 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47892 fd=8 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62167 fd=9 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35477 fd=10 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62168 fd=11 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:9992 fd=13 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47895 fd=12 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:9993 fd=14 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62171 fd=15 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35479 fd=16 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.177.21.27:46446 fd=17 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=expire
addr=10.176.215.197:35480 fd=18 idle=13 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:9995 fd=19 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.176.202.139:47897 fd=20 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62173 fd=21 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:9997 fd=22 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35481 fd=23 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47899 fd=24 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62175 fd=26 idle=5 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35483 fd=27 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:9999 fd=28 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:10000 fd=25 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47900 fd=29 idle=8 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:46449 fd=30 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35484 fd=31 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62176 fd=32 idle=4 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62177 fd=33 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:10001 fd=34 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47901 fd=35 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:46451 fd=36 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.215.197:35485 fd=37 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47902 fd=38 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.166.241.118:62180 fd=40 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:10005 fd=39 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.241.118:62181 fd=41 idle=1 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.176.202.139:47904 fd=42 idle=2 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.166.41.203:10007 fd=43 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=lpush
addr=10.177.21.27:46452 fd=44 idle=3 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd=discard
addr=10.166.241.118:62183 fd=45 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=0 oll=0 events=r cmd
[14926] 13 Apr 16:52:45 # --- CURRENT CLIENT INFO
[14926] 13 Apr 16:52:45 # client: addr=10.166.241.118:62417 fd=639 idle=0 flags=N db=0 sub=0 psub=0 qbuf=0 obl=2770 oll=0 events=rw cmd=sort
[14926] 13 Apr 16:52:45 # argv[0]: 'SORT'
[14926] 13 Apr 16:52:45 # argv[1]: 'J7T:userfriends:S:uId:100003011673731'
[14926] 13 Apr 16:52:45 # argv[2]: 'asc'
[14926] 13 Apr 16:52:45 # argv[3]: 'GET'
[14926] 13 Apr 16:52:45 # argv[4]: 'J7T:userfriends:K:*'
[14926] 13 Apr 16:52:45 # key 'J7T:userfriends:S:uId:100003011673731' found in DB containing the following object:
[14926] 13 Apr 16:52:45 # Object type: 2
[14926] 13 Apr 16:52:45 # Object encoding: 2
[14926] 13 Apr 16:52:45 # Object refcount: 2
[14926] 13 Apr 16:52:45 # Set size: 39
[14926] 13 Apr 16:52:45 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report the crash opening an issue on github:

       http://github.com/antirez/redis/issues

Suspect RAM error? Use redis-server --test-memory to veryfy it.

[15026] 13 Apr 16:55:58 * Server started, Redis version 2.4.6
[15026] 13 Apr 16:56:56 * DB loaded from disk: 58 seconds
[15026] 13 Apr 16:56:56 * The server is now ready to accept connections on port 6379
[15026] 13 Apr 16:56:57 * Slave ask for synchronization
[15026] 13 Apr 16:56:57 * Starting BGSAVE for SYNC
[15026] 13 Apr 16:56:58 * Background saving started by pid 15043
[15043] 13 Apr 16:57:41 * DB saved on disk
[15026] 13 Apr 16:57:41 * Background saving terminated with success
[15026] 13 Apr 16:58:02 * Synchronization with slave succeeded
[15026] 13 Apr 17:57:42 * 10000 changes in 3600 seconds. Saving...
[15026] 13 Apr 17:57:42 * Background saving started by pid 25363
[25363] 13 Apr 17:58:32 * DB saved on disk
[15026] 13 Apr 17:58:32 * Background saving terminated with success
[15026] 13 Apr 18:58:33 * 10000 changes in 3600 seconds. Saving...
[15026] 13 Apr 18:58:34 * Background saving started by pid 4379
[4379] 13 Apr 18:59:17 * DB saved on disk
[15026] 13 Apr 18:59:17 * Background saving terminated with success
[15026] 13 Apr 19:59:18 * 10000 changes in 3600 seconds. Saving...
[15026] 13 Apr 19:59:18 * Background saving started by pid 15757
[15757] 13 Apr 20:00:01 * DB saved on disk
[15026] 13 Apr 20:00:02 * Background saving terminated with success
[15026] 13 Apr 21:00:03 * 10000 changes in 3600 seconds. Saving...
[15026] 13 Apr 21:00:03 * Background saving started by pid 27108
[27108] 13 Apr 21:00:49 * DB saved on disk
[15026] 13 Apr 21:00:49 * Background saving terminated with success
[15026] 13 Apr 22:00:50 * 10000 changes in 3600 seconds. Saving...
[15026] 13 Apr 22:00:50 * Background saving started by pid 6055
[6055] 13 Apr 22:01:41 * DB saved on disk
[15026] 13 Apr 22:01:42 * Background saving terminated with success
[15026] 13 Apr 23:01:43 * 10000 changes in 3600 seconds. Saving...
[15026] 13 Apr 23:01:44 * Background saving started by pid 17439
[17439] 13 Apr 23:02:37 * DB saved on disk
[15026] 13 Apr 23:02:38 * Background saving terminated with success
[15026] 14 Apr 00:02:39 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 00:02:40 * Background saving started by pid 28837
[28837] 14 Apr 00:03:27 * DB saved on disk
[15026] 14 Apr 00:03:27 * Background saving terminated with success
[15026] 14 Apr 01:03:28 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 01:03:29 * Background saving started by pid 7745
[7745] 14 Apr 01:04:16 * DB saved on disk
[15026] 14 Apr 01:04:17 * Background saving terminated with success
[15026] 14 Apr 02:04:18 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 02:04:19 * Background saving started by pid 19105
[19105] 14 Apr 02:05:15 * DB saved on disk
[15026] 14 Apr 02:05:16 * Background saving terminated with success
[15026] 14 Apr 03:05:17 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 03:05:18 * Background saving started by pid 30476
[30476] 14 Apr 03:06:05 * DB saved on disk
[15026] 14 Apr 03:06:06 * Background saving terminated with success
[15026] 14 Apr 04:06:07 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 04:06:08 * Background saving started by pid 9944
[9944] 14 Apr 04:06:57 * DB saved on disk
[15026] 14 Apr 04:06:58 * Background saving terminated with success
[15026] 14 Apr 05:06:59 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 05:07:00 * Background saving started by pid 21307
[21307] 14 Apr 05:07:51 * DB saved on disk
[15026] 14 Apr 05:07:52 * Background saving terminated with success
[15026] 14 Apr 06:07:53 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 06:07:54 * Background saving started by pid 32682
[32682] 14 Apr 06:08:47 * DB saved on disk
[15026] 14 Apr 06:08:48 * Background saving terminated with success
[15026] 14 Apr 07:08:49 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 07:08:50 * Background saving started by pid 11668
[11668] 14 Apr 07:09:42 * DB saved on disk
[15026] 14 Apr 07:09:43 * Background saving terminated with success
[15026] 14 Apr 08:09:44 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 08:09:45 * Background saving started by pid 23040
[23040] 14 Apr 08:10:40 * DB saved on disk
[15026] 14 Apr 08:10:41 * Background saving terminated with success
[15026] 14 Apr 09:10:42 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 09:10:43 * Background saving started by pid 1973
[1973] 14 Apr 09:11:41 * DB saved on disk
[15026] 14 Apr 09:11:42 * Background saving terminated with success
[15026] 14 Apr 10:11:43 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 10:11:44 * Background saving started by pid 13375
[13375] 14 Apr 10:12:39 * DB saved on disk
[15026] 14 Apr 10:12:40 * Background saving terminated with success
[15026] 14 Apr 11:12:41 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 11:12:42 * Background saving started by pid 24752
[24752] 14 Apr 11:13:39 * DB saved on disk
[15026] 14 Apr 11:13:41 * Background saving terminated with success
[15026] 14 Apr 12:13:42 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 12:13:43 * Background saving started by pid 3688
[3688] 14 Apr 12:14:40 * DB saved on disk
[15026] 14 Apr 12:14:41 * Background saving terminated with success
[15026] 14 Apr 13:14:42 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 13:14:43 * Background saving started by pid 15084
[15084] 14 Apr 13:15:43 * DB saved on disk
[15026] 14 Apr 13:15:43 * Background saving terminated with success
[15026] 14 Apr 14:15:44 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 14:15:45 * Background saving started by pid 26479
[26479] 14 Apr 14:16:41 * DB saved on disk
[15026] 14 Apr 14:16:42 * Background saving terminated with success
[15026] 14 Apr 15:16:43 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 15:16:44 * Background saving started by pid 10492
[10492] 14 Apr 15:17:44 * DB saved on disk
[15026] 14 Apr 15:17:45 * Background saving terminated with success
[15026] 14 Apr 16:17:46 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 16:17:47 * Background saving started by pid 31457
[31457] 14 Apr 16:18:47 * DB saved on disk
[15026] 14 Apr 16:18:48 * Background saving terminated with success
[15026] 14 Apr 17:18:49 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 17:18:50 * Background saving started by pid 12179
[12179] 14 Apr 17:19:55 * DB saved on disk
[15026] 14 Apr 17:19:56 * Background saving terminated with success
[15026] 14 Apr 18:19:57 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 18:19:58 * Background saving started by pid 23619
[23619] 14 Apr 18:20:59 * DB saved on disk
[15026] 14 Apr 18:21:00 * Background saving terminated with success
[15026] 14 Apr 19:21:01 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 19:21:02 * Background saving started by pid 2579
[2579] 14 Apr 19:22:05 * DB saved on disk
[15026] 14 Apr 19:22:05 * Background saving terminated with success
[15026] 14 Apr 20:22:06 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 20:22:07 * Background saving started by pid 13986
[13986] 14 Apr 20:23:06 * DB saved on disk
[15026] 14 Apr 20:23:07 * Background saving terminated with success
[15026] 14 Apr 21:23:08 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 21:23:09 * Background saving started by pid 25375
[25375] 14 Apr 21:24:08 * DB saved on disk
[15026] 14 Apr 21:24:08 * Background saving terminated with success
[15026] 14 Apr 22:24:09 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 22:24:10 * Background saving started by pid 4318
[4318] 14 Apr 22:25:19 * DB saved on disk
[15026] 14 Apr 22:25:19 * Background saving terminated with success
[15026] 14 Apr 23:25:20 * 10000 changes in 3600 seconds. Saving...
[15026] 14 Apr 23:25:21 * Background saving started by pid 15957
[15957] 14 Apr 23:26:22 * DB saved on disk
[15026] 14 Apr 23:26:23 * Background saving terminated with success
[15026] 15 Apr 00:26:24 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 00:26:25 * Background saving started by pid 27377
[27377] 15 Apr 00:27:30 * DB saved on disk
[15026] 15 Apr 00:27:31 * Background saving terminated with success
[15026] 15 Apr 01:27:32 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 01:27:33 * Background saving started by pid 6348
[6348] 15 Apr 01:28:42 * DB saved on disk
[15026] 15 Apr 01:28:44 * Background saving terminated with success
[15026] 15 Apr 02:28:45 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 02:28:46 * Background saving started by pid 17769
[17769] 15 Apr 02:29:48 * DB saved on disk
[15026] 15 Apr 02:29:49 * Background saving terminated with success
[15026] 15 Apr 03:29:50 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 03:29:51 * Background saving started by pid 29162
[29162] 15 Apr 03:30:57 * DB saved on disk
[15026] 15 Apr 03:30:59 * Background saving terminated with success
[15026] 15 Apr 04:31:00 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 04:31:01 * Background saving started by pid 22136
[22136] 15 Apr 04:32:15 * DB saved on disk
[15026] 15 Apr 04:32:16 * Background saving terminated with success
[15026] 15 Apr 05:32:17 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 05:32:18 * Background saving started by pid 1139
[1139] 15 Apr 05:33:23 * DB saved on disk
[15026] 15 Apr 05:33:24 * Background saving terminated with success
[15026] 15 Apr 06:33:25 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 06:33:26 * Background saving started by pid 12565
[12565] 15 Apr 06:34:31 * DB saved on disk
[15026] 15 Apr 06:34:32 * Background saving terminated with success
[15026] 15 Apr 07:34:33 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 07:34:34 * Background saving started by pid 23977
[23977] 15 Apr 07:35:39 * DB saved on disk
[15026] 15 Apr 07:35:39 * Background saving terminated with success
[15026] 15 Apr 08:35:40 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 08:35:41 * Background saving started by pid 2930
[2930] 15 Apr 08:36:47 * DB saved on disk
[15026] 15 Apr 08:36:48 * Background saving terminated with success
[15026] 15 Apr 09:36:49 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 09:36:50 * Background saving started by pid 14346
[14346] 15 Apr 09:38:06 * DB saved on disk
[15026] 15 Apr 09:38:08 * Background saving terminated with success
[15026] 15 Apr 10:38:09 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 10:38:10 * Background saving started by pid 25787
[25787] 15 Apr 10:39:21 * DB saved on disk
[15026] 15 Apr 10:39:22 * Background saving terminated with success
[15026] 15 Apr 11:39:23 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 11:39:24 * Background saving started by pid 4771
[4771] 15 Apr 11:40:33 * DB saved on disk
[15026] 15 Apr 11:40:34 * Background saving terminated with success
[15026] 15 Apr 12:40:35 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 12:40:36 * Background saving started by pid 16220
[16220] 15 Apr 12:41:50 * DB saved on disk
[15026] 15 Apr 12:41:51 * Background saving terminated with success
[15026] 15 Apr 13:41:52 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 13:41:53 * Background saving started by pid 27654
[27654] 15 Apr 13:43:12 * DB saved on disk
[15026] 15 Apr 13:43:13 * Background saving terminated with success
[15026] 15 Apr 14:43:14 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 14:43:15 * Background saving started by pid 6665
[6665] 15 Apr 14:44:24 * DB saved on disk
[15026] 15 Apr 14:44:25 * Background saving terminated with success
[15026] 15 Apr 15:44:26 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 15:44:27 * Background saving started by pid 18086
[18086] 15 Apr 15:45:37 * DB saved on disk
[15026] 15 Apr 15:45:38 * Background saving terminated with success
[15026] 15 Apr 16:45:39 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 16:45:40 * Background saving started by pid 29527
[29527] 15 Apr 16:46:56 * DB saved on disk
[15026] 15 Apr 16:46:57 * Background saving terminated with success
[15026] 15 Apr 17:46:58 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 17:46:59 * Background saving started by pid 8532
[8532] 15 Apr 17:48:09 * DB saved on disk
[15026] 15 Apr 17:48:10 * Background saving terminated with success
[15026] 15 Apr 18:48:11 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 18:48:12 * Background saving started by pid 19955
[19955] 15 Apr 18:49:35 * DB saved on disk
[15026] 15 Apr 18:49:35 * Background saving terminated with success
[15026] 15 Apr 19:49:36 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 19:49:37 * Background saving started by pid 31415
[31415] 15 Apr 19:50:49 * DB saved on disk
[15026] 15 Apr 19:50:50 * Background saving terminated with success
[15026] 15 Apr 20:50:51 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 20:50:52 * Background saving started by pid 10420
[10420] 15 Apr 20:52:04 * DB saved on disk
[15026] 15 Apr 20:52:05 * Background saving terminated with success
[15026] 15 Apr 21:52:06 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 21:52:07 * Background saving started by pid 21921
[21921] 15 Apr 21:53:20 * DB saved on disk
[15026] 15 Apr 21:53:21 * Background saving terminated with success
[15026] 15 Apr 22:53:22 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 22:53:23 * Background saving started by pid 888
[888] 15 Apr 22:54:37 * DB saved on disk
[15026] 15 Apr 22:54:39 * Background saving terminated with success
[15026] 15 Apr 23:54:40 * 10000 changes in 3600 seconds. Saving...
[15026] 15 Apr 23:54:41 * Background saving started by pid 12375
[12375] 15 Apr 23:55:55 * DB saved on disk
[15026] 15 Apr 23:55:56 * Background saving terminated with success
[15026] 16 Apr 00:55:57 * 10000 changes in 3600 seconds. Saving...
[15026] 16 Apr 00:55:58 * Background saving started by pid 23820
[23820] 16 Apr 00:57:12 * DB saved on disk
[15026] 16 Apr 00:57:13 * Background saving terminated with success
[15026] 16 Apr 01:57:14 * 10000 changes in 3600 seconds. Saving...
[15026] 16 Apr 01:57:15 * Background saving started by pid 2804
[2804] 16 Apr 01:58:32 * DB saved on disk
[15026] 16 Apr 01:58:33 * Background saving terminated with success
[15026] 16 Apr 02:58:34 * 10000 changes in 3600 seconds. Saving...
[15026] 16 Apr 02:58:35 * Background saving started by pid 14258
[14258] 16 Apr 03:00:04 * DB saved on disk
[15026] 16 Apr 03:00:05 * Background saving terminated with success
[15026] 16 Apr 04:00:06 * 10000 changes in 3600 seconds. Saving...
[15026] 16 Apr 04:00:07 * Background saving started by pid 25749
[25749] 16 Apr 04:01:42 * DB saved on disk
[15026] 16 Apr 04:01:43 * Background saving terminated with success
[15026] 16 Apr 05:01:44 * 10000 changes in 3600 seconds. Saving...
[15026] 16 Apr 05:01:45 * Background saving started by pid 6772
[6772] 16 Apr 05:03:09 * DB saved on disk
[15026] 16 Apr 05:03:09 * Background saving terminated with success
[15026] 16 Apr 06:03:10 * 10000 changes in 3600 seconds. Saving...
[15026] 16 Apr 06:03:11 * Background saving started by pid 18644
[18644] 16 Apr 06:04:33 * DB saved on disk
[15026] 16 Apr 06:04:34 * Background saving terminated with success
[15026]

@antirez antirez was assigned Apr 17, 2012
@antirez
Owner
antirez commented Apr 17, 2012

Hi, thanks for reporting, definitely a real bug... I think what it is, and I think it was actually also present in previous versions of Redis (but now 100% sure). More info soon...

@antirez
Owner
antirez commented Apr 17, 2012

Hey, this is what happens:

SORT lookup keys for the "GET" option using a stack allocated robj structure, however this object in the current 2.4.x implementation is no longer a "read only" object, to propagate the expire to the slave we use it to compose the protocol that we send to the slave. But this object can't be shared, as will be destroyed after the function returns. Hence everything crashes apart ;)

Writing a fix. Thanks.

@farmerluo

Thanks

@antirez antirez added a commit that referenced this issue Apr 17, 2012
@antirez lookupKeyByPattern() used by SORT GET/BY rewritten. Fixes issue #460.
lookupKeyByPattern() was implemented with a trick to speedup the lookup
process allocating two fake Redis obejcts on the stack. However now that
we propagate expires to the slave as DEL operations the lookup of the
key may result into a call to expireIfNeeded() having the stack
allocated object as argument, that may in turn use it to create the
protocol to send to the slave. But since this fake obejcts are
inherently read-only this is a problem.

As a side effect of this fix there are no longer size limits in the
pattern to be used with GET/BY option of SORT.

See #460 for bug details.
3c25c4a
@antirez antirez added a commit that referenced this issue Apr 17, 2012
@antirez lookupKeyByPattern() used by SORT GET/BY rewritten. Fixes issue #460.
lookupKeyByPattern() was implemented with a trick to speedup the lookup
process allocating two fake Redis obejcts on the stack. However now that
we propagate expires to the slave as DEL operations the lookup of the
key may result into a call to expireIfNeeded() having the stack
allocated object as argument, that may in turn use it to create the
protocol to send to the slave. But since this fake obejcts are
inherently read-only this is a problem.

As a side effect of this fix there are no longer size limits in the
pattern to be used with GET/BY option of SORT.

See #460 for bug details.
68ee185
@antirez antirez added a commit that referenced this issue Apr 17, 2012
@antirez lookupKeyByPattern() used by SORT GET/BY rewritten. Fixes issue #460.
lookupKeyByPattern() was implemented with a trick to speedup the lookup
process allocating two fake Redis obejcts on the stack. However now that
we propagate expires to the slave as DEL operations the lookup of the
key may result into a call to expireIfNeeded() having the stack
allocated object as argument, that may in turn use it to create the
protocol to send to the slave. But since this fake obejcts are
inherently read-only this is a problem.

As a side effect of this fix there are no longer size limits in the
pattern to be used with GET/BY option of SORT.

See #460 for bug details.
8e5e8f0
@antirez
Owner
antirez commented Apr 17, 2012

Issue fixed in the latest commit of the 2.4 branch, please could you upgrade and see if this works as expected (should work well as far as I can tell). Thanks. Taking the issue open for now.

@farmerluo

I want to know how test to reappear this bug? thanks

@antirez
Owner
antirez commented Apr 18, 2012

@farmerluo there is no easy way to replicate this bug, I was not able to replicate it in my environment, I know it is fixed because I was fortunately able to understand what was happening from the bug report you provided.

So basically I suggest installing in your production environment and the server should no longer crash :) If something bad happens please report here if possible, but I'm pretty confident that the fix is good.

@antirez
Owner
antirez commented Apr 21, 2012

Closing, please reopen if the problem is still present after upgrade. Thanks!

@antirez antirez closed this Apr 21, 2012
@farmerluo

I have already installed the redis 2.4.14 in the production environment, the running after a few days will be posted test results at here.

@farmerluo

uptime_in_seconds:607630
uptime_in_days:7

@farmerluo

It normal to run more than seven days

@JackieXie168 JackieXie168 pushed a commit to JackieXie168/redis that referenced this issue Aug 29, 2016
@antirez lookupKeyByPattern() used by SORT GET/BY rewritten. Fixes issue #460.
lookupKeyByPattern() was implemented with a trick to speedup the lookup
process allocating two fake Redis obejcts on the stack. However now that
we propagate expires to the slave as DEL operations the lookup of the
key may result into a call to expireIfNeeded() having the stack
allocated object as argument, that may in turn use it to create the
protocol to send to the slave. But since this fake obejcts are
inherently read-only this is a problem.

As a side effect of this fix there are no longer size limits in the
pattern to be used with GET/BY option of SORT.

See antirez#460 for bug details.
d767813
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment