problem happended in case of migrating key using redis cluster version #863

Closed
ghost opened this Issue Jan 7, 2013 · 1 comment

Comments

Projects
None yet
1 participant
@ghost

ghost commented Jan 7, 2013

=== REDIS BUG REPORT START: Cut & paste starting from here ===
[32330] 07 Jan 09:59:29.977 # === ASSERTION FAILED ===
[32330] 07 Jan 09:59:29.977 # ==> cluster.c:1140 'clusterNodeClearSlotBit(n,slot) == 1' is not true
[32330] 07 Jan 09:59:29.977 # (forcing SIGSEGV to print the bug report.)
[32330] 07 Jan 09:59:29.977 # Redis 2.9.7 crashed by signal: 11
[32330] 07 Jan 09:59:29.977 # Failed assertion: clusterNodeClearSlotBit(n,slot) == 1 (cluster.c:1140)
[32330] 07 Jan 09:59:29.977 # --- STACK TRACE
./src/redis-server(logStackTrace+0x54)[0x43c324]
./src/redis-server(_redisAssert+0x72)[0x43c072]
/lib64/libpthread.so.0[0x338540eb10]
./src/redis-server(_redisAssert+0x72)[0x43c072]
./src/redis-server(clusterDelSlot+0x4d)[0x43f37d]
./src/redis-server(clusterCommand+0x7e2)[0x4429a2]
./src/redis-server(call+0x53)[0x418c73]
./src/redis-server(processCommand+0x4a2)[0x4192a2]
./src/redis-server(processInputBuffer+0x4b)[0x4238bb]
./src/redis-server(readQueryFromClient+0x16b)[0x423a8b]
./src/redis-server(aeProcessEvents+0x16a)[0x4150ba]
./src/redis-server(aeMain+0x2b)[0x4152fb]
./src/redis-server(main+0x238)[0x41b7f8]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x338481d994]
./src/redis-server[0x414729]
[32330] 07 Jan 09:59:30.006 # --- INFO OUTPUT
[32330] 07 Jan 09:59:30.007 # # Server
redis_version:2.9.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_mode:cluster
os:Linux 2.6.18-238.el5 x86_64
arch_bits:64
multiplexing_api:epoll
gcc_version:4.1.2
process_id:32330
run_id:96d953f3421b1405285ff90dadbc12befc1b13e2
tcp_port:9738
uptime_in_seconds:1336
uptime_in_days:0
lru_clock:1534668

Clients

connected_clients:8
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0

Memory

used_memory:5077432
used_memory_human:4.84M
used_memory_rss:8663040
used_memory_peak:7193176
used_memory_peak_human:6.86M
used_memory_lua:31744
mem_fragmentation_ratio:1.71
mem_allocator:jemalloc-3.0.0

Persistence

loading:0
rdb_changes_since_last_save:6481
rdb_bgsave_in_progress:0
rdb_last_save_time:1357523958
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:0
rdb_current_bgsave_time_sec:-1
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok

Stats

total_connections_received:3135
total_commands_processed:210443
instantaneous_ops_per_sec:116
rejected_connections:0
expired_keys:0
evicted_keys:0
keyspace_hits:98717
keyspace_misses:10138
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:1640
migrate_cached_sockets:1

Replication

role:master
connected_slaves:0

CPU

used_cpu_sys:7.96
used_cpu_user:5.01
used_cpu_sys_children:0.03
used_cpu_user_children:0.07

Commandstats

cmdstat_get:calls=98591,usec=522334,usec_per_call=5.30
cmdstat_set:calls=98442,usec=1006617,usec_per_call=10.23
cmdstat_del:calls=10264,usec=2485868,usec_per_call=242.19
cmdstat_ping:calls=3,usec=7,usec_per_call=2.33
cmdstat_info:calls=2,usec=379,usec_per_call=189.50
cmdstat_cluster:calls=3141,usec=386001,usec_per_call=122.89

Cluster

cluster_enabled:1

Keyspace

db0:keys=18198,expires=0
hash_init_value: 1357084825

[32330] 07 Jan 09:59:30.007 # --- CLIENT LIST OUTPUT
[32330] 07 Jan 09:59:30.007 # addr=10.12.160.19:55152 fd=10 age=240 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
addr=10.12.160.19:55162 fd=15 age=240 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
addr=10.12.160.19:55164 fd=16 age=240 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
addr=10.12.160.19:55166 fd=17 age=240 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
addr=10.12.160.19:56176 fd=20 age=231 idle=8 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
addr=192.168.229.102:52912 fd=22 age=43 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=cluster
addr=10.12.160.19:58386 fd=18 age=3 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
addr=10.12.160.19:58583 fd=11 age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set

[32330] 07 Jan 09:59:30.007 # --- CURRENT CLIENT INFO
[32330] 07 Jan 09:59:30.007 # client: addr=192.168.229.102:52912 fd=22 age=43 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=cluster
[32330] 07 Jan 09:59:30.007 # argv[0]: 'cluster'
[32330] 07 Jan 09:59:30.007 # argv[1]: 'setslot'
[32330] 07 Jan 09:59:30.007 # argv[2]: '371'
[32330] 07 Jan 09:59:30.007 # argv[3]: 'node'
[32330] 07 Jan 09:59:30.007 # argv[4]: '5aef11b71c7a9107387e4bf8eed228405e95dca8'
[32330] 07 Jan 09:59:30.007 # --- REGISTERS
[32330] 07 Jan 09:59:30.007 #
RAX:0000000000000000 RBX:000000000048db90
RCX:0000000000000000 RDX:0000003384b53980
RDI:0000000000000000 RSI:0000000000000000
RBP:0000000000000173 RSP:00007fff5257bc60
R8 :00000000ffffffff R9 :00000000ffffffff
R10:7562206568742074 R11:0000000000000202
R12:000000000048e43d R13:0000000000000474
R14:00002aaaab289000 R15:00002b535a89b800
RIP:000000000043c072 EFL:0000000000010206
CSGSFS:0000000000000033
[32330] 07 Jan 09:59:30.007 # (00007fff5257bcd8) -> 0000000000000010
[32330] 07 Jan 09:59:30.007 # (00007fff5257bcd0) -> 00002aaaab24d03e
[32330] 07 Jan 09:59:30.007 # (00007fff5257bcc8) -> 0000000000000028
[32330] 07 Jan 09:59:30.007 # (00007fff5257bcc0) -> 0000000000000040
[32330] 07 Jan 09:59:30.007 # (00007fff5257bcb8) -> 0000000000000031
[32330] 07 Jan 09:59:30.007 # (00007fff5257bcb0) -> 0000000000000000
[32330] 07 Jan 09:59:30.007 # (00007fff5257bca8) -> 01002aaaab24d000
[32330] 07 Jan 09:59:30.007 # (00007fff5257bca0) -> 0000000000000009
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc98) -> 0000000000474906
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc90) -> 0000000000008009
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc88) -> 00000000004429a2
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc80) -> 00002aaaab0235c8
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc78) -> 000000000043f37d
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc70) -> 0000000000000173
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc68) -> 00002b535aa50df0
[32330] 07 Jan 09:59:30.007 # (00007fff5257bc60) -> 0000000000000173
[32330] 07 Jan 09:59:30.007 # --- FAST MEMORY TEST
[32330] 07 Jan 09:59:30.008 # Bio thread for job type #0 terminated
[32330] 07 Jan 09:59:30.008 # Bio thread for job type #1 terminated
[32330] 07 Jan 09:59:30.008 # Testing memory at 6af000 (184320 bytes)
[32330] 07 Jan 09:59:30.009 # Testing memory at e206000 (135168 bytes)
[32330] 07 Jan 09:59:30.010 # Testing memory at 40900000 (10485760 bytes)
[32330] 07 Jan 09:59:30.045 # Testing memory at 41301000 (10485760 bytes)
[32330] 07 Jan 09:59:30.078 # Testing memory at 3384b53000 (20480 bytes)
[32330] 07 Jan 09:59:30.078 # Testing memory at 3385617000 (16384 bytes)
[32330] 07 Jan 09:59:30.078 # Testing memory at 2aaaab000000 (4198400 bytes)
[32330] 07 Jan 09:59:30.086 # Testing memory at 2b535a058000 (8192 bytes)
[32330] 07 Jan 09:59:30.086 # Testing memory at 2b535a071000 (8192 bytes)
[32330] 07 Jan 09:59:30.086 # Testing memory at 2b535a400000 (8392704 bytes)
[32330] 07 Jan 09:59:30.113 # Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
[32330] 07 Jan 09:59:30.113 #
=== REDIS BUG REPORT END. Make sure to include from START to END. ===

@ghost

ghost commented Jan 9, 2013

If you has any suggestion to me, please contact me : zhangjinjun@360buy.com

@mattsta mattsta closed this Aug 1, 2014

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment