[BUG] The redis down by it's self ,redis verison 5.0.3( ASSERTION FAILED) #10905

tiggoliu · 2022-06-30T06:09:06Z

Describe the bug
The redis server down by it's self. The bug report below.

REDIS BUG REPORT START:Cut & paste starting fron here
2532:M 21 Jun 2022 19:55:12.083ASSERTION FAILED
2532:M 21 Jun 2022 19:55:12.083*>dict.c:197 'd->ht[0].size>(unsigned long)d->rehashidx'is not true 2532:M 21 Jun 2022 19:55:12.083#(forcing SIGSEGV to print the bug report.)
2532:M 21 Jun 2022 19:55:12.083#Redis 5.0.3 crashed by signal:11
2532:M 21 Jun 2022 19:55:12.083#Crashed running the instruction at:0x46e73a 2532:M 21 Jun 2022 19:55:12.083 #Accessing address:oxffffffffffffffff
2532:M 21 Jun 2022 19:55:12.083 # Failed assertion: d->ht[e].size > (unsigned long)d->rehashidx (dict.c:197)
STACK TRACE
EIP:
/home/redis/bin/redis-server*:63791(_serverAssert+0x6a)[0x46e73a] Backtrace:
/home/redis/bin/redis-server*:63791(1ogStackTrace+0x29)[0x470919] /home/redis/bin/redis-server:63791(sigsegvHandler+0xac)[0x470fbc] /1ib64/1ibpthread.so.0(+0xf630)[0x7f346872b630]
/home/redis/bin/redis-server*:63791(_serverAssert+0x6a)[0x46e73a] /home/redis/bin/redis-server *:63791(dictRehash+0xf0)[0x42c340】 /home/redis/bin/redis-server*:63791(dictFind+0xda)[0x42cc2a] /home/redis/bin/redis-server*:63791(getExpire+0x24)[0x445a34] /home/redis/bin/redis-server *:63791(keyIsExpired+0x6)[0x445b26] /home/redis/bin/redis-server*:63791(expireIfNeeded+0x11)[0x446791]
/home/redis/bin/redis-server*:63791(1ookupKeyReadwithF1ags+0x12)[0x446822] /home/redis/bin/redis-server*:63791(1ookupKeyReadorReply+0x17)[0x4468c7] /home/redis/bin/redis-server *:63791(1rangeConnand+0x62)[0x454612]
/home/redis/bin/redis-server:63791(ca11+0xa7)[0x430657]
/home/redis/bin/redis-server *:63791(processCommand+0x33f)[0x4318ef] /home/redis/bin/redis-server*:63791(processInputBuffer+0x175)[0x440475] /home/redis/bin/redis-server*:63791(aeProcessEvents+0x2a0)[0x42ab10] /home/redis/bin/redis-server *:63791(aeMain+0x2b)[0x42addb]
/home/redis/bin/redis-server*:63791(main+0x4af)[0x427c8f] /11b64/1ibc.so.6(_libc_start_main+0xf5)[ex7+3468370555] /home/redis/bin/redis-server*:63791[0x427eda]
INFO OUTPUT. ------
# Server
redis_version:5.0.3 redis_git_shal:00000000 redis_git_dirty:0
redis_build_id:832d8ac449b67014 redis mode:standalone
os:Linux 3.10.0-1127.e17.x86_64 x86_64 arch_bits:64
multiplexing_api:epol1 atomicvar_api:atonic-builtin gcc_version:4.8.5
process id:2532
run_id:3c079c02cc04a8017a8fc5b369ed1d4c27260fd9 tcp_port:63791
uptime_in_seconds:5901402 uptime_in_days:68
hz:10
configured hz:10 1ru_clock:11645344
executable:/home/redis/bin/redis-server config_file:/hone/redis/conf/63791.conf Clients
connected_clients:26
client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0
#Memory
used_memory:899493536 used_memory_hunan:857.82M used_nenory_rss:925822976 used_memory_rss_human:882.93M used_nemory_peak:900837176 used_dehory_peak_human:859.11M used_memory_peak_perc:99.85% used menory overhead:118763296 used_memory_startup:792056 used_memory_dataset:780730240 used_memory_dataset_perc:86.87% allocator allocated:899609392 allocator active:901378048 allocator_resident:921731072 total_system_menory:33539612672 total_system_memory_human:31.24G used_menory_lua:37888
used_memory_lua_human:37.00K used_nenory_scripts:0
used_menory_scripts_human:08 number_of_cached_scripts:0 maxmenory:0
maxmemory_human:08
maxmemory_policy:noeviction allocator_frag_ratio:1.00 allocator_frag_bytes:1768656 allocator rss_ratio:1.02 allocator_rss_bytes:20353024 rss_overhead_ratio:1.00 rss_overhead_bytes:4091904 mem_fragmentation_ratio:1.03 mem_fragmentation_bytes:26330872 mem_not_counted_for_evict:3740 mem_replication_backlog:0 mem clients_ slaves:0 mem_clients_nornal:571060 mem_aof_buffer:3740
mem allocator:jenalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0 #Persistence
loading:0
rdb_changes since _last_save:20256 rdb_bgsave_in_progress:1
rdb_last_save_time:1655811753 rdb_last_bgsave_status:err rdb_last_bgsave_time_sec:8 rdb_current_bgsave_time_sec:6 rdb_last_cow_size:6205440 aof_enabled:1
mof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:12 aof_current_rewrite time sec:-1 aof_last_bgrewrite_status:ok aof last_write_status:ok aof_last_cow_size:9342976 aof_current_size:498228060 aof_base_size:281845178 aof_pending rewrite:0 aof_buffer length:0
nof_rewrite buffer length:0 aof pending_bio_fsync:0 aof_delayed_fsync:30 # Stats
total connections_received:349278 total commands processed:3699871959 instantaneous_ops_per_sec:4901 total net input bytes:363225698884 total net output bytes:363490433045 instantaneous_input_kbps:236.74 instantaneous_output_kbps:1131.02 rejected_connections:0
sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:19156464 expired_stale_perc:0.32
expired_time_cap_reached_count:0 evicted keys:0
keyspace_hits:475505663 keyspace_misses:292239404 pubsub_channels:1
pubsub_patterns:0 latest_fork_usec:31048 migrate cached sockets:0 slave_expires_tracked keys:0 active_defrag_hits:0
active defrag misses:0 active_defrag_key_hits:e active_defrag_key_misses:0 # Replication
role:master
connected slaves:0
master_replid:d7953059d8411a171b79457388cd415b7ae5f2c2 master_replid2:00000000000000
00000 master_repl_offset:0
second_repl_offset:-1 repl backlog_active:0 repl_backlog_size:1048576
repl_backlog_first_byte_offset:0 repl backlog_histlen:0
# CPU
used_cpu_sys:71393.377563 used_cpu_user:85765.102154
used_cpu sys_children:7421.702684 used_cpu_user_children:103487.149565 # Commandstats
cmdstat_get:calls=49215416,usec=267117912,usec_per_cail=5.43 mdstat_rpush:calls-79434791,usec-500566120,usec_per_call-6.30 cmdstat_hset:calls-11150603,usec=49281810,usec_per call-4.42 cmdstat_del:calls-151166063,usec-906272849,usec_per_call-6.00 cmdstat_incrby:calls-4,usec-66,usec_per_call-16.50
cmdstat_hincrby:calls-238401,usec-1644202,usec_per_ca1l-6.90 cmdstat_multi:calls=10346964,usec-9179564,usec_per_call=0.9 cmdstat_hget:calls-514831,usec-1439323,usec_per_call-2.80
cmdstat_expire:calls-121029559,usec-532028053,usec_per_call-4.40 cmdstat_info:calls=128094,usec=13935989,usec_per_call=108.80 cmdstat_publish:calls-9900,usec-147496,usec_per_call-14.90 cmdstat_ping:calls=2196921,usec=2348718,usec_per_ca11=1.07 cmdstat_incr:calls-1236,usec-5716,usec_per_call-4.62 cmdstat_setnx:calls-286,usec-1338,usec_per_call-4.68
cmdstat_set:calls=89140544,usec=512096422,usec_per_cal1=5.74 cmdstat_hgetall:calls-425782720,usec-4015414117,usec_per_ca11-9.43 cmdstat_discard:calls-3,usec=3,usec_per_call-1.00
cmdstat_exists:calls=124054961,usec=532620304,usec_per_call=4.29 cmdstat_hdel:calls-3072,usec-11995,usec_per_call-3.90
cmdstat_11en:calls-39035262,usec-70148055,usec_per_ca1l-1.80 cmdstat_setex:calls-50797064,usec=259738442,usec_per_call=5.11 cmdstat_subscribe:calls-30,usec-298,usec_per_call-9.93
cmdstat_auth:calls-368952,usec-889573,usec_per_call-2.41
cmdstat_1rem:calls-39035262,usec-9945641730,usec_per_call-254.79 cmdstat_1range:calls-129141877,usec-547276048,usec_per_call-4.24 cmdstat_hmset:calls=168224392,usec=2683597423,usec_per_call=16.75 cmdstat select:calls-2193928833,usec-2108313766,usec_per_cal1-0.96 cmdstat brpop:calls-12576849,usec-128083214,usec per call-10.18 cmdstat_exec:calls-10346961,usec-315159311,usec_per_call-30.46 # Clusten
cluster enabled:0 # Keyspace
dbe:keys=42,expires=0,avg_ttl=0 dbl:keys-1,expires-0,avg_tt1-0
db2:keys=86,expires=83,avg_tt1=5492815 db3:keys-26,expires-25,avg_tt1-16510023
db4:keys-1047620,expires-1047587,avg_tt1-108304128 db10:keys=63,expires=0,avg_ttl=0
db15:keys-24,expires-0,avg_tt1-0 -CLIENT LIST OUTPUT-----
id-231843 addr-193.168.10.208:53534 fd-19 name- age-1998118 idle-4611 flags-P db-0 sub-1 psub-0 multi--1 qbuf-0 qbuf-frec-0 obl-0 o11-0 omem-0 events-r cmd-subscribe id-235092 addr-193.168.10.208:57850 fd-16 names age-1929425 idle-4611 flags-P db-0 sub-1 psub-0 multi--1 qbuf-0 qbuf-free-0 obl-0 ol1-0 omem-0 eventsar cmdasubscribe id-349279 addr=193.168.10.208:40128 fd-33 name= age=6 idle=4 flags=N db-4 sub-8 psub=e multi=-1 qbuf=0 qbuf-free=0 obl=0 oll-0 omem=0 events=r cmd-set
id-231847 addr-193.168.10.208:53568 fd-25 nane- age-1998102 idle-4611 flags-P db-0 sub-1 psub-0 multi--1 qbuf-0 qbuf-free-0 obl-0 o11-0 omem-0 events-r cmd-subscribe 1d*41685 addr=193.168.10.208:60096 fd=11 name=age=5212938 idle=4611 flags=P db=0 sub=1 psub=θ multi=-1 qbuf=0 qbuf-free=0 obl=0 o11=0 omem=0 eventsar cnd=subscribe id-231850 addr-193.168.10.208:53706 fd-28 name= age-1998051 idle=4611 flags-P db-0 sub-1 psub=θ multi=-1 qbuf=0 qbuf-free=0 obl-0 o11-0 omem-0 events=r cmd-subscribe id-349275 addr-193.168.10.208:39920 fd=27 name-age-14 idle-0 flags-N db-4 sub-0 psub-0 multi--1 qbuf-92 qbuf-free-32676 ob1-0 011-0 omem-e eventser cnd-1range id=349267 addr=193.168.10.208:39266 fd=18 nane= age=44 idle=1 flags=N db=4 sub=θ psub=θ multi=-1 qbuf=θ qbuf-free=32768 obl=θ o11=0 omem=8 events=r cmd=brpop id-349273 addr-193.168.10.208:39917 fd-9 name- age-14 idle-1 flags-N db-4 sub-0 psub-0 multi--1 qbuf=0 qbuf-free-32768 ob1-0 o11-0 onem-e events-r cmd-set id=349274 addr=193.168.10.208:39916 fd=20 name=age=14 idle=1 flags=N db=4 sub=0 psub=θ multi=-1 qbuf=θ qbuf-free=32768 obl=0 o1l=0 onem-0 events=r cmd=1range id=349277 addr=193.168.10.208:40064 fd=24 name= age=9 idle=1 flags=N db=2 sub=Ø psub=θ multi=-1 qbuf=0 qbuf-free=0 obl=0 011=0 omem=0 eventser cmd=exec
id-349278 addr-193.168.10.20B:40068 fd-26 nane- age-9 idle-1 flags-N db-2 sub-0 psub-0 multi--1 qbuf-0 qbuf-free-0 ob1-0 o11-0 omem-0 eventser cmd-exec
id=231852 addr-193.168.10.208:53852 fd-29 nanes age-1998008 idle-4611 flags=P db-0 sub-1 psub=0 multia-1 qbuf=0 qbuf-free=0 obl=0 o11=0 omem=0 eventsar cmd-subscribe id-231840 addr-193.168.10.208:53294 fd-15 nane= age-1998208 idle-4611 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl-0 oll=0 omem=0 eventser cmd-subscribe id-235112 addr-193.168.10.208:58456 fd-13 nane-age-1929211 idle-4611 flags-P db-0 sub-1 psub-θ multi--1 qbuf-0 qbuf-free-0 ob1-0 011-0 omem-0 events-r cmd-subscribe
addr=193.168.10.208:54438 fd=104 name= age=1997845 idle=4611 flags=P db=θ sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 ol1=0 omem=0 events=r cmd=subscribe
193,1,1.2    anese cad-subscrbe
addr=193.168.10.208:54142 fd-8 name-age-1997890 idle-4611 flags-P db-0 sub-1 psub-θ multi--1 qbuf-0 qbuf-free=0 obl-0 o11-8 omcm-0 events=r cnd-subscribe ------
CURRENT CLIENT INFO
id-349275 addr-193.168.10.208:39920 fd-27 name- age-14 idle-0 flags-N db=4 sub-0 psub-0 multi--1 qbuf-92 qbuf-free-32676 ob1-8 o11-8 omem-0 eventser cmd-1range argv[e]:'LRANGE
argv[1]: 'datahub.sys.tiner.abe8fbb1-a600-4923-b4f9-8f6989f9b91d' arEV[2]:'0'
argv[3]:*-1*
REGISTERS
2532:M 21 Jun 2022 19:55:12.085#
RAX:0000000000000000 RBX:00000000000000c5 RCX:0000000000e89800 RDX:00000000000135c0 RDI:00007f3468715760 RSI:0000000000000000 RBP:000000000052c2e1 RSP:00007fffd61095a0 R8:0000000000000001 R9:00007f346925cf80 R10:7562206568742074 R11:0000000000000206 R12:000000000052c328 R13:00007f3467e2b050 R14:66000000000000aa0 R15:00007+3467e8bb40 RIP:000000000046e73a EFL:0000000000010206 CSGSFS:0000000000000033
2532:M 21 Jun 2022 19:55:12,085 #(00007fffd61095af)->0000000000000000 2532:M 21 Jun 2022 19:55:12.085 #(00007fffd61095ae)->00007f3467e3c790 2532:M 21 Jun 2022 19:55:12.086 #(00007fffd61095ad)->00007f3467e1ad00 2532:M 21 Jun 2022 19:55:12.086#(00307fffd61095ac)->00007f340d5eeb00 2532:H 21 Jun 2022 19:55:12.086 #(00007fffd61095ab)>
000000000042cc2a 2532:M 21 Jun 2022 19:55:12.086 #(00007+ffd61095aa)->
00007f3467e0bb48 2532:M 21 Jun 2022 19:55:12.886#(00007fffd61095a9)->
0000000000000000 2532:H 21 Jun 2022 19:55:12.086#(00007fffd61095a8)->
00007f3467e2b050 2532:M
21 Jun 2022 19:55:12.086#(00007fffd61095a7)->
0000000000000000 2532:H 21 Jun 2022 19:55:12.086*(00007fffd61095a6)
->
00007f344406c0c3 2532:M 21 Jun 2022 19:55:12.086#(00007fffd6109585)->
00007f3467e1a000 2532:M 21 Jun 2022 19:55:12.086#(08007+ffd61095a4)->
0000000000000000 2532:M 21 Jun 2022 19:55:12.086 #(00007fffd61095a3)->000000000042c340 2532:H 21 Jun 2022 19:55:12.086#(00007fffd61095a2)-
2000000000000000
2532:M 21 Jun 2022 19:55:12.086=(00007fffd61095a1)->80007f344406c0c3 2532:8 21 Jun 2022 19:55:12.086 #(00007fffd61095a0)
->
00007f3467c0bb40 --
FAST MEMORY TEST
2532:H 21 Jun 2022 19:55:12.087# Bio thread for job type le terminated 2532:H 21 Jun 2022 19:55:12.088 # Bio thread for job type #1 terminated 2532:H 21 Jun 2022 19:55:12.088# Bio thread for job type #2 terminated
***Preparing to test menory region 78d000 (2252800 bytes)
***Preparing to test memory region e7ceee(135168 bytes)
***Preparing to test memory region 7f3409e00000 (1277165568 bytes)
***Preparing to test menory region 7f34560ba000 (163577856 bytes)
**Preparing to test menory region 7+345fcbb000(8388608 bytes)
***Preparing to test memory region 7f34604bc000(8388608 bytes) Preparing to test menory region 7f3460cbd000 (8388608 bytes)
***Preparing to test memory region 7f3467a00000 (8388608 bytes)
***Preparing to test menory region 7f3468717000(20480 bytes)
***Preparing to test menory region 7f3468934000(16384 bytes)
***Preparing to test memory region 7f346925b000(20480 bytes)
***Preparing to test memory region 7f3469265000(4096 bytes)
**Preparing to test memory region 7f3469266000(4096 bytes)
*** Preparing to test memory region 7f3469269000 (4096 bytes) 0.0.0.0.0.0.0.0.0.0.0.0.0.0
Fast memory test PASSED,however your memory can still be broken.Please run a memory test for several hours if possible. -DUMPING CODE AROUND EIP
Symbol: serverAssert (base:0x46e6d0)
Module:redis-rdb-bgsave*:63791 (base 0x400000) $ xxd-r-p/tep/dump.hex/tmp/dump.bin
$objdump--adjust-vma-0x46e6de -D -b binary -m 1386:x86-64/tmp/dump.bin 28167:C-21 Jun 2022 19:55:14.064=dunp of function (hexdump of 234 bytes):
41548605940b32004989fc554889f585c05389d37505e8f5fdffffbeaec65300bf0300000031c0e874fafbff4d89e089d94889eabec7c65300bf0300000031c0eB5bfafbffbe48b65300bf0300000031c04c8925300b32004889 F1f84000000000041544989fc55534883c4808b150beb320085d20f84e700000031cebe78b65300bf03000000e6f6f9fbff418b9424a000000031c0bee2c65300bf0300000031ed31dbe8d9f9Fbff418b54240831c0bef5c6530 REDIS BUG REPORT END.Make sure to include from START to END.O
Please report the crash by opening an issue on github: http://github.com/antirez/redis/issues
suspect RAM error? Use redis-server--test-memory to verify it. 0.0.0.0.0.0.0.0.0.0.0.0
Fast nenory test PASSED,however your memory can still be broken,Please run a memory test for several hours if possible. ------
DUMPING CODE AROUND EIP. Symbol: serverAssert (base: 0x46e6de)
Module:/home/redis/bin/redis-server *:63791 (base 0x400000) $xxd-r-p/tmp/durp.hex/tmp/dump.bin
$ objdump--adjust-vma-0x46e6de-D-b binary-m 1386:x86-64/tmp/dump.bin -----
2532:H 21 Jun 2022 19:55:18.751 #dump of function(hexdump of 234 bytes):
41548b05940b32004989fc5548891585c05389d37505e8f5faffffbeaec65300bf0300000031c0e874fafbff4d89e089d94889eabec7c65300bfe300000031cee85bfafbffbe48b65300bf0300000031c04c8925300b32004889 f1f84000000000041544989fc55534883c48086150b0b320085d20f84e700000031c0be78b65300bf03000000c8f6f9fbff418b9424a000000031c0bee2c65300bf0300000031ed31dbe8d9f9fbff418b54240831c0bef5c6530 REDIS BUG REPORT END.Make sure to include from START to END.
Please report the crash by opening an issue on github: http://github.com/antirez/redis/issues
Suspect RAM error> Use redis-server--test-memory to verify it.
29054:C 21 Jun 2022 20:09:47.673 #000000000000o Redis is starting o000000000000
29054:C 21 Jun 2022 20:09:47.684 #Redis version-5.0.3,bits-64,commit-00000000,modified-0,pid-29054,just started 29054:C 21 Jun 2022 20:09:47.684 # Configuration loaded

The text was updated successfully, but these errors were encountered:

oranagra · 2022-06-30T06:13:43Z

@tiggoliu please post it as text, not an image.
please also try to describe the scenario that lead to this crash.
maybe also include a few lines from the log file from before it crashed.
p.s. 5.0.3 is old, and no longer supported, chance are that this issue is already fixed.

tiggoliu · 2022-06-30T06:23:26Z

@oranagra I hava update the bug report ,please confirm it ,thanks!

oranagra · 2022-06-30T06:27:35Z

@tiggoliu thank you. that's a little bit better since we can use copy / search on that text, but for some reason many line breaks disappeared and many lines are mashed together..

Gongyihui · 2022-07-02T12:12:50Z

I also encountered this problem, did you solve it?

oranagra · 2022-07-03T06:20:21Z

@Gongyihui please describe what exactly you encountered, which version, what was the scenario which lead to it, and if yo can also post a crash log.
maybe additional info would lead to some realization.

Gongyihui · 2022-07-04T03:07:19Z

@Gongyihui please describe what exactly you encountered, which version, what was the scenario which lead to it, and if yo can also post a crash log. maybe additional info would lead to some realization.

=== REDIS BUG REPORT START: Cut & paste starting from here ===
30073:M 02 Jul 2022 18:42:36.350 # === ASSERTION FAILED ===
30073:M 02 Jul 2022 18:42:36.350 # ==> dict.c:197 'd->ht[0].size > (unsigned long)d->rehashidx' is not true
30073:M 02 Jul 2022 18:42:36.350 # (forcing SIGSEGV to print the bug report.)
30073:M 02 Jul 2022 18:42:36.350 # Redis 5.0.14 crashed by signal: 11
30073:M 02 Jul 2022 18:42:36.350 # Crashed running the instruction at: 0x46fc6a
30073:M 02 Jul 2022 18:42:36.350 # Accessing address: 0xffffffffffffffff
30073:M 02 Jul 2022 18:42:36.350 # Failed assertion: d->ht[0].size > (unsigned long)d->rehashidx (dict.c:197)

oranagra · 2022-07-04T05:26:19Z

@Gongyihui thank you. do you happen to have some info about what triggers it, or how to reproduce it?
can you please post a complete crash log?

Gongyihui · 2022-07-04T05:35:05Z

@Gongyihui谢谢你。你碰巧有一些关于什么触发它的信息，或者如何重现它？你能发布一个完整的崩溃日志吗？

=== REDIS BUG REPORT START: Cut & paste starting from here ===
30073:M 02 Jul 2022 18:42:36.350 # === ASSERTION FAILED ===
30073:M 02 Jul 2022 18:42:36.350 # ==> dict.c:197 'd->ht[0].size > (unsigned long)d->rehashidx' is not true
30073:M 02 Jul 2022 18:42:36.350 # (forcing SIGSEGV to print the bug report.)
30073:M 02 Jul 2022 18:42:36.350 # Redis 5.0.14 crashed by signal: 11
30073:M 02 Jul 2022 18:42:36.350 # Crashed running the instruction at: 0x46fc6a
30073:M 02 Jul 2022 18:42:36.350 # Accessing address: 0xffffffffffffffff
30073:M 02 Jul 2022 18:42:36.350 # Failed assertion: d->ht[0].size > (unsigned long)d->rehashidx (dict.c:197)

------ STACK TRACE ------
EIP:
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](_serverAssert+0x6a)[0x46fc6a]

Backtrace:
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](logStackTrace+0x29)[0x471e49]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](sigsegvHandler+0xac)[0x4724ec]
/lib64/libpthread.so.0(+0xf5d0)[0x7f41b4d495d0]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](_serverAssert+0x6a)[0x46fc6a]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](dictRehash+0xf0)[0x42cad0]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](dictRehashMilliseconds+0x3d)[0x42cdbd]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](incrementallyRehash+0x33)[0x42ee33]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](databasesCron+0xd9)[0x42f3c9]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](serverCron+0x207)[0x431647]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](aeProcessEvents+0x32f)[0x42b32f]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](aeMain+0x2b)[0x42b56b]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster](main+0x4c0)[0x428350]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f41b498f495]
/usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster][0x4285aa]

------ INFO OUTPUT ------
# Server
redis_version:5.0.14
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:1ab6cca463b399de
redis_mode:cluster
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.5
process_id:30073
run_id:15c09b32ac4428ea84ce0a1cd40c0454dcaaf46c
tcp_port:7003
uptime_in_seconds:6222846
uptime_in_days:72
hz:10
configured_hz:10
lru_clock:12591388
executable:/usr/local/redis/bin/redis-server
config_file:/data/redis/redis-cluster/7003/redis_7003.conf

# Clients
connected_clients:46
client_recent_max_input_buffer:2
client_recent_max_output_buffer:0
blocked_clients:0

# Memory
used_memory:506802784
used_memory_human:483.32M
used_memory_rss:542609408
used_memory_rss_human:517.47M
used_memory_peak:507100352
used_memory_peak_human:483.61M
used_memory_peak_perc:99.94%
used_memory_overhead:129464684
used_memory_startup:1456032
used_memory_dataset:377338100
used_memory_dataset_perc:74.67%
allocator_allocated:507022752
allocator_active:527568896
allocator_resident:542932992
total_system_memory:16537907200
total_system_memory_human:15.40G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.04
allocator_frag_bytes:20546144
allocator_rss_ratio:1.03
allocator_rss_bytes:15364096
rss_overhead_ratio:1.00
rss_overhead_bytes:-323584
mem_fragmentation_ratio:1.07
mem_fragmentation_bytes:35726000
mem_not_counted_for_evict:1266
mem_replication_backlog:1048576
mem_clients_slaves:16922
mem_clients_normal:1073360
mem_aof_buffer:1266
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0

# Persistence
loading:0
rdb_changes_since_last_save:23411
rdb_bgsave_in_progress:0
rdb_last_save_time:1656758508
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:4
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:4780032
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:5
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:5279744
aof_current_size:264378112
aof_base_size:230215285
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:6

# Stats
total_connections_received:830383
total_commands_processed:2990897394
instantaneous_ops_per_sec:1497
total_net_input_bytes:97590575380
total_net_output_bytes:326166986568
instantaneous_input_kbps:45.83
instantaneous_output_kbps:146.31
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:18631934
expired_stale_perc:0.76
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:440034801
keyspace_misses:170589145
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:8866
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

# Replication
role:master
connected_slaves:1
slave0:ip=10.13.79.31,port=7006,state=online,offset=56763392337,lag=1
master_replid:97aac61c0b415acca3717b157cb19df7ba505ba7
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:56763417832
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:56762369257
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:54986.653833
used_cpu_user:40102.149267
used_cpu_sys_children:5557.904197
used_cpu_user_children:90080.758779

# Commandstats
cmdstat_incr:calls=36797754,usec=152462236,usec_per_call=4.14
cmdstat_hvals:calls=5953179,usec=51955765,usec_per_call=8.73
cmdstat_dbsize:calls=18,usec=15,usec_per_call=0.83
cmdstat_hdel:calls=30230,usec=391923,usec_per_call=12.96
cmdstat_flushall:calls=1,usec=12288,usec_per_call=12288.00
cmdstat_hget:calls=1447485,usec=6951048,usec_per_call=4.80
cmdstat_info:calls=2,usec=127,usec_per_call=63.50
cmdstat_ping:calls=1493163637,usec=561356102,usec_per_call=0.38
cmdstat_scan:calls=180,usec=25454,usec_per_call=141.41
cmdstat_command:calls=3,usec=3742,usec_per_call=1247.33
cmdstat_psync:calls=1,usec=458,usec_per_call=458.00
cmdstat_replconf:calls=6209600,usec=10545123,usec_per_call=1.70
cmdstat_set:calls=159819003,usec=923218537,usec_per_call=5.78
cmdstat_auth:calls=829698,usec=1091309,usec_per_call=1.32
cmdstat_expire:calls=646367311,usec=1240877456,usec_per_call=1.92
cmdstat_setex:calls=3267313,usec=28185355,usec_per_call=8.63
cmdstat_get:calls=603223282,usec=2447400634,usec_per_call=4.06
cmdstat_hset:calls=441365,usec=7814003,usec_per_call=17.70
cmdstat_del:calls=33346829,usec=118653501,usec_per_call=3.56
cmdstat_cluster:calls=503,usec=46573,usec_per_call=92.59

# Cluster
cluster_enabled:1

# Keyspace
db0:keys=1049527,expires=1048633,avg_ttl=1310323254082

------ CLIENT LIST OUTPUT ------
id=830363 addr=10.13.127.128:60962 fd=38 name= age=58 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=830371 addr=10.13.79.238:30580 fd=34 name= age=35 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=setex
id=830341 addr=10.13.127.128:49508 fd=22 name= age=118 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830380 addr=10.13.180.225:55788 fd=47 name= age=9 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=830381 addr=10.13.180.225:55790 fd=56 name= age=9 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=830376 addr=10.13.180.225:54812 fd=7 name= age=15 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=830377 addr=10.13.180.225:54814 fd=14 name= age=15 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=830378 addr=10.13.180.225:54816 fd=16 name= age=15 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=830379 addr=10.13.180.225:54818 fd=26 name= age=15 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=830354 addr=10.13.180.225:43748 fd=23 name= age=75 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830357 addr=10.13.79.238:24284 fd=51 name= age=65 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830258 addr=10.13.79.238:29404 fd=45 name= age=305 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830368 addr=10.13.142.210:12062 fd=40 name= age=47 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=830369 addr=10.13.142.210:12064 fd=42 name= age=47 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=830382 addr=10.13.79.238:36620 fd=63 name= age=5 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=830331 addr=10.13.79.238:11584 fd=57 name= age=125 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830359 addr=10.13.41.219:27888 fd=55 name= age=64 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830375 addr=10.13.138.111:58118 fd=53 name= age=21 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=830360 addr=10.13.41.219:27890 fd=58 name= age=64 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830336 addr=10.13.127.128:49480 fd=46 name= age=118 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830337 addr=10.13.127.128:49482 fd=62 name= age=118 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830319 addr=10.13.138.111:25170 fd=64 name= age=171 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=830320 addr=10.13.142.210:41224 fd=65 name= age=167 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830372 addr=10.13.139.229:29124 fd=27 name= age=24 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=830383 addr=10.13.41.219:38916 fd=30 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=830384 addr=10.13.41.219:38918 fd=39 name= age=4 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=830385 addr=10.13.41.219:38920 fd=61 name= age=4 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=830373 addr=10.13.139.229:29126 fd=37 name= age=24 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=830374 addr=10.13.139.229:29130 fd=60 name= age=24 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=830346 addr=10.13.79.238:18128 fd=54 name= age=95 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830350 addr=10.13.138.111:45098 fd=59 name= age=81 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830342 addr=10.13.138.111:38264 fd=35 name= age=111 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830343 addr=10.13.142.210:54042 fd=24 name= age=107 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=830344 addr=10.13.142.210:54044 fd=50 name= age=107 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830300 addr=10.13.138.111:18630 fd=49 name= age=201 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=830348 addr=10.13.139.229:18532 fd=32 name= age=84 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=incr
id=830370 addr=10.13.180.225:50008 fd=36 name= age=39 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=incr
id=830349 addr=10.13.139.229:18534 fd=41 name= age=84 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830355 addr=10.13.180.225:44622 fd=31 name= age=69 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830364 addr=10.13.127.128:60978 fd=11 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830365 addr=10.13.127.128:60980 fd=12 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830366 addr=10.13.127.128:60982 fd=21 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830367 addr=10.13.127.128:60984 fd=52 name= age=58 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=830356 addr=10.13.180.225:44624 fd=48 name= age=69 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=5 addr=10.13.79.31:13387 fd=10 name= age=6222768 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=replconf
id=830361 addr=10.13.127.128:60958 fd=25 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=830362 addr=10.13.127.128:60960 fd=33 name= age=58 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire

------ REGISTERS ------
30073:M 02 Jul 2022 18:42:36.351 # 
RAX:0000000000000000 RBX:00000000000000c5
RCX:0000000001616670 RDX:0000000000012750
RDI:00007f41b4d33760 RSI:0000000000000000
RBP:000000000052ee01 RSP:00007ffeab40b500
R8 :0000000000000001 R9 :00007f41b5879f80
R10:7562206568742074 R11:0000000000000206
R12:000000000052ee48 R13:000000000000001f
R14:0000000000000063 R15:0000000000000000
RIP:000000000046fc6a EFL:0000000000010206
CSGSFS:002b000000000033
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b50f) -> 0000000000000001
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b50e) -> 0000000000000010
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b50d) -> 0000000000000000
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b50c) -> 00007f419c379e40
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b50b) -> 000000000042cdbd
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b50a) -> 00007f41b44150c0
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b509) -> 20c49ba5e353f7cf
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b508) -> 00000181be8156be
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b507) -> 0000000000000001
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b506) -> 00007f41b440b420
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b505) -> 00000000000000c8
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b504) -> 0000000000000064
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b503) -> 000000000042cad0
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b502) -> 00000000000003d8
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b501) -> 00007f4195a8d5d8
30073:M 02 Jul 2022 18:42:36.351 # (00007ffeab40b500) -> 00007f41b440b420

------ FAST MEMORY TEST ------
30073:M 02 Jul 2022 18:42:36.351 # Bio thread for job type #0 terminated
30073:M 02 Jul 2022 18:42:36.352 # Bio thread for job type #1 terminated
30073:M 02 Jul 2022 18:42:36.352 # Bio thread for job type #2 terminated
*** Preparing to test memory region 791000 (2252800 bytes)
*** Preparing to test memory region 1608000 (135168 bytes)
*** Preparing to test memory region 7f4163a00000 (1186988032 bytes)
*** Preparing to test memory region 7f41aa680000 (18350080 bytes)
*** Preparing to test memory region 7f41ab840000 (2621440 bytes)
*** Preparing to test memory region 7f41abac1000 (10485760 bytes)
*** Preparing to test memory region 7f41ac4c2000 (10485760 bytes)
*** Preparing to test memory region 7f41acec3000 (10485760 bytes)
*** Preparing to test memory region 7f41b4000000 (8388608 bytes)
*** Preparing to test memory region 7f41b4d35000 (20480 bytes)
*** Preparing to test memory region 7f41b4f52000 (16384 bytes)
*** Preparing to test memory region 7f41b5878000 (20480 bytes)
*** Preparing to test memory region 7f41b5883000 (4096 bytes)
*** Preparing to test memory region 7f41b5884000 (4096 bytes)
*** Preparing to test memory region 7f41b5887000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.

------ DUMPING CODE AROUND EIP ------
Symbol: _serverAssert (base: 0x46fc00)
Module: /usr/local/redis/bin/redis-server 10.13.72.193:7003 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x46fc00 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
30073:M 02 Jul 2022 18:42:43.054 # dump of function (hexdump of 234 bytes):
41548b05ac3632004989fc554889f585c05389d37505e8f5fdffffbe8ef45300bf0300000031c0e8d4ecfbff4d89e089d94889eabea7f45300bf0300000031c0e8bbecfbffbe28e45300bf0300000031c04c89254836320048892d49363200891d4b363200e896ecfbffc60425ffffffff785b5d415cc3660f1f84000000000041544989fc55534883c4808b152336320085d20f84e700000031c0be58e45300bf03000000e856ecfbff418b9424a000000031c0bec2f45300bf0300000031ed31dbe839ecfbff418b54240831c0bed5f45300bf03000000e823ecfbff418b54244031c0bee5f45300bf

=== REDIS BUG REPORT END. Make sure to include from START to END. ===

       Please report the crash by opening an issue on github:

           http://github.com/antirez/redis/issues

  Suspect RAM error? Use redis-server --test-memory to verify it.

oranagra · 2022-07-04T05:52:06Z

any chance you can try a more recent version of Redis?
looking at dict.c between this version and the 6.2, i see dict.c is unchanged, however, i haven't seen any similar reports and i'm unable to reproduce or figure out what the problem is.

tiggoliu · 2022-07-04T05:53:46Z

I also encountered this problem, did you solve it?

I had update the redis to 5.0.14 version.

Gongyihui · 2022-07-04T05:57:58Z

您有机会尝试更新版本的 Redis 吗？查看这个版本和 6.2 之间的 dict.c，我看到 dict.c 没有改变，但是，我没有看到任何类似的报告，我无法重现或找出问题所在。

The production environment is inconvenient to update

Gongyihui · 2022-07-04T06:15:43Z

There is another bug, please take a look

any chance you can try a more recent version of Redis? looking at dict.c between this version and the 6.2, i see dict.c is unchanged, however, i haven't seen any similar reports and i'm unable to reproduce or figure out what the problem is.

There is another bug, please take a look

Gongyihui · 2022-07-04T06:16:20Z

any chance you can try a more recent version of Redis? looking at dict.c between this version and the 6.2, i see dict.c is unchanged, however, i haven't seen any similar reports and i'm unable to reproduce or figure out what the problem is.

=== REDIS BUG REPORT START: Cut & paste starting from here ===
3169:M 22 Jun 2022 12:43:04.536 # Redis 5.0.14 crashed by signal: 11
3169:M 22 Jun 2022 12:43:04.536 # Crashed running the instruction at: 0x431e0e
3169:M 22 Jun 2022 12:43:04.536 # Accessing address: 0x7fba00010008
3169:M 22 Jun 2022 12:43:04.536 # Failed assertion: <no assertion failed> (<no file>:0)

------ STACK TRACE ------
EIP:
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processCommand+0x1e)[0x431e0e]

Backtrace:
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](logStackTrace+0x29)[0x471e49]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](sigsegvHandler+0xac)[0x4724ec]
/lib64/libpthread.so.0(+0xf5d0)[0x7fbad85275d0]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processCommand+0x1e)[0x431e0e]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processInputBuffer+0x175)[0x4410c5]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](aeProcessEvents+0x2a0)[0x42b2a0]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](aeMain+0x2b)[0x42b56b]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](main+0x4c0)[0x428350]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fbad816d495]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster][0x4285aa]

------ INFO OUTPUT ------
# Server
redis_version:5.0.14
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:eeedfe8753b30ce3
redis_mode:cluster
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.5
process_id:3169
run_id:46da8bc086b71db9d6f36c663537f1ec7389af82
tcp_port:7001
uptime_in_seconds:5337274
uptime_in_days:61
hz:10
configured_hz:10
lru_clock:11705816
executable:/usr/local/redis/bin/redis-server
config_file:/data/redis/redis-cluster/7001/redis_7001.conf

# Clients
connected_clients:27
client_recent_max_input_buffer:2
client_recent_max_output_buffer:0
blocked_clients:0

# Memory
used_memory:269238152
used_memory_human:256.77M
used_memory_rss:319258624
used_memory_rss_human:304.47M
used_memory_peak:281246592
used_memory_peak_human:268.22M
used_memory_peak_perc:95.73%
used_memory_overhead:58105306
used_memory_startup:1456032
used_memory_dataset:211132846
used_memory_dataset_perc:78.85%
allocator_allocated:268902488
allocator_active:308342784
allocator_resident:321269760
total_system_memory:16537907200
total_system_memory_human:15.40G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.15
allocator_frag_bytes:39440296
allocator_rss_ratio:1.04
allocator_rss_bytes:12926976
rss_overhead_ratio:0.99
rss_overhead_bytes:-2011136
mem_fragmentation_ratio:1.19
mem_fragmentation_bytes:50514304
mem_not_counted_for_evict:1122
mem_replication_backlog:1048576
mem_clients_slaves:16922
mem_clients_normal:981246
mem_aof_buffer:1122
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0

# Persistence
loading:0
rdb_changes_since_last_save:65870
rdb_bgsave_in_progress:1
rdb_last_save_time:1655872923
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:1
rdb_current_bgsave_time_sec:0
rdb_last_cow_size:2973696
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:2
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:3010560
aof_current_size:226527648
aof_base_size:130822830
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:3

# Stats
total_connections_received:586317
total_commands_processed:4766783817
instantaneous_ops_per_sec:1384
total_net_input_bytes:148520878623
total_net_output_bytes:229403881424
instantaneous_input_kbps:41.61
instantaneous_output_kbps:51.59
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:16330138
expired_stale_perc:1.37
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:246441640
keyspace_misses:44394874
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:5096
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

# Replication
role:master
connected_slaves:1
slave0:ip=10.13.72.193,port=7004,state=online,offset=106077585412,lag=1
master_replid:238bdc40ebb6240d3b2152745078afc4c5a6d34b
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:106077603756
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:106076555181
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:47015.673437
used_cpu_user:34738.464793
used_cpu_sys_children:2803.126697
used_cpu_user_children:50352.920614

# Commandstats
cmdstat_psync:calls=1,usec=280,usec_per_call=280.00
cmdstat_hdel:calls=3967,usec=27272,usec_per_call=6.87
cmdstat_auth:calls=584778,usec=576746,usec_per_call=0.99
cmdstat_hget:calls=713107,usec=2000977,usec_per_call=2.81
cmdstat_info:calls=3,usec=126,usec_per_call=42.00
cmdstat_getset:calls=6,usec=19,usec_per_call=3.17
cmdstat_scan:calls=181,usec=15770,usec_per_call=87.13
cmdstat_dbsize:calls=3,usec=1,usec_per_call=0.33
cmdstat_hset:calls=213029,usec=1941564,usec_per_call=9.11
cmdstat_expire:calls=1498652910,usec=1611615436,usec_per_call=1.08
cmdstat_incr:calls=666486,usec=1224290,usec_per_call=1.84
cmdstat_del:calls=55186,usec=76542,usec_per_call=1.39
cmdstat_hvals:calls=10318830,usec=22502735,usec_per_call=2.18
cmdstat_command:calls=2,usec=1199,usec_per_call=599.50
cmdstat_replconf:calls=5322775,usec=5788665,usec_per_call=1.09
cmdstat_set:calls=586904651,usec=929865099,usec_per_call=1.58
cmdstat_cluster:calls=85,usec=6456,usec_per_call=75.95
cmdstat_ping:calls=2381442021,usec=458617906,usec_per_call=0.19
cmdstat_get:calls=279804571,usec=644540549,usec_per_call=2.30
cmdstat_flushall:calls=1,usec=9660,usec_per_call=9660.00
cmdstat_setex:calls=2101224,usec=11450612,usec_per_call=5.45

# Cluster
cluster_enabled:1

# Keyspace
db0:keys=591222,expires=590638,avg_ttl=1125277365179

------ CLIENT LIST OUTPUT ------
id=586310 addr=10.13.79.238:22266 fd=60 name= age=2 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=14 qbuf-free=32754 obl=0 oll=0 omem=0 events=r cmd=set
id=586235 addr=10.13.180.225:15440 fd=28 name= age=235 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=586273 addr=10.13.180.225:15822 fd=24 name= age=61 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586165 addr=10.13.180.225:14970 fd=25 name= age=415 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=586144 addr=10.13.127.128:49650 fd=46 name= age=467 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586241 addr=10.13.180.225:15576 fd=30 name= age=175 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586312 addr=10.13.180.225:15964 fd=7 name= age=1 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=586313 addr=10.13.180.225:15966 fd=22 name= age=1 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hvals
id=586285 addr=10.13.79.238:22162 fd=55 name= age=33 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586286 addr=10.13.79.238:22164 fd=56 name= age=33 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586190 addr=10.13.127.128:49778 fd=32 name= age=390 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586261 addr=10.13.79.238:22040 fd=47 name= age=72 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set
id=586274 addr=10.13.127.128:50290 fd=29 name= age=33 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=4 addr=10.13.72.193:29855 fd=10 name= age=5337196 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=replconf
id=586228 addr=10.13.180.225:15284 fd=26 name= age=295 idle=25 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586255 addr=10.13.127.128:50204 fd=36 name= age=93 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586232 addr=10.13.127.128:50006 fd=27 name= age=243 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=586246 addr=10.13.180.225:15706 fd=33 name= age=115 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire
id=586294 addr=10.13.180.225:15908 fd=21 name= age=31 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586295 addr=10.13.180.225:15910 fd=23 name= age=31 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586296 addr=10.13.79.238:22238 fd=31 name= age=2 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586298 addr=10.13.79.238:22242 fd=37 name= age=2 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586300 addr=10.13.79.238:22246 fd=42 name= age=2 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586314 addr=10.13.79.238:22280 fd=39 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586315 addr=10.13.79.238:22282 fd=41 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586317 addr=10.13.79.238:22288 fd=45 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
id=586318 addr=10.13.79.238:22290 fd=48 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=ping
id=586319 addr=10.13.79.238:22292 fd=50 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire

Gongyihui · 2022-07-04T06:28:53Z

I also encountered this problem, did you solve it?

I had update the redis to 5.0.14 version.

The bug still exists in this version

oranagra mentioned this issue Jul 18, 2022

Guru Meditation: Unknown encoding type #object.c:533 #10995

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BUG] The redis down by it's self ,redis verison 5.0.3( ASSERTION FAILED) #10905

[BUG] The redis down by it's self ,redis verison 5.0.3( ASSERTION FAILED) #10905

tiggoliu commented Jun 30, 2022 •

edited by oranagra

oranagra commented Jun 30, 2022

tiggoliu commented Jun 30, 2022

oranagra commented Jun 30, 2022

Gongyihui commented Jul 2, 2022

oranagra commented Jul 3, 2022

Gongyihui commented Jul 4, 2022

oranagra commented Jul 4, 2022

Gongyihui commented Jul 4, 2022 •

edited by oranagra

oranagra commented Jul 4, 2022

tiggoliu commented Jul 4, 2022

Gongyihui commented Jul 4, 2022

Gongyihui commented Jul 4, 2022

Gongyihui commented Jul 4, 2022 •

edited by oranagra

Gongyihui commented Jul 4, 2022

[BUG] The redis down by it's self ,redis verison 5.0.3( ASSERTION FAILED) #10905

[BUG] The redis down by it's self ,redis verison 5.0.3( ASSERTION FAILED) #10905

Comments

tiggoliu commented Jun 30, 2022 • edited by oranagra

oranagra commented Jun 30, 2022

tiggoliu commented Jun 30, 2022

oranagra commented Jun 30, 2022

Gongyihui commented Jul 2, 2022

oranagra commented Jul 3, 2022

Gongyihui commented Jul 4, 2022

oranagra commented Jul 4, 2022

Gongyihui commented Jul 4, 2022 • edited by oranagra

oranagra commented Jul 4, 2022

tiggoliu commented Jul 4, 2022

Gongyihui commented Jul 4, 2022

Gongyihui commented Jul 4, 2022

Gongyihui commented Jul 4, 2022 • edited by oranagra

Gongyihui commented Jul 4, 2022

tiggoliu commented Jun 30, 2022 •

edited by oranagra

Gongyihui commented Jul 4, 2022 •

edited by oranagra

Gongyihui commented Jul 4, 2022 •

edited by oranagra