Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Redis 4.0.10 Bug Report #6510

Closed
ullumullu opened this issue Oct 28, 2019 · 2 comments
Closed

Redis 4.0.10 Bug Report #6510

ullumullu opened this issue Oct 28, 2019 · 2 comments

Comments

@ullumullu
Copy link

=== REDIS BUG REPORT START: Cut & paste starting from here ===
194:M 28 Oct 15:11:30.650 # Redis 4.0.10 crashed by signal: 11
194:M 28 Oct 15:11:30.650 # Crashed running the instruction at: 0x5642c2ec9377
194:M 28 Oct 15:11:30.650 # Accessing address: 0x50
194:M 28 Oct 15:11:30.650 # Failed assertion: (:0)

------ STACK TRACE ------
EIP:
/usr/local/bin/redis-server 0.0.0.0:6379(dictAddRaw+0x17)[0x5642c2ec9377]

Backtrace:
/usr/local/bin/redis-server 0.0.0.0:6379(logStackTrace+0x37)[0x5642c2f0cad7]
/usr/local/bin/redis-server 0.0.0.0:6379(sigsegvHandler+0xb0)[0x5642c2f0d200]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7feda87310e0]
/usr/local/bin/redis-server 0.0.0.0:6379(dictAddRaw+0x17)[0x5642c2ec9377]
/usr/local/bin/redis-server 0.0.0.0:6379(dictAdd+0x11)[0x5642c2ec9561]
/usr/local/bin/redis-server 0.0.0.0:6379(blockForKeys+0x5a)[0x5642c2ef188a]
/usr/local/bin/redis-server 0.0.0.0:6379(brpoplpushCommand+0xce)[0x5642c2ef21fe]
/usr/local/bin/redis-server 0.0.0.0:6379(loadAppendOnlyFile+0x24c)[0x5642c2f089cc]
/usr/local/bin/redis-server 0.0.0.0:6379(loadDataFromDisk+0xbc)[0x5642c2ed10bc]
/usr/local/bin/redis-server 0.0.0.0:6379(main+0x42f)[0x5642c2ec45cf]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7feda83a12e1]
/usr/local/bin/redis-server 0.0.0.0:6379(_start+0x2a)[0x5642c2ec497a]

------ INFO OUTPUT ------

Server

redis_version:4.0.10
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:7e5b76126d1fa7f0
redis_mode:standalone
os:Linux 4.4.0-165-generic x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:6.3.0
process_id:194
run_id:450e789c72862a6c086634e5934b7f6b9f282064
tcp_port:6379
uptime_in_seconds:11
uptime_in_days:0
hz:10
lru_clock:11994390
executable:/usr/local/bin/redis-server
config_file:/conf/redis/redis.conf

Clients

connected_clients:2
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0

Memory

used_memory:3662361400
used_memory_human:3.41G
used_memory_rss:0
used_memory_rss_human:0B
used_memory_peak:3662428792
used_memory_peak_human:3.41G
used_memory_peak_perc:100.00%
used_memory_overhead:11485908
used_memory_startup:786664
used_memory_dataset:3650875492
used_memory_dataset_perc:99.71%
total_system_memory:67539574784
total_system_memory_human:62.90G
used_memory_lua:66560
used_memory_lua_human:65.00K
maxmemory:6871947673
maxmemory_human:6.40G
maxmemory_policy:noeviction
mem_fragmentation_ratio:0.00
mem_allocator:jemalloc-4.0.3
active_defrag_running:0
lazyfree_pending_objects:0

Persistence

loading:1
rdb_changes_since_last_save:82999
rdb_bgsave_in_progress:0
rdb_last_save_time:1572275478
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:0
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
loading_start_time:1572275478
loading_total_bytes:895362003
loading_loaded_bytes:839605003
loading_loaded_perc:93.77
loading_eta_seconds:0

Stats

total_connections_received:7
total_commands_processed:148534
instantaneous_ops_per_sec:0
total_net_input_bytes:926
total_net_output_bytes:19956
instantaneous_input_kbps:0.00
instantaneous_output_kbps:0.00
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:18328
keyspace_misses:31674
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

Replication

role:master
connected_slaves:0
master_replid:a156bd3c13fe4c05282e4125e9699701f34514e7
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:0
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:10485760
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0

CPU

used_cpu_sys:2.51
used_cpu_user:9.17
used_cpu_sys_children:0.00
used_cpu_user_children:0.00

Commandstats

cmdstat_auth:calls=6,usec=17,usec_per_call=2.83
cmdstat_info:calls=17,usec=550,usec_per_call=32.35

Cluster

cluster_enabled:0

Keyspace

db0:keys=212478,expires=112,avg_ttl=0

------ CLIENT LIST OUTPUT ------
id=8 addr=172.30.83.231:45502 fd=9 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=ping
id=9 addr=172.30.105.172:60742 fd=10 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=ping

------ REGISTERS ------
194:M 28 Oct 15:11:30.651 #
RAX:0000000000000000 RBX:00007fecb7a77860
RCX:0000016e12ec22e2 RDX:0000000000000000
RDI:0000000000000000 RSI:00007fecb7a77860
RBP:00007feda7fa1b80 RSP:00007ffe60bffec0
R8 :00007fecb7a80f60 R9 :773a5173746e656d
R10:00007fecb7a83d59 R11:0000000000000003
R12:0000000000000000 R13:00007ffe60bffff0
R14:00007feda7fa1b80 R15:0000000000000000
RIP:00005642c2ec9377 EFL:0000000000010206
CSGSFS:0000000000000033
194:M 28 Oct 15:11:30.651 # (00007ffe60bffecf) -> 00005642c2ef188a
194:M 28 Oct 15:11:30.651 # (00007ffe60bffece) -> 00007fecb69fdcf0
194:M 28 Oct 15:11:30.651 # (00007ffe60bffecd) -> 00007feda7fa1b80
194:M 28 Oct 15:11:30.651 # (00007ffe60bffecc) -> 00007fecb69fdce8
194:M 28 Oct 15:11:30.651 # (00007ffe60bffecb) -> 00005642c2ec9561
194:M 28 Oct 15:11:30.651 # (00007ffe60bffeca) -> 0000000000000001
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec9) -> 00007feda7fa1b80
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec8) -> 00007ffe60bffff0
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec7) -> 0000000000000000
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec6) -> 00007feda7fa1b80
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec5) -> 0000000000000000
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec4) -> 00007fecb7a77860
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec3) -> 00007feda7f88000
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec2) -> 00007feda7fa1b80
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec1) -> 00005642c2ec9894
194:M 28 Oct 15:11:30.651 # (00007ffe60bffec0) -> 00007feda7f88000

------ FAST MEMORY TEST ------
194:M 28 Oct 15:11:30.652 # Bio thread for job type #0 terminated
194:M 28 Oct 15:11:30.652 # Bio thread for job type #1 terminated
194:M 28 Oct 15:11:30.652 # Bio thread for job type #2 terminated
*** Preparing to test memory region 5642c31f8000 (98304 bytes)
*** Preparing to test memory region 5642c431a000 (2916352 bytes)
*** Preparing to test memory region 7fecadc00000 (20971520 bytes)
*** Preparing to test memory region 7fecb1400000 (29360128 bytes)
*** Preparing to test memory region 7fecb3800000 (20971520 bytes)
*** Preparing to test memory region 7fecb4e00000 (31457280 bytes)
*** Preparing to test memory region 7fecb6e00000 (4016046080 bytes)
*** Preparing to test memory region 7feda65fe000 (8388608 bytes)
*** Preparing to test memory region 7feda6dff000 (8388608 bytes)
*** Preparing to test memory region 7feda7600000 (12582912 bytes)
*** Preparing to test memory region 7feda871c000 (16384 bytes)
*** Preparing to test memory region 7feda8939000 (16384 bytes)
*** Preparing to test memory region 7feda9061000 (16384 bytes)
*** Preparing to test memory region 7feda906a000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.

------ DUMPING CODE AROUND EIP ------
Symbol: dictAddRaw (base: 0x5642c2ec9360)
Module: /usr/local/bin/redis-server 0.0.0.0:6379 (base 0x5642c2e99000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x5642c2ec9360 -D -b binary -m i386:x86-64 /tmp/dump.bin

194:M 28 Oct 15:11:45.027 # dump of function (hexdump of 151 bytes):
415741564989ff415541544989d455534889f34883ec2848837f50ff740b48837f58000f8487010000498b074889dfff104d85e448890424740849c704240000000049837f50ff0f8493000000498d471048894424184989c5498d475048894424104c8b34244d2375104a8d04f5000000004889442408498b45004a8b2cf04885ed752ee9a70000000f1f8000000000498b07488b4018

=== REDIS BUG REPORT END. Make sure to include from START to END. ===
@ullumullu
Copy link
Author

Most likely related to #5816

Stacktrace matches to that one. Will close this one out and have a look at #5816. Seems resolved & backported to Redis 4.0.13.

@itamarhaber
Copy link
Member

👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@itamarhaber @ullumullu