[CRASH] My Redis server is crashing. Im on a Mac Book Pro, M2, using docker

[beovideskevin]

Redis used to work just fine. Today stopped working for no reason.

root@934e962812b1:/var/lib/redis# service redis-server start
Job for redis-server.service failed because a fatal signal was delivered to the control process.
See "systemctl status redis-server.service" and "journalctl -xeu redis-server.service" for details.

root@934e962812b1:/var/lib/redis# systemctl status redis-server.service
x redis-server.service - Advanced key-value store
     Loaded: loaded (/lib/systemd/system/redis-server.service; enabled; vendor preset: enabled)
     Active: failed (Result: signal) since Fri 2023-11-24 15:43:54 EST; 9s ago
       Docs: http://redis.io/documentation,
             man:redis-server(1)
    Process: 1647 ExecStart=/usr/bin/redis-server /etc/redis/redis.conf --supervised systemd --daemonize no (code=killed, signal>
   Main PID: 1647 (code=killed, signal=SEGV)
     Status: "Redis is loading..."
        CPU: 558ms

Nov 24 15:43:54 934e962812b1 systemd[1]: redis-server.service: Scheduled restart job, restart counter is at 5.
Nov 24 15:43:54 934e962812b1 systemd[1]: Stopped Advanced key-value store.
Nov 24 15:43:54 934e962812b1 systemd[1]: redis-server.service: Start request repeated too quickly.
Nov 24 15:43:54 934e962812b1 systemd[1]: redis-server.service: Failed with result 'signal'.
Nov 24 15:43:54 934e962812b1 systemd[1]: Failed to start Advanced key-value store.

Crash report

790:M 24 Nov 2023 15:12:49.897 # Server initialized
790:M 24 Nov 2023 15:12:49.906 * Loading RDB produced by version 6.0.16
790:M 24 Nov 2023 15:12:49.908 * RDB age 112547 seconds
790:M 24 Nov 2023 15:12:49.908 * RDB memory usage when created 1.98 Mb

=== REDIS BUG REPORT START: Cut & paste starting from here ===

790:M 24 Nov 2023 15:12:49.913 # Redis 6.0.16 crashed by signal: 11, si_code: 1
790:M 24 Nov 2023 15:12:49.913 # Crashed running the instruction at: 0x400003da03
790:M 24 Nov 2023 15:12:49.913 # Accessing address: 0x65726568742074
790:M 24 Nov 2023 15:12:49.913 # Failed assertion: <no assertion failed> (<no file>:0)

------ STACK TRACE ------
EIP:
/usr/bin/redis-server 127.0.0.1:6379(dictAddRaw+0xc3)[0x400003da03]

Backtrace:
/usr/bin/redis-server 127.0.0.1:6379(logStackTrace+0x5c)[0x400009d83c]
/usr/bin/redis-server 127.0.0.1:6379(sigsegvHandler+0xd0)[0x40000a0320]
/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x4002bcf520]
/usr/bin/redis-server 127.0.0.1:6379(dictAddRaw+0xc3)[0x400003da03]
/usr/bin/redis-server 127.0.0.1:6379(dictAdd+0x15)[0x400003db45]
/usr/bin/redis-server 127.0.0.1:6379(rdbLoadObject+0x30b)[0x4000070f8b]
/usr/bin/redis-server 127.0.0.1:6379(rdbLoadRio+0x689)[0x4000072f79]
/usr/bin/redis-server 127.0.0.1:6379(rdbLoad+0xb0)[0x4000073760]
/usr/bin/redis-server 127.0.0.1:6379(loadDataFromDisk+0xab)[0x400004cc9b]
/usr/bin/redis-server 127.0.0.1:6379(main+0x3e6)[0x4000032576]
/lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x4002bb6d90]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x4002bb6e40]
/usr/bin/redis-server 127.0.0.1:6379(_start+0x25)[0x40000329d5]

------ INFO OUTPUT ------
# Server
redis_version:6.0.16
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:a3fdef44459b3ad6
redis_mode:standalone
os:Linux 5.15.49-linuxkit-pr x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:11.2.0
process_id:790
run_id:f3f853bcb285d8ee24724d2a26a31e858d3eb36d
tcp_port:6379
uptime_in_seconds:0
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:6357953
executable:/usr/bin/redis-server
config_file:/etc/redis/redis.conf
io_threads_active:0

# Clients
connected_clients:0
client_recent_max_input_buffer:0
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0

# Memory
used_memory:987240
used_memory_human:964.10K
used_memory_rss:0
used_memory_rss_human:0B
used_memory_peak:987240
used_memory_peak_human:964.10K
used_memory_peak_perc:inf%
used_memory_overhead:809904
used_memory_startup:809688
used_memory_dataset:177336
used_memory_dataset_perc:99.88%
allocator_allocated:0
allocator_active:0
allocator_resident:0
total_system_memory:8337125376
total_system_memory_human:7.76G
used_memory_lua:41984
used_memory_lua_human:41.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:noeviction
allocator_frag_ratio:-nan
allocator_frag_bytes:0
allocator_rss_ratio:-nan
allocator_rss_bytes:0
rss_overhead_ratio:-nan
rss_overhead_bytes:0
mem_fragmentation_ratio:-nan
mem_fragmentation_bytes:0
mem_not_counted_for_evict:0
mem_replication_backlog:0
mem_clients_slaves:0
mem_clients_normal:0
mem_aof_buffer:0
mem_allocator:jemalloc-5.2.1
active_defrag_running:0
lazyfree_pending_objects:0

# Persistence
loading:1
rdb_changes_since_last_save:0
rdb_bgsave_in_progress:0
rdb_last_save_time:1700856769
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:0
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
module_fork_in_progress:0
module_fork_last_cow_size:0
loading_start_time:1700856769
loading_total_bytes:243794
loading_loaded_bytes:0
loading_loaded_perc:0.00
loading_eta_seconds:1

# Stats
total_connections_received:0
total_commands_processed:0
instantaneous_ops_per_sec:0
total_net_input_bytes:0
total_net_output_bytes:0
instantaneous_input_kbps:0.00
instantaneous_output_kbps:0.00
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:0
evicted_keys:0
keyspace_hits:0
keyspace_misses:0
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_reads_processed:0
total_writes_processed:0
io_threaded_reads_processed:0
io_threaded_writes_processed:0

# Replication
role:master
connected_slaves:0
master_replid:6783603fe22ec206f1d6a409fb1765c635d1d210
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:0
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0

# CPU
used_cpu_sys:0.038088
used_cpu_user:0.271631
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000

# Modules

# Commandstats

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=3,expires=0,avg_ttl=0

------ CLIENT LIST OUTPUT ------

------ REGISTERS ------
790:M 24 Nov 2023 15:12:49.919 # 
RAX:00000040039b5e00 RBX:00000040038beb30
RCX:000000000000074f RDX:8498af14ee2feb57
RDI:a6168581d922acd6 RSI:0000000000000000
RBP:0000000000000000 RSP:00000040019862e0
R8 :c711ebe01d012f1a R9 :00000040039b3283
R10:0000000000000004 R11:000000400012ec00
R12:0065726568742074 R13:00000040038beb30
R14:00000040038beb20 R15:00000040039b3263
RIP:000000400003da03 EFL:0000000000000206
CSGSFS:002b000000000033
790:M 24 Nov 2023 15:12:49.919 # (00000040019862ef) -> 0000004000070f8b
790:M 24 Nov 2023 15:12:49.919 # (00000040019862ee) -> 0000000000000008
790:M 24 Nov 2023 15:12:49.919 # (00000040019862ed) -> 00000040039b3263
790:M 24 Nov 2023 15:12:49.919 # (00000040019862ec) -> 0000000000000024
790:M 24 Nov 2023 15:12:49.919 # (00000040019862eb) -> 000000400003db45
790:M 24 Nov 2023 15:12:49.919 # (00000040019862ea) -> 0000004001986960
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e9) -> 0000000000000000
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e8) -> 000000400392fdd0
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e7) -> 00000040039b3298
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e6) -> 00000040039b3263
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e5) -> 00000040038beb20
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e4) -> 00000040032962c0
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e3) -> 000000000000074f
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e2) -> 00000040038beb70
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e1) -> 0000000000003a78
790:M 24 Nov 2023 15:12:49.919 # (00000040019862e0) -> d4163f1ea10f274f

------ MODULES INFO OUTPUT ------

------ FAST MEMORY TEST ------
790:M 24 Nov 2023 15:12:49.920 # Bio thread for job type #0 terminated
790:M 24 Nov 2023 15:12:49.920 # Bio thread for job type #1 terminated
790:M 24 Nov 2023 15:12:49.920 # Bio thread for job type #2 terminated
*** Preparing to test memory region 4000169000 (118784 bytes)
*** Preparing to test memory region 40019c3000 (8192 bytes)
*** Preparing to test memory region 40019cf000 (8192 bytes)
*** Preparing to test memory region 40019da000 (4096 bytes)
*** Preparing to test memory region 40022d4000 (2240512 bytes)
*** Preparing to test memory region 40025de000 (8192 bytes)
*** Preparing to test memory region 40026a6000 (4096 bytes)
*** Preparing to test memory region 4002b8a000 (12288 bytes)
*** Preparing to test memory region 4002da8000 (53248 bytes)
*** Preparing to test memory region 4002fe3000 (20480 bytes)
*** Preparing to test memory region 400326a000 (12288 bytes)
*** Preparing to test memory region 4003293000 (24576 bytes)
*** Preparing to test memory region 4003600000 (2097152 bytes)
*** Preparing to test memory region 4003899000 (2097152 bytes)
*** Preparing to test memory region 4004000000 (4194304 bytes)
*** Preparing to test memory region 4004782000 (8388608 bytes)
*** Preparing to test memory region 4004f83000 (8388608 bytes)
*** Preparing to test memory region 4005784000 (8388608 bytes)
*** Preparing to test memory region 4005f85000 (8388608 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.

------ DUMPING CODE AROUND EIP ------
Symbol: dictAddRaw (base: 0x400003d940)
Module: /usr/bin/redis-server 127.0.0.1:6379 (base 0x4000000000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x400003d940 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
790:M 24 Nov 2023 15:12:50.136 # dump of function (hexdump of 323 bytes):
f30f1efa41574989f741564989fe41554154554889d5534883ec2848837f50ff0f85ca000000498b064c89ffff10488904244885ed740848c745000000000049837e50ff751a498b4e184885c90f8475010000498b76284839f10f8630010000498d4650498d5e1048894424104989dd488b0c2449234d10488d04cd0000000048894c24184889442408498b45004c8b24c84d85e4752ceb770f1f8000000000498b06488b40184885c0740d498b7e084c89feffd085c075134d8b6424104d85e4744d498b14244939d775d44885ed74044c8965004531ed4883c4284c89e85b5d415c415d415e415fc3660f1f44000048837f58000f852bffffffbe01000000e88bdbffffe91cffffff660f1f44000049837e50ff0f84bc0000004983c5204c396c24100f8546ffffff48837c2418ff74a3498d5e30bf18000000e8c06c00004c8b64

1. Im running docker image

Linux 934e962812b1 5.15.49-linuxkit-pr #1 SMP PREEMPT Thu May 25 07:27:39 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 

[sundb]

@beovideskevin did you see the keyword qemu in the full crash log?
it's kind of similar to #11633.