Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CRASH] <short description> #11633

Closed
thachlp opened this issue Dec 16, 2022 · 7 comments
Closed

[CRASH] <short description> #11633

thachlp opened this issue Dec 16, 2022 · 7 comments
Labels
state:to-be-closed requesting the core team to close the issue

Comments

@thachlp
Copy link

thachlp commented Dec 16, 2022

Notice!

  • If a Redis module was involved, please open an issue in the module's repo instead!
  • If you're using docker on Apple M1, please make sure the image you're using was compiled for ARM!

Crash report

Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.

2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.937 # Redis 6.2.6 crashed by signal: 11, si_code: 1
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.937 # Accessing address: 0x1
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.937 # Crashed running the instruction at: 0x4000049b23
2022-12-16 11:28:03 
2022-12-16 11:28:03 ------ STACK TRACE ------
2022-12-16 11:28:03 EIP:
2022-12-16 11:28:03 redis-server *:6379(dictAddRaw+0x163)[0x4000049b23]
2022-12-16 11:28:03 
2022-12-16 11:28:03 Backtrace:
2022-12-16 11:28:03 /lib/x86_64-linux-gnu/libpthread.so.0(+0x14140)[0x4002158140]
2022-12-16 11:28:03 redis-server *:6379(dictAddRaw+0x163)[0x4000049b23]
2022-12-16 11:28:03 redis-server *:6379(dictAdd+0x11)[0x4000049ca1]
2022-12-16 11:28:03 redis-server *:6379(zsetAdd+0x14c)[0x400008b54c]
2022-12-16 11:28:03 redis-server *:6379(zaddGenericCommand+0x364)[0x400008c374]
2022-12-16 11:28:03 redis-server *:6379(loadAppendOnlyFile+0x66f)[0x400009d87f]
2022-12-16 11:28:03 redis-server *:6379(loadDataFromDisk+0x144)[0x40000550e4]
2022-12-16 11:28:03 redis-server *:6379(main+0x2b1)[0x4000044251]
2022-12-16 11:28:03 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea)[0x400218cd0a]
2022-12-16 11:28:03 redis-server *:6379(_start+0x2a)[0x400004478a]
2022-12-16 11:28:03 
2022-12-16 11:28:03 ------ REGISTERS ------
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # 
2022-12-16 11:28:03 RAX:0000004002aad040 RBX:0000004002a85730
2022-12-16 11:28:03 RCX:0000000000000044 RDX:000000000000000a
2022-12-16 11:28:03 RDI:0000004002aa2bb1 RSI:0000004002aa0dc1
2022-12-16 11:28:03 RBP:0000000000000000 RSP:0000004001c3f840
2022-12-16 11:28:03 R8 :000000400019b24c R9 :00000040026000c0
2022-12-16 11:28:03 R10:0000000000000005 R11:000000400293a000
2022-12-16 11:28:03 R12:0000000000000001 R13:0000004002a85750
2022-12-16 11:28:03 R14:0000004002a85720 R15:0000004002aa2bb1
2022-12-16 11:28:03 RIP:0000004000049b23 EFL:0000000000000202
2022-12-16 11:28:03 CSGSFS:002b000000000033
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f84f) -> 000000400008b54c
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f84e) -> 0000004002aa2bb1
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f84d) -> 0000004001c3f978
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f84c) -> 0000000000000000
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f84b) -> 0000004000049ca1
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f84a) -> 0000004002a97b50
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f849) -> 0000000000000000
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f848) -> 0000004001c3f974
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f847) -> 0000004002aaab78
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.940 # (0000004001c3f846) -> 0000004001c3f978
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.941 # (0000004001c3f845) -> 0000004002a85720
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.941 # (0000004001c3f844) -> 00000040029ad400
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.941 # (0000004001c3f843) -> 0000000000000044
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.941 # (0000004001c3f842) -> 0000004002a85770
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.941 # (0000004001c3f841) -> 0000000000000220
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.941 # (0000004001c3f840) -> 393d13f253808844
2022-12-16 11:28:03 
2022-12-16 11:28:03 ------ INFO OUTPUT ------
2022-12-16 11:28:03 # Server
2022-12-16 11:28:03 redis_version:6.2.6
2022-12-16 11:28:03 redis_git_sha1:00000000
2022-12-16 11:28:03 redis_git_dirty:0
2022-12-16 11:28:03 redis_build_id:9c335ca9779faba5
2022-12-16 11:28:03 redis_mode:standalone
2022-12-16 11:28:03 os:Linux 5.15.49-linuxkit x86_64
2022-12-16 11:28:03 arch_bits:64
2022-12-16 11:28:03 multiplexing_api:epoll
2022-12-16 11:28:03 atomicvar_api:atomic-builtin
2022-12-16 11:28:03 gcc_version:10.2.1
2022-12-16 11:28:03 process_id:1
2022-12-16 11:28:03 process_supervised:no
2022-12-16 11:28:03 run_id:ab5bb6e1e6807c488305c59132cd750672207ce2
2022-12-16 11:28:03 tcp_port:6379
2022-12-16 11:28:03 server_time_usec:1671164883929384
2022-12-16 11:28:03 uptime_in_seconds:0
2022-12-16 11:28:03 uptime_in_days:0
2022-12-16 11:28:03 hz:10
2022-12-16 11:28:03 configured_hz:10
2022-12-16 11:28:03 lru_clock:10220499
2022-12-16 11:28:03 executable:/data/redis-server
2022-12-16 11:28:03 config_file:
2022-12-16 11:28:03 io_threads_active:0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Clients
2022-12-16 11:28:03 connected_clients:0
2022-12-16 11:28:03 cluster_connections:0
2022-12-16 11:28:03 maxclients:10000
2022-12-16 11:28:03 client_recent_max_input_buffer:0
2022-12-16 11:28:03 client_recent_max_output_buffer:0
2022-12-16 11:28:03 blocked_clients:0
2022-12-16 11:28:03 tracking_clients:0
2022-12-16 11:28:03 clients_in_timeout_table:0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Memory
2022-12-16 11:28:03 used_memory:1468600
2022-12-16 11:28:03 used_memory_human:1.40M
2022-12-16 11:28:03 used_memory_rss:0
2022-12-16 11:28:03 used_memory_rss_human:0B
2022-12-16 11:28:03 used_memory_peak:2077048
2022-12-16 11:28:03 used_memory_peak_human:1.98M
2022-12-16 11:28:03 used_memory_peak_perc:70.71%
2022-12-16 11:28:03 used_memory_overhead:880968
2022-12-16 11:28:03 used_memory_startup:880600
2022-12-16 11:28:03 used_memory_dataset:587632
2022-12-16 11:28:03 used_memory_dataset_perc:99.94%
2022-12-16 11:28:03 allocator_allocated:1046312
2022-12-16 11:28:03 allocator_active:1486848
2022-12-16 11:28:03 allocator_resident:4939776
2022-12-16 11:28:03 total_system_memory:8233013248
2022-12-16 11:28:03 total_system_memory_human:7.67G
2022-12-16 11:28:03 used_memory_lua:37888
2022-12-16 11:28:03 used_memory_lua_human:37.00K
2022-12-16 11:28:03 used_memory_scripts:0
2022-12-16 11:28:03 used_memory_scripts_human:0B
2022-12-16 11:28:03 number_of_cached_scripts:0
2022-12-16 11:28:03 maxmemory:0
2022-12-16 11:28:03 maxmemory_human:0B
2022-12-16 11:28:03 maxmemory_policy:noeviction
2022-12-16 11:28:03 allocator_frag_ratio:1.42
2022-12-16 11:28:03 allocator_frag_bytes:440536
2022-12-16 11:28:03 allocator_rss_ratio:3.32
2022-12-16 11:28:03 allocator_rss_bytes:3452928
2022-12-16 11:28:03 rss_overhead_ratio:0.00
2022-12-16 11:28:03 rss_overhead_bytes:-4939776
2022-12-16 11:28:03 mem_fragmentation_ratio:0.00
2022-12-16 11:28:03 mem_fragmentation_bytes:-1003816
2022-12-16 11:28:03 mem_not_counted_for_evict:0
2022-12-16 11:28:03 mem_replication_backlog:0
2022-12-16 11:28:03 mem_clients_slaves:0
2022-12-16 11:28:03 mem_clients_normal:0
2022-12-16 11:28:03 mem_aof_buffer:0
2022-12-16 11:28:03 mem_allocator:jemalloc-5.1.0
2022-12-16 11:28:03 active_defrag_running:0
2022-12-16 11:28:03 lazyfree_pending_objects:0
2022-12-16 11:28:03 lazyfreed_objects:0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Persistence
2022-12-16 11:28:03 loading:1
2022-12-16 11:28:03 current_cow_size:0
2022-12-16 11:28:03 current_cow_size_age:0
2022-12-16 11:28:03 current_fork_perc:0.00
2022-12-16 11:28:03 current_save_keys_processed:0
2022-12-16 11:28:03 current_save_keys_total:0
2022-12-16 11:28:03 rdb_changes_since_last_save:18942
2022-12-16 11:28:03 rdb_bgsave_in_progress:0
2022-12-16 11:28:03 rdb_last_save_time:1671164883
2022-12-16 11:28:03 rdb_last_bgsave_status:ok
2022-12-16 11:28:03 rdb_last_bgsave_time_sec:-1
2022-12-16 11:28:03 rdb_current_bgsave_time_sec:-1
2022-12-16 11:28:03 rdb_last_cow_size:0
2022-12-16 11:28:03 aof_enabled:0
2022-12-16 11:28:03 aof_rewrite_in_progress:0
2022-12-16 11:28:03 aof_rewrite_scheduled:0
2022-12-16 11:28:03 aof_last_rewrite_time_sec:-1
2022-12-16 11:28:03 aof_current_rewrite_time_sec:-1
2022-12-16 11:28:03 aof_last_bgrewrite_status:ok
2022-12-16 11:28:03 aof_last_write_status:ok
2022-12-16 11:28:03 aof_last_cow_size:0
2022-12-16 11:28:03 module_fork_in_progress:0
2022-12-16 11:28:03 module_fork_last_cow_size:0
2022-12-16 11:28:03 aof_current_size:0
2022-12-16 11:28:03 aof_base_size:0
2022-12-16 11:28:03 aof_pending_rewrite:0
2022-12-16 11:28:03 aof_buffer_length:0
2022-12-16 11:28:03 aof_rewrite_buffer_length:0
2022-12-16 11:28:03 aof_pending_bio_fsync:0
2022-12-16 11:28:03 aof_delayed_fsync:0
2022-12-16 11:28:03 loading_start_time:1671164883
2022-12-16 11:28:03 loading_total_bytes:1366989
2022-12-16 11:28:03 loading_rdb_used_mem:0
2022-12-16 11:28:03 loading_loaded_bytes:1302914
2022-12-16 11:28:03 loading_loaded_perc:95.31
2022-12-16 11:28:03 loading_eta_seconds:1
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Stats
2022-12-16 11:28:03 total_connections_received:0
2022-12-16 11:28:03 total_commands_processed:1
2022-12-16 11:28:03 instantaneous_ops_per_sec:0
2022-12-16 11:28:03 total_net_input_bytes:0
2022-12-16 11:28:03 total_net_output_bytes:0
2022-12-16 11:28:03 instantaneous_input_kbps:0.00
2022-12-16 11:28:03 instantaneous_output_kbps:0.00
2022-12-16 11:28:03 rejected_connections:0
2022-12-16 11:28:03 sync_full:0
2022-12-16 11:28:03 sync_partial_ok:0
2022-12-16 11:28:03 sync_partial_err:0
2022-12-16 11:28:03 expired_keys:0
2022-12-16 11:28:03 expired_stale_perc:0.00
2022-12-16 11:28:03 expired_time_cap_reached_count:0
2022-12-16 11:28:03 expire_cycle_cpu_milliseconds:0
2022-12-16 11:28:03 evicted_keys:0
2022-12-16 11:28:03 keyspace_hits:0
2022-12-16 11:28:03 keyspace_misses:0
2022-12-16 11:28:03 pubsub_channels:0
2022-12-16 11:28:03 pubsub_patterns:0
2022-12-16 11:28:03 latest_fork_usec:0
2022-12-16 11:28:03 total_forks:0
2022-12-16 11:28:03 migrate_cached_sockets:0
2022-12-16 11:28:03 slave_expires_tracked_keys:0
2022-12-16 11:28:03 active_defrag_hits:0
2022-12-16 11:28:03 active_defrag_misses:0
2022-12-16 11:28:03 active_defrag_key_hits:0
2022-12-16 11:28:03 active_defrag_key_misses:0
2022-12-16 11:28:03 tracking_total_keys:0
2022-12-16 11:28:03 tracking_total_items:0
2022-12-16 11:28:03 tracking_total_prefixes:0
2022-12-16 11:28:03 unexpected_error_replies:0
2022-12-16 11:28:03 total_error_replies:0
2022-12-16 11:28:03 dump_payload_sanitizations:0
2022-12-16 11:28:03 total_reads_processed:0
2022-12-16 11:28:03 total_writes_processed:0
2022-12-16 11:28:03 io_threaded_reads_processed:0
2022-12-16 11:28:03 io_threaded_writes_processed:0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Replication
2022-12-16 11:28:03 role:master
2022-12-16 11:28:03 connected_slaves:0
2022-12-16 11:28:03 master_failover_state:no-failover
2022-12-16 11:28:03 master_replid:4bfb9949b236d3626f09e1fe9f818480c27ac29d
2022-12-16 11:28:03 master_replid2:0000000000000000000000000000000000000000
2022-12-16 11:28:03 master_repl_offset:0
2022-12-16 11:28:03 second_repl_offset:-1
2022-12-16 11:28:03 repl_backlog_active:0
2022-12-16 11:28:03 repl_backlog_size:1048576
2022-12-16 11:28:03 repl_backlog_first_byte_offset:0
2022-12-16 11:28:03 repl_backlog_histlen:0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # CPU
2022-12-16 11:28:03 used_cpu_sys:0.025276
2022-12-16 11:28:03 used_cpu_user:0.380162
2022-12-16 11:28:03 used_cpu_sys_children:0.000000
2022-12-16 11:28:03 used_cpu_user_children:0.000000
2022-12-16 11:28:03 used_cpu_sys_main_thread:0.024052
2022-12-16 11:28:03 used_cpu_user_main_thread:0.370806
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Modules
2022-12-16 11:28:03 module:name=timeseries,ver=10617,api=1,filters=0,usedby=[],using=[],options=[handle-io-errors]
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Commandstats
2022-12-16 11:28:03 cmdstat_info:calls=1,usec=959,usec_per_call=959.00,rejected_calls=0,failed_calls=0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Errorstats
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Cluster
2022-12-16 11:28:03 cluster_enabled:0
2022-12-16 11:28:03 
2022-12-16 11:28:03 # Keyspace
2022-12-16 11:28:03 db0:keys=6,expires=0,avg_ttl=0
2022-12-16 11:28:03 
2022-12-16 11:28:03 ------ CLIENT LIST OUTPUT ------
2022-12-16 11:28:03 
2022-12-16 11:28:03 ------ MODULES INFO OUTPUT ------
2022-12-16 11:28:03 
2022-12-16 11:28:03 ------ FAST MEMORY TEST ------
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.945 # Bio thread for job type #0 terminated
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.945 # Bio thread for job type #1 terminated
2022-12-16 11:28:03 1:M 16 Dec 2022 04:28:03.946 # Bio thread for job type #2 terminated
2022-12-16 11:28:03 *** Preparing to test memory region 4000213000 (2691072 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4001c6c000 (12288 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4001db5000 (8192 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4002140000 (16384 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4002162000 (16384 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4002327000 (40960 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4002600000 (2097152 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4002931000 (2097152 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4003000000 (4194304 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 40035a4000 (4096 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4003771000 (12288 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 400378f000 (8388608 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4003f90000 (8388608 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4004791000 (8388608 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4004f92000 (8388608 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4005793000 (8388608 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4005f94000 (8388608 bytes)
2022-12-16 11:28:03 *** Preparing to test memory region 4006794000 (2621440 bytes)
2022-12-16 11:28:04 .O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
2022-12-16 11:28:04 Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
2022-12-16 11:28:04 
2022-12-16 11:28:04 ------ DUMPING CODE AROUND EIP ------
2022-12-16 11:28:04 Symbol: dictAddRaw (base: 0x40000499c0)
2022-12-16 11:28:04 Module: redis-server *:6379 (base 0x4000000000)
2022-12-16 11:28:04 $ xxd -r -p /tmp/dump.hex /tmp/dump.bin
2022-12-16 11:28:04 $ objdump --adjust-vma=0x40000499c0 -D -b binary -m i386:x86-64 /tmp/dump.bin
2022-12-16 11:28:04 ------
2022-12-16 11:28:04 1:M 16 Dec 2022 04:28:04.248 # dump of function (hexdump of 483 bytes):
2022-12-16 11:28:04 41574989f741564989fe41554154554889d5534883ec2848837f50ff0f856e010000498b064c89ffff10488904244885ed740848c745000000000049837e50ff0f85ba000000498b4e184885c90f84dd010000498b76284839f10f87a00000008b05cace1b0085c075124889f031d248f7f14883f8050f8684000000498b064c8d5601488b50304885d20f84c50100004885f60f88e9010000660fefc0f2480f2ac64885c90f88b9010000660fefc9f2480f2ac948b8feffffffffffff7f31fff20f5ec14939c277264983fa040f86e5010000b8040000000f1f8400000000004889c74801c04c39d072f548c1e704ffd285c00f85540100000f1f8000000000498d4650498d5e1048894424104989dd488b0c2449234d10488d04cd0000000048894c24184889442408498b45004c8b24c84d85e4752ceb770f1f8000000000498b06488b40184885c0740d498b7e084c89feffd085c075134d8b6424104d85e4744d498b14244939d775d44885ed74044c8965004531ed4883c4284c89e85b5d415c415d415e415fc3660f1f44000066837f58000f8587feffffbe01000000e84bfaffffe978feffff660f1f44000049837e50ff0f84e50000004983c5204c396c24100f8546ffffff48837c2418ff74a3498d5e30bf18000000e8b0f000004c8b64
2022-12-16 11:28:04 Function at 0x40000495b0 is dictRehash
2022-12-16 11:28:04 Function at 0x4000058c50 is zmalloc
2022-12-16 11:28:04 

Additional information

  1. OS distribution and version
  2. Steps to reproduce (if any)
@sundb
Copy link
Collaborator

sundb commented Dec 16, 2022

@thachlp Are you using docker in MAC m1? The logs you post are not complete, did you find the keyword qemu in the crash logs?

@thachlp
Copy link
Author

thachlp commented Dec 16, 2022

@sundb
Yes, I try to run docker on MAC m1.
Here is the end of the log:

redis_ru102j  |        Please report the crash by opening an issue on github:
redis_ru102j  | 
redis_ru102j  |            http://github.com/redis/redis/issues
redis_ru102j  | 
redis_ru102j  |   Suspect RAM error? Use redis-server --test-memory to verify it.
redis_ru102j  | 
redis_ru102j  | qemu: uncaught target signal 11 (Segmentation fault) - core dumped

Thanks for replying to me, hope that my information can useful :)

@sundb
Copy link
Collaborator

sundb commented Dec 16, 2022

@thachlp Please follow the comment at #10162 (comment) and try using the recommanded docker images.

@sundb sundb added the state:to-be-closed requesting the core team to close the issue label Dec 16, 2022
@thachlp
Copy link
Author

thachlp commented Dec 16, 2022

@thachlp Please follow the comment at #10162 (comment) and try using the recommanded docker images.

Thanks @sundb

@thachlp thachlp closed this as completed Dec 16, 2022
@oranagra
Copy link
Member

@thachlp can you specify which docker image were you using?

@thachlp
Copy link
Author

thachlp commented Dec 20, 2022

@thachlp can you specify which docker image were you using?

@oranagra this image: redislabs/redistimeseries

@gkorland
Copy link
Contributor

@thachlp please try to work with the redis-stack docker redis/redis-stack-server.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
state:to-be-closed requesting the core team to close the issue
Projects
None yet
Development

No branches or pull requests

4 participants