Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redis crashes after a while #9

Closed
gurc4n opened this issue Feb 9, 2022 · 9 comments
Closed

Redis crashes after a while #9

gurc4n opened this issue Feb 9, 2022 · 9 comments

Comments

@gurc4n
Copy link

gurc4n commented Feb 9, 2022

Redis crashes after a while. It is random. I cannot see a regular time schema.
After that problem, there will be a lot of from this error message: Error registering fd event for the new client: No error

@gurc4n
Copy link
Author

gurc4n commented Feb 10, 2022

Exception in the client :
[13:11:19.895] [ERR] { ThreadId: 60 } No connection is active/available to service this operation: GET CH:coreGetCNCDeviceByMachine-1947848840; An established connection was aborted by the software in your host machine, mc: 1/1/0, mgr: 10 of 10 available, clientName: XXXXXXXXXXXXX, IOCP: (Busy=0,Free=1000,Min=16,Max=1000), WORKER: (Busy=2,Free=32765,Min=16,Max=32767), v: 2.2.88.56325
StackExchange.Redis.RedisConnectionException: No connection is active/available to service this operation: GET CH:coreGetCNCDeviceByMachine-1947848840; An established connection was aborted by the software in your host machine, mc: 1/1/0, mgr: 10 of 10 available, clientName: EPDI-WEB01b71cfb44-36bf-4694-8a03-23c35315ff4c, IOCP: (Busy=0,Free=1000,Min=16,Max=1000), WORKER: (Busy=2,Free=32765,Min=16,Max=32767), v: 2.2.88.56325 ---> StackExchange.Redis.RedisConnectionException: SocketFailure (ReadEndOfStream, 0-read, last-recv: 0) on XXXXXXXXXXX/Subscription, Flushing/NotStarted, last: SUBSCRIBE, origin: OnEstablishingAsyncAwaited, outstanding: 3, last-read: 0s ago, last-write: 0s ago, keep-alive: 60s, state: ConnectedEstablishing, mgr: 10 of 10 available, last-heartbeat: never, global: 0s ago, v: 2.2.88.56325 ---> System.Net.Sockets.SocketException: An established connection was aborted by the software in your host machine
at Pipelines.Sockets.Unofficial.Internal.Throw.Socket(Int32 errorCode) in //src/Pipelines.Sockets.Unofficial/Internal/Throw.cs:line 59
at Pipelines.Sockets.Unofficial.SocketAwaitableEventArgs.GetResult() in /
/src/Pipelines.Sockets.Unofficial/SocketAwaitableEventArgs.cs:line 74
at Pipelines.Sockets.Unofficial.SocketConnection.d__81.MoveNext() in //src/Pipelines.Sockets.Unofficial/SocketConnection.Send.cs:line 64
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.IO.Pipelines.PipeCompletion.ThrowLatchedException()
at System.IO.Pipelines.Pipe.GetFlushResult(FlushResult& result)
at System.IO.Pipelines.Pipe.PrepareFlush(CompletionData& completionData, ValueTask1& result, CancellationToken cancellationToken) at System.IO.Pipelines.Pipe.FlushAsync(CancellationToken cancellationToken) at System.IO.Pipelines.Pipe.DefaultPipeWriter.FlushAsync(CancellationToken cancellationToken) at Pipelines.Sockets.Unofficial.SocketConnection.WrappedWriter.FlushAsync(CancellationToken cancellationToken) in /_/src/Pipelines.Sockets.Unofficial/SocketConnection.cs:line 432 at StackExchange.Redis.PhysicalConnection.FlushAsync() in /_/src/StackExchange.Redis/PhysicalConnection.cs:line 286 at StackExchange.Redis.ServerEndPoint.<HandshakeAsync>d__120.MoveNext() in /_/src/StackExchange.Redis/ServerEndPoint.cs:line 885 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at StackExchange.Redis.ServerEndPoint.<OnEstablishingAsyncAwaited>d__97.MoveNext() in /_/src/StackExchange.Redis/ServerEndPoint.cs:line 566 --- End of inner exception stack trace --- --- End of inner exception stack trace --- at StackExchange.Redis.ConnectionMultiplexer.ExecuteSyncImpl[T](Message message, ResultProcessor1 processor, ServerEndPoint server) in /
/src/StackExchange.Redis/ConnectionMultiplexer.cs:line 2863
at StackExchange.Redis.RedisBase.ExecuteSync[T](Message message, ResultProcessor`1 processor, ServerEndPoint server) in //src/StackExchange.Redis/RedisBase.cs:line 54
at StackExchange.Redis.RedisDatabase.StringGet(RedisKey key, CommandFlags flags) in /
/src/StackExchange.Redis/RedisDatabase.cs:line 2433
at CommonUtils.RedisWrapper.StringGet(String key, String prefix) in

@gurc4n
Copy link
Author

gurc4n commented Feb 10, 2022

=== REDIS BUG REPORT START: Cut & paste starting from here ===
Redis version: 6.2.6
[51188] 10 Feb 14:23:58.261 # --- EXCEPTION_ACCESS_VIOLATION
[51188] 10 Feb 14:23:58.261 # --- STACK TRACE
redis-server.exe!((null):0)(0x1401B7F30, 0x00DEFF90, 0x00000001, 0x00DEE990)
redis-server.exe!((null):0)(0x00DEE990, 0x00000001, 0x00000000, 0x00000001)
KERNELBASE.dll!UnhandledExceptionFilter((null):0)(0x00000000, 0x7FF8C640E4F8, 0x00000000, 0x00DEEAB0)
ntdll.dll!memset((null):0)(0x00000000, 0x00000000, 0x7FF8C62384D4, 0x00DEFCF0)
ntdll.dll!_C_specific_handler((null):0)(0x00000000, 0x00DEEB00, 0x00DEF100, 0x00000000)
ntdll.dll!_chkstk((null):0)(0x7FF8C62D5498, 0x00DEF100, 0x020F8500, 0x7FF8C6326956)
ntdll.dll!RtlImageNtHeaderEx((null):0)(0x00DEF400, 0x7FF8C6322217, 0x14020A050, 0x00000000)
ntdll.dll!KiUserExceptionDispatcher((null):0)(0x00000000, 0x016ED410, 0x00000000, 0x013E0700)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00DEF948, 0x0000043E, 0x00000000, 0x013E0710)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000001, 0x00000001, 0x00000000, 0x00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000002, 0xFFFFFFFF0000001B, 0x00000000, 0x10B1800000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x0000C7F4, 0x1401B1720, 0x00180FC0, 0x00008000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x016ED410, 0x016ED410, 0x00571D40, 0x016ED410)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x0058FDF0, 0x0058FDF0, 0x0058FDF0, 0x016ED410)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
KERNEL32.dll!BaseThreadInitThunk((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
[51188] 10 Feb 14:23:58.292 # --- INFO OUTPUT

Server

redis_version:6.2.6
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:164b73bbc4ccd2e9
redis_mode:standalone
os:Windows
arch_bits:64
multiplexing_api:WinSock_IOCP
atomicvar_api:pthread-mutex
gcc_version:0.0.0
process_id:51188
process_supervised:no
run_id:d5c2974f763fd1e2949dfa8840c089acb1d9e429
tcp_port:61472
server_time_usec:1644492238261960
uptime_in_seconds:50199
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:325070
executable:C:\Redis"c:\redis\redis-server.exe"
config_file:C:\Redis\redis.conf
io_threads_active:0

Clients

connected_clients:19
cluster_connections:0
maxclients:3168
client_recent_max_input_buffer:40984
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0

Memory

used_memory:12523152
used_memory_human:11.94M
used_memory_rss:12603256
used_memory_rss_human:12.02M
used_memory_peak:16339264
used_memory_peak_human:15.58M
used_memory_peak_perc:76.64%
used_memory_overhead:872824
used_memory_startup:391888
used_memory_dataset:11650328
used_memory_dataset_perc:96.04%
allocator_allocated:12941928
allocator_active:729808896
allocator_resident:738197504
total_system_memory:0
total_system_memory_human:0B
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:1073741824
maxmemory_human:1.00G
maxmemory_policy:allkeys-lru
allocator_frag_ratio:56.39
allocator_frag_bytes:716866968
allocator_rss_ratio:1.01
allocator_rss_bytes:8388608
rss_overhead_ratio:0.02
rss_overhead_bytes:-725594248
mem_fragmentation_ratio:1.00
mem_fragmentation_bytes:0
mem_not_counted_for_evict:0
mem_replication_backlog:0
mem_clients_slaves:0
mem_clients_normal:389520
mem_aof_buffer:0
mem_allocator:jemalloc-5.2.1-redis
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0

Persistence

loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:107
rdb_bgsave_in_progress:1
rdb_last_save_time:1644492227
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:1644492228
rdb_current_bgsave_time_sec:0
rdb_last_cow_size:0
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
module_fork_in_progress:0
module_fork_last_cow_size:0

Stats

total_connections_received:3264
total_commands_processed:16418984
instantaneous_ops_per_sec:45
total_net_input_bytes:4245461759
total_net_output_bytes:107221370959
instantaneous_input_kbps:86.56
instantaneous_output_kbps:86.88
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:10
evicted_keys:0
keyspace_hits:10382554
keyspace_misses:5513892
pubsub_channels:1
pubsub_patterns:0
latest_fork_usec:31243
total_forks:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:43
dump_payload_sanitizations:0
total_reads_processed:16271209
total_writes_processed:16472396
io_threaded_reads_processed:0
io_threaded_writes_processed:0

Replication

role:master
connected_slaves:0
master_failover_state:no-failover
master_replid:0ea6b9767beb155acb5bc6519deb15a2e4175fd2
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:0
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0

CPU

used_cpu_sys:1211.000000
used_cpu_user:463.765625
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000

Modules

Commandstats

cmdstat_client:calls=47,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_subscribe:calls=22,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_unsubscribe:calls=47,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_ttl:calls=19,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_info:calls=9167,usec=527257,usec_per_call=57.52,rejected_calls=0,failed_calls=0
cmdstat_echo:calls=43,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_scan:calls=4,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_cluster:calls=21,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=21
cmdstat_expire:calls=26696,usec=65510,usec_per_call=2.45,rejected_calls=0,failed_calls=0
cmdstat_config:calls=67,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=10297,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0
cmdstat_set:calls=362741,usec=2692091,usec_per_call=7.42,rejected_calls=0,failed_calls=0
cmdstat_unlink:calls=113386,usec=393258,usec_per_call=3.47,rejected_calls=0,failed_calls=0
cmdstat_get:calls=15896408,usec=76687298,usec_per_call=4.82,rejected_calls=1,failed_calls=0
cmdstat_type:calls=19,usec=0,usec_per_call=0.00,rejected_calls=0,failed_calls=0

Errorstats

errorstat_ERR:count=43

Cluster

cluster_enabled:0

Keyspace

db0:keys=1875,expires=0,avg_ttl=0
[51188] 10 Feb 14:23:58.324 #
=== REDIS BUG REPORT END. Make sure to include from START to END. ===

@zkteco-home
Copy link
Owner

ok,thanks,i will check it.

@zkteco-home
Copy link
Owner

you tell me your email,i send redis 7.0 to you

@gurc4n
Copy link
Author

gurc4n commented Feb 10, 2022

gurcan [@] gmail [.] com

@zkteco-home
Copy link
Owner

gurcan [@] gmail [.] com

your email has been returned,you send it to my email: my9988@126.com

@zkteco-home
Copy link
Owner

sorry to delay,i reproduced your issue and solved it,please pull redis 7.0

@Arnacels
Copy link

Hi, I have same error with latest version, can you help me?

[10256] 23 Feb 11:19:34.488 * monotonic clock: POSIX clock_gettime _._ _.-``__ ''-._ _.-`` . _. ''-._ Redis 7.0.0 (02/14/2022/0) 64 bit .-`` .-```. ```\/ _.,_ ''-._ ( ' , .- | , ) Running in standalone mode |-.-...- __...-.``-.|'_.-'| Port: 6379 | -._ `._ / .-' | PID: 10256
`-.
`-._ `-./ .-' .-'
|`-.
`-.
`-..-' .-'.-'|
| `-.`-. .-'.-' | https://redis.io
`-._ `-._`-.
.-'.-' .-'
|`-.
`-.
`-..-' .-'.-'|
| `-.`-. .-'.-' |
`-._ `-._`-.
.-'_.-' .-'
`-.
`-.__.-' .-'
`-.
_.-'

[10256] 23 Feb 11:19:34.491 # Server initialized
[10256] 23 Feb 11:19:34.492 * The AOF directory appendonlydir doesn't exist
[10256] 23 Feb 11:19:34.492 * Loading RDB produced by version 7.0.0
[10256] 23 Feb 11:19:34.492 * RDB age 2831 seconds
[10256] 23 Feb 11:19:34.493 * RDB memory usage when created 0.71 Mb
[10256] 23 Feb 11:19:34.493 * Done loading RDB, keys loaded: 0, keys expired: 0.
[10256] 23 Feb 11:19:34.493 * DB loaded from disk: 0.001 seconds
[10256] 23 Feb 11:19:34.493 * Ready to accept connections

=== REDIS BUG REPORT START: Cut & paste starting from here ===
[10256] 23 Feb 11:19:55.675 # --- EXCEPTION_ACCESS_VIOLATION
[10256] 23 Feb 11:19:55.676 # --- STACK TRACE
redis-server.exe!((null):0)(0x1401DCF10, 0x0014FF60, 0x0014E960, 0x0014E960)
redis-server.exe!((null):0)(0x0014E960, 0x0014FF01, 0x140114430, 0x14011E250)
KERNELBASE.dll!UnhandledExceptionFilter((null):0)(0x00000000, 0x7FFC11C82020, 0x00000000, 0x00000000)
ntdll.dll!memset((null):0)(0x00000000, 0x00000000, 0x0014F5F0, 0x0014EF28)
ntdll.dll!_C_specific_handler((null):0)(0x00000000, 0x0014EF10, 0x00000000, 0x140000000)
ntdll.dll!_chkstk((null):0)(0x0014EF10, 0x00000000, 0x7FFC1194CC3C, 0x7FFC118A0000)
ntdll.dll!RtlWalkFrameChain((null):0)(0x00000000, 0x00000000, 0x7FEB16028000, 0x00000000)
ntdll.dll!KiUserExceptionDispatcher((null):0)(0x02A7ECE0, 0x0014F8F9, 0x0014F8F2, 0x7FEB00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0xFFFFFFFFFFFFFFFF, 0x7FEB16028000, 0x02A7ECE0, 0x7FEB16028000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x1D828A748FEE501, 0x0000000F, 0x00000000, 0x00000001)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x14005C2F0, 0x00000000, 0x00000001, 0x7FEB1602D065)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000060, 0x7FEB00000000, 0x00000001, 0x00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x7FEB16028000, 0x7FEB16028000, 0x00000000, 0x7FEB16028000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000082, 0x7FEB16028000, 0x00000000, 0x00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x0000000D, 0x7FEB080002A0, 0x00000000, 0x00000001)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000000, 0xFFFFFFFF0000001B, 0x00000001, 0x00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00002810, 0x1401D6C50, 0x7FEAFF800008, 0x7FEB05C00E70)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x004EAF50, 0x004EAF50, 0x004EAF50, 0x00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000000, 0x00000000, 0x004EAF50, 0x00000000)
redis-server.exe!KiUserExceptionDispatcher((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
KERNEL32.DLL!BaseThreadInitThunk((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart((null):0)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
[10256] 23 Feb 11:19:55.680 #
=== REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report this bug by following the instructions at:

 https://github.com/zkteco-home/redis-windows/wiki/Submitting-an-Issue

Suspect RAM error? Use redis-server --test-memory to verify it.

PS C:\Users\Administrator\radflow\redis> git pull
Already up to date.
PS C:\Users\Administrator\radflow\redis>`

@zkteco-home
Copy link
Owner

is issue still there?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants