Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

i always get the handle uplink error using v4 #40

Closed
hd10180 opened this issue Sep 9, 2022 · 4 comments
Closed

i always get the handle uplink error using v4 #40

hd10180 opened this issue Sep 9, 2022 · 4 comments

Comments

@hd10180
Copy link

hd10180 commented Sep 9, 2022

all the things works fine after docker restart, but after running a while, maybe 2 or 3 hours, maybe a whole day, i will get the same error in logs.
i have stuck in this error for a week, can u give me some suggestions?

Sep 09 04:27:49.477 DEBUG gRPC{uri=/api.InternalService/StreamDeviceEvents}: chirpstack::api: Started processing request
Sep 09 04:27:49.478 DEBUG gRPC{uri=/api.InternalService/StreamDeviceEvents}: chirpstack::api: Started processing request
Sep 09 04:27:49.479  INFO gRPC{uri=/api.InternalService/StreamDeviceEvents}: chirpstack::api: Finished processing request status="200" latency=1.745125ms
Sep 09 04:27:49.480  INFO gRPC{uri=/api.InternalService/StreamDeviceEvents}: chirpstack::api: Finished processing request status="200" latency=1.96641ms
Sep 09 04:27:49.936 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:49.936 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:49.938 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:49.938 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:50.079 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:50.079 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:50.080 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:50.080 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:50.512 ERROR chirpstack::uplink: Deduplication error error=timed out waiting for connection
Sep 09 04:27:50.513 ERROR chirpstack::uplink: Deduplication error error=timed out waiting for connection
Sep 09 04:27:50.513 ERROR chirpstack::uplink: Deduplication error error=timed out waiting for connection
Sep 09 04:27:50.513 ERROR chirpstack::uplink: Deduplication error error=timed out waiting for connection
Sep 09 04:27:50.513 ERROR chirpstack::uplink: Deduplication error error=log_uplink_for_gateways error
Sep 09 04:27:50.513 ERROR up{deduplication_id=4e8a7e30-e713-4b78-92f7-fe2f7d268d20}: chirpstack::uplink::data: Handle uplink error error=Get device-session
Sep 09 04:27:50.513 ERROR chirpstack::uplink: Deduplication error error=log_uplink_for_gateways error
Sep 09 04:27:50.513 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.514 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.514 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.514 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.514 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.514 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.515 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.515 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.515 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.515 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.515 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.516 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.515 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.516 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.516 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.516 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.516 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.516 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.517 ERROR chirpstack::uplink: Deduplication error error=Zero items in collect set
Sep 09 04:27:50.517  INFO chirpstack::gateway::backend::mqtt: Message received from gateway region_name="as923" topic="as923/gateway/ac1f09fffe015ed3/event/up" qos=0 json=false
Sep 09 04:27:50.517 TRACE chirpstack::uplink: Adding uplink event to deduplication set key="up:collect:08c0eea7b803120a1a0808c8d00710072801:805350200080b3160a7d8855fc52a222"
Sep 09 04:27:50.517 TRACE chirpstack::eventlog: Event-log received from stream key=status id=1662690659222-0
Sep 09 04:27:50.517 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662690659229-0
Sep 09 04:27:50.517 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.518 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662690662929-0
Sep 09 04:27:50.518 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.518 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662690666934-0
Sep 09 04:27:50.518 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.518 TRACE chirpstack::eventlog: Event-log received from stream key=join id=1662691825952-0
Sep 09 04:27:50.518 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662691831858-0
Sep 09 04:27:50.518 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.518 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.519 TRACE chirpstack::eventlog: Event-log received from stream key=status id=1662691835757-0
Sep 09 04:27:50.519 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.519 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662691835764-0
Sep 09 04:27:50.519 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.519 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662691839474-0
Sep 09 04:27:50.519 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.519 TRACE chirpstack::eventlog: Event-log received from stream key=up id=1662691843468-0
Sep 09 04:27:50.519 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.519 TRACE chirpstack::api::internal: Message received from Redis Stream channel
Sep 09 04:27:50.939 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:50.939 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:50.941 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:50.941 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:51.082 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:51.082 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:51.083 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:51.083 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:51.941 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:51.941 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:51.943 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:51.943 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:52.084 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:52.084 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:52.085 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:52.085 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:52.944 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:52.944 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:52.946 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:52.946 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:53.086 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:53.086 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:53.087 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:53.088 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:53.947 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:53.947 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:53.949 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:53.949 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:54.089 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:54.089 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:54.090 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:54.090 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:54.951 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:54.951 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:54.953 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:54.953 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:55.091 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:55.091 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:55.092 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:55.092 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:55.954 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:55.955 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:55.956 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:55.956 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:56.094 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:56.094 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:56.095 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:56.095 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:56.958 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:56.958 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:56.960 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:56.960 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:57.097 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:57.097 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:57.098 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:57.098 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:57.960 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:57.960 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:57.962 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:57.962 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:58.100 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:58.100 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:58.101 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:58.101 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:58.964 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:58.964 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:58.966 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:58.966 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:27:59.103 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:27:59.103 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:27:59.104 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:27:59.104 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:27:59.966 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:27:59.966 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:27:59.968 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:27:59.968 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:00.105 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:00.105 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:00.106 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:00.106 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:00.969 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:00.969 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:00.971 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:00.971 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:01.107 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:01.107 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:01.109 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:01.109 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:01.972 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:01.972 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:01.974 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:01.974 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:02.109 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:02.110 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:02.111 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:02.111 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:02.975 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:02.975 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:02.977 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:02.977 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:03.111 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:03.112 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:03.113 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:03.113 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:03.979 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:03.979 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:03.981 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:03.981 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:04.115 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:04.115 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:04.116 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:04.116 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:04.981 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:04.981 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:04.983 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:04.983 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:05.117 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:05.117 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:05.119 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:05.119 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:05.984 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:05.984 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:05.986 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:05.986 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:06.120 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:06.120 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:06.121 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:06.121 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:06.988 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:06.988 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:06.990 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:06.990 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:07.122 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:07.122 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:07.123 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:07.123 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:07.990 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:07.990 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:07.993 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:07.993 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:08.125 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:08.125 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:08.126 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:08.126 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:08.993 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:08.993 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:08.995 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:08.995 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:09.127 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:09.127 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:09.129 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:09.129 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:09.996 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:09.996 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:09.998 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:09.998 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:10.129 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:10.129 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:10.131 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:10.131 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:10.999 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:10.999 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:11.001 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:11.001 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:11.131 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:11.132 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:11.133 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:11.133 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:12.002 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:12.002 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:12.004 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:12.004 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:12.134 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:12.134 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:12.135 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:12.136 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:13.005 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:13.005 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:13.007 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:13.007 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:13.137 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:13.137 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:13.138 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:13.138 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:14.008 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:14.008 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:14.010 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:14.010 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:14.140 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:14.140 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:14.141 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:14.141 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:15.012 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:15.012 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:15.014 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:15.014 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:15.142 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:15.142 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:15.143 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:15.143 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:16.015 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:16.015 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:16.021 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:16.021 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:16.145 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:16.145 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:16.147 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:16.147 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:17.021 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:17.021 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:17.023 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:17.023 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:17.148 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:17.148 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:17.150 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:17.150 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:18.024 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:18.024 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:18.026 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:18.026 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:18.151 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:18.151 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:18.152 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:18.152 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:19.028 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:19.028 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:19.030 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:19.030 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:19.153 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:19.153 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:19.154 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:19.154 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:19.480 ERROR chirpstack::api::internal: Reading event-log returned error: timed out waiting for connection
Sep 09 04:28:19.480 TRACE chirpstack::api::internal: DropReceiver drop method called
Sep 09 04:28:20.030 TRACE chirpstack::downlink::scheduler: Starting class_b_c_scheduler_loop run
Sep 09 04:28:20.030 TRACE chirpstack::downlink::scheduler: Getting devices that have schedulable queue-items
Sep 09 04:28:20.032 TRACE chirpstack::downlink::scheduler: Got this number of devices with schedulable queue-items device_count=0
Sep 09 04:28:20.032 TRACE chirpstack::downlink::scheduler: class_b_c_scheduler_loop completed successfully
Sep 09 04:28:20.156 TRACE chirpstack::downlink::scheduler: Starting multicast-group queue scheduler loop run
Sep 09 04:28:20.156 TRACE chirpstack::downlink::scheduler: Getting schedulable multicast-group queue items
Sep 09 04:28:20.157 TRACE chirpstack::downlink::scheduler: Got this number of multicast-group queue items count=0
Sep 09 04:28:20.157 TRACE chirpstack::downlink::scheduler: Multicast-group queue scheduler run completed successfully
Sep 09 04:28:20.520 ERROR chirpstack::uplink: Deduplication error error=timed out waiting for connection
Sep 09 04:28:20.520 ERROR chirpstack::gateway::backend::mqtt: Processing gateway event error: timed out waiting for connection topic="as923/gateway/ac1f09fffe015ed3/event/up" qos=0

my docker-compose.yml

version: "3"

services:
  chirpstack:
    image: chirpstack/chirpstack:4.0.0-rc.4
    command: -c /etc/chirpstack
    restart: unless-stopped
    volumes:
      - ./configuration/chirpstack:/etc/chirpstack
      - ./lorawan-devices:/opt/lorawan-devices
    depends_on:
      - postgres
      - mosquitto
      - redis
    ports:
      - 8080:8080

  chirpstack-gateway-bridge-as923:
    image: chirpstack/chirpstack-gateway-bridge:4.0.0-rc.2
    ports:
      - 1700:1700/udp
    volumes:
      - ./configuration/chirpstack-gateway-bridge:/etc/chirpstack-gateway-bridge
    depends_on: 
      - mosquitto

  chirpstack-rest-api:
    image: chirpstack/chirpstack-rest-api:4.0.0-rc.1
    command: --server chirpstack:8080 --bind 0.0.0.0:8090 --insecure
    ports:
      - 8090:8090
    depends_on:
      - chirpstack

  postgres:
    image: postgres:9.6-alpine
    volumes:
      - ./configuration/postgresql/initdb:/docker-entrypoint-initdb.d
      - postgresqldata:/var/lib/postgresql/data
    environment:
      - POSTGRES_PASSWORD=root

  redis:
    image: redis:5-alpine
    volumes:
      - redisdata:/data

  mosquitto:
    image: eclipse-mosquitto:2
    ports:
      - 1883:1883
    volumes: 
      - ./configuration/mosquitto/mosquitto.conf:/mosquitto/config/mosquitto.conf
      - ./configuration/mosquitto/acl:/mosquitto/acl
      - ./configuration/mosquitto/passwd:/mosquitto/passwd

volumes:
  postgresqldata:
  redisdata:
@brocaar
Copy link
Contributor

brocaar commented Sep 10, 2022

Looks like ChirpStack gets stuck on waiting for a Redis connection:

timed out waiting for connection

Have you inspected your Redis logs?

@hd10180
Copy link
Author

hd10180 commented Sep 10, 2022 •
edited
Loading

Looks like ChirpStack gets stuck on waiting for a Redis connection:

timed out waiting for connection

Have you inspected your Redis logs?

thanks your reply.
redis logs looks nothing abnormal.

here are the redis logs when the error occured

docker logs --since '2022-09-09T12:25:05.999999999' --until='2022-09-09T12:29:05.999999999' 79
1:M 09 Sep 2022 04:25:49.381 * 10000 changes in 60 seconds. Saving...
1:M 09 Sep 2022 04:25:49.382 * Background saving started by pid 86
86:C 09 Sep 2022 04:25:49.386 * DB saved on disk
86:C 09 Sep 2022 04:25:49.386 * RDB: 0 MB of memory used by copy-on-write
1:M 09 Sep 2022 04:25:49.482 * Background saving terminated with success

@lawrencedudley
Copy link

@hd10180 try changing the redis image to image: redis:6-alpine

@brocaar
Copy link
Contributor

brocaar commented Sep 28, 2022

I have found the issue and the above commit fixes this. I'll release a bugfix release soon. Thanks for reporting 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@brocaar @lawrencedudley @hd10180