Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

All Modules Failing to GetTwinAsync #3382

Closed
ejectbutton opened this issue Aug 10, 2020 · 5 comments
Closed

All Modules Failing to GetTwinAsync #3382

ejectbutton opened this issue Aug 10, 2020 · 5 comments
Assignees
@damonbarry
Labels
customer-reported iotedge

Comments

@ejectbutton
Copy link

Expected Behavior

When my modules attempt to get their DeviceTwin through GetTwinAsync, they're able to pull down their device twin successfully.

Current Behavior

All modules besides edgeAgent & edgeHub on my machine sit for 4-5 minutes until returning an IoTHubCommunicationException: Transient network error occurred, please retry. As well as SocketExpection (11001)L No such host is known.

Steps to Reproduce

Provide a detailed set of steps to reproduce the bug.

  1. Restart all modules
  2. View logs on modules
  3. Wait 4-5 minutes
  4. See that all modules are now in Failed state
  5. Check logs, see various exceptions

Context (Environment)

Output of iotedge check

Click here 

Configuration checks
--------------------
√ config.yaml is well-formed - OK
√ config.yaml has well-formed connection string - OK
√ container engine is installed and functional - OK
√ Windows host version is supported - OK
√ config.yaml has correct hostname - OK
√ config.yaml has correct URIs for daemon mgmt endpoint - OK
√ latest security daemon - OK
√ host time is close to real time - OK
√ container time is close to host time - OK
√ DNS server - OK
‼ production readiness: certificates - Warning
    The Edge device is using self-signed automatically-generated development certificates.
    They will expire in 89 days (at 2020-11-08 16:44:21 UTC) causing module-to-module and downstream device communication to fail on an active deployment.
    After the certs have expired, restarting the IoT Edge daemon will trigger it to generate new development certs.
    Please consider using production certificates instead. See https://aka.ms/iotedge-prod-checklist-certs for best practices.
√ production readiness: container engine - OK
√ production readiness: logs policy - OK
√ production readiness: Edge Agent's storage directory is persisted on the host filesystem - OK
√ production readiness: Edge Hub's storage directory is persisted on the host filesystem - OK

Connectivity checks
-------------------
√ host can connect to and perform TLS handshake with IoT Hub AMQP port - OK
√ host can connect to and perform TLS handshake with IoT Hub HTTPS / WebSockets port - OK
√ host can connect to and perform TLS handshake with IoT Hub MQTT port - OK
√ container on the IoT Edge module network can connect to IoT Hub AMQP port - OK
√ container on the IoT Edge module network can connect to IoT Hub HTTPS / WebSockets port - OK
√ container on the IoT Edge module network can connect to IoT Hub MQTT port - OK

20 check(s) succeeded.
1 check(s) raised warnings. Re-run with --verbose for more details.

Device Information

  • Host OS [e.g. Ubuntu 16.04, Ubuntu 18.04, Windows IoT Core]: Windows 10 Enterprise LTSC
  • Architecture [e.g. amd64, arm32, arm64]: x64-based
  • Container OS [e.g. Linux containers, Windows containers]: Windows

Runtime Versions

  • iotedged [run iotedge version]: 1.0.9.4
  • Edge Agent [image tag (e.g. 1.0.0)]: 1.0.9
  • Edge Hub [image tag (e.g. 1.0.0)]: 1.0.9
  • Docker/Moby [run docker version]: 19.03.12

Note: when using Windows containers on Windows, run docker -H npipe:////./pipe/iotedge_moby_engine version instead

Logs

iotedged logs 

What is iotedged logs? running iotedged doesn't do anything
edge-agent logs 

        █████╗ ███████╗██╗   ██╗██████╗ ███████╗
       ██╔══██╗╚══███╔╝██║   ██║██╔══██╗██╔════╝
       ███████║  ███╔╝ ██║   ██║██████╔╝█████╗
       ██╔══██║ ███╔╝  ██║   ██║██╔══██╗██╔══╝
       ██║  ██║███████╗╚██████╔╝██║  ██║███████╗
       ╚═╝  ╚═╝╚══════╝ ╚═════╝ ╚═╝  ╚═╝╚══════╝

 ██╗ ██████╗ ████████╗    ███████╗██████╗  ██████╗ ███████╗
 ██║██╔═══██╗╚══██╔══╝    ██╔════╝██╔══██╗██╔════╝ ██╔════╝
 ██║██║   ██║   ██║       █████╗  ██║  ██║██║  ███╗█████╗
 ██║██║   ██║   ██║       ██╔══╝  ██║  ██║██║   ██║██╔══╝
 ██║╚██████╔╝   ██║       ███████╗██████╔╝╚██████╔╝███████╗
 ╚═╝ ╚═════╝    ╚═╝       ╚══════╝╚═════╝  ╚═════╝ ╚══════╝

<6> 2020-08-10 10:35:59.887 -07:00 [INF] - Experimental features configuration: {"Enabled":false,"DisableCloudSubscriptions":false,"EnableUploadLogs":false,"EnableGetLogs":false,"EnableMetrics":false}
<6> 2020-08-10 10:36:00.007 -07:00 [INF] - Installing certificates [CN=Test Edge Owner CA:11/8/2020 8:44:21 AM] to CertificateAuthority
<6> 2020-08-10 10:36:00.344 -07:00 [INF] - Created persistent store at C:\files\artifacts\edgeAgent
<6> 2020-08-10 10:36:00.397 -07:00 [INF] - Started operation refresh twin config
<6> 2020-08-10 10:36:00.415 -07:00 [INF] - Edge agent attempting to connect to IoT Hub via Amqp_Tcp_Only...
<6> 2020-08-10 10:36:00.446 -07:00 [INF] - Registering request handler RestartModule
<6> 2020-08-10 10:36:01.470 -07:00 [INF] - Edge agent connected to IoT Hub via Amqp_Tcp_Only.
<6> 2020-08-10 10:36:01.685 -07:00 [INF] - Initialized new module client with subscriptions enabled
<6> 2020-08-10 10:36:01.811 -07:00 [INF] - Obtained Edge agent twin from IoTHub with desired properties version 474 and reported properties version 3377.
<6> 2020-08-10 10:36:03.928 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:45s left).
<6> 2020-08-10 10:36:03.928 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:54s left).
<6> 2020-08-10 10:36:03.928 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:45s left).
<6> 2020-08-10 10:36:03.928 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:45s left).
<6> 2020-08-10 10:36:03.928 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:45s left).
<6> 2020-08-10 10:36:03.928 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:45s left).
<6> 2020-08-10 10:36:04.196 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:36:09.224 -07:00 [INF] - Module 'edgeHub' scheduled to restart after 20s (14s left).
<6> 2020-08-10 10:36:09.224 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:40s left).
<6> 2020-08-10 10:36:09.426 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:36:14.428 -07:00 [INF] - Module 'edgeHub' scheduled to restart after 20s (09s left).
<6> 2020-08-10 10:36:14.626 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:36:19.651 -07:00 [INF] - Module 'edgeHub' scheduled to restart after 20s (04s left).
<6> 2020-08-10 10:36:24.690 -07:00 [INF] - Plan execution started for deployment 474
<6> 2020-08-10 10:36:24.694 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module edgeHub]\n  [Start module edgeHub]\n  [Saving edgeHub to store]\n)"
<6> 2020-08-10 10:36:24.700 -07:00 [INF] - Executing command: "Stop module edgeHub"
<6> 2020-08-10 10:36:24.726 -07:00 [INF] - Executing command: "Start module edgeHub"
<6> 2020-08-10 10:36:25.247 -07:00 [INF] - Executing command: "Saving edgeHub to store"
<6> 2020-08-10 10:36:25.256 -07:00 [INF] - Plan execution ended for deployment 474
<6> 2020-08-10 10:36:30.531 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:40:11.576 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:56s left).
<6> 2020-08-10 10:40:11.576 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:59s left).
<6> 2020-08-10 10:40:11.576 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:58s left).
<6> 2020-08-10 10:40:11.576 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:57s left).
<6> 2020-08-10 10:40:11.792 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:40:16.795 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:51s left).
<6> 2020-08-10 10:40:16.795 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:59s left).
<6> 2020-08-10 10:40:16.795 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:54s left).
<6> 2020-08-10 10:40:16.795 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:52s left).
<6> 2020-08-10 10:40:16.795 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:52s left).
<6> 2020-08-10 10:40:16.982 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:40:21.995 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:46s left).
<6> 2020-08-10 10:40:21.995 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:53s left).
<6> 2020-08-10 10:40:21.995 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:49s left).
<6> 2020-08-10 10:40:21.995 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:47s left).
<6> 2020-08-10 10:40:21.995 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:47s left).
<6> 2020-08-10 10:40:21.995 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:55s left).
<6> 2020-08-10 10:40:22.186 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:40:27.206 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:41s left).
<6> 2020-08-10 10:40:27.206 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:48s left).
<6> 2020-08-10 10:40:27.206 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:43s left).
<6> 2020-08-10 10:40:27.206 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:42s left).
<6> 2020-08-10 10:40:27.206 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:41s left).
<6> 2020-08-10 10:40:27.206 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:49s left).
<6> 2020-08-10 10:40:32.234 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:36s left).
<6> 2020-08-10 10:40:32.234 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:43s left).
<6> 2020-08-10 10:40:32.234 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:38s left).
<6> 2020-08-10 10:40:32.234 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:37s left).
<6> 2020-08-10 10:40:32.234 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:36s left).
<6> 2020-08-10 10:40:32.234 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:44s left).
<6> 2020-08-10 10:40:37.278 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:31s left).
<6> 2020-08-10 10:40:37.278 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:38s left).
<6> 2020-08-10 10:40:37.278 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:33s left).
<6> 2020-08-10 10:40:37.278 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:32s left).
<6> 2020-08-10 10:40:37.278 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:31s left).
<6> 2020-08-10 10:40:37.278 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:39s left).
<6> 2020-08-10 10:40:42.310 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:26s left).
<6> 2020-08-10 10:40:42.310 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:33s left).
<6> 2020-08-10 10:40:42.310 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:28s left).
<6> 2020-08-10 10:40:42.310 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:27s left).
<6> 2020-08-10 10:40:42.310 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:26s left).
<6> 2020-08-10 10:40:42.310 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:34s left).
<6> 2020-08-10 10:40:47.330 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:21s left).
<6> 2020-08-10 10:40:47.330 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:28s left).
<6> 2020-08-10 10:40:47.330 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:23s left).
<6> 2020-08-10 10:40:47.330 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:22s left).
<6> 2020-08-10 10:40:47.330 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:21s left).
<6> 2020-08-10 10:40:47.330 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:29s left).
<6> 2020-08-10 10:40:52.355 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:16s left).
<6> 2020-08-10 10:40:52.355 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:23s left).
<6> 2020-08-10 10:40:52.355 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:18s left).
<6> 2020-08-10 10:40:52.355 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:17s left).
<6> 2020-08-10 10:40:52.355 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:16s left).
<6> 2020-08-10 10:40:52.355 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:24s left).
<6> 2020-08-10 10:40:57.383 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:11s left).
<6> 2020-08-10 10:40:57.383 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:18s left).
<6> 2020-08-10 10:40:57.383 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:13s left).
<6> 2020-08-10 10:40:57.383 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:12s left).
<6> 2020-08-10 10:40:57.383 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:11s left).
<6> 2020-08-10 10:40:57.383 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:19s left).
<6> 2020-08-10 10:41:02.395 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:06s left).
<6> 2020-08-10 10:41:02.395 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:13s left).
<6> 2020-08-10 10:41:02.395 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:08s left).
<6> 2020-08-10 10:41:02.395 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:07s left).
<6> 2020-08-10 10:41:02.395 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:06s left).
<6> 2020-08-10 10:41:02.395 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:14s left).
<6> 2020-08-10 10:41:07.417 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04m:00s left).
<6> 2020-08-10 10:41:07.417 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:08s left).
<6> 2020-08-10 10:41:07.417 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (04m:03s left).
<6> 2020-08-10 10:41:07.417 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (04m:02s left).
<6> 2020-08-10 10:41:07.417 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (04m:01s left).
<6> 2020-08-10 10:41:07.417 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:09s left).
<6> 2020-08-10 10:41:12.441 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:55s left).
<6> 2020-08-10 10:41:12.441 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (04m:03s left).
<6> 2020-08-10 10:41:12.441 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:58s left).
<6> 2020-08-10 10:41:12.441 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:57s left).
<6> 2020-08-10 10:41:12.441 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:56s left).
<6> 2020-08-10 10:41:12.441 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (04m:04s left).
<6> 2020-08-10 10:41:17.470 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:50s left).
<6> 2020-08-10 10:41:17.470 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:58s left).
<6> 2020-08-10 10:41:17.470 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:53s left).
<6> 2020-08-10 10:41:17.470 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:52s left).
<6> 2020-08-10 10:41:17.471 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:51s left).
<6> 2020-08-10 10:41:17.471 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:59s left).
<6> 2020-08-10 10:41:22.496 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:45s left).
<6> 2020-08-10 10:41:22.496 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:53s left).
<6> 2020-08-10 10:41:22.496 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:48s left).
<6> 2020-08-10 10:41:22.496 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:47s left).
<6> 2020-08-10 10:41:22.496 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:46s left).
<6> 2020-08-10 10:41:22.496 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:54s left).
<6> 2020-08-10 10:41:27.512 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:40s left).
<6> 2020-08-10 10:41:27.512 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:48s left).
<6> 2020-08-10 10:41:27.512 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:43s left).
<6> 2020-08-10 10:41:27.512 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:42s left).
<6> 2020-08-10 10:41:27.512 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:41s left).
<6> 2020-08-10 10:41:27.512 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:49s left).
<6> 2020-08-10 10:41:32.540 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:35s left).
<6> 2020-08-10 10:41:32.540 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:43s left).
<6> 2020-08-10 10:41:32.540 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:38s left).
<6> 2020-08-10 10:41:32.540 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:37s left).
<6> 2020-08-10 10:41:32.540 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:36s left).
<6> 2020-08-10 10:41:32.540 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:44s left).
<6> 2020-08-10 10:41:37.568 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:30s left).
<6> 2020-08-10 10:41:37.568 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:38s left).
<6> 2020-08-10 10:41:37.568 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:33s left).
<6> 2020-08-10 10:41:37.568 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:32s left).
<6> 2020-08-10 10:41:37.568 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:31s left).
<6> 2020-08-10 10:41:37.568 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:39s left).
<6> 2020-08-10 10:41:42.595 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:25s left).
<6> 2020-08-10 10:41:42.595 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:33s left).
<6> 2020-08-10 10:41:42.595 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:28s left).
<6> 2020-08-10 10:41:42.595 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:27s left).
<6> 2020-08-10 10:41:42.595 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:26s left).
<6> 2020-08-10 10:41:42.595 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:34s left).
<6> 2020-08-10 10:41:47.628 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:20s left).
<6> 2020-08-10 10:41:47.628 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:28s left).
<6> 2020-08-10 10:41:47.628 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:23s left).
<6> 2020-08-10 10:41:47.628 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:22s left).
<6> 2020-08-10 10:41:47.628 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:21s left).
<6> 2020-08-10 10:41:47.628 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:29s left).
<6> 2020-08-10 10:41:52.650 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:15s left).
<6> 2020-08-10 10:41:52.650 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:23s left).
<6> 2020-08-10 10:41:52.650 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:18s left).
<6> 2020-08-10 10:41:52.650 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:17s left).
<6> 2020-08-10 10:41:52.650 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:16s left).
<6> 2020-08-10 10:41:52.650 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:24s left).
<6> 2020-08-10 10:41:57.692 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:10s left).
<6> 2020-08-10 10:41:57.692 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:18s left).
<6> 2020-08-10 10:41:57.692 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:13s left).
<6> 2020-08-10 10:41:57.692 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:12s left).
<6> 2020-08-10 10:41:57.692 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:11s left).
<6> 2020-08-10 10:41:57.692 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:19s left).
<6> 2020-08-10 10:42:02.705 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:05s left).
<6> 2020-08-10 10:42:02.705 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:13s left).
<6> 2020-08-10 10:42:02.705 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:08s left).
<6> 2020-08-10 10:42:02.705 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:07s left).
<6> 2020-08-10 10:42:02.705 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:06s left).
<6> 2020-08-10 10:42:02.705 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:14s left).
<6> 2020-08-10 10:42:07.731 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (03m:00s left).
<6> 2020-08-10 10:42:07.731 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:08s left).
<6> 2020-08-10 10:42:07.731 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (03m:03s left).
<6> 2020-08-10 10:42:07.731 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (03m:02s left).
<6> 2020-08-10 10:42:07.731 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (03m:01s left).
<6> 2020-08-10 10:42:07.731 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:09s left).
<6> 2020-08-10 10:42:12.753 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:55s left).
<6> 2020-08-10 10:42:12.753 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (03m:03s left).
<6> 2020-08-10 10:42:12.753 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:58s left).
<6> 2020-08-10 10:42:12.753 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:57s left).
<6> 2020-08-10 10:42:12.753 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:56s left).
<6> 2020-08-10 10:42:12.753 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (03m:04s left).
<6> 2020-08-10 10:42:17.775 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:50s left).
<6> 2020-08-10 10:42:17.775 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:58s left).
<6> 2020-08-10 10:42:17.775 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:53s left).
<6> 2020-08-10 10:42:17.775 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:51s left).
<6> 2020-08-10 10:42:17.775 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:51s left).
<6> 2020-08-10 10:42:17.775 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:59s left).
<6> 2020-08-10 10:42:22.807 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:45s left).
<6> 2020-08-10 10:42:22.807 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:53s left).
<6> 2020-08-10 10:42:22.807 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:48s left).
<6> 2020-08-10 10:42:22.807 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:46s left).
<6> 2020-08-10 10:42:22.807 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:46s left).
<6> 2020-08-10 10:42:22.807 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:54s left).
<6> 2020-08-10 10:42:27.825 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:40s left).
<6> 2020-08-10 10:42:27.825 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:48s left).
<6> 2020-08-10 10:42:27.825 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:43s left).
<6> 2020-08-10 10:42:27.825 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:41s left).
<6> 2020-08-10 10:42:27.825 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:41s left).
<6> 2020-08-10 10:42:27.825 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:49s left).
<6> 2020-08-10 10:42:32.852 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:35s left).
<6> 2020-08-10 10:42:32.852 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:42s left).
<6> 2020-08-10 10:42:32.852 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:38s left).
<6> 2020-08-10 10:42:32.852 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:36s left).
<6> 2020-08-10 10:42:32.852 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:36s left).
<6> 2020-08-10 10:42:32.852 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:44s left).
<6> 2020-08-10 10:42:37.863 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:30s left).
<6> 2020-08-10 10:42:37.863 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:37s left).
<6> 2020-08-10 10:42:37.863 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:33s left).
<6> 2020-08-10 10:42:37.863 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:31s left).
<6> 2020-08-10 10:42:37.863 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:31s left).
<6> 2020-08-10 10:42:37.863 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:39s left).
<6> 2020-08-10 10:42:42.882 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:25s left).
<6> 2020-08-10 10:42:42.882 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:32s left).
<6> 2020-08-10 10:42:42.882 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:28s left).
<6> 2020-08-10 10:42:42.882 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:26s left).
<6> 2020-08-10 10:42:42.882 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:26s left).
<6> 2020-08-10 10:42:42.883 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:34s left).
<6> 2020-08-10 10:42:47.904 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:20s left).
<6> 2020-08-10 10:42:47.904 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:27s left).
<6> 2020-08-10 10:42:47.904 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:23s left).
<6> 2020-08-10 10:42:47.904 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:21s left).
<6> 2020-08-10 10:42:47.904 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:21s left).
<6> 2020-08-10 10:42:47.904 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:29s left).
<6> 2020-08-10 10:42:52.928 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:15s left).
<6> 2020-08-10 10:42:52.928 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:22s left).
<6> 2020-08-10 10:42:52.928 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:18s left).
<6> 2020-08-10 10:42:52.928 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:16s left).
<6> 2020-08-10 10:42:52.928 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:16s left).
<6> 2020-08-10 10:42:52.928 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:24s left).
<6> 2020-08-10 10:42:57.959 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:10s left).
<6> 2020-08-10 10:42:57.959 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:17s left).
<6> 2020-08-10 10:42:57.959 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:13s left).
<6> 2020-08-10 10:42:57.959 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:11s left).
<6> 2020-08-10 10:42:57.959 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:11s left).
<6> 2020-08-10 10:42:57.959 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:19s left).
<6> 2020-08-10 10:43:02.983 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:05s left).
<6> 2020-08-10 10:43:02.983 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:12s left).
<6> 2020-08-10 10:43:02.983 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:08s left).
<6> 2020-08-10 10:43:02.983 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:06s left).
<6> 2020-08-10 10:43:02.983 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:06s left).
<6> 2020-08-10 10:43:02.983 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:14s left).
<6> 2020-08-10 10:43:08.002 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (02m:00s left).
<6> 2020-08-10 10:43:08.003 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:07s left).
<6> 2020-08-10 10:43:08.003 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02m:03s left).
<6> 2020-08-10 10:43:08.003 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (02m:01s left).
<6> 2020-08-10 10:43:08.003 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (02m:01s left).
<6> 2020-08-10 10:43:08.003 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:09s left).
<6> 2020-08-10 10:43:13.024 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:55s left).
<6> 2020-08-10 10:43:13.024 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (02m:02s left).
<6> 2020-08-10 10:43:13.024 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:57s left).
<6> 2020-08-10 10:43:13.024 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:56s left).
<6> 2020-08-10 10:43:13.024 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:56s left).
<6> 2020-08-10 10:43:13.024 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02m:03s left).
<6> 2020-08-10 10:43:18.061 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:50s left).
<6> 2020-08-10 10:43:18.061 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:57s left).
<6> 2020-08-10 10:43:18.061 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:52s left).
<6> 2020-08-10 10:43:18.061 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:51s left).
<6> 2020-08-10 10:43:18.061 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:51s left).
<6> 2020-08-10 10:43:18.061 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:58s left).
<6> 2020-08-10 10:43:23.087 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:45s left).
<6> 2020-08-10 10:43:23.087 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:52s left).
<6> 2020-08-10 10:43:23.087 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:47s left).
<6> 2020-08-10 10:43:23.087 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:46s left).
<6> 2020-08-10 10:43:23.087 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:45s left).
<6> 2020-08-10 10:43:23.087 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:53s left).
<6> 2020-08-10 10:43:28.103 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:40s left).
<6> 2020-08-10 10:43:28.103 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:47s left).
<6> 2020-08-10 10:43:28.103 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:42s left).
<6> 2020-08-10 10:43:28.103 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:41s left).
<6> 2020-08-10 10:43:28.103 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:40s left).
<6> 2020-08-10 10:43:28.103 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:48s left).
<6> 2020-08-10 10:43:33.133 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:35s left).
<6> 2020-08-10 10:43:33.133 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:42s left).
<6> 2020-08-10 10:43:33.133 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:37s left).
<6> 2020-08-10 10:43:33.133 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:36s left).
<6> 2020-08-10 10:43:33.133 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:35s left).
<6> 2020-08-10 10:43:33.133 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:43s left).
<6> 2020-08-10 10:43:38.166 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:30s left).
<6> 2020-08-10 10:43:38.166 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:37s left).
<6> 2020-08-10 10:43:38.166 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:32s left).
<6> 2020-08-10 10:43:38.166 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:31s left).
<6> 2020-08-10 10:43:38.166 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:30s left).
<6> 2020-08-10 10:43:38.166 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:38s left).
<6> 2020-08-10 10:43:43.176 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:25s left).
<6> 2020-08-10 10:43:43.176 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:32s left).
<6> 2020-08-10 10:43:43.176 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:27s left).
<6> 2020-08-10 10:43:43.176 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:26s left).
<6> 2020-08-10 10:43:43.176 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:25s left).
<6> 2020-08-10 10:43:43.176 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:33s left).
<6> 2020-08-10 10:43:48.202 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:20s left).
<6> 2020-08-10 10:43:48.202 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:27s left).
<6> 2020-08-10 10:43:48.202 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:22s left).
<6> 2020-08-10 10:43:48.202 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:21s left).
<6> 2020-08-10 10:43:48.202 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:20s left).
<6> 2020-08-10 10:43:48.202 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:28s left).
<6> 2020-08-10 10:43:53.224 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:15s left).
<6> 2020-08-10 10:43:53.224 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:22s left).
<6> 2020-08-10 10:43:53.224 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:17s left).
<6> 2020-08-10 10:43:53.224 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:16s left).
<6> 2020-08-10 10:43:53.224 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:15s left).
<6> 2020-08-10 10:43:53.224 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:23s left).
<6> 2020-08-10 10:43:58.244 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:10s left).
<6> 2020-08-10 10:43:58.244 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:17s left).
<6> 2020-08-10 10:43:58.244 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:12s left).
<6> 2020-08-10 10:43:58.244 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:11s left).
<6> 2020-08-10 10:43:58.244 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:10s left).
<6> 2020-08-10 10:43:58.244 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:18s left).
<6> 2020-08-10 10:44:03.271 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:05s left).
<6> 2020-08-10 10:44:03.272 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:12s left).
<6> 2020-08-10 10:44:03.272 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:07s left).
<6> 2020-08-10 10:44:03.272 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:06s left).
<6> 2020-08-10 10:44:03.272 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:05s left).
<6> 2020-08-10 10:44:03.272 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:13s left).
<6> 2020-08-10 10:44:08.297 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (01m:00s left).
<6> 2020-08-10 10:44:08.297 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:07s left).
<6> 2020-08-10 10:44:08.297 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (01m:02s left).
<6> 2020-08-10 10:44:08.297 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01m:01s left).
<6> 2020-08-10 10:44:08.297 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (01m:00s left).
<6> 2020-08-10 10:44:08.297 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:08s left).
<6> 2020-08-10 10:44:13.324 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (55s left).
<6> 2020-08-10 10:44:13.324 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01m:02s left).
<6> 2020-08-10 10:44:13.324 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (57s left).
<6> 2020-08-10 10:44:13.324 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (56s left).
<6> 2020-08-10 10:44:13.324 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (55s left).
<6> 2020-08-10 10:44:13.324 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (01m:03s left).
<6> 2020-08-10 10:44:18.355 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (50s left).
<6> 2020-08-10 10:44:18.355 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (57s left).
<6> 2020-08-10 10:44:18.355 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (52s left).
<6> 2020-08-10 10:44:18.355 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (51s left).
<6> 2020-08-10 10:44:18.355 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (50s left).
<6> 2020-08-10 10:44:18.355 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (58s left).
<6> 2020-08-10 10:44:23.380 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (45s left).
<6> 2020-08-10 10:44:23.380 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (52s left).
<6> 2020-08-10 10:44:23.380 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (47s left).
<6> 2020-08-10 10:44:23.380 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (46s left).
<6> 2020-08-10 10:44:23.380 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (45s left).
<6> 2020-08-10 10:44:23.380 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (53s left).
<6> 2020-08-10 10:44:28.404 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (40s left).
<6> 2020-08-10 10:44:28.404 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (47s left).
<6> 2020-08-10 10:44:28.404 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (42s left).
<6> 2020-08-10 10:44:28.404 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (41s left).
<6> 2020-08-10 10:44:28.404 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (40s left).
<6> 2020-08-10 10:44:28.404 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (48s left).
<6> 2020-08-10 10:44:33.427 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (34s left).
<6> 2020-08-10 10:44:33.427 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (42s left).
<6> 2020-08-10 10:44:33.427 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (37s left).
<6> 2020-08-10 10:44:33.427 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (36s left).
<6> 2020-08-10 10:44:33.427 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (35s left).
<6> 2020-08-10 10:44:33.427 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (43s left).
<6> 2020-08-10 10:44:38.460 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (29s left).
<6> 2020-08-10 10:44:38.460 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (37s left).
<6> 2020-08-10 10:44:38.460 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (32s left).
<6> 2020-08-10 10:44:38.460 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (31s left).
<6> 2020-08-10 10:44:38.460 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (30s left).
<6> 2020-08-10 10:44:38.460 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (38s left).
<6> 2020-08-10 10:44:43.487 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (24s left).
<6> 2020-08-10 10:44:43.487 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (32s left).
<6> 2020-08-10 10:44:43.487 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (27s left).
<6> 2020-08-10 10:44:43.487 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (26s left).
<6> 2020-08-10 10:44:43.487 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (25s left).
<6> 2020-08-10 10:44:43.487 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (33s left).
<6> 2020-08-10 10:44:48.508 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (19s left).
<6> 2020-08-10 10:44:48.508 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (27s left).
<6> 2020-08-10 10:44:48.508 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (22s left).
<6> 2020-08-10 10:44:48.508 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (21s left).
<6> 2020-08-10 10:44:48.508 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (20s left).
<6> 2020-08-10 10:44:48.508 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (28s left).
<6> 2020-08-10 10:44:53.538 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (14s left).
<6> 2020-08-10 10:44:53.538 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (22s left).
<6> 2020-08-10 10:44:53.538 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (17s left).
<6> 2020-08-10 10:44:53.538 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (16s left).
<6> 2020-08-10 10:44:53.538 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (15s left).
<6> 2020-08-10 10:44:53.538 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (23s left).
<6> 2020-08-10 10:44:58.555 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (09s left).
<6> 2020-08-10 10:44:58.556 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (17s left).
<6> 2020-08-10 10:44:58.556 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (12s left).
<6> 2020-08-10 10:44:58.556 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (11s left).
<6> 2020-08-10 10:44:58.556 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (10s left).
<6> 2020-08-10 10:44:58.556 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (18s left).
<6> 2020-08-10 10:45:03.577 -07:00 [INF] - Module 'tcplistenermodule-events' scheduled to restart after 05m:00s (04s left).
<6> 2020-08-10 10:45:03.577 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (12s left).
<6> 2020-08-10 10:45:03.577 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (07s left).
<6> 2020-08-10 10:45:03.577 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (06s left).
<6> 2020-08-10 10:45:03.577 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (05s left).
<6> 2020-08-10 10:45:03.577 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (13s left).
<6> 2020-08-10 10:45:08.599 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (07s left).
<6> 2020-08-10 10:45:08.599 -07:00 [INF] - Module 'localblobstorage' scheduled to restart after 05m:00s (02s left).
<6> 2020-08-10 10:45:08.599 -07:00 [INF] - Module 'tcplistenermodule' scheduled to restart after 05m:00s (01s left).
<6> 2020-08-10 10:45:08.599 -07:00 [INF] - Module 'fileuploadmodule' scheduled to restart after 05m:00s (00s left).
<6> 2020-08-10 10:45:08.599 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (08s left).
<6> 2020-08-10 10:45:08.599 -07:00 [INF] - Plan execution started for deployment 474
<6> 2020-08-10 10:45:08.600 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module tcplistenermodule-events]\n  [Start module tcplistenermodule-events]\n  [Saving tcplistenermodule-events to store]\n)"
<6> 2020-08-10 10:45:08.600 -07:00 [INF] - Executing command: "Stop module tcplistenermodule-events"
<6> 2020-08-10 10:45:08.602 -07:00 [INF] - Executing command: "Start module tcplistenermodule-events"
<6> 2020-08-10 10:45:09.085 -07:00 [INF] - Executing command: "Saving tcplistenermodule-events to store"
<6> 2020-08-10 10:45:09.085 -07:00 [INF] - Plan execution ended for deployment 474
<6> 2020-08-10 10:45:14.124 -07:00 [INF] - Module 'forwardingmodule' scheduled to restart after 05m:00s (01s left).
<6> 2020-08-10 10:45:14.124 -07:00 [INF] - Module 'movetocloudstoragemodule' scheduled to restart after 05m:00s (02s left).
<6> 2020-08-10 10:45:14.125 -07:00 [INF] - Plan execution started for deployment 474
<6> 2020-08-10 10:45:14.125 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module localblobstorage]\n  [Start module localblobstorage]\n  [Saving localblobstorage to store]\n)"
<6> 2020-08-10 10:45:14.125 -07:00 [INF] - Executing command: "Stop module localblobstorage"
<6> 2020-08-10 10:45:14.127 -07:00 [INF] - Executing command: "Start module localblobstorage"
<6> 2020-08-10 10:45:14.627 -07:00 [INF] - Executing command: "Saving localblobstorage to store"
<6> 2020-08-10 10:45:14.627 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module tcplistenermodule]\n  [Start module tcplistenermodule]\n  [Saving tcplistenermodule to store]\n)"
<6> 2020-08-10 10:45:14.627 -07:00 [INF] - Executing command: "Stop module tcplistenermodule"
<6> 2020-08-10 10:45:14.628 -07:00 [INF] - Executing command: "Start module tcplistenermodule"
<6> 2020-08-10 10:45:15.153 -07:00 [INF] - Executing command: "Saving tcplistenermodule to store"
<6> 2020-08-10 10:45:15.153 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module fileuploadmodule]\n  [Start module fileuploadmodule]\n  [Saving fileuploadmodule to store]\n)"
<6> 2020-08-10 10:45:15.153 -07:00 [INF] - Executing command: "Stop module fileuploadmodule"
<6> 2020-08-10 10:45:15.155 -07:00 [INF] - Executing command: "Start module fileuploadmodule"
<6> 2020-08-10 10:45:15.811 -07:00 [INF] - Executing command: "Saving fileuploadmodule to store"
<6> 2020-08-10 10:45:15.812 -07:00 [INF] - Plan execution ended for deployment 474
<6> 2020-08-10 10:45:16.022 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:45:21.061 -07:00 [INF] - Plan execution started for deployment 474
<6> 2020-08-10 10:45:21.061 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module forwardingmodule]\n  [Start module forwardingmodule]\n  [Saving forwardingmodule to store]\n)"
<6> 2020-08-10 10:45:21.061 -07:00 [INF] - Executing command: "Stop module forwardingmodule"
<6> 2020-08-10 10:45:21.063 -07:00 [INF] - Executing command: "Start module forwardingmodule"
<6> 2020-08-10 10:45:21.543 -07:00 [INF] - Executing command: "Saving forwardingmodule to store"
<6> 2020-08-10 10:45:21.543 -07:00 [INF] - Executing command: "Command Group: (\n  [Stop module movetocloudstoragemodule]\n  [Start module movetocloudstoragemodule]\n  [Saving movetocloudstoragemodule to store]\n)"
<6> 2020-08-10 10:45:21.543 -07:00 [INF] - Executing command: "Stop module movetocloudstoragemodule"
<6> 2020-08-10 10:45:21.546 -07:00 [INF] - Executing command: "Start module movetocloudstoragemodule"
<6> 2020-08-10 10:45:22.137 -07:00 [INF] - Executing command: "Saving movetocloudstoragemodule to store"
<6> 2020-08-10 10:45:22.141 -07:00 [INF] - Plan execution ended for deployment 474
<6> 2020-08-10 10:45:22.361 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:45:27.573 -07:00 [INF] - Updated reported properties
<6> 2020-08-10 10:46:07.736 -07:00 [INF] - HealthRestartPlanner is clearing restart stats for module 'edgeHub' as it has been running healthy for 00:10:00.
<6> 2020-08-10 10:46:07.736 -07:00 [INF] - Plan execution started for deployment 474
<6> 2020-08-10 10:46:07.737 -07:00 [INF] - Executing command: "Saving edgeHub to store"
<6> 2020-08-10 10:46:07.739 -07:00 [INF] - Plan execution ended for deployment 474
<6> 2020-08-10 10:46:12.960 -07:00 [INF] - Updated reported properties
edge-hub logs 

        █████╗ ███████╗██╗   ██╗██████╗ ███████╗
       ██╔══██╗╚══███╔╝██║   ██║██╔══██╗██╔════╝
       ███████║  ███╔╝ ██║   ██║██████╔╝█████╗
       ██╔══██║ ███╔╝  ██║   ██║██╔══██╗██╔══╝
       ██║  ██║███████╗╚██████╔╝██║  ██║███████╗
       ╚═╝  ╚═╝╚══════╝ ╚═════╝ ╚═╝  ╚═╝╚══════╝

 ██╗ ██████╗ ████████╗    ███████╗██████╗  ██████╗ ███████╗
 ██║██╔═══██╗╚══██╔══╝    ██╔════╝██╔══██╗██╔════╝ ██╔════╝
 ██║██║   ██║   ██║       █████╗  ██║  ██║██║  ███╗█████╗
 ██║██║   ██║   ██║       ██╔══╝  ██║  ██║██║   ██║██╔══╝
 ██║╚██████╔╝   ██║       ███████╗██████╔╝╚██████╔╝███████╗
 ╚═╝ ╚═════╝    ╚═╝       ╚══════╝╚═════╝  ╚═════╝ ╚══════╝

<6> 2020-08-10 10:36:27.064 -07:00 [INF] - Version - 1.0.9.29532150 (1f7cf6a21dfa365c8f21475553c544f4df02dd44)
<6> 2020-08-10 10:36:27.064 -07:00 [INF] - OptimizeForPerformance=True
<6> 2020-08-10 10:36:27.066 -07:00 [INF] - Loaded server certificate with expiration date of "2020-11-08T08:44:21.0000000-08:00"
<6> 2020-08-10 10:36:27.103 -07:00 [INF] - Created new message store
<6> 2020-08-10 10:36:27.103 -07:00 [INF] - Started task to cleanup processed and stale messages
<6> 2020-08-10 10:36:27.173 -07:00 [INF] - Created DeviceConnectivityManager with connected check frequency 00:05:00 and disconnected check frequency 00:02:00
<6> 2020-08-10 10:36:27.198 -07:00 [INF] - Created device scope identities cache
<6> 2020-08-10 10:36:27.203 -07:00 [INF] - Starting refresh of device scope identities cache
<6> 2020-08-10 10:36:27.215 -07:00 [INF] - Initialized storing twin manager
<6> 2020-08-10 10:36:27.230 -07:00 [INF] - Initializing configuration
<6> 2020-08-10 10:36:27.249 -07:00 [INF] - New device connection for device Edge-EJ-1/$edgeHub
<6> 2020-08-10 10:36:27.259 -07:00 [INF] - Processing pending subscriptions for Edge-EJ-1/$edgeHub
<6> 2020-08-10 10:36:27.320 -07:00 [INF] - Attempting to connect to IoT Hub for client Edge-EJ-1/$edgeHub via AMQP...
<6> 2020-08-10 10:36:27.566 -07:00 [INF] - Created cloud endpoint iothub with max batch size 10 and fan-out factor of 10.
<6> 2020-08-10 10:36:27.705 -07:00 [INF] - Set the following 5 route(s) in edge hub
<6> 2020-08-10 10:36:27.705 -07:00 [INF] - TCPListenerModuleToForwardingModule: FROM /messages/modules/tcplistenermodule/outputs/* INTO BrokeredEndpoint("/modules/forwardingmodule/inputs/input1")
<6> 2020-08-10 10:36:27.705 -07:00 [INF] - ForwardingModuleToIoTHub: FROM /messages/modules/forwardingmodule/outputs/* INTO $upstream
<6> 2020-08-10 10:36:27.705 -07:00 [INF] - FileUploadEventToForwardingModule: FROM /messages/modules/fileuploadmodule/outputs/eventoutput INTO BrokeredEndpoint("/modules/forwardingmodule/inputs/input1")
<6> 2020-08-10 10:36:27.705 -07:00 [INF] - MoveToCloudStorageEventToForwardingModule: FROM /messages/modules/movetocloudstoragemodule/outputs/eventoutput INTO BrokeredEndpoint("/modules/forwardingmodule/inputs/input1")
<6> 2020-08-10 10:36:27.706 -07:00 [INF] - TCPListenerModuleEventsToForwardingModule: FROM /messages/modules/tcplistenermodule-events/outputs/* INTO BrokeredEndpoint("/modules/forwardingmodule/inputs/input1")
<6> 2020-08-10 10:36:27.707 -07:00 [INF] - Updated message store TTL to 7200 seconds
<6> 2020-08-10 10:36:27.708 -07:00 [INF] - Updated the edge hub store and forward configuration
<6> 2020-08-10 10:36:27.730 -07:00 [INF] - Started operation Get EdgeHub config
<6> 2020-08-10 10:36:27.730 -07:00 [INF] - Initialized edge hub configuration
<6> 2020-08-10 10:36:27.740 -07:00 [INF] - Starting timer to authenticate connections with a period of 300 seconds
<6> 2020-08-10 10:36:27.796 -07:00 [INF] - Scheduling server certificate renewal for "2020-11-08T08:41:51.0000555Z".
<6> 2020-08-10 10:36:27.798 -07:00 [INF] - Starting protocol heads - (MQTT, AMQP, HTTP)
<6> 2020-08-10 10:36:27.801 -07:00 [INF] - Starting MQTT head
<6> 2020-08-10 10:36:27.828 -07:00 [INF] - Initializing TLS endpoint on port 8883 for MQTT head.
<6> 2020-08-10 10:36:27.898 -07:00 [INF] - Starting AMQP head
<6> 2020-08-10 10:36:27.919 -07:00 [INF] - Started MQTT head
<6> 2020-08-10 10:36:27.980 -07:00 [INF] - Started AMQP head
<6> 2020-08-10 10:36:27.982 -07:00 [INF] - Starting HTTP head
<6> 2020-08-10 10:36:28.100 -07:00 [INF] - User profile is available. Using '"C:\\Users\\ContainerUser\\AppData\\Local\\ASP.NET\\DataProtection-Keys"' as key repository and Windows DPAPI to encrypt keys at rest.
<6> 2020-08-10 10:36:28.329 -07:00 [INF] - Exiting disconnected state
<6> 2020-08-10 10:36:28.332 -07:00 [INF] - Received device connected callback
<6> 2020-08-10 10:36:28.341 -07:00 [INF] - Device connected to cloud, processing subscriptions for connected clients.
<6> 2020-08-10 10:36:28.343 -07:00 [INF] - Processing subscriptions for client Edge-EJ-1/$edgeHub on device connected.
<6> 2020-08-10 10:36:28.351 -07:00 [INF] - Starting refresh of device scope identities cache
<6> 2020-08-10 10:36:28.359 -07:00 [INF] - Entering connected state
<6> 2020-08-10 10:36:28.362 -07:00 [INF] - Cloud connection for Edge-EJ-1/$edgeHub is True
<6> 2020-08-10 10:36:28.366 -07:00 [INF] - Connection status for Edge-EJ-1/$edgeHub changed to ConnectionEstablished
<6> 2020-08-10 10:36:28.368 -07:00 [INF] - Client Edge-EJ-1/$edgeHub connected to cloud, processing existing subscriptions.
<6> 2020-08-10 10:36:28.372 -07:00 [INF] - Created cloud proxy for client Edge-EJ-1/$edgeHub via AMQP, with client operation timeout 20 seconds.
<6> 2020-08-10 10:36:28.377 -07:00 [INF] - Initialized cloud proxy ccd50d63-547d-4aa0-9b67-d159ae0e03dc for Edge-EJ-1/$edgeHub
<6> 2020-08-10 10:36:28.378 -07:00 [INF] - Created cloud connection for client Edge-EJ-1/$edgeHub
<4> 2020-08-10 10:36:28.449 -07:00 [WRN] - Overriding address(es) '"http://+:80"'. Binding to endpoints defined in "UseKestrel()" instead.
<6> 2020-08-10 10:36:28.471 -07:00 [INF] - Started HTTP head
<6> 2020-08-10 10:36:28.640 -07:00 [INF] - Processing pending subscriptions for Edge-EJ-1/$edgeHub
<6> 2020-08-10 10:36:28.781 -07:00 [INF] - Updated reported properties for Edge-EJ-1/$edgeHub
<6> 2020-08-10 10:36:28.792 -07:00 [INF] - Obtained edge hub config from module twin
<6> 2020-08-10 10:36:32.383 -07:00 [INF] - Updated reported properties for Edge-EJ-1/$edgeHub
<6> 2020-08-10 10:41:27.753 -07:00 [INF] - Entering periodic task to reauthenticate connected clients
<6> 2020-08-10 10:46:27.752 -07:00 [INF] - Entering periodic task to reauthenticate connected clients
custom module logs 
8/10/2020 10:36:03 AM> Initialization Complete. Starting module logic...
IoT Hub module client initialized.
Unhandled exception. System.AggregateException: One or more errors occurred. (Transient network error occurred, please retry.)
 ---> Microsoft.Azure.Devices.Client.Exceptions.IotHubCommunicationException: Transient network error occurred, please retry.
 ---> System.Net.Sockets.SocketException (11001): No such host is known.
   at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpIoTTransport.InitializeAsync(TimeSpan timeout)
   at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpIoTConnector.OpenConnectionAsync(TimeSpan timeout)
   at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.EnsureConnectionAsync(TimeSpan timeout)
   at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.OpenSessionAsync(DeviceIdentity deviceIdentity, TimeSpan timeout)
   at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.EnsureSessionAsync(TimeSpan timeout)
   at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.OpenAsync(TimeSpan timeout)
   at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpTransportHandler.OpenAsync(CancellationToken cancellationToken)
   at Microsoft.Azure.Devices.Client.Transport.ProtocolRoutingDelegatingHandler.OpenAsync(CancellationToken cancellationToken)
   at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.<>c__DisplayClass23_0.<<ExecuteWithErrorHandlingAsync>b__0>d.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation)
   --- End of inner exception stack trace ---
   at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation)
   at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass33_0.<<OpenInternalAsync>b__0>d.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.EnsureOpenedAsync(CancellationToken cancellationToken)
   at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass24_0.<<SendTwinGetAsync>b__0>d.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.SendTwinGetAsync(CancellationToken cancellationToken)
   at Microsoft.Azure.Devices.Client.InternalClient.GetTwinAsync()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at TCPListenerModule.Program.Main(String[] args) in C:\app\Program.cs:line 20
8/10/2020 10:45:15 AM> Initialization Complete. Starting module logic...
IoT Hub module client initialized.

Additional Information

These modules all work perfectly fine in a simulator. From my perspective, the only problem occurs when trying to execute this code from within the edge runtime.

The timing of this issue starting is close to when I was trying to resolve some edgeHub storage binding warnings from the iotedge check command. Would be interested to know if this is an issue related to edgeHub 1.0.9.

Thank you.
@ejectbutton
Copy link
Author

I changed my system's name to a new name based on this thread and it looks to have resolved the issue: #1269

I previously already had the system name as all lowercase, but changing it again to a different all lowercase name seems to have fixed the issue.

@damonbarry
Copy link
Member

@ejectbutton Glad to hear you got past this issue. Would you mind sharing what your original hostname (the one that didn't work) was?

@damonbarry damonbarry added customer-reported iotedge needinfo Needs more info from issue reporter / updates from PR submitter labels Aug 11, 2020
@damonbarry damonbarry self-assigned this Aug 11, 2020
@emmanuel-bv
Copy link
Contributor

@ejectbutton Would you mind sharing your original hostname? Thanks!

@ejectbutton
Copy link
Author

The hostname was changed from 'intconnect' to 'edgedevice'. They were both 10 letters, all lowercase

@varunpuranik varunpuranik removed the needinfo Needs more info from issue reporter / updates from PR submitter label Aug 25, 2020
@jgrimm74
Copy link

jgrimm74 commented Sep 3, 2020

I ran into this exact same issue. Same versions of everything. I did not want to change the hostname of my pc so I dug into other possible things to change and I found something that got mine working:
Within C:\ProgramData\iotedge\config.yaml I simply renamed network from "nat" to something else - i chose "edgenat". Then I restarted the iotedge-moby service. After that restart both of my modules that were having network issues were able to communicate. For confirmation i changed the config back to the original network name of "nat" and my connection issues returned.

I hope that info helps.

config.yaml section i changed:

moby_runtime:
  uri: 'npipe://./pipe/iotedge_moby_engine'
  network: 'edgenat'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@damonbarry damonbarry

Labels
customer-reported iotedge
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@ejectbutton @varunpuranik @damonbarry @jgrimm74 @emmanuel-bv