Module cannot connect to edgeHub

[oliverchristen]

Since recently the security IoT Edge module stopped working on one specific device. The module cannot connect to the edgeHub any more. Everything else works fine on this device especially all the other modules can connect to edgeHub and send data to IoT Hub. Also on another device the same configuration works fine including the security module. The debug logs of the security module look like this:

08/31/2020 08:03:59 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Information: Agent is initializing...
08/31/2020 08:03:59 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Information: Using Delayed start to allow EdgeHub module to complete initialization.
08/31/2020 08:04:09 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Gateway Host: w120edgelinuxsimatic1
08/31/2020 08:04:09 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: EdgeHub IP: 172.18.0.2
08/31/2020 08:04:09 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Module Id: azureiotsecurity
08/31/2020 08:04:09 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Adding hosts mapping: 172.18.0.2 w120edgelinuxsimatic1
08/31/2020 08:04:09 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Information: Verifiying EdgeHub is reachable using Amqp
08/31/2020 08:04:09 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Checking connection: w120edgelinuxsimatic1:5671
08/31/2020 08:06:20 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Error: Unable To Reach: w120edgelinuxsimatic1:5671
08/31/2020 08:06:20 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Checking connection: w120edgelinuxsimatic1:443
08/31/2020 08:08:31 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Debug: Error: Unable To Reach: w120edgelinuxsimatic1:443
08/31/2020 08:08:31 | CorrelationId: 8621917e-5ac9-49f9-8730-0a8822b1f7a6 | Fatal: Edgehub unreachable using Amqp. Terminating Module
08/31/2020 08:08:31 | CorrelationId: f3054c41-e6cd-494b-877c-c5f25b66af22 | Information: On stop Cancellation was requested, Disposing...
08/31/2020 08:08:43 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Information: Agent is initializing...
08/31/2020 08:08:44 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Information: Using Delayed start to allow EdgeHub module to complete initialization.
08/31/2020 08:08:54 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Gateway Host: w120edgelinuxsimatic1
08/31/2020 08:08:54 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: EdgeHub IP: 172.18.0.2
08/31/2020 08:08:54 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Module Id: azureiotsecurity
08/31/2020 08:08:54 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Adding hosts mapping: 172.18.0.2 w120edgelinuxsimatic1
08/31/2020 08:08:54 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Information: Verifiying EdgeHub is reachable using Amqp
08/31/2020 08:08:54 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Checking connection: w120edgelinuxsimatic1:5671
08/31/2020 08:11:04 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Error: Unable To Reach: w120edgelinuxsimatic1:5671
08/31/2020 08:11:04 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Checking connection: w120edgelinuxsimatic1:443
08/31/2020 08:13:15 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Debug: Error: Unable To Reach: w120edgelinuxsimatic1:443
08/31/2020 08:13:15 | CorrelationId: 8dafcbf0-adc3-433b-b9ab-dbde3179e7ac | Fatal: Edgehub unreachable using Amqp. Terminating Module
08/31/2020 08:13:15 | CorrelationId: 298a08d2-9c3b-4b8e-9d89-ef780e8c0d5e | Information: On stop Cancellation was requested, Disposing...
08/31/2020 08:13:41 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Information: Agent is initializing...
08/31/2020 08:13:41 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Information: Using Delayed start to allow EdgeHub module to complete initialization.
08/31/2020 08:13:51 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Gateway Host: w120edgelinuxsimatic1
08/31/2020 08:13:51 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: EdgeHub IP: 172.18.0.2
08/31/2020 08:13:51 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Module Id: azureiotsecurity
08/31/2020 08:13:51 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Adding hosts mapping: 172.18.0.2 w120edgelinuxsimatic1
08/31/2020 08:13:51 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Information: Verifiying EdgeHub is reachable using Amqp
08/31/2020 08:13:51 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Checking connection: w120edgelinuxsimatic1:5671
08/31/2020 08:16:01 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Error: Unable To Reach: w120edgelinuxsimatic1:5671
08/31/2020 08:16:01 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Checking connection: w120edgelinuxsimatic1:443
08/31/2020 08:18:12 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Debug: Error: Unable To Reach: w120edgelinuxsimatic1:443
08/31/2020 08:18:12 | CorrelationId: f237b898-262a-4673-9e12-239560f2edc5 | Fatal: Edgehub unreachable using Amqp. Terminating Module

I tried the following:

• Restart the security deamon
• Restart edge service
• Restart edgeHub and edgeAgent
• Recreate edgeHub docker container

We are currently on version 1.0.9.4 of edgeHub and edgeAgent.

Are there any ideas what I can try to solve the issue?