Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GELF driver fails to promptly reconnect to a ingress TCP endpoint when backing TCP server service is updated #38775

Open
leojonathanoh opened this issue Feb 22, 2019 · 0 comments
Open

GELF driver fails to promptly reconnect to a ingress TCP endpoint when backing TCP server service is updated #38775

leojonathanoh opened this issue Feb 22, 2019 · 0 comments
Labels
area/logging

Comments

@leojonathanoh
Copy link

leojonathanoh commented Feb 22, 2019 •
edited

Description

Given a Swarm client service configured to use the GELF logging driver with a TCP endpoint - the TCP endpoint being an ingress-published TCP endpoint backed by a TCP service on the same Swarm - when the TCP server service is updated, the GELF driver fails to respond to a connection CLOSE by establishing a new TCP connection to the same ingress TCP endpoint. Instead, logs appear to queue up in the old TCP socket, and do not arrive at the new replacement Swarm client Task until the old connection is killed and a new connection is established, which takes at least 3.5 minutes. That is 3.5 minutes of lost logs.

Given a Swarm client service configured to use the GELF logging driver with a UDP endpoint, and knowing that UDP have no "connection", as expected, when the UDP server service is updated, the GELF driver keeps sending UDP logs to the same UDP endpoint. Note that this should be a different issue that is unrelated to the GELF driver, but instead related to the ingress network and how the replaced Swarm task's iptables UDP "connection" is not reset: UDP logs continue arriving at the old replaced Swarm client Task, and do not arrive at the new replacement Swarm client Task until the UDP "connection" is finally reset, which takes at least 5 minutes. That means 5 minutes of lost logs.

Despite UDP losses being unrelated to the GELF driver, I included a UDP server endpoint in my testing of a TCP server endpoint just to show how logging with the GELF driver over TCP or UDP resulted in lost logs anyway, when the Swarm service backing the GELF endpoint is updated.

Tested this on a 1-node and 3-node Swarm and got the same issue.

Steps to reproduce the issue:

  1. Create a TCP server to simulate the GELF TCP endpoint: nc-tcp-server
  2. Create a UDP server to simulate the GELF UDP endpoint: nc-udp-server
  3. Watch the TCP server and UDP server logs
  4. Watch /var/log/syslog and netstat
  5. Create a TCP client that uses the GELF driver to log to the TCP server: gelf-tcp-client
  6. Create a UDP client that uses the GELF driver to log to the UDP server: gelf-udp-client
  7. Force update both the TCP server and UDP server

Here's the shell scripts:

#!/bin/sh

# 1. Publish TCP server on ingress
docker service create --name=nc-tcp-server --publish published=12345,target=12345,protocol=tcp --update-order start-first --replicas 1 alpine sh -c "$(cat - <<-'EOF'
apk add --no-cache netcat-openbsd && nc -v -k -l 12345 | awk '{ print strftime("%c: "), $0; fflush(); }'
EOF
)"

# 2. Publish UDP server on ingress
docker service create --name=nc-udp-server --publish published=12346,target=12346,protocol=udp --replicas 1 -- alpine sh -c "$(cat - <<-'EOF'
apk add --no-cache netcat-openbsd && nc -v -ku -l 12346 | awk '{ print strftime("%c: "), $0; fflush(); }'
EOF
)"

# 3a. Tail TCP server logs
docker service logs nc-tcp-server --follow

# 3b. Tail UDP server logs
docker service logs nc-udp-server --follow

# 4a. Watch the syslog
tail -f /var/log/syslog

# 4b. Watch netstat
while true; do date; netstat -antelup | grep -E '12345|12346|Proto'; sleep 5; done

# 5. Start a TCP client
docker service create --name gelf-tcp-client --log-driver=gelf --log-opt gelf-address=tcp://127.0.0.1:12345 --replicas 1 --constraint node.hostname==$HOSTNAME alpine /bin/sh -c 'while true; do echo "hello from gelf tcp"; sleep 5; done'

# 6. Start a UDP client
docker service create --name gelf-udp-client --log-driver=gelf --log-opt gelf-address=udp://127.0.0.1:12346 --replicas 1 --constraint node.hostname==$HOSTNAME alpine /bin/sh -c 'while true; do echo "hello from gelf tcp"; sleep 5; done'

# Note the time. Time is now 2019-02-21 23:47:08

# 7. Force update the TCP / UDP server
docker service update nc-tcp-server --update-order start-first --force
docker service update nc-udp-server --update-order start-first --force

# 2019-02-21 23:47:09   TCP Service converged
# 2019-02-21 23:47:09   The new TCP task is 'running'
# 2019-02-21 23:47:18   Old TCP task continues receives logs
# 2019-02-21 23:47:23   The old TCP task is 'shutdown'
# 2019-02-21 23:47:23   New TCP task does not receive logs
# 2019-02-21 23:50:59   After 3.5 minutes, TCP server begins to receive logs

# 2019-02-21 23:47:13   UDP Service converged
# 2019-02-21 23:47:13   The new UDP task is 'running'
# 2019-02-21 23:47:22   Old UDP task continues to receive logs
# 2019-02-21 23:47:27   The old UDP task is 'shutdown'
# 2019-02-21 23:47:27   New UDP task does not receive logs.
# 2019-02-21 23:52:32   After 5 minutes, UDP server begins to receive logs

Describe the results you received:

TCP server

Events summary for TCP server while it is updated

# 2019-02-21 23:47:09   TCP Service converged
# 2019-02-21 23:47:09   The new TCP task is 'running'
# 2019-02-21 23:47:18   Old TCP task continues receives logs
# 2019-02-21 23:47:23   The old TCP task is 'shutdown'
# 2019-02-21 23:47:23   New TCP task does not receive logs
# 2019-02-21 23:50:59   After 3.5 minutes, TCP server begins to receive logs

Referring to the TCP server logs below:

  • The old task stopped receiving logs at Thu Feb 21 23:47:18 2019
  • The new task only started receiving logs at Thu Feb 21 23:50:59 2019, approximately 3.5 minutes after

Referring to the Netstat logs below:

  • At Fri Feb 21 23:47:26 UTC 2019, when the old TCP task is killed, the TCP connection goes into CLOSE_WAIT. You see a Recv-Q of 1. The Send-Q keep growing.
  • At Fri Feb 21 23:50:57 UTC 2019, the old TCP connection is removed
  • At Fri Feb 21 23:51:02 UTC 2019, the TCP connection is ESTABLISHED

TCP server logs

nc-tcp-server.1.izjhphwcshtu@dockermanager2    | fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | (1/2) Installing libbsd (0.8.6-r2)
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | (2/2) Installing netcat-openbsd (1.130-r1)
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | Executing busybox-1.29.3-r10.trigger
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | OK: 6 MiB in 16 packages
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | Listening on [0.0.0.0] (family 0, port 12345)
nc-tcp-server.1.vuhdo6pouks9@dockermanager3    | Thu Feb 21 23:47:13 2019:  {"version":"1.1","host":"dockermanager1","short_message":"hello from gelf tcp","timestamp":1550792833.7,"level":6,"_command":"/bin/sh -c while true; do echo \"hello from gelf tcp\"; sleep 5; done","_container_id":"11af3a1851ceca12d1cd9ba43b9cb7e530220585117a326932bb024aa50457c3","_container_name":"gelf-tcp-client.1.fs3uthcevpox2xl7j24d6egdp","_created":"2019-02-21T23:45:37.994244742Z","_image_id":"sha256:caf27325b298a6730837023a8a342699c8b7b388b8d878966b064a1320043019","_image_name":"alpine:latest@sha256:b3dbf31b77fd99d9c08f780ce6f5282aba076d70a513a8be859d8d3a4d0c92b8","_tag":"11af3a1851ce"}
nc-tcp-server.1.vuhdo6pouks9@dockermanager3    | Thu Feb 21 23:47:18 2019:  {"version":"1.1","host":"dockermanager1","short_message":"hello from gelf tcp","timestamp":1550792838.702,"level":6,"_command":"/bin/sh -c while true; do echo \"hello from gelf tcp\"; sleep 5; done","_container_id":"11af3a1851ceca12d1cd9ba43b9cb7e530220585117a326932bb024aa50457c3","_container_name":"gelf-tcp-client.1.fs3uthcevpox2xl7j24d6egdp","_created":"2019-02-21T23:45:37.994244742Z","_image_id":"sha256:caf27325b298a6730837023a8a342699c8b7b388b8d878966b064a1320043019","_image_name":"alpine:latest@sha256:b3dbf31b77fd99d9c08f780ce6f5282aba076d70a513a8be859d8d3a4d0c92b8","_tag":"11af3a1851ce"}
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | Connection from 10.255.0.2 44918 received!
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | Thu Feb 21 23:50:59 2019:  {"version":"1.1","host":"dockermanager1","short_message":"hello from gelf tcp","timestamp":1550793058.782,"level":6,"_command":"/bin/sh -c while true; do echo \"hello from gelf tcp\"; sleep 5; done","_container_id":"11af3a1851ceca12d1cd9ba43b9cb7e530220585117a326932bb024aa50457c3","_container_name":"gelf-tcp-client.1.fs3uthcevpox2xl7j24d6egdp","_created":"2019-02-21T23:45:37.994244742Z","_image_id":"sha256:caf27325b298a6730837023a8a342699c8b7b388b8d878966b064a1320043019","_image_name":"alpine:latest@sha256:b3dbf31b77fd99d9c08f780ce6f5282aba076d70a513a8be859d8d3a4d0c92b8","_tag":"11af3a1851ce"}
nc-tcp-server.1.izjhphwcshtu@dockermanager2    | Thu Feb 21 23:51:03 2019:  {"version":"1.1","host":"dockermanager1","short_message":"hello from gelf tcp","timestamp":1550793063.784,"level":6,"_command":"/bin/sh -c while true; do echo \"hello from gelf tcp\"; sleep 5; done","_container_id":"11af3a1851ceca12d1cd9ba43b9cb7e530220585117a326932bb024aa50457c3","_container_name":"gelf-tcp-client.1.fs3uthcevpox2xl7j24d6egdp","_created":"2019-02-21T23:45:37.994244742Z","_image_id":"sha256:caf27325b298a6730837023a8a342699c8b7b388b8d878966b064a1320043019","_image_name":"alpine:latest@sha256:b3dbf31b77fd99d9c08f780ce6f5282aba076d70a513a8be859d8d3a4d0c92b8","_tag":"11af3a1851ce"}
...
...

UDP server

Events summary for UDP server once it is updated

# 2019-02-21 23:47:13   UDP Service converged
# 2019-02-21 23:47:13   The new UDP task is 'running'
# 2019-02-21 23:47:22   Old UDP task continues to receive logs
# 2019-02-21 23:47:27   The old UDP task is 'shutdown'
# 2019-02-21 23:47:27   New UDP task does not receive logs.
# 2019-02-21 23:52:32   After 5 minutes, UDP server begins to receive logs

Referring to the UDP server logs below:

  • The old task stopped receiving logs at Thu Feb 21 23:47:22 2019
  • The new task only started receiving logs at Thu Feb 21 23:52:32 2019, approximately 5 minutes after.

Referring to the Netstat logs below:

  • As expected, throughout the update of the UDP service, the UDP "connection" remains ESTABLISHED, with Recv-Q and Send-Q staying at 0. The "connection" remains unchanged throughout

UDP server logs

nc-udp-server.1.vs80iwud7ypm@dockermanager2    | fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | (1/2) Installing libbsd (0.8.6-r2)
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | (2/2) Installing netcat-openbsd (1.130-r1)
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Executing busybox-1.29.3-r10.trigger
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | OK: 6 MiB in 16 packages
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Listening on [0.0.0.0] (family 0, port 12346)
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:  �
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:  �T��n�<F_��������_�!9����L�
                                                                                                          ����
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:  m�3�����і}��E�    ��u���:M�65>����y?�u��hb`�Zw1�*&����'��ʭ�z�A9'C�h���x��o\a�'��}]i+0�SZ��6�s�y�,���Ϣ��������]�k^�Y��|�Y�}cxGn�����R`
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:  ���
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:  �@)����!C�Q[�W�\��䔓H>;�
                                                                                                      'JV���h}L�����r;����/�b�_���ϟ���!�}�SH1a����$�%e���H�P?��ޖ��J�[��ÒLI�Q)���Xb�8����4jJ$�/A�S�01�X��E���  ��&��胧�6��
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:  ��NU�Z
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:17 2019:
^[[?63;1;2;4;6;9;15;22;29cnc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:  �
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:  �T��n�<F_��������_�!9����L�
                                                                                                          ����
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:  m�3�����і}��E�    ��u���:M�65>����y?�u��hb`�Zw1�*&����'��ʭ�z�A9'C�h��u��o\a�'��}]i+0�SZ��6�s�y�,���Ϣ��������]�k^�Y��|�Y�}cxGn�����R`
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:  ���
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:  �@)����!C�Q[�W�\��䔓H>;�
                                                                                                      'JV���h}L�����r;����/�b�_���ϟ���!�}�SH1a����$�%e���H�P?��ޖ��J�[��ÒLI�Q)���Xb�8����4jJ$�/A�S�01�X��E���  ��&��胧�6��
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:  ���CX�Z
nc-udp-server.1.wz92un9gr754@dockermanager3    | Thu Feb 21 23:47:22 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:  �
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:  �T�InF�B�Z�9O����W��HV��4i+r�@��$��������k�!�8����Z8����x�NЗv��F��La�Z▒▒������F��       ƺQ��
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:  c�
��Һ?���3�/k%6�Wzf�1�Kc/�P��Mk^���Jtc晕��#���N�u-��`��B�a                        Jy�֜�����ܶ
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:  ^`��xt&�����+,�����=�l�P�0i�/r��1y�:�_����J�����v��\��^[g�����ƌ�tJ�$�G���q�У�҆�}rIy�|��k����k�E�C���z[w���߇%��&%�sS      �����<�d'#�Ą���8��'�&_��s���    �g�`r��b!�~�
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:  ������Z
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:32 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:  �
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:  �T�InF�B�Z�9O����W��HV��4i+r�@��$��������k�!�8����Z8����x�NЗv��F��La�Z▒▒������F��       ƺQ��
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:  c�
��Һ?���3�/k%6�Wzf�1�Kc/�P��Mk^���Jtc晕��#���N�u-��`��B�a                        Jw�֝�����ܶ
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:  ^`��xt&�����+,�����=�l�P�0i�/r��1y�:�_����J�����v��\��^[g�����ƌ�tJ�$�G���q�У�҆�}rIy�|��k����k�E�C���z[w���߇%��&%�sS      �����<�d'#�Ą���8��'�&_��s���    �g�`r��b!�~�
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:  ��-��kZ
nc-udp-server.1.vs80iwud7ypm@dockermanager2    | Thu Feb 21 23:52:37 2019:
...
...

Netstat output

This is the netstat from the time of deployment of the TCP server and UDP server, till the time the TCP and UDP logs were correctly arriving at the new replacement Tasks backing the TCP / UDP ingress GELF endpoints.

Fri Feb 21 23:45:46 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44778         127.0.0.1:12345         ESTABLISHED 0          582951     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
...
...
Fri Feb 21 23:47:06 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44778         127.0.0.1:12345         ESTABLISHED 0          582951     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:11 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44778         127.0.0.1:12345         ESTABLISHED 0          582951     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:16 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44778         127.0.0.1:12345         ESTABLISHED 0          582951     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:21 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44778         127.0.0.1:12345         ESTABLISHED 0          582951     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:26 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1    603 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (0.42/3/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:31 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   1206 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (5.30/5/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:36 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   1809 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (0.28/5/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:41 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   2412 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (8.44/6/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:46 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   3015 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (3.38/6/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:51 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   3618 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (24.72/7/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:47:56 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   4221 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (19.68/7/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:01 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   4824 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (14.64/7/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:06 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   5427 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (9.60/7/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:11 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   6030 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (4.59/7/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:16 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   6633 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (0.00/7/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:21 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   7236 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (48.02/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:26 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   7839 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (42.98/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:31 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   8442 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (37.96/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:37 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   9045 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (32.93/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:42 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1   9648 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (27.90/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:47 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  10251 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (22.88/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:52 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  10854 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (17.83/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:48:57 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  11457 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (12.80/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:02 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  12060 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (7.76/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:07 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  12663 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (2.75/8/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:12 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  13266 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (103.19/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:17 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  13869 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (98.16/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:22 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  14471 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (93.14/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:27 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  15074 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (88.12/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:32 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  15677 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (83.09/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:37 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  16280 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (78.06/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:42 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  16883 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (73.02/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:47 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  17486 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (67.99/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:52 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  18088 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (62.98/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:49:57 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  18691 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (57.95/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:02 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  19294 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (52.89/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:07 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  19897 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (47.88/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:12 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  20500 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (42.85/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:17 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  21103 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (37.84/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:22 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  21706 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (32.82/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:27 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  22308 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (27.79/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:32 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  22911 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (22.78/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:37 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  23514 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (17.76/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:42 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  24117 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (12.73/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:47 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  24720 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (7.72/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:52 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        1  25323 127.0.0.1:44778         127.0.0.1:12345         CLOSE_WAIT  0          582951     1422/dockerd         on (2.70/9/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:50:57 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:02 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:07 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:12 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:17 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:22 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:27 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:32 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:38 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:43 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:48 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:53 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:51:58 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:03 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:08 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:13 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:18 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:23 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:28 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:33 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:38 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:43 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:48 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:53 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
Fri Feb 21 23:52:58 UTC 2019
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name     Timer
tcp        0      0 0.0.0.0:12345           0.0.0.0:*               LISTEN      0          579238     1422/dockerd         off (0.00/0/0)
tcp        0      0 127.0.0.1:44918         127.0.0.1:12345         ESTABLISHED 0          588368     1422/dockerd         off (0.00/0/0)
udp        0      0 0.0.0.0:12346           0.0.0.0:*                           0          581616     1422/dockerd         off (0.00/0/0)
udp        0      0 127.0.0.1:48600         127.0.0.1:12346         ESTABLISHED 0          584935     1422/dockerd         off (0.00/0/0)
...
...

Syslog

This is the syslog from the time of deployment of the TCP server and UDP server, till the time the TCP and UDP logs were correctly arriving at the new replacement Tasks backing the TCP / UDP ingress GELF endpoints.

Feb 21 23:45:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:28.377003418+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:kykfwli9asy7k23f8hz1zia44 leaving:false netPeers:3 entries:36 Queue qLen:0 netMsg/s:0"
Feb 21 23:45:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:28.377303007+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:thuvj1x4p4mrpc9h2dd5x6xqi leaving:false netPeers:2 entries:10 Queue qLen:0 netMsg/s:0"
Feb 21 23:45:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:28.377524098+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:nfx0t6cuj89995o57jwy9sain leaving:false netPeers:3 entries:11 Queue qLen:0 netMsg/s:0"
Feb 21 23:45:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:28.377674992+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:04y5y2c6teir9fmrg1k9c85uo leaving:false netPeers:2 entries:10 Queue qLen:0 netMsg/s:0"
Feb 21 23:45:38 dockermanager1 systemd-udevd[224317]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Feb 21 23:45:38 dockermanager1 systemd-udevd[224317]: Could not generate persistent MAC address for veth3f27183: No such file or directory
Feb 21 23:45:38 dockermanager1 systemd-udevd[224316]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Feb 21 23:45:38 dockermanager1 systemd-udevd[224316]: Could not generate persistent MAC address for veth606007d: No such file or directory
Feb 21 23:45:38 dockermanager1 kernel: [66980.943291] docker0: port 2(veth3f27183) entered blocking state
Feb 21 23:45:38 dockermanager1 kernel: [66980.943295] docker0: port 2(veth3f27183) entered disabled state
Feb 21 23:45:38 dockermanager1 kernel: [66980.943420] device veth3f27183 entered promiscuous mode
Feb 21 23:45:38 dockermanager1 systemd-timesyncd[198958]: Network configuration changed, trying to establish connection.
Feb 21 23:45:38 dockermanager1 networkd-dispatcher[1274]: WARNING:Unknown index 328 seen, reloading interface list
Feb 21 23:45:38 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:38+00:00" level=info msg="shim docker-containerd-shim started" address="/containerd-shim/moby/11af3a1851ceca12d1cd9ba43b9cb7e530220585117a326932bb024aa50457c3/shim.sock" debug=false pid=224324
Feb 21 23:45:38 dockermanager1 systemd-timesyncd[198958]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).
Feb 21 23:45:38 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:38+00:00" level=warning msg="file does not exist: /proc/sys/net/ipv6/conf/all/disable_ipv6 : stat /proc/sys/net/ipv6/conf/all/disable_ipv6: no such file or directory Has IPv6 been disabled in this node's kernel?"
Feb 21 23:45:38 dockermanager1 systemd-timesyncd[198958]: Network configuration changed, trying to establish connection.
Feb 21 23:45:38 dockermanager1 kernel: [66981.384647] eth0: renamed from veth606007d
Feb 21 23:45:38 dockermanager1 systemd-networkd[23289]: veth3f27183: Gained carrier
Feb 21 23:45:38 dockermanager1 kernel: [66981.404721] docker0: port 2(veth3f27183) entered blocking state
Feb 21 23:45:38 dockermanager1 kernel: [66981.404724] docker0: port 2(veth3f27183) entered forwarding state
Feb 21 23:45:38 dockermanager1 systemd-timesyncd[198958]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).
Feb 21 23:45:41 dockermanager1 kernel: [66984.600721] docker0: port 4(vethc475819) entered blocking state
Feb 21 23:45:41 dockermanager1 kernel: [66984.600724] docker0: port 4(vethc475819) entered disabled state
Feb 21 23:45:41 dockermanager1 kernel: [66984.600847] device vethc475819 entered promiscuous mode
Feb 21 23:45:41 dockermanager1 systemd-udevd[224425]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Feb 21 23:45:41 dockermanager1 systemd-udevd[224424]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Feb 21 23:45:41 dockermanager1 systemd-udevd[224424]: Could not generate persistent MAC address for veth3cb650f: No such file or directory
Feb 21 23:45:41 dockermanager1 systemd-udevd[224425]: Could not generate persistent MAC address for vethc475819: No such file or directory
Feb 21 23:45:41 dockermanager1 systemd-timesyncd[198958]: Network configuration changed, trying to establish connection.
Feb 21 23:45:41 dockermanager1 networkd-dispatcher[1274]: WARNING:Unknown index 330 seen, reloading interface list
Feb 21 23:45:41 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:41+00:00" level=info msg="shim docker-containerd-shim started" address="/containerd-shim/moby/5c9676ade47ab981ac8c58a759790924579616a5c7b34b51508a6c5413ebab42/shim.sock" debug=false pid=224433
Feb 21 23:45:41 dockermanager1 systemd-timesyncd[198958]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).
Feb 21 23:45:42 dockermanager1 dockerd[1422]: time="2019-02-21T23:45:42+00:00" level=warning msg="file does not exist: /proc/sys/net/ipv6/conf/all/disable_ipv6 : stat /proc/sys/net/ipv6/conf/all/disable_ipv6: no such file or directory Has IPv6 been disabled in this node's kernel?"
Feb 21 23:45:42 dockermanager1 systemd-timesyncd[198958]: Network configuration changed, trying to establish connection.
Feb 21 23:45:42 dockermanager1 kernel: [66985.047091] eth0: renamed from veth3cb650f
Feb 21 23:45:42 dockermanager1 systemd-networkd[23289]: vethc475819: Gained carrier
Feb 21 23:45:42 dockermanager1 kernel: [66985.060634] docker0: port 4(vethc475819) entered blocking state
Feb 21 23:45:42 dockermanager1 kernel: [66985.060636] docker0: port 4(vethc475819) entered forwarding state
Feb 21 23:45:42 dockermanager1 systemd-timesyncd[198958]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).
Feb 21 23:47:23 dockermanager1 dockerd[1422]: time="2019-02-21T23:47:23.275694182+00:00" level=warning msg="rmServiceBinding cb91b154fbe40663cf857fcfa5401b8531c6710d84f2a580ad0a2c76035b0b6c possible transient state ok:false entries:0 set:false "
Feb 21 23:47:26 dockermanager1 dockerd[1422]: time="2019-02-21T23:47:26.866923702+00:00" level=warning msg="rmServiceBinding 929d45db5dd864111bf356bb7d21265129eed6402d38f0bc58be9cdc30b15745 possible transient state ok:false entries:0 set:false "
Feb 21 23:50:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:50:28.577780381+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:kykfwli9asy7k23f8hz1zia44 leaving:false netPeers:3 entries:40 Queue qLen:0 netMsg/s:0"
Feb 21 23:50:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:50:28.577938280+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:thuvj1x4p4mrpc9h2dd5x6xqi leaving:false netPeers:2 entries:10 Queue qLen:0 netMsg/s:0"
Feb 21 23:50:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:50:28.577995580+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:nfx0t6cuj89995o57jwy9sain leaving:false netPeers:3 entries:11 Queue qLen:0 netMsg/s:0"
Feb 21 23:50:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:50:28.578028380+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:04y5y2c6teir9fmrg1k9c85uo leaving:false netPeers:2 entries:10 Queue qLen:0 netMsg/s:0"
Feb 21 23:55:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:55:28.776858255+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:kykfwli9asy7k23f8hz1zia44 leaving:false netPeers:3 entries:38 Queue qLen:0 netMsg/s:0"
Feb 21 23:55:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:55:28.776971954+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:thuvj1x4p4mrpc9h2dd5x6xqi leaving:false netPeers:2 entries:10 Queue qLen:0 netMsg/s:0"
Feb 21 23:55:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:55:28.777028454+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:nfx0t6cuj89995o57jwy9sain leaving:false netPeers:3 entries:11 Queue qLen:0 netMsg/s:0"
Feb 21 23:55:28 dockermanager1 dockerd[1422]: time="2019-02-21T23:55:28.777057053+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:04y5y2c6teir9fmrg1k9c85uo leaving:false netPeers:2 entries:10 Queue qLen:0 netMsg/s:0"
Feb 22 00:00:28 dockermanager1 dockerd[1422]: time="2019-02-22T00:00:28.976790207+00:00" level=info msg="NetworkDB stats dockermanager1(480b5990b20a) - netID:kykfwli9asy7k23f8hz1zia44 leaving:false netPeers:3 entries:38 Queue qLen:0 netMsg/s:0"

Describe the results you expected:

The logs should keep going through ingress, and arrive at the TCP / UDP server.

Additional information you deem important (e.g. issue happens only occasionally):

Nil

Output of docker version:

Client:
 Version:           18.06.1-ce
 API version:       1.38
 Go version:        go1.10.3
 Git commit:        e68fc7a
 Built:             Tue Aug 21 17:24:51 2018
 OS/Arch:           linux/amd64
 Experimental:      false

Server:
 Engine:
  Version:          18.06.1-ce
  API version:      1.38 (minimum version 1.12)
  Go version:       go1.10.3
  Git commit:       e68fc7a
  Built:            Tue Aug 21 17:23:15 2018
  OS/Arch:          linux/amd64
  Experimental:     false

Output of docker info:

Containers: 143
 Running: 9
 Paused: 0
 Stopped: 134
Images: 323
Server Version: 18.06.1-ce
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: active
 NodeID: hhn7a1k30wcdoig25qezm894q
 Is Manager: true
 ClusterID: by8vcpvjdnje4gqza19ic5ymt
 Managers: 3
 Nodes: 3
 Orchestration:
  Task History Retention Limit: 5
 Raft:
  Snapshot Interval: 10000
  Number of Old Snapshots to Retain: 0
  Heartbeat Tick: 1
  Election Tick: 10
 Dispatcher:
  Heartbeat Period: 5 seconds
 CA Configuration:
  Expiry Duration: 3 months
  Force Rotate: 0
 Autolock Managers: false
 Root Rotation In Progress: false
 Node Address: 10.0.0.1
 Manager Addresses:
  10.0.0.1:2377
  10.0.0.2:2377
  10.0.0.3:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 468a545b9edcd5932818eb9de8e72413e616e86e
runc version: 69663f0bd4b60df09991c08812a60108003fa340
init version: fec3683
Security Options:
 apparmor
 seccomp
  Profile: default
Kernel Version: 4.15.0-45-generic
Operating System: Ubuntu 18.04.1 LTS
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 3.809GiB
Name: dockermanager1
ID: 2UHY:QOLS:SEUU:5NUI:CE7E:UPKI:TS3P:YZTM:TBVT:XGSD:MQS6:MV53
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

WARNING: No swap limit support

Additional environment details (AWS, VirtualBox, physical, etc.):

Hyper-V VM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/logging
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@thaJeztah @GordonTheTurtle @leojonathanoh