NodeUi: All services offline

[Peter-SovietSquirrel]

A clear and concise description of what the bug is.
Without any user interaction in NodeUi Node status will say No services available. The service will still be running transferring data and is visible in discovery.
If this is left the the service will stop and it will not be in discovery and NodeUI will only show spinning circle is anything. At this point the actual Linux system will become unresponsive as it may take minutes to log in via SSH.
If nothing is still not done the sometime after a period of time the system will return to normal but this may take hours.

The screenshots were taken when the system was unresponsive

• Node version: 0.1.9.5
• OS: Ubuntu 18.04.6 LTS

This issue seem to happen when there has been a large amount of data transferred over a long continues length of time.

daba_node.zip

[Peter-SovietSquirrel]

node.logs7.txt.zip
kern.log
Providing the latest log and also the kern.log

Another shutdown. at around 16:30 the service stopped being able to transfer data and it
went offline including the Linux system until around 22:51 that everything returned to normal.

[etherunit]

Thanks for reporting @Peter-SovietSquirrel
We will investigate it further

[Peter-SovietSquirrel]

heap.out.zip

Outputs of the myst process using 250 & 500MB

[Peter-SovietSquirrel]

goroutine.out.zip

[Snawoot]

it created about 13000 goroutines and they consume a lot of memory:

root cause is in server side events code.

[Snawoot]

goroutines hang sending into this channel:

node/tequilapi/endpoints/sse_handler.go

Line 200 in ead5fcd

h.messages <- string(marshaled)

[etherunit]

relates to #5244

[Snawoot]

Fixed in 1.9.7.