librespot-java hangs on some Spotify Connect failures, 100% CPU

[markferry]

https://snapshots.raintank.io/dashboard/snapshot/z1bSuIZzVn10eCAQtRKPSc6Bi4emnC38

One CPU got pegged high at approx 00:57 on the Sunday morning of the SummerParty2023.

In particular IO Wait jumped from 4% to 26%.
At about 9am IO and System dropped back but User remained ~30%.

Restarting snapserver fixed the CPU usage.

[markferry]

Killing the librespot-java process also recovers things. Snapserver restarts it.

[markferry]

# failed to connect to Outside about here
Aug 20 16:14:09 cyclops snapserver[25137]: Stream: Outside, switching active stream: - outside spotify => announcer
Aug 20 16:14:09 cyclops snapserver[25137]: State changed: Outside, state: playing => idle
Aug 20 16:14:09 cyclops snapserver[25137]: onStateChanged (Outside): idle
Aug 20 16:15:51 cyclops snapserver[25137]: Error while reading from control socket: Connection reset by peer
Aug 20 16:15:51 cyclops snapserver[25137]: Error in socket shutdown: Transport endpoint is not connected
Aug 20 16:22:35 cyclops snapserver[25137]: State changed: - outside iris, state: idle => playing
Aug 20 16:22:35 cyclops snapserver[25137]: onStateChanged (- outside iris): playing
Aug 20 16:22:35 cyclops snapserver[25137]: Removing 1 inactive session(s), active sessions: 1
Aug 20 16:22:35 cyclops snapserver[25137]: State changed: Outside, state: idle => playing
Aug 20 16:22:35 cyclops snapserver[25137]: onStateChanged (Outside): playing
Aug 20 16:22:35 cyclops snapserver[25137]: first read, updating timestamp
Aug 20 16:22:36 cyclops snapserver[25137]: State changed: - outside iris, state: playing => idle
Aug 20 16:22:36 cyclops snapserver[25137]: onStateChanged (- outside iris): idle
Aug 20 16:22:36 cyclops snapserver[25137]: Stream: Outside, switching active stream: - outside iris => announcer
Aug 20 16:22:36 cyclops snapserver[25137]: State changed: Outside, state: playing => idle
Aug 20 16:22:36 cyclops snapserver[25137]: onStateChanged (Outside): idle
Aug 20 16:23:13 cyclops snapserver[25137]: State changed: - outside iris, state: idle => playing
Aug 20 16:23:13 cyclops snapserver[25137]: onStateChanged (- outside iris): playing
Aug 20 16:23:13 cyclops snapserver[25137]: Stream: Outside, switching active stream: announcer => - outside iris
Aug 20 16:23:13 cyclops snapserver[25137]: State changed: Outside, state: idle => playing
Aug 20 16:23:13 cyclops snapserver[25137]: onStateChanged (Outside): playing
Aug 20 16:23:13 cyclops snapserver[25137]: first read, updating timestamp
Aug 20 16:30:26 cyclops snapserver[25137]: ControlServer::NewConnection: 192.168.6.150
# switched to Ballroom
Aug 20 16:35:17 cyclops snapserver[25137]: State changed: - outside iris, state: playing => idle
Aug 20 16:35:17 cyclops snapserver[25137]: onStateChanged (- outside iris): idle
Aug 20 16:35:17 cyclops snapserver[25137]: Stream: Outside, switching active stream: - outside iris => announcer
Aug 20 16:35:17 cyclops snapserver[25137]: State changed: Outside, state: playing => idle
Aug 20 16:35:17 cyclops snapserver[25137]: onStateChanged (Outside): idle
Aug 20 16:35:55 cyclops snapserver[25137]: onStateChanged (- ballroom iris): playing
Aug 20 16:35:55 cyclops snapserver[25137]: Stream: Ballroom, switching active stream: announcer => - ballroom iris
Aug 20 16:35:55 cyclops snapserver[25137]: Wrote 533 bytes to control socket
Aug 20 16:35:55 cyclops snapserver[25137]: onStateChanged (Ballroom): playing
Aug 20 16:35:55 cyclops snapserver[25137]: first read, updating timestamp
Aug 20 16:36:07 cyclops snapserver[25137]: Exception: end of file
Aug 20 16:36:08 cyclops snapserver[25137]: onResync (Ballroom): 380.338 ms
Aug 20 16:36:08 cyclops snapserver[25137]: first read, updating timestamp
Aug 20 16:36:35 cyclops snapserver[25137]: check state last: 5124161536, read: 5124161536
Aug 20 16:36:35 cyclops snapserver[25137]: State changed: - ballroom iris, state: playing => idle
Aug 20 16:36:35 cyclops snapserver[25137]: onStateChanged (- ballroom iris): idle
Aug 20 16:36:35 cyclops snapserver[25137]: Stream: Ballroom, switching active stream: - ballroom iris => announcer
Aug 20 16:36:35 cyclops snapserver[25137]: State changed: Ballroom, state: playing => idle
Aug 20 16:36:35 cyclops snapserver[25137]: onStateChanged (Ballroom): idle
Aug 20 16:36:35 cyclops snapserver[25137]: Wrote 530 bytes to control socket
Aug 20 16:36:42 cyclops snapserver[25137]: check state last: 0, read: 0
Aug 20 16:36:42 cyclops snapserver[25137]: State changed: - ballroom iris, state: idle => playing