json_bourne: resource leak and other issues

[FreddieAkeroyd]

json bourne stopped working #5279 and was consuming a large amount of memory. There were multiple log messages about connection failures, so it looks like connection failures cause at least a memory leak. I forgot to check the handle count, but looking at the new process i believe it is also leaking socket handles as the handle count is increasing. Have attached a process monitor to verify this. Error logs are on the server.

acceptance criteria

• running perfmon shows no memory or handle leak in presence of connection failures
• can we write system/unit tests for this?

[FreddieAkeroyd]

[FreddieAkeroyd]

red is handle count

[FreddieAkeroyd]

note: json bourne is currently using the caffi rather than ca backend to cachannel - this was because ca didn;t seem to be available in python 3.8 when it was installed

[Tom-Willemsen]

note: json bourne is currently using the caffi rather than ca backend to cachannel - this was because ca didn;t seem to be available in python 3.8 when it was installed

https://github.com/ISISComputingGroup/genie_python/pull/221 uses python 3.8 with the full ca CaChannel backend if you want to try it?

[FreddieAkeroyd]

@Tom-Willemsen should i copy the files from the genie python PR pipeline build?

[FreddieAkeroyd]

Handle leak still present after moving to 3.8 with native caChannel, lots of connection errors in logs so maybe something is not getting cleaned up on error

[Tom-Willemsen]

Now deployed and no longer looks to be leaking handles.

[FreddieAkeroyd]

memory and handle slook good