Use proc_events on Java processes

[YishaiZinkin]

Description

Use proc_events from granulate-utils to track async-profiled processes and log when they exit with non-zero code.

Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots

Checklist:

• I have read the CONTRIBUTING document.
• I have updated the relevant documentation.
• I have added tests for new logic.

[Jongy]

Looks good. I'll do a full CR once we restructure it ,let's make it an object instead of a set of functions, I think that's more managable.

[Jongy]

@YishaiZinkin - let's move this code to https://github.com/Granulate/utils so it can be used by other components. I'll explain on Sunday.

[YishaiZinkin]

I suggest we finish the PR here just to concentrate the comments in one place. I'll move the module to utils once we're finished.

[Jongy]

Very clean API 👍

Some small comments.

[Jongy]

@YishaiZinkin can you merge from master? The other PR got merged

[Jongy]

You're now tracking processes both here and in JavaProfiler._profiled_processes :(

[Jongy]

Getting this error:

Exception in thread Process Events Listener:
Traceback (most recent call last):
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.8/dist-packages/granulate_utils/linux/proc_events.py", line 165, in _proc_events_listener
    self._register_for_connector_events(self._socket)
  File "/usr/local/lib/python3.8/dist-packages/granulate_utils/linux/proc_events.py", line 110, in _register_for_connector_events
    socket.send(nl_msg)
ConnectionRefusedError: [Errno 111] Connection refused

[Jongy]

Getting this error:

Exception in thread Process Events Listener:
Traceback (most recent call last):
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.8/dist-packages/granulate_utils/linux/proc_events.py", line 165, in _proc_events_listener
    self._register_for_connector_events(self._socket)
  File "/usr/local/lib/python3.8/dist-packages/granulate_utils/linux/proc_events.py", line 110, in _register_for_connector_events
    socket.send(nl_msg)
ConnectionRefusedError: [Errno 111] Connection refused

We're failing tests upon ERRORs in the log, but since this happens in another thread and it's not logged, it doesn't fail the tests :/

[Jongy]

I pushed an update that merges this logic with #219 , as suggested in #219 (comment).

[Jongy]

Getting this error:

Exception in thread Process Events Listener:
Traceback (most recent call last):
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.8/dist-packages/granulate_utils/linux/proc_events.py", line 165, in _proc_events_listener
    self._register_for_connector_events(self._socket)
  File "/usr/local/lib/python3.8/dist-packages/granulate_utils/linux/proc_events.py", line 110, in _register_for_connector_events
    socket.send(nl_msg)
ConnectionRefusedError: [Errno 111] Connection refused

It seems like this happens since we're running in a network namespace. forkstat fails on a privileged container but passes on if --net=host.

.