Monitoring 2.0

[yadudoc]

Extensive updates to the monitoring subsystem:

• Monitoring now uses a separate MonitoringHub that launches on the Parsl side
• Cleaner DB integration with Sqlalchemy
• Default logging to a local sqlite database
• ZMQ channels for priority messages to ensure ciritical info is not dropped
• UDP packets for lower priority resource monitoring information
• Updated configs with a cleaner class based model.

Here's a sample config:

config = Config(
    executors=[
        HighThroughputExecutor(
            label="local_htex",
            cores_per_worker=1,
            address=address_by_hostname(),
        )
    ],
    monitoring=MonitoringHub(
        hub_address=address_by_hostname(),
        hub_port=55055,
        logging_level=logging.INFO,
        resource_monitoring_interval=10,
    ),
    strategy=None
)

Please note that this is not tested for remote interchange configurations where worker nodes are not able to reach the parsl client side.