Refactoring webserver: async metrics handler, upgrades dependencies and fixes testing fixtures

[pcrespov]

What do these changes do?

General maintenance of the webserver

• CHANGES: makes metrics_handler implementation async by using a thread pool executor ot execute prometheos_client.generate_latest call
• CHANGES: general upgrade of webserver dependencies:
  • aiohttp and python-socketio cannot be upgraded to the latest. Needs further refactoring (see ⚗️ web-server refactoring backlog #2008 and notes in requirement files)!
• FIXES: services/web/server/tests/integration/01/test_exporter.py was de-activated.
  • Minor refactoring of fixtures
• CHANGES: unified pylint testing by reusing pytest-simcore utils
• CHANGES: moves socket-io fixtures to simcore-pytest

Next steps (different PRs)

• Remove trafaret dependency by pydantic-settings
• Remove constraints to aiohttp and python-socketio
• Replace openapi-core by pydantic (evaluate https://github.com/Maillol/aiohttp-pydantic)

Related issue/s

Towards spliting webserver

How to test

Checklist

• Did you change any service's API? Then make sure to bundle document and upgrade version (make openapi-specs, git commit ... and then make version-*)
• Unit tests for the changes exist
• Runs in the swarm
• Documentation reflects the changes
• New module? Add your github username to .github/CODEOWNERS

[codecov]

Codecov Report

Merging #2343 (ef900eb) into master (2f08064) will increase coverage by 1.5%.
The diff coverage is 57.1%.

@@           Coverage Diff            @@
##           master   #2343     +/-   ##
========================================
+ Coverage    73.0%   74.6%   +1.5%     
========================================
  Files         508     508             
  Lines       19768   19772      +4     
  Branches     1943    1943             
========================================
+ Hits        14436   14751    +315     
+ Misses       4846    4506    -340     
- Partials      486     515     +29     

Flag	Coverage Δ
integrationtests	66.7% <35.7%> (+4.7%)	⬆️
unittests	68.3% <57.1%> (-0.1%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...imcore_service_webserver/diagnostics_monitoring.py	88.7% <50.0%> (-2.5%)	⬇️
...mcore_service_webserver/socketio/handlers_utils.py	92.8% <100.0%> (+0.2%)	⬆️
...ce_webserver/resource_manager/garbage_collector.py	74.8% <0.0%> (-1.9%)	⬇️
.../director/src/simcore_service_director/producer.py	60.8% <0.0%> (+0.2%)	⬆️
...imcore_service_webserver/scicrunch/scicrunch_db.py	48.5% <0.0%> (+2.8%)	⬆️
...r/src/simcore_service_webserver/exporter/config.py	100.0% <0.0%> (+5.5%)	⬆️
...er/src/simcore_service_webserver/catalog_client.py	53.9% <0.0%> (+7.8%)	⬆️
...ce_webserver/exporter/formatters/base_formatter.py	100.0% <0.0%> (+18.1%)	⬆️
.../src/simcore_service_webserver/storage_handlers.py	79.6% <0.0%> (+19.4%)	⬆️
...vice_webserver/exporter/formatters/sds/__init__.py	100.0% <0.0%> (+20.0%)	⬆️
... and 11 more

[sanderegg]

great! just concerning the thread pool quickly check my comment there before merging.

[GitHK]

Very nice overall.
One concern, as said below. Why not replace the prometheus client with the async version?

[mguidon]

Looks good. Did you think about using celery for the metrics generation?