Speed up websocket and ingress with aiohttp-zlib-ng

[bdraco]

Proposed change

https://github.com/bdraco/aiohttp-zlib-ng
https://github.com/pycompression/python-zlib-ng

zlib-ng was choosen because:

• Its at the point where cloudflare is using it in production (they have some more patches on top, and some have been contributed back)
• Its a drop-in replacement for zlib with no code changes needed
• Fedora is talking about making it the default zlib implementation https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/thread/CDNPJ4SOTRQMYVCDI3ZSY4SP4FYESCWD/
• well maintained https://github.com/zlib-ng/zlib-ng/releases
• It has significant performance improvements over stock zlib https://www.phoronix.com/news/Zlib-ng-2.1-Beta

Other alternatives (https://bugs.python.org/issue41566) where not choosen because:

python-isal: https://github.com/pycompression/python-isal: not widely compatible, not a drop-in replacement
libdeflate: no stream implementation, not a drop-in replacement

wheels have built successfully: https://wheels.home-assistant.io/musllinux/

Type of change

• Dependency upgrade
• Bugfix (non-breaking change which fixes an issue)
• New integration (thank you!)
• New feature (which adds functionality to an existing integration)
• Deprecation (breaking change to happen in the future)
• Breaking change (fix/feature causing existing functionality to break)
• Code quality improvements to existing code or addition of tests

Additional information

• This PR fixes or closes issue: fixes #
• This PR is related to issue:
• Link to documentation pull request:

Checklist

• The code change is tested and works locally.
• Local tests pass. Your PR cannot be merged unless tests pass
• There is no commented out code in this PR.
• I have followed the development checklist
• I have followed the perfect PR recommendations
• The code has been formatted using Black (black --fast homeassistant tests)
• Tests have been added to verify that the new code works.

If user exposed functionality or configuration variables are added/changed:

• Documentation added/updated for www.home-assistant.io

If the code communicates with devices, web services, or third-party tools:

• The manifest file has all fields filled out correctly.
  Updated and included derived files by running: python3 -m script.hassfest.
• New or updated dependencies have been added to requirements_all.txt.
  Updated by running python3 -m script.gen_requirements_all.
• For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.
• Untested files have been added to .coveragerc.

To help with the load of incoming pull requests:

• I have reviewed two other open pull requests in this repository.

[home-assistant]

Hey there @home-assistant/core, mind taking a look at this pull request as it has been labeled with an integration (http) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of http can trigger bot actions by commenting:

• @home-assistant close Closes the pull request.
• @home-assistant rename Awesome new title Renames the pull request.
• @home-assistant reopen Reopen the pull request.
• @home-assistant unassign http Removes the current integration label and assignees on the pull request, add the integration domain after the command.

[bdraco]

anything that is added as a dep to http needs to be a core dep because its too late to import it otherwise

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/bdraco/home-assistant/homeassistant/runner.py", line 17, in <module>
    from . import bootstrap
  File "/Users/bdraco/home-assistant/homeassistant/bootstrap.py", line 20, in <module>
    from .components import http
  File "/Users/bdraco/home-assistant/homeassistant/components/http/__init__.py", line 46, in <module>
    from .auth import async_setup_auth
  File "/Users/bdraco/home-assistant/homeassistant/components/http/auth.py", line 21, in <module>
    from homeassistant.components import websocket_api
  File "/Users/bdraco/home-assistant/homeassistant/components/websocket_api/__init__.py", line 13, in <module>
    from . import commands, connection, const, decorators, http, messages  # noqa: F401
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/bdraco/home-assistant/homeassistant/components/websocket_api/commands.py", line 54, in <module>
    from . import const, decorators, messages
  File "/Users/bdraco/home-assistant/homeassistant/components/websocket_api/decorators.py", line 15, in <module>
    from .connection import ActiveConnection
  File "/Users/bdraco/home-assistant/homeassistant/components/websocket_api/connection.py", line 13, in <module>
    from homeassistant.components.http import current_request
ImportError: cannot import name 'current_request' from partially initialized module 'homeassistant.components.http' (most likely due to a circular import) (/Users/bdraco/home-assistant/homeassistant/components/http/__init__.py)

[jpbede]

I've tested this in my local dev environment and prod environment with addons, everything works fine. No visible break in ingress or websocket while using. Ingress felt more responsive, but haven't measured this.

[bdraco]

Thanks for testing 👍

[bdraco]

Pushed to a few more production systems. All good

[bdraco]

mysql test failure is unrelated. still don't know why that times out.

[sairon]

This change is probably cause of this regression, where the Core fails to start completely on CPUs that don't support some modern instruction sets used by our zlib-ng build: #105254