Upgrade to Python 3.11

[AetherUnbound]

Description

Python 3.11 is finally out, and with it comes a tremendous potential speedup:

Python 3.11 is between 10-60% faster than Python 3.10. On average, we measured a 1.25x speedup on the standard benchmark suite.

There are also some other exciting changes, including TypedDict optional fields improvements, enriched exceptions, and finer-grained exceptions.

We should try to get on this version as soon as possible, but unfortunately we're dependent on Airflow being Python 3.11 compatible. Work is being done upstream to accomplish this, and we should try to monitor it closely!

apache/airflow#27292

apache/airflow#27264

Additional context

Implementation

• 🙋 I would be interested in implementing this feature.

[dhruvkb]

This issue should go in WordPress/openverse. We would definitely want Python 3.11 in the API and ingestion-server as well!

[AetherUnbound]

Agreed, we'll want them upgraded too! I'm assuming dependabot will actually cover those two repos next month, but I think a separate issue in this repo is reasonable since we're pretty heavily dependent on Airflow supporting 3.11 before advancing on this.

[dhruvkb]

😄 The action item from 2022-11-03 was finally completed.

[sarayourfriend]

Closing this as finished, in favour of just using #663 to upgrade Airflow.