Upgrade to PySpark 4 #223
Description
PySpark 4 is available as of May 2025: https://pypi.org/project/pyspark/.
We should upgrade if possible. I've tried upgrading and running the tests, and it seems that there are some issues to work through.
{{ message }}