661: update supported python versions

[lindsay-stevens]

Closes #661
Closes #701

• python 3.10, 3.11, 3.12 with 3.10 as the default
• update ruff and lxml
• ruff formatting changes for py3.10 are generally one of the following:
  • line at top of file after module docstring
  • typing:
    • Union[x, y] -> x | y
    • imports from typing to use either builtins or stdlib
  • replace simple string subs "%s" with f-strings
    • many still remain due to use of common templates etc
  • explicitly state new default strict=False for zip, map
  • parenthesis allowed in with to group contexts

Why is this the best possible solution? Were any other approaches considered?

Considered including 3.8 (EOL 2024-10) and 3.9 (EOL 2025-10) but that would have meant testing on 5 different major Python versions or excluding newer versions, being limited to the oldest version's syntax, and increasing the potential for code or library incompatibilities. Also, lately we have updated Python version support every 2 years (2020, 2022, 2024) so these would have gone out of support by 2026.

Considered supporting 3.12 only (in line with pyODK) but according to these PyPi stats it's adoption is about 5% as of 2024-05-04. Adoption of 3.10 to 3.12 inclusive is more like 40%. Using 3.10 as the default / lowest version allows for nice things like the newer typing syntax and structural pattern matching.

What are the regression risks?

The py3.10 typing syntax would throw an error for older Python versions. The f-strings replacements were fiddly and so could be off but I checked them over a few times and the tests pass.

Does this change require updates to documentation? If so, please file an issue here and include the link below.

Yes, the README is updated.

Before submitting this PR, please make sure you have:

• included test cases for core behavior and edge cases in tests
• run python -m unittest and verified all tests pass
• run ruff format pyxform tests and ruff check pyxform tests to lint code
• verified that any code or assets from external sources are properly credited in comments

[lognaturel]

according to these PyPi stats it's adoption is about 5% as of 2024-05-04

😱 Should we consider expanding the range for pyodk? Maybe we only consider it if someone asks for it. I wonder whether that number is so low because most Python installations are just default ones that come with OS distributions.

[lognaturel]

Fascinating to see these numbers and the relationship between them change.

[lindsay-stevens]

Yep I've added #708 for follow up

[lognaturel]

Hurray! 🎉