Create benchmark suite

[ricardoV94]

Description

Something like https://github.com/numpy/numpy/tree/main/benchmarks could be useful to guide performance-related decisions and alert us to unintended regressions.

[ricardoV94]

Using pytest-benchmark in #139

There's an option to obtain graphs in a github page of the repo, if anyone is interested in exploring: https://github.com/benchmark-action/github-action-benchmark#charts-on-github-pages-1

[ricardoV94]

We should also add benchmark tests for compilation times, not just runtime. That may be a bit tricky because we need to clear the cache between runs?

[michaelosthege]

The benchmark suite is there, but it appears to be a bit flaky.
On this recent commit that only affects PyPI package builds, there was a performance alert: a6e7722#commitcomment-98337087