Rust Performance Measurements

[voronaam]

We should retest benchmarks as we migrate to Rust and also test on a variety of worker setups (different size of workers different amount of memory for workers)

KJ: do you think this is trivial with the benchmarking script you made? as in, will it work automatically with the new runtime (I imagine?) if so (or not!) can you add a time estimate here?

Yann: Correct. Having the new runtime won't impact the benchmarking script since it interacts only with pycape (create datasets with different sizes, add dataviews, run a job etc.). So it will be trivial to re-benchmark. What could be more time consuming is if we want to benchmark with different machines (need launch new workers with new config etc.) but that's not a problem.

Original Clickup: https://app.clickup.com/t/f908fa