Skip to content

[bench] Group benchmarked tests better to more clearly show appropriate comparisons. #29

@tshur

Description

@tshur

Today, when we benchmark tests, all the tests are clumped together, and they are not being compared with each other clearly. Can we group by file / target such that sorts are compared vs sorts, and so on?

Today running a blanket benchmark (note how many different algorithms are compared in the same table; hard to see which sort is the best):
Image

For now, a workaround is limiting the set of benchmarks:

# Only run benchmarks, for sorting directory, which contain "lg" (i.e., the large scale benches).
uv run pytest --benchmark-only tests/sort/ -k "lg"
Image

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions