A collection of TTFX workloads for Julia packages, for longitudinal performance testing.
Manual PRs are also accepted, but I think you’ll find the issue-based approach pretty smooth 😎.
Tasks should be a tiny representative workload that doesn’t require network access or modify the system state beyond creating files in the working, temp, and cache directories (submitted tasks are run in a sandbox that enforces this).
TTFX workloads can be found under tasks/<pkg>/* each workload consists of a
script (task.jl) and a Project.toml. When executed, each script will print the
time taken to:
- Load the package
- Run the script
- The total run time
With the format:
[load time], [run time], [total time] seconds
for example:
0.1, 0.2, 0.3 seconds
Also take note this is a community effort involving package authors and third-party contributions. While we try to ensure the submissions are of a reasonable quality, it is always sensible to take precautions when running a collection of snippets, such as using containers.