job runner benchmarking

[johrstrom]

One thing we're going to want in this new job interface is benchmarks (or the ability to benchmark) a given an ... input (whatever that may be).

Don't know what this looks like, but it seems like it would be something like

• ability to bench mark a job/project
• keep track of benchmarks
• publicize/share benchmarks

┆Issue is synchronized with this Asana task by Unito

[sync-by-unito]

➤ Travis Ravert commented:

I spoke with Ricardo de Souza Jacomini at PEARC and he mentioned that he has been doing work around exactly this type of problem, while also working around trying to use ML to then analyze the results to then possibly help users run more efficient and less error prone jobs.

I will send an email to try and coordinate a meeting with him to see if we can share ideas.