[backend-comparison] Burnbench CLI

[syl20bnr]

Checklist

• Confirmed that run-checks all script has been executed.
• Made sure the book is up to date with changes in this PR.

Related Issues/PRs

Issue #1072

Changes

Add a new binary to backend-comparison crate called burnbench.

There are two mods for this CLI: term and tui. The UI is a work in progress and must be enabled explicitly with the tui feature.

See the README for details about the CLI user experience. I tried to made it auto-discoverable and auto-correct as much as possible. For instance typos show the list of supported benchmarks or backends with a proposal to fix it:

I chose to repeat the arguments --backend and --bench instead of using comma separated list because the code is simpler and it better leverage clap and strum.

I chose l-b shorthand for a bench and -B for backend because the tool is about benchmarks so I believe that the natural lower case is for a bench.

I'll open a different PR for the upload.

Testing

Here is two commands to quickly test:

cargo run --bin burnbench -- list

cargo run --bin burnbench -- run --bench unary --bench binary --backend wgpu-fusion --backend wgpu

[codecov]

Codecov Report

Attention: 127 lines in your changes are missing coverage. Please review.

Comparison is base (9df2071) 84.41% compared to head (8cac2d6) 84.26%.
Report is 16 commits behind head on main.

Files	Patch %	Lines
backend-comparison/src/burnbenchapp/base.rs	0.00%	58 Missing ⚠️
burn-dataset/src/vision/image_folder.rs	79.91%	49 Missing ⚠️
backend-comparison/src/burnbenchapp/term/base.rs	0.00%	17 Missing ⚠️
backend-comparison/src/bin/burnbench.rs	0.00%	3 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1260      +/-   ##
==========================================
- Coverage   84.41%   84.26%   -0.15%     
==========================================
  Files         549      553       +4     
  Lines       61952    62275     +323     
==========================================
+ Hits        52295    52478     +183     
- Misses       9657     9797     +140     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[nathanielsimard]

I don't have much comments, seems good in general!