Right now i personally am quite lost how the benchmark has evolved the changelogs are not clear. I do fill a bit overwhelmed while setting the bench and using it has truly became a different story.
I suggest for addition of tutorial and introduction videos for bench that help why the benchmark was made, setup, usage.
This could be potentially used for purpose of PR of competitions that happen under the Benchmarks them.
Also i Suggest to update the Benchmark graph if we have tested new models the benchmark readme feels less updated.
Right now i personally am quite lost how the benchmark has evolved the changelogs are not clear. I do fill a bit overwhelmed while setting the bench and using it has truly became a different story.
I suggest for addition of tutorial and introduction videos for bench that help why the benchmark was made, setup, usage.
This could be potentially used for purpose of PR of competitions that happen under the Benchmarks them.
Also i Suggest to update the Benchmark graph if we have tested new models the benchmark readme feels less updated.