This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 137
Testing suite for builder #10
Comments
I was thinking we need these things:
the output should be something like:
ideally this is somehow standardized with the same inputs so that you can directly compare 2 versions of the code and say "hey, this version performed better than the other, which performs better than the main branch" |
Ruteri
added a commit
that referenced
this issue
Dec 21, 2022
Ruteri
added a commit
that referenced
this issue
Dec 21, 2022
Ruteri
added a commit
that referenced
this issue
Dec 21, 2022
avalonche
pushed a commit
that referenced
this issue
Feb 7, 2023
avalonche
pushed a commit
that referenced
this issue
Feb 7, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 9, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 9, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 15, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 15, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 17, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 17, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 22, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 22, 2023
avalonche
pushed a commit
that referenced
this issue
Jul 6, 2023
avalonche
pushed a commit
that referenced
this issue
Jul 6, 2023
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Rationale
To allow anyone to easily make changes to the builder, measure their impact, and ensure that they are safe.
Implementation
One way to approach this is to create a mass conflicting bundles at random and test merging against those. But thinking it through we might want a standardized dataset that allows for more precise measurement of performance (e.g. variance in the randomized generation of bundles doesn't affect performance)
The text was updated successfully, but these errors were encountered: