-
Notifications
You must be signed in to change notification settings - Fork 501
[EXPERIMENT] [Builtins] 10x more builtins #6502
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[EXPERIMENT] [Builtins] 10x more builtins #6502
Conversation
|
/benchmark validation |
|
/benchmark nofib |
|
/benchmark lists |
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
/benchmark validation |
|
Comparing benchmark results of 'nofib' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'lists' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
|
/benchmark validation |
2 similar comments
|
/benchmark validation |
|
/benchmark validation |
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR) Results table
|
Yup, the benchmarking machine is cooked as it turns out (confirmed elsewhere). Well, gotta wait for it to recover. |
|
/benchmark validation-full |
1 similar comment
|
/benchmark validation-full |
|
Click here to check the status of your benchmark. |
|
/benchmark validation-full |
|
Comparing benchmark results of 'validation-decode' on 'edcb89629b' (base) and 'c5bb3ac926' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and 'c5bb3ac926' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and 'c5bb3ac926' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and 'c5bb3ac926' (PR) Results table
|
…to effectfully/experiment/builtins/10x-more-builtins
|
/benchmark validation |
1 similar comment
|
/benchmark validation |
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '0effd6cae' (base) and '48616b60b' (PR) Results table
|
|
Click here to check the status of your benchmark. |
|
Comparing benchmark results of 'validation' on '0effd6cae' (base) and '48616b60b' (PR) Results table
|
|
Experiment over, this weirdness needs to be investigated, maybe we already pay some unnecessary costs. Made a subticket in #4306:
|
|
The conflicts don't seem too bad, we should rerun the benchmarks once the issue of misleading benchmarking is fixed before this branch bitrots any further. |

This replicates the existing builtins so that there are 10x of them now. This is just to check whether it results in any evaluation slowdown.