-
Notifications
You must be signed in to change notification settings - Fork 650
Add AlgoTune tasks for OpenEvolve #181
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add AlgoTune tasks for OpenEvolve #181
Conversation
|
Hi thank you so much for doing this! Did you obtain any results that beat the ones in the paper? |
@ofirpress Thank you for creating such a great benchmark! I'm still running experiments on it, so I don't have results yet, but it's been interesting so far. Would be cool to see others try it too! |
|
We did benchmark with AlgoTune recently, here are some early results - https://huggingface.co/blog/driaforall/towards-open-evolutionary-agents |
|
@codelion Super cool!!! Looking forward to what you'll discover next there. |
|
@richardcsuwandi we do not need the full source of all the algotune tasks we can just clone the repo and then use your create_task.py to adapt the task. Can you remove all the existing tasks and update the script so that it can take the location of the algotune repo/folder that ways we can generate the openeolve programs and evaluators as needed. |
|
@codelion Hi, thanks for the suggestions! I have refactored the AlgoTune task adapter to work with external AlgoTune repositories instead of maintaining duplicate task copies in the OpenEvolve repository. |
|
I took over this PR to get algotune in the repo. Will be part of the new 0.1.1 release. |
|
Thanks so much @codelion! |
…ndi/main Add AlgoTune tasks for OpenEvolve
This PR integrates AlgoTune tasks into OpenEvolve.
Key Additions
initial_program.py,evaluator.py, andconfig.yamlImplementation
EVOLVE-BLOCKmarkersExample: SVM Task