-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add detailed tutorial for adding new evaluation benchmarks #1827
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is exciting!
One suggestions is that we can probably make the README a bit less verbose without hurting understandability at all. Personally when I see a long README I hesitate to read it a bit, so making it more concise might make it seem less intimidating.
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Thanks a ton, @neubig, for the feedback! I've cleaned up the README and move those comments to the actual code file :) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is very helpful! Appreciate your attention to details. I left some suggestions. I already applied all typo fixes, but the rest are up to you.
@xingyaoww ping me when this is ready to review (maybe also considering @li-boxuan 's comments), and I'll make a final pass through! |
Co-authored-by: Boxuan Li <liboxuan@connect.hku.hk>
Co-authored-by: Boxuan Li <liboxuan@connect.hku.hk>
Co-authored-by: Boxuan Li <liboxuan@connect.hku.hk>
Co-authored-by: Boxuan Li <liboxuan@connect.hku.hk>
@neubig Should be ready for another round of review now :) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thank you!
Looks great! |
Co-authored by OpenDevin :)