Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] alpaca_eval 2.0 #196

Merged
merged 25 commits into from
Jan 10, 2024
Merged

[ENH] alpaca_eval 2.0 #196

merged 25 commits into from
Jan 10, 2024

Conversation

YannDubs
Copy link
Collaborator

@YannDubs YannDubs commented Jan 3, 2024

Todo:

  • update website
  • update readme
  • precompute the full minimal leaderboard with alpaca_eval_cot_gpt4_turbo_fn
  • precompute the full minimal leaderboard with alpaca_eval_gpt4_turbo_fn
  • better interpretability of CoT
  • decide on the desired annotator
  • add sample sheet formatting for CoT

Here's how the website now looks like:

Screenshot 2024-01-03 at 18 54 28

@YannDubs YannDubs changed the title [ENH] alpaca_eval 2.0 [WIP] alpaca_eval 2.0 Jan 3, 2024
@YannDubs YannDubs changed the title [WIP] alpaca_eval 2.0 [ENH] alpaca_eval 2.0 Jan 4, 2024
@YannDubs YannDubs merged commit a023f53 into main Jan 10, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant