-
Notifications
You must be signed in to change notification settings - Fork 203
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Humpback to AlpacaEval #120
Conversation
Thanks @xianxl. Please double check the LLaMA2 question, and if it’s correct I’ll |
@YannDubs thanks for taking a look. Could point me where to check for "LLaMA2 question"? Sorry I may be missing something obvious. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@xianxl added, sorry seems like I forgot to submit the review before
prompt_template: "humpback-llama-65b/prompt.txt" | ||
fn_completions: "" | ||
completions_kwargs: | ||
model_name: "humpback-llama2-65b" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If that is LLAMA2 is it supposed to be 70B ?
temperature: 0.7 | ||
top_p: 0.9 | ||
pretty_name: "Humpback LLaMa2 65B" | ||
link: "" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you send a PR for the arxiv link when it’s online, thanks!
We can merge this one before
@YannDubs Thanks! I've updated the model name for llama2. Will open another PR to add the link to arxiv paper by Monday. |
Thanks!! |
Thanks for catching that! I'll add the missing examples. |
Add two Humpback models to the leaderboard: humpback-llama-65b and humpback-llama2-65b. Model details can be find in the paper to be appeared on arxiv.