Skip to content

How to evaluate chat-based models on examination datasets (e.g. C-Eval) properly? #674

Answered by Leymore
Owen-Qin asked this question in Q&A
Discussion options

You must be logged in to vote

It seems that you are using the wrong qwen-72b-chat model config as the user & bot prompt is missing, plz try this:

https://github.com/open-compass/opencompass/blob/8798336b8593ce059ff0e54b2f2faf78c328bccc/configs/models/qwen/hf_qwen_72b_chat.py

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@Owen-Qin
Comment options

Answer selected by Owen-Qin
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants