New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

多轮对话evaluation #32

Closed

MelodyChenjun opened this issue Sep 4, 2023 · 1 comment

MelodyChenjun commented Sep 4, 2023

请问可以公开多轮对话评测的实现细节和prompt吗？

Contributor

jymChen commented Sep 26, 2023

Hi @MelodyChenjun,
多轮对话评测是将评测数据中的病人信息给ChatGPT模拟病人，然后ChatGPT询问模型拿到对话信息，再用GPT4对不同模型的对话内容进行打分。

病人Prompt

你是一名患者，下面是你的病情， 你正在向${model_name} 智能医生咨询病情相关的问题，请记住这是一个多轮咨询过程，每次询问要精炼一些，第一次询问要尽可能简单点、内容少一点。
${medical_case} 
当你认为整个问诊应该结束的时候请说：再见

StevenZHB closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment