Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ChatLog-Monthly数据集形式 #1

Closed
phoenixsecularbird opened this issue May 4, 2023 · 3 comments
Closed

ChatLog-Monthly数据集形式 #1

phoenixsecularbird opened this issue May 4, 2023 · 3 comments

Comments

@phoenixsecularbird
Copy link

您好！根据文章里表1，ChatLog-Monthly好像是一个分类任务，但是我下载了您发布的数据集，好像不是这样，请问具体是什么情况呢？
@ShangQingTu
Copy link
Member

ChatLog-Monthly大部分是分类任务，比如情感分类的GoEmo。也有推理任务，比如MathQA。
发布出来的数据是ChatGPT的原始回答，可能是一段话而不是标签，我们是用正则表达式后处理后得到分类标签再去计算得分的。
如果您还有其他疑问，欢迎继续联系我！

@ShangQingTu
Copy link
Member

我们在论文的附录A中详细介绍了ChatLog-Monthly使用的所有benchmark，正文里可能介绍的不是很详细～

@phoenixsecularbird
Copy link
Author

好的，谢谢回复！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@phoenixsecularbird @ShangQingTu