New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

预训练数据集问题 #12

Open

lxianl455 opened this issue Apr 5, 2024 · 1 comment

lxianl455 commented Apr 5, 2024

请问使用的预训练数据集是什么？我去BELLE仓库去看，看到的大多数都是指令微调的数据集。你是使用类似于Multiturn Chat这种数据集去做预训练的吗？

Owner

charent commented Apr 20, 2024

现在huggingface发布的版本中，有添加过单论对话的语料，多轮对话的语料没有添加

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment