Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chinese custom dataset #16

Closed
xxllp opened this issue Mar 14, 2022 · 2 comments
Closed

chinese custom dataset #16

xxllp opened this issue Mar 14, 2022 · 2 comments

Comments

@xxllp
Copy link

xxllp commented Mar 14, 2022

中文的数据格式需要转换成哪张数据集的 格式才可以
@Coopercoppers
Copy link
Owner

Coopercoppers commented Mar 14, 2022 •
edited
Loading

随便哪个都行，所有的数据集经过preprocess函数之后都会转换成统一格式，你可以先转换成任意已有数据集的格式，或者是自定义preprocess函数，直接转换成类似ace_preprocess的输出形式

另外中文数据集用pfn-nested，尽量不要用原模型

@guanxichouqu
Copy link

中文的数据格式需要转换成哪张数据集的 格式才可以

你好 请问一下 我最近也想用该模型在中文数据集上测试测试效果 可以向你请问一下相关经验吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@xxllp @Coopercoppers @guanxichouqu