Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问有finetune教程的教程吗 #63

Open
wind91725 opened this issue Apr 10, 2020 · 9 comments
Open

请问有finetune教程的教程吗 #63

wind91725 opened this issue Apr 10, 2020 · 9 comments

Comments

@wind91725
Copy link

您好，请问如何使用自己的数据集finetune？有没有啥readme之类的 ？
@SeekPoint
Copy link

+1

2 similar comments
@fred-github
Copy link

+1

@sugarshaw95
Copy link

+1

@wind91725
Copy link
Author

finetune教程 https://github.com/wind91725/gpt2-ml-finetune-

@huangdacheng
Copy link

finetune教程 https://github.com/wind91725/gpt2-ml-finetune-

觉得奇怪的地方， train和 inference的时候使用的vocabulary 不是同一个文件的？

@danielkaifeng
Copy link

用的是不是tokenization/clue-vocab.txt？

@huangdacheng
Copy link

用的是不是tokenization/clue-vocab.txt？

我的理解 应该是 train和inference 应该是需要是同一个 vocabulary，因为原来作者给的5G模型 用的是 tokenization/clue-vocab.txt，那应该finetuning的时候 也使用这个

@cncbec
Copy link

cncbec commented Sep 26, 2020

finetune教程 https://github.com/wind91725/gpt2-ml-finetune-

请问能对最新模型进行调优吗？没看到有教程，请教。

@zaqzaq163
Copy link

zaqzaq163 commented Apr 2, 2021 •
edited

最新模型地址
https://github.com/zaqzaq163/gpt2-ml-finetune-example

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@huangdacheng @fred-github @sugarshaw95 @SeekPoint @danielkaifeng @zaqzaq163 @wind91725 @cncbec