Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

中文版蒸馏模型 #41

Closed
Cumberbatch08 opened this issue Feb 6, 2020 · 9 comments
Closed

中文版蒸馏模型 #41

Cumberbatch08 opened this issue Feb 6, 2020 · 9 comments

Comments

@Cumberbatch08
Copy link

  1. 官方最近有更新中文版模型计划吗？
  2. 有人自己训练蒸馏中文版模型吗？蒸馏模型做下游任务效果如何？
@wykdg
Copy link

wykdg commented Feb 7, 2020

2.跟英文的差不多，效果缩水一点

@Cumberbatch08
Copy link
Author

tinybert通用蒸馏模型可以发布出来吗？或者是共享一下？

@yxjhuster
Copy link

简单任务的话性能和论文里差不多，复杂任务有所缩水

@guotong1988
Copy link

同问。

@DeligientSloth
Copy link

  1. 官方最近有更新中文版模型计划吗？
  2. 有人自己训练蒸馏中文版模型吗？蒸馏模型做下游任务效果如何？

请问你搞来了中文蒸馏模型了吗？

@ann22
Copy link

ann22 commented Aug 18, 2020

2.跟英文的差不多，效果缩水一点

请问如何自己训练中文版蒸馏模型

@wykdg
Copy link

wykdg commented Aug 18, 2020

直接用textbrewer吧

@SunShuoying
Copy link

@wykdg 老哥，你是怎么做的能给个教程不？

@jacobrxz
Copy link
Member

jacobrxz commented Jan 6, 2021

您好，如果有相关开源计划我们会第一时间告知，多谢关注~

@jacobrxz jacobrxz closed this as completed Jan 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@guotong1988 @wykdg @SunShuoying @jacobrxz @ann22 @Cumberbatch08 @DeligientSloth @yxjhuster