Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

squad数据集的模型怎么构造? #73

Closed
miaohaa opened this issue Jul 12, 2019 · 7 comments
Closed

squad数据集的模型怎么构造? #73

miaohaa opened this issue Jul 12, 2019 · 7 comments
Assignees
Labels
enhancement New feature or request

Comments

@miaohaa
Copy link

miaohaa commented Jul 12, 2019

squad数据集的模型怎么构造?ernie的sequence_out输出后,我接了两层全连接,最后输出shape为[-1,2], 和label[23,28]计算cross_entropy,然后使用finetue_and_evl函数(“sequence_labeling”)训练,怎么报错? Invoke operator mul error.

@miaohaa
Copy link
Author

miaohaa commented Jul 12, 2019

可以出一个阅读理解的demo吗?

@miaohaa
Copy link
Author

miaohaa commented Jul 13, 2019

ernie输入的max_seq_len必须是512吗?

@miaohaa
Copy link
Author

miaohaa commented Jul 13, 2019

出错是这个原因吗?

@Steffy-zxf
Copy link
Contributor

感谢反馈!目前PaddleHub还未支持阅读理解任务迁移学习,需要用户自定义阅读理解的Task、SQuAD数据集的加载和Reader。另外,由于PaddleHub开放的Module ERNIE预训练数据集为中文数据集,故利用ERNIE Module不能完成SQuAD数据集的阅读理解任务。不过您可以尝试PaddleHub Module bert_uncased_L-12_H-768_A-12,支持该任务。ERNIE的max_seq_len不是必须512,可以根据您的显存大小选择合适的max_seq_len。另外PaddleHub会尽快release SQuAD数据集的阅读理解任务demo。

@miaohaa
Copy link
Author

miaohaa commented Jul 13, 2019

那中文数据集的阅读理解任务的迁移学习,是否会出吗?

@ZeyuChen ZeyuChen added the enhancement New feature or request label Jul 18, 2019
@Steffy-zxf
Copy link
Contributor

基于SQuAD数据集的阅读理解任务demo在测试分支add-reading-comprehension-task,
欢迎试用。
https://github.com/PaddlePaddle/PaddleHub/tree/add-reading-comprehension-task/demo

@Steffy-zxf
Copy link
Contributor

您好,此issue在近一个星期内暂无更新,我们将于今天内关闭。若在关闭后您仍需跟进提问,可重新开启此问题。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants