Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

training continuous with ctc loss? #4

Closed
PanXiebit opened this issue Jun 12, 2020 · 1 comment
Closed

training continuous with ctc loss? #4

PanXiebit opened this issue Jun 12, 2020 · 1 comment

Comments

@PanXiebit
Copy link

你好，

请问你有试着用ctc loss来训练 continuous SLR 吗？我的模型很简单，就是 pretrained EfficientNet + self-attention(3 layer) + linear + ctc loss. 我是在RWTH-PHOENIX- Weather-2014T 这个数据集上训练的，然后发现loss完全降不下去，维持在5.2左右，而且在解码的时候只预测blank。个人感觉应该不是我的ctc loss使用问题，因为我之前用ctc loss训练machine translation是没有问题的。想知道你有训练过这个数据集和用ctc来训这个模型吗？
@0aqz0
Copy link
Owner

0aqz0 commented Jun 16, 2020

我个人没试过诶，只是看到过这种方法
尝试检查一下输入输出吧，或者是不是学习率设太高了

@0aqz0 0aqz0 closed this as completed Jun 22, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@PanXiebit @0aqz0