Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The question about GRU setting #27

Closed
liu0527aa opened this issue Oct 13, 2020 · 1 comment
Closed

The question about GRU setting #27

liu0527aa opened this issue Oct 13, 2020 · 1 comment

Comments

@liu0527aa
Copy link

我注意到你使用GRU模块将128维降维至32。这块对于GRU的设置处理是怎么思考的,GRU的降维是否会导致部分信息的损失?

@lidq92
Copy link
Owner

lidq92 commented Oct 13, 2020

@liu0527aa 降维是会丢失信息,但是这个网络从输入到输出本来就是在丢失次要信息留下主要信息的过程呀,没明白你有疑问的点在哪里。

GRU模块的超参数我没用验证集去选择,就是简单设置的,从128->32就是兼带降维,你也可以试试128->128, 或者甚至是升维,但是升维的操作在这个问题里是不常见的。

@lidq92 lidq92 closed this as completed Oct 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants