Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train base model in teacher-forcing mode #13

Closed
pratham16cse opened this issue Sep 27, 2020 · 1 comment
Closed

Train base model in teacher-forcing mode #13

pratham16cse opened this issue Sep 27, 2020 · 1 comment
Assignees
Labels

Comments

@pratham16cse
Copy link
Owner

pratham16cse commented Sep 27, 2020

  • The model makes sequential predictions during training also.
  • This might be the reason for poor performance of DILATE and MSE on Taxi dataset as forecast horizon at the bottom level is sufficiently large.
  • Add teacher-forcing mode of training in order to better learn the parameters of the base model at bottom level.
@pratham16cse
Copy link
Owner Author

Added teacher-forcing with parameter teacher_forcing_ratio that controls the amount of teacher forcing in an epoch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant