Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

questions about metrics #9

Closed
houjie8888 opened this issue Jan 22, 2024 · 1 comment
Closed

questions about metrics #9

houjie8888 opened this issue Jan 22, 2024 · 1 comment

Comments

@houjie8888
Copy link

Hi author, thanks for your team's contribution.

I would like to ask you a question about calculating the metrics during the training process. Specifically, the training process is usually interspersed with a validation step, do you perform the computation of the evaluation metrics during the validation step, which seems to be time consuming. So I'm wondering how you schedule the evaluation during the training process?

@thaoshibe
Copy link
Collaborator

Hi houjie8888,

I didnt calculating the metrics during the training process (e.g., validation step). Rather than that, I just simply train for 1000 timesteps and save the best checkpoints (checkpoint with lowest MSE loss) (check the code here).

Please check 4.1 Experimental Settings in our main paper for more details.
Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants