how many iterations to get good performance on GloVe models?

[mrlamm]

hello!

I'm currently training your nl2code-glove model with default settings, except with label_smooth loss. I'm wondering how many steps you found were needed to get the numbers reported in the paper.

thanks for your help.

[cindycandy]

hi，I wonder if you get the answer through training. I have trained the glove model for 31000 steps, and the loss of val is increasing. I want to stop it.

[berlino]

Hi, sorry for the late reply.

I used 40k steps for training, you can find it in the config here

rat-sql/configs/spider/nl2code-base.libsonnet

Line 94 in 727cf70

max_steps: 40000,

@cindycandy sometimes dev accuracy keeps improving even when val loss is increasing.