How do you continue training from the same place in the training set?

[xzuyn]

So I wanna be able to stop training at say 500 steps, then later on continue that from 500 steps into the training data on my saved model. How can I do that?

I think just loading the model and training it normally just defaults to the beginning of the training data, unless I'm mistaken. I don't wanna run through the exact same training data just to get to fresh data, I may as well just start from the beginning again.