Aboat training

[hx1024]

In the training .yml file，what does the "ft_tsa_only" mean?
when I doesn't use it, prompted WARNING: Offset mean is XX, larger than 100.
and the loss is larger than use the "ft_tsa_only" to train

[xinntao]

ft_tsa_only: only finetune TSA module
We first train a model w/o TSA. Then we add the TSA module and only finetune TSA for some iterations. After that, we finetune the whole model.

[TouqeerAhmad]

I wanted to make sure I understood is correctly. Is this how the complete training goes:

1. Train the model with only PCD and reconstruction modules i.e. woTSA,
2. Train only TSA module.
3. Train the full EDVR with everything in place.

If that is the case; can you please answer the following questions:

1. For how long you train woTSA?
2. How to train only TSA module? Is there a setting I can do in the yml file? And how long this should be trained/fine-tuned?

[TouqeerAhmad]

Hi, by looking at the provided log files; it feels you are first training for 600K iterations woTSA and then using this pre-trained model, further training for another 600K iterations with TSA module in place. Is this correct?

Why fine-tuning based on TSA required equal amount of training?

[xinntao]

1. Yes, correct.
2. I think we can shorten the training iteration without affecting the performance much. I set it the same as the first stage, for simplicity.