Five time evaluation in Evaluation protocole

[MosyMosy]

Hi, on section 3. Evaluation Settings and LibFewSh > Evaluation Protocols, it is stated that "we control the evaluation setting for all methods, evaluate them on 2000 sampled tasks and repeat this process five times, i.e., a total of 10000 tasks".
It seems you have used different seed values for each of these evaluations, I will appreciate it if you can share that five seeds list (the default is 0 now).
Or If all of them are evaluated with the same seed, I am wonder what will be the difference between five-time 2000 episodes and one-time 10000 episodes?

[wZuck]

You can set any seed. For example, when set test_epochs to 2, the test episodes in test-epoch-1 and test-epoch-2 are different, so you don't need to worry about that question. Actually, in the training stage, the episodes in train-epoch-1 and train-epoch-2 are also different.