Update Mean-Teacher and FixMatch Self-Training Scheme(s) #116
Conversation
anwai98
commented
Mar 30, 2023
anwai98
commented
- Mean-Teacher training parameters updated
- AdaMT training parameters updated
anwai98
changed the title
| # TODO | ||
| def strong_augmentations(): | ||
| pass | ||
| def strong_augmentations(p=0.5): |
There was a problem hiding this comment.
Intuitively I would increase the probability further. With p=0.5 you still have a fairly high probability that no transformation is applied (1/2 * 3 / 4 * 1/2 = 3 / 16). Since you're running the experiments with these settings now we should probably keep it for now, but it would eventually make sense to double check if higher probabilities change the results.
There was a problem hiding this comment.
Okay. Will increase the probability for the next set of experiments and update it likewise. Thanks!
|
|
||
| self._kwargs = kwargs | ||
|
|
||
| def get_distribution_alignment(self, pseudo_labels, label_threshold=0.5): |
There was a problem hiding this comment.
I didn't fully go through this, and I assume you adapted it from our previous code for the distro alignment.
Still, it would be good to check this again and to give some comments / formulas here.
|
Thanks for all the feedback! The expected changes have been taken care of (in both the self-training approaches). |
|
The |
