Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Single batch: Supervised or Unsupervised #12

Closed
AKASH2907 opened this issue Apr 11, 2021 · 1 comment
Closed

Single batch: Supervised or Unsupervised #12

AKASH2907 opened this issue Apr 11, 2021 · 1 comment

Comments

@AKASH2907
Copy link

AKASH2907 commented Apr 11, 2021

hi,
in the experiment section, you mentioned that labeled and unlabeled data are randomly shuffled and selected. I wanted to know why it's necessary to have each mini-batch containing both labeled as well as unlabeled data?

What happens if one of mini-batch contains only unlabeled data (since the majority of data is unlabeled)? Can we handle that case? What would be the value of loss?

I'm new to semi-supervised.
thanks.

@soo89
Copy link
Owner

soo89 commented Apr 12, 2021

In semi-supervised learning of classification, the minibatch size is very large (100-512). Therefore, labeled and unlabeled losses can be calculated simultaneously within one mini-batch. In the same way as above, we want labeled data and unlabeled data to be calculated simultaneously.

In the case of SSD, since the mini-batch size is large(32), we followed the same as the classification. In the case of R-FCN, however, since the mini-batch size is 4, we sampled labeled and unlabeled data as 1:3.

@soo89 soo89 closed this as completed Apr 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants