How to prevent an element in the enqueue come from the same sample as the query?

[ZYX-MLer]

How to prevent an element in the enqueue come from the same sample as the query， especially when the dataloader‘s param "shuffle" is True?

Thank you

CMC/NCE/NCEAverage.py

Line 178 in 783bf95

l_neg = torch.mm(queue.detach(), q.transpose(1, 0))

[HobbitLong]

Hi, @HebutAIer ,

That case can only happen at the beginning of each epoch. It's pretty sparse in general.

It should not affect the performance much if your dataset is big enough, e.g., ImageNet. Even on ImageNet100, I did not see a big difference in the final accuracy.