The loss label of of NCESoftmaxLoss in NCECriterion.py?

[xuChenSJTU]

Hi,

I see your code for NCESoftmaxLoss as follows:

#########
class NCESoftmaxLoss(nn.Module):
"""Softmax cross-entropy loss (a.k.a., info-NCE loss in CPC paper)"""
def init(self):
super(NCESoftmaxLoss, self).init()
self.criterion = nn.CrossEntropyLoss()

def forward(self, x):
    bsz = x.shape[0]
    x = x.squeeze()
    label = torch.zeros([bsz]).cuda().long()
    loss = self.criterion(x, label)
    return loss

###########
The label for this loss is label = torch.zeros([bsz]).cuda().long(), but in your paper, according to eq.2,

You have one positive for each sample.

So is something missed here??

Thanks.