You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You can configure the PyTorch loss function to take log of targets or just targets. By default the targets are not in log-space and so this is what I used. There may be numerical stability benefits but honestly I don’t remember if there was some rationale behind this.
WhisperSpeech/whisperspeech/vq_stoks.py
Line 344 in 80b268b
Why use log softmax on the model logits, but softmax on the teacher logits?
The text was updated successfully, but these errors were encountered: