You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
I am trying to estimate the perplexity on a test set (unseen set of documents). After the inference step on the test set, I see the likelihood file has large negative numbers (e.g. -1800). What are these numbers exactly. If these are log likelihood estimates, should we compute the perplexity by just taking the exponent of average of these values.
Looking forward for an answer.
Thanks,
Jagdeep
The text was updated successfully, but these errors were encountered:
Hi,
I am trying to estimate the perplexity on a test set (unseen set of documents). After the inference step on the test set, I see the likelihood file has large negative numbers (e.g. -1800). What are these numbers exactly. If these are log likelihood estimates, should we compute the perplexity by just taking the exponent of average of these values.
Looking forward for an answer.
Thanks,
Jagdeep
The text was updated successfully, but these errors were encountered: