You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think it is due to the default smoothing function.
Before nltk < 3.3 (released 2018.05.06), there was a bug in the SmoothingFunction().method0 (i.e. no smoothing),
which was the default smoothing function of sentence_bleu
That bug led to incorrect high values of BLEU for cases with no matched n-gram (common when n is high).
Texygen uses SmoothingFunction().method1 by default: using 0.1 as the numerator in precision instead of 0 if there's no matched n-gram,
so it is unaffected by the bug regardless of NLTK version.
The BLEU score of LeakGAN is far lower than that reported in the paper.
The text was updated successfully, but these errors were encountered: