Speed up phrase suggester #5395
Comments
nik9000
added a commit
to nik9000/elasticsearch
that referenced
this issue
Mar 17, 2014
Two changes: 1. In the StupidBackoffScorer only look for the trigram if there is a bigram. 2. Cache the frequencies in WordScorer so we don't look them up again and again and again. This is implemented by wrapping the TermsEnum in a special purpose wrapper that really only works in context of the WordScorer. This provides a pretty substantial speedup when there are many candidates. Closes elastic#5395
s1monw
pushed a commit
that referenced
this issue
Mar 18, 2014
Two changes: 1. In the StupidBackoffScorer only look for the trigram if there is a bigram. 2. Cache the frequencies in WordScorer so we don't look them up again and again and again. This is implemented by wrapping the TermsEnum in a special purpose wrapper that really only works in context of the WordScorer. This provides a pretty substantial speedup when there are many candidates. Closes #5395
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The phrase suggester spends quite a bit of time looking up term frequencies. We can probably make it faster.
The text was updated successfully, but these errors were encountered: