Highlighting: Highlighter still fails if broken analysis chains are used with fast vector highlighter #3006
Assignees
Labels
Comments
ghost
assigned 
s1monw
added a commit
that referenced
this issue
May 7, 2013
Today an analysis chain with broken tokenfilters or tokenizers like WordDelimiterFilter might produce somewhat broken term vectors that cause `StringIndexOutOfBoundsExceptions` if FastVectorHighlighter is used since the positions / offsets contract is violated and offsets of highlight tokens are not increasing but decreasing even if their positions are increasing. Yet, if we detect such a situation we can resort the tokens which might cause somewhat odd highlights but doesn't fail hard with a StringIndexOOBException. Closes #3006
mute
pushed a commit
to mute/elasticsearch
that referenced
this issue
Jul 29, 2015
Today an analysis chain with broken tokenfilters or tokenizers like WordDelimiterFilter might produce somewhat broken term vectors that cause `StringIndexOutOfBoundsExceptions` if FastVectorHighlighter is used since the positions / offsets contract is violated and offsets of highlight tokens are not increasing but decreasing even if their positions are increasing. Yet, if we detect such a situation we can resort the tokens which might cause somewhat odd highlights but doesn't fail hard with a StringIndexOOBException. Closes elastic#3006
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
TokenFilters like
word_delimiter_filtermight produce broken term_vectors and mess up highlighting. We still fail withStringIndexOutOfBoundsExceptionwhich is no good. Even if those filters are broken we should try at least best effort to not fail with a SIOOBExceptionThe text was updated successfully, but these errors were encountered: