Skip to content

Improve opensearch highlighting, fix favorites#2514

Merged
fschade merged 6 commits intoopencloud-eu:mainfrom
aduffeck:improve-opensearch
Mar 25, 2026
Merged

Improve opensearch highlighting, fix favorites#2514
fschade merged 6 commits intoopencloud-eu:mainfrom
aduffeck:improve-opensearch

Conversation

@aduffeck
Copy link
Member

This PR introduces a new opensearch index which

  • fixes persisting and querying favorite information
  • enables the Fast Vector Highlighter which performs much faster and doesn't run into the character limits the previous default highlighter had

Note This is an incompatible change. Users of the opensearch backend will have to drop their old index and rebuild it using

opencloud search index --all-spaces

aduffeck and others added 4 commits March 25, 2026 08:41
The new index allows for faster highlighing uses the fvh highlighter and
searching for favorites.
Co-authored-by: Florian Schade <f.schade@icloud.com>
@aduffeck aduffeck force-pushed the improve-opensearch branch from 1525739 to de5deff Compare March 25, 2026 07:42
@micbar
Copy link
Member

micbar commented Mar 25, 2026

Good work!

There is an API test related to stop words failing.
Are we planning a behavior change?

Keeping the stop words leads to slightly bigger indexes but fixes
chopped up highlights of search results and phrase accuracy during
search.
@aduffeck aduffeck force-pushed the improve-opensearch branch from de5deff to dea3062 Compare March 25, 2026 08:41
@sonarqubecloud
Copy link

@aduffeck
Copy link
Member Author

Good work!

There is an API test related to stop words failing. Are we planning a behavior change?

Yes, we currently enable stop word filtering by default which leads to phrase accuracy issues during search and chopped up highlighting results. I would like to change the default to keep stop words.

Here's an example showing both versions:

Content:

image

Highlights:

image

Indexing stop words slightly increases the index size, but I would argue that the current highlighting results are very confusing and not helpful at all.

@fschade fschade merged commit 3f4a64f into opencloud-eu:main Mar 25, 2026
60 checks passed
@openclouders openclouders mentioned this pull request Mar 25, 2026
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants