Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reindexing has unexpected results #8

Closed
2 tasks done
ugm2 opened this issue Sep 22, 2022 · 3 comments · Fixed by #9
Closed
2 tasks done

Reindexing has unexpected results #8

ugm2 opened this issue Sep 22, 2022 · 3 comments · Fixed by #9
Assignees
Labels
bug Something isn't working

Comments

@ugm2
Copy link
Owner

ugm2 commented Sep 22, 2022

  • Reindexing with keyword search pipelines doesn't work, the first indexed documents prevail

  • Reindexing in any pipeline doesn't clear index so the documents will just add-up

  • Fix keyword search indexing

  • Add clear index option in the UI

@ugm2 ugm2 added the bug Something isn't working label Sep 22, 2022
@ugm2 ugm2 self-assigned this Sep 22, 2022
@ugm2
Copy link
Owner Author

ugm2 commented Sep 23, 2022

The issue on keyword search, which uses Tfidf, depends on this other issue in Haystack: deepset-ai/haystack#1634

I will check the fix on keyword search indexing since it doesn't depend on me.

A workaround for this would be to implement the feature add clear index so we are always working with a clean index

@ugm2
Copy link
Owner Author

ugm2 commented Sep 23, 2022

The workaround didn't work for keyword search, so it will only work after refreshing the page

@ugm2 ugm2 mentioned this issue Sep 23, 2022
@ugm2
Copy link
Owner Author

ugm2 commented Sep 23, 2022

It seems I've been able to solve the issue by not indexing documents with the same ID.

Also, now clear index is implemented

@ugm2 ugm2 closed this as completed in #9 Sep 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant