Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reindexation of new sentences takes more time than usual #1929

Closed
jiru opened this issue Jul 26, 2019 · 1 comment

Comments

@jiru
Copy link
Member

commented Jul 26, 2019

Due to a limitation in Manticore, some delta indexes cannot be merged with their corresponding main indexes. As a result, some delta indexes have been growing bigger and bigger as they are never merged into main, and their reindexation is taking longer and longer as time goes. As a result, in the past month, new sentences could not be made available to search within 15 minutes, but more like 30 or 45 minutes. When I posted the issue on the Manticore forum, I recreated the main indexes to temporarily get rid of the problem. Reindexation is taking about 10-11 minutes now. As suggested in the manticore forum, we need to upgrade to Manticore 3 to permanently fix the problem.

@jiru

This comment has been minimized.

Copy link
Member Author

commented Jul 26, 2019

I updated Manticore to version 3.1.0 on both tatoeba.org and dev.tatoeba.org. The problem should be solved now.

@jiru jiru closed this Jul 26, 2019

jiru added a commit to Tatoeba/imouto that referenced this issue Jul 26, 2019
Update to Manticore 3.1.0
The bug described in 88f40bd
is still present but the work around doesn’t work any more.
Here is another work around by removing the generator script.

Refs Tatoeba/tatoeba2#1929.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.