Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Faster search index refresh using delta index #442
This allows newly inserted sentences to be quickly found, using the delta index technique described in the Sphinx documentation.
As mentioned in #233, it isn’t as complete as it could, but it can already be used. The limitation is that we must recreate the main indexes once in a while, instead of being able to merge them with the delta ones little by little.
We need to setup a frequent delta index refresh (like an hour, possibly less) and a less frequent main index refresh (in a way that the delta doesn’t get too big). To run the refreshes, use the appropriate CakePHP shells:
These should be run using the sphinxsearch user, so use the sphinxsearch user crontab or
@trang Before pushing on production, you need to increase the maximum opened file limit for the Sphinx daemon.
@jiru, I let you do the merge when you feel ready.
It works, but I haven't tested thouroughly. Maybe I can do a few more tests tonight.
Anyway I have been able to test only on my Windows version so I cannot say if there are environment config issues, besides the
I did try to test this on my VM (provided by lool0), but I ran into memory issues when starting searchd. I can't remember if I ever managed to run Sphinx on that VM though. I didn't investigate the problem further, I'm thinking that the indexer didn't work properly.