Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
Full-text search #92
I tried to keep the search index close to the database but it's not going to work well since the index is 3-5x times bigger than the database itself. So the full database serialization takes time, besides the main process might get blocked by expensive serialization/indexing/search actions. So going to try maintaining all the expensive indexing operations in a separate process and save the index in an individual encrypted file like
Since indexing works quite fast I'm also considering not persisting the search index at all but just spawn the separate process which will build the index on app start and keep it up to date while the app is started, so completely in memory only. The implementation would be much simpler and somehow more secure (no addition data persisting).