Hey,
Thought I would recommend you try out these two projects for your search tool needs
https://github.com/lightonai/next-plaid/tree/main/colgrep
https://github.com/MinishLab/semble
Litonai/Colgrep advantages
- builds AST tree and keeps it in internal database
- allows searches for regex/keywords AND semantic search in the same call
- uses very small embedding models (onnx), so speed should be quite decent, and you can fit them in VRAM alongside the coding model
- benchmarks they did claim very good performance - grep on steroids
Semble advantages
- uses model2vec embedding - almost instant on CPU only
- very good benchmark score claims
Search quality:
Speed:

Hey,
Thought I would recommend you try out these two projects for your search tool needs
https://github.com/lightonai/next-plaid/tree/main/colgrep
https://github.com/MinishLab/semble
Litonai/Colgrep advantages
Semble advantages
Search quality:
Speed: