I am not sure, I think sqlite-vec is currently using brute-force?
consider using this library here:
https://github.com/nmslib/hnswlib
it would speed the search up a lot... it is header-only library which I imagine
wouldn't make it too hard, integrating it with sqlite-vec? This library also works with WASM.
I would be glad to help with this project! I love this sqlite extension and that its possible to use as WASM.