Vecsearch is an all-in-one vector search library for ruby that uses a 4-bit (Q4_1) quantization of gte-tiny by using bert.cpp (a GGML implementation of BERT via FFI, and an in-process FAISS index.
Vecsearch embeds pre-built dynamic libraries for libbert and libggml, as well as a quantized model checkpoint for
gte-tiny (total size: 14MB).
Currently only ARM64 macOS is supported, purely because I haven't bothered to build other dylibs yet. There is nothing difficult about this.
require 'vecsearch'
vs = Vecsearch.new
vs << "sharks with freaking laser beams"
vs << "hello"
vs << "the sky is green"
puts(vs.nearest("hey there")) # => "hello"