Skip to content

Experimenting with LLMs through Ollama and retrieval augmented generation (RAG) in Rust

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE20
MIT
LICENSE-MIT
Notifications You must be signed in to change notification settings

SimonCW/ollama-rag-rs

Repository files navigation

Retrieval Augmented Generation with Llamafile, LanceDB in Rust

Note, this is WIP. I try to avoid building abstractions too early.

Useful Commands

Start Ollama in the background and log outputs.

nohup ollama serve > ~/Repos/rag-rs/logs/ollama_serve.log 2>&1 &

Install protobuf for LanceDB

brew install protobuf

License Notice

The Rust Book is licensed under MIT and Apache License 2.0. The Rust Book was downloaded as pdf from here: https://doc.rust-lang.org/book/print.html and converted to txt via:

# brew install poppler

pdftotext .data/2024-02-13_the_rust_book.pdf knowledge/2024-02-13_the_rust_book.txt

About

Experimenting with LLMs through Ollama and retrieval augmented generation (RAG) in Rust

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE20
MIT
LICENSE-MIT

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages