Rust Ollama Code Examples

• YouTube Rust Ollama Video

  • GitHub Repo Tag: E01
  • Fix for ollama-rs 0.1.6 - Tag: E01-01

• Related Links:

  • Ollama API documentation
  • Learn Rust OpenAI API - Building AI Buddy from Scratch!!!
  • Rust10x VSCode Extension

IMPORTANT ollama-rs 0.1.6 introduced a change where stream.next() now returns a Result<Vec<GenerationResponse>> instead of a single GenerationResponse. The fix is straightforward. It has been implemented in the main branch and tagged as E01-01.

Cargo Runs & Watches

cargo run --example c01-simple
cargo watch -q -c -x "run -q --example c01-simple"

cargo run --example c02-context
cargo watch -q -c -x "run -q --example c02-context"

cargo run --example c03-chat
cargo watch -q -c -x "run -q --example c03-chat"

cargo run --example c04-embeddings
cargo watch -q -c -x "run -q --example c04-embeddings"

cargo run --example c05-models
cargo watch -q -c -x "run -q --example c05-models"

Some .sh/.zsh aliases / functions

# Cargo watch quiet clear (user need to add the -x)
alias cw="cargo watch -q -c"

# Cargo watch run
alias cwr="cargo watch -q -c -w src/ -x 'run -q'"

# watch example
function cwe() {
  cargo watch -q -c -x "run -q --example '$1'"
}

Other Links

• ollama-rs

• ollama Official API

This repo on GitHub