Skip to content

relm 0.1.0 — first public release

Choose a tag to compare

@Vadale Vadale released this 08 Jul 23:09
· 204 commits to main since this release
215e533

relm runs open-weight LLMs locally from R and hands you the results as base-R data.frames and matrixes — no Python, no API keys. It embeds a vendored, patched llama.cpp in a Rust core. The differentiator over a plain binding: it opens the model up — trace activations, steer the residual stream, ablate units — mechanistic interpretability from R.

Install (macOS Apple Silicon + Linux binaries, no toolchain)

install.packages("relm", repos = c("https://vadale.r-universe.dev", getOption("repos")))

What's in it

  • Model loading (llm) and tokenization (llm_tokens)
  • Text generation (llm_generate) and next-token distributions (llm_logits)
  • Embeddings (llm_embed)
  • The interpretability core: activation tracing (llm_trace), steering (llm_steer), ablation (llm_ablate)
  • Checksum-verified model download (llm_download)
  • Two runnable demos: topics without Python and the anatomy lab

Notes

  • Every numerical feature is validated value-for-value against an independent reference.
  • Text-only; vision is planned for v0.2.0.
  • Binaries: macOS arm64 (Apple Silicon) + Linux. Windows and Intel-Mac binaries are a later phase — build from source meanwhile (needs Rust + CMake).

See the README and docs/getting-started.md.