Skip to content

Repository files navigation

Magnitude

Documentation Discord Follow Magnitude on Twitter

Open source agent built on local models, with its own inference engine. 100% private and offline. No token costs. No API keys. No rate limits.

Magnitude running a local model

Get started

npm install -g @magnitudedev/cli
cd your-project
magnitude

Magnitude supports macOS and Linux. Windows is supported through WSL.

What you can use it for

  • Analyze sensitive data
  • Manage private notes
  • Review code and logs
  • Search and organize files
  • Build docs or slides
  • Create automation scripts

Out of the box it can use your shell, edit files, and run scripts. Add skills and it can work with Excel, PowerPoint, PDFs or Chrome.

Add skills

Skills are reusable capabilities for your agent. A good way to get them is skills.sh, a skills directory from Vercel.

Skills we recommend:

npx skills add vercel-labs/agent-browser   # drive your logged-in Chrome browser
npx skills add anthropics/skills/xlsx      # read and build Excel spreadsheets
npx skills add anthropics/skills/pptx      # build PowerPoint decks
npx skills add anthropics/skills/docx      # read and write Word documents
npx skills add anthropics/skills/pdf       # read, fill, and create PDFs

How it works

Automatic model setup

Magnitude profiles your hardware and recommends the best models your machine can run. Choose Balanced, Best Quality, Fastest, or Lightweight, and Magnitude handles the download and configuration.

An inference engine built for agent work

Magnitude includes a custom inference engine written in Rust on top of llama.cpp. It offers verified model configurations, calculates memory requirements before loading, and tunes acceleration, placement, and batching for your hardware. Parallel agents retain full context windows, model switching preserves consistent tool use, and new requests remain responsive while other work is running.

An agent built around local models

Magnitude can inspect and edit files, run commands, work with images, and manage long sessions. Because local inference is built in, it also manages model loading and switching and surfaces native prefill, cache reuse, and generation performance directly in the agent UI. Nothing leaves your machine.

Learn more

License

Magnitude is licensed under the Apache License 2.0.

About

Open source agent built on local models, with its own inference engine. 100% private and offline

Resources

Stars

869 stars

Watchers

2 watching

Forks

Releases

Packages

Contributors

Languages