Skip to main content
Magnitude is an open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. It’s over 2x faster than Ollama and works on Apple Silicon, NVIDIA, AMD, or just a CPU. One click connects it to the agent you already use (Pi, OpenCode, Hermes, Codex, and more).

​
Why Magnitude?

  • 2x faster than Ollama: on average across popular local models, on Mac and NVIDIA
  • Tuned on your hardware: kernels are tuned for each model when you download it
  • Best drafter built in: each model ships with the fastest speculative decoding drafter
  • Memory that flexes: quantized KV halves memory per agent, freed when agents stop
  • Fast concurrent sessions: sessions share prefix caches to prevent slowdown
  • Works with your agent: one click to connect Pi, OpenCode, Hermes, Codex, and more
  • Free, private, open source: no token costs, nothing leaves your machine, Apache 2.0