> ## Documentation Index
> Fetch the complete documentation index at: https://docs.magnitude.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Introduction

> Run open models as fast as your hardware allows

Magnitude is an open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. It's over 2x faster than Ollama and works on Apple Silicon, NVIDIA, AMD, or just a CPU. One click connects it to the agent you already use (Pi, OpenCode, Hermes, Codex, and more).

<video controls playsInline preload="metadata" poster="https://magnitude.dev/videos/demo9-29-poster.jpg" aria-label="Magnitude demo: run local models on your machine" style={{ width: "100%", borderRadius: "12px" }}>
  <source src="https://magnitude.dev/videos/demo9-29.mp4" type="video/mp4" />

  <a href="https://magnitude.dev/videos/demo9-29.mp4">Watch the Magnitude demo</a>
</video>

## Why Magnitude?

* **2x faster than Ollama:** on average across popular local models, on Mac and NVIDIA
* **Tuned on your hardware:** kernels are tuned for each model when you download it
* **Best drafter built in:** each model ships with the fastest speculative decoding drafter
* **Memory that flexes:** quantized KV halves memory per agent, freed when agents stop
* **Fast concurrent sessions:** sessions share prefix caches to prevent slowdown
* **Works with your agent:** one click to connect Pi, OpenCode, Hermes, Codex, and more
* **Free, private, open source:** no token costs, nothing leaves your machine, Apache 2.0


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.