FAQ

​

What is Magnitude?

An open source inference server that runs the best local models for your hardware, plugged into the agent you already use. It profiles your machine, recommends the models that fit, then downloads, tunes, and runs them.

​

What hardware do I need?

There’s no fixed minimum. Magnitude profiles your hardware and recommends the best models for your machine. More memory lets you run larger models.

​

Why not just have my agent set up Ollama?

Your agent would be guessing. It doesn’t know your hardware, which quant fits, or how fast it’ll run. Magnitude gives it a catalog with recommendations computed for your machine, an onboarding flow that writes your harness config, and inference built for agent workloads. Models load just in time and unload when idle or memory gets tight.

​

Which harnesses work with it?

Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline. During setup, your agent connects your harness to the model you pick. Or use Magnitude’s built-in harness.

​

Do I need to manage Magnitude after setup?

No. It runs in the background, loads models when your agent needs them, and unloads them when idle or memory gets tight. Your agent can install or switch models through the Magnitude CLI anytime.

​

Does my data go to the cloud?

No. Prompts, files, and models stay on your machine.

​

Can it run completely offline?

Yes. Once Magnitude and a model are downloaded, no internet connection needed.

​

Can I use models outside the catalog?

Yes. You can download compatible GGUF models from Hugging Face and use them in Magnitude.