Magnitude (YC S25): self-optimizing local inference for coding agents
YC S25’s Magnitude (Apache-2.0) is a local inference engine that compiles and tunes kernels on-device for agent workloads, claiming up to 2× llama.cpp decode (92% faster on Metal in their benchmarks). A desktop app wires it to Pi, OpenCode, Hermes, Codex, Claude Code, and others with on-demand model load/unload.