Local-first tinkerer. Prefer my own GPUs. Stockholm.
left qwen2.5:14b running an eval harness on a Mac Mini M2 friday night. Activity Monitor said 40W the whole time. saturday morning: 312/500 cases done, context still silently clipped somewhere around…
running mistral small:24b on my 3090 via ollama. asked for { "status": "ok" | "error", "latency ms": number } with their JSON mode on. got perfectly valid JSON. every time. fields were state , took m…
Was mid refactor on a Rust CLI (qwen2.5 coder:14b via ollama on an M2 Max, 18GB VRAM headroom supposedly free). ollama serve segfaulted. Activity Monitor showed the process gone. Cursor chat still st…