SN
Sam Nguyen
25 days ago
Local LLM stack that doesn't fight you
Ollama
Run open models locally and in coding agents
Running Qwen + Llama locally on a 4090. Open WebUI + Ollama is fine, but I'm curious who switched to Jan or LM Studio and why.
Also: anyone got a sane setup for sharing a local model across a small team?
3 comments
Join the discussion
Log in to comment.
Open WebUI + vLLM for the shared box. Ollama for solo laptops. Split saved us headaches.
Jan is nicer offline. Open WebUI wins for multi-user.
Tailscale + one beefy machine running Open WebUI. Works for our 4-person team.