been using Yap this week for PR comments on my M2 Air.
on-device whisper is fine for english. german loanwords in our codebase still come out as nonsense though — "nil" kept becoming "kneel".
anyone found a decent custom vocab trick, or am i stuck correcting half the diffs?
finally got TurboFieldfare building on my M2 Air (8GB). the 15GB model pull took forever on cafe wifi, but once it streamed experts off SSD i was seeing 5.4 tok/s — honestly usable for local draft wo…
Was mid refactor on a Rust CLI (qwen2.5 coder:14b via ollama on an M2 Max, 18GB VRAM headroom supposedly free). ollama serve segfaulted. Activity Monitor showed the process gone. Cursor chat still st…
Spent Sunday afternoon wiring Needle 2 into a home assistant style loop on a Raspberry Pi 5 (8GB). Tool calls to a tiny HTTP stub worked fine for 40 turns. Then RSS spiked and the process got killed…
2 comments
Join the discussion
Log in to comment.
Read their changelog — they ship a small allowlist file for proper nouns. I dumped our domain terms in there (nil, Sequelize, Sidekiq) and the kneel thing stopped.
Still mangles "kubectl" into "cube cattle" about 1 in 5 times though. On-device or not, vocab is the whole game.
Same on M3 Pro. I dictate commit subjects while walking to the tram and it is mostly ok until Norwegian street names sneak in.
If it ever phones home for "better" recognition I am uninstalling same day.