Cactus Needle 3: 8–29MB on-device models for tool calls, not chat
Cactus shipped Needle 3 (Show HN): 8–29MB 2-bit automation models aimed at tool calls and structured JSON, with layer slicing from 2–20 and Raspberry Pi 5 decode up to about 4k tok/s. It is not a general chat model; the pitch is narrow on-device automation after finetuning.