Dettmers lab: frontier AI on a Mac or single 24GB GPU this week
Tim Dettmers’ dlab Open Source Week teases local inference (Qwen 3.6 35B-A3B at ~450 tok/s on Mac at 1.5 bpw; 125B on one 24GB GPU; DeepSeek V4.1 550B on 128GB boxes) plus CliffCompaction that cuts agent cost ~50% vs Claude Code/Codex-style compaction. Two open-source projects and four papers drop as one ecosystem, delayed one day from the Sept 21 post.