Microsoft ThinkingBox: grades agents on DB state, not chat replies
Microsoft and Hugging Face released ThinkingBox: 507 stateful business workflows graded on terminal backend state and side effects across 20 repeats—not tool-call trails or final replies. Run it via OpenEnv; Claude Opus 5.5 leads pass@1 (~67%), and ~80% of failures are tool-handling, not reasoning.