vibehacker
News
VentureBeat ·

Study: a coding agent's harness can triple cost per task without improving accuracy

Shandong University researchers held models fixed and ran Claude Code, OpenCode, and the ~100-line mini-SWE-agent on 492 SWE-bench Verified tasks, finding statistically equivalent success rates but up to 3x differences in cost per task. On the 45 hardest tasks, switching harnesses flipped results about as often as simply rerunning the same setup (13%), so small single-run benchmark gaps say little.

More news

View all

Copilot Autofix in Azure DevOps now fixes vulnerable dependencies and third-party scanner alerts

GitHub Advanced Security for Azure DevOps now uses the Copilot coding agent to propose pull request fixes for dependency vulnerabilities and third party scanning findings, following repo instructions and skills in .github or .agents . It also adds EPSS exploit likelihood percentiles and dev versus runtime dependency labels to triage, and you still review and merge every fix yourself…

Spotted something we missed? Start a thread.