vibehacker

Eval Harness First

Skill

Build the eval harness that gates every fine-tuning run

by wshobson Listed Jul 24, 2025

Clone or download it from github.com, then drop the folder into ~/.claude/skills/ (Claude Code) or your agent's skills directory.

Product badge

Share this product's name and rating in your README or on your website.

Eval Harness First: rating on VibeHacker

Updates may be delayed by image caching.

Eval Harness First cover

About Eval Harness First

A fine-tuning skill arguing you should build evals before training: golden sets, per-failure-mode graders, judge calibration and base-model baselines.

Part of the wshobson/agents plugin collection.

Used Eval Harness First?

Log in to write a review.

No reviews yet

Used it? Write the first review.