Context◆Article
smevals is my third iteration on the idea of an evals approach and it feels right to me.
The author states this is their third iteration on an evals approach and it finally feels right. ✦ AI generated
Simon Willison · Simon Willison's Weblog · 2026-07-31 · original ↗
I've been trying to figure out an approach I like for evals for several years now. smevals is my third iteration on the idea and it feels right to me.
Read full article ↗excerpt · fair-use quotation
- ·Author spent several years exploring eval approaches
- ·smevals is the third iteration of this idea
- ·The author states this iteration finally feels right
Around this claim
This moment responds to
provides context → smevals separates runs from grading operations, and can output results as a static HTML report via the build command.Simon Willison · Simon Willison's Weblogprovides context → You can run smevals by telling your coding agent to run uvx smevals docs to learn the tool, then build an eval suite, and run it against models with uvx smevals run.Simon Willison · Simon Willison's Weblog