MechanismArticle
smevals separates runs from grading operations, and can output results as a static HTML report via the build command.
Describes the separation of run and grade operations, and the ability to generate static HTML reports from results. ✦ AI generated
Simon Willison · Simon Willison's Weblog · 2026-07-31 · original ↗
Runs are treated separately from grading operations - you can grade your runs (against your defined set of checks) using: uvx smevals grade path-to-eval/ Then you can run a localhost web server to explore the results: uvx smevals serve path-to-eval/ Or run the smevals build command to build that report as static HTML, which you can then host anywhere.
Read full article ↗excerpt · fair-use quotation
Around this claim
Extends · 2
smevals is a new tool for running small eval suites across different model configurations and grading the results.Simon Willison · Simon Willison's Weblog · conf 90%You can run smevals by telling your coding agent to run uvx smevals docs to learn the tool, then build an eval suite, and run it against models with uvx smevals run.Simon Willison · Simon Willison's Weblog · conf 70%