ATRIUMsearch → argument graph
Article · 2026-08-10 · 6 moments

🎙️ How I AI: Build an AI code review bot in 30 minutes + Claude Code for normal people

Your weekly listens from How I AI, part of the Lenny's Podcast Network ✦ AI generated

01
Example

A useful internal agent can be built and deployed in a single Codex session starting from a prompt only a couple of sentences long.

The initial ask was a short prompt to build a GitHub bot that grades PRs and auto-approves low-risk ones; everything after was steering and refinement.

transcript

Claire: A useful internal agent can now be built and deployed in a single Codex session, starting with a prompt that's only a couple of sentences long. In this case, the initial ask was essentially: build a GitHub bot that waits for checks to pass; grades each PR as low, medium, or high risk; and automatically approves the low-risk ones. Everything after that was steering and refinement, not a giant up-front specification.

02
Mechanism

Browser use removes the configuration tax that makes agent setup feel harder than it should.

Codex handled creating the Slack bot and GitHub app through the browser; the human mostly clicked save and completed 2FA, turning hours into minutes.

transcript

Claire: Browser use removes much of the configuration tax that makes agent setup feel harder than it should. Creating a Slack bot and GitHub app manually normally means clicking through endless permission screens, choosing scopes, and managing tokens. Codex handled almost all of that through the browser. The human's job was mostly to click "save" and complete 2FA. What usually takes hours took minutes.

03
Example

Operational design matters — the agent signals via a gray check and Slack message but preserves human accountability for the final merge.

Merge Mommy posts a gray check in GitHub and sends the risk score via Slack, but doesn't merge itself, keeping humans accountable while eliminating routine-review cognitive work.

transcript

Claire: The operational design matters just as much as the underlying technology. Merge Mommy doesn't actually merge anything. Instead, it posts a gray check in GitHub as a signal, then sends a Slack message with the risk score and a note saying the PR is ready to approve and merge. That small handoff preserves human accountability for the final action while eliminating most of the cognitive work involved in reviewing a routine change.

04
Mechanism

The key is a clear risk model that separates changes that can skip human review from those that can't, scored across six dimensions.

Each PR is scored on size, blast radius, reversibility, data/security, operational impact, and test completion; under 24 points auto-clears, over 64 goes to a human.

transcript

Claire: The key is having a clear way to separate changes that can skip human review from ones that can't. The risk model used here scores each PR across six dimensions: the size of the change, its blast radius, how easily it can be reversed, its data and security implications, its operational impact, and whether tests and CI have actually been completed. Anything below 24 points is classified as low risk and cleared by the agent; anything above 64 goes straight to a human for review. The exact numbers matter less than turning a vague judgment call into a repeatable system.

05
Claim

Vercel Eve may be the fastest way to deploy a serious internal AI agent across Slack and GitHub without building infrastructure.

Eve handles the plumbing — connectors, tokens, sandboxing, routing — so the real work is writing instructions in Markdown instead of babysitting OAuth flows.

transcript

Claire: Vercel's Eve may be the fastest way to deploy a serious internal AI agent across Slack and GitHub without spending weeks building infrastructure. It handles the annoying plumbing—connectors, refresh tokens, sandboxing, and routing across channels—so the actual work becomes writing instructions and skills in Markdown instead of babysitting OAuth flows.

06
Claimâ—†

You don't need a human to review every AI-generated PR — AI-reviewed code ships faster and is less likely to need fixing.

Intercom shows AI-approved PRs move five times faster than human-reviewed ones with a lower revert rate, so letting AI review AI code may be the smarter operating model.

transcript

Claire: You don't need a human to review every AI-generated PR. That may sound reckless, but it's increasingly looking like the smarter operating model. Intercom has already shown this can work at scale: PRs approved by its AI system move five times as fast as human-reviewed ones and have a lower revert rate. In other words, the AI-reviewed code isn't just shipping faster—it's less likely to need fixing after it reaches production.

Highlight slides
Related episodes