ClaimAudio · 16:52 — 25:10
AI progress is not bottlenecked by expert human data; what matters is compute, the science of constructing RL environments, and algorithmic improvements, so automating AI R&D does not require replicating the human data industry.
Ryan argues that scaling up human expert data is not the primary driver of AI R&D progress—better RL environments, compute, and algorithmic curation matter far more—so removing expert data would not stall automated AI R&D. ✦ AI generated
Ryan Greenblatt · Dwarkesh Podcast · 2026-08-11 · original ↗
plays this moment only · 16:52 — 25:10
Elicited by
“How are the AIs able to replicate the effect that expert human judgment currently seems to be playing in AI progress?”
My sense is that scaling up the amount of effort spent on getting expert human data has not been hugely important for AI R&D in general. In particular, over the last few years, we've been scaling up compute, scaling up people working at AI companies, and scaling up the amount of effort spent on data labeling. My sense is that if you removed the last two doublings or whatever of data generation from expert humans, that would not make a huge difference.
verbatim transcript · starts at 16:52
Transcript · around this moment
16:52– Is AI progress bottlenecked by human expert data?
16:52– Is AI progress bottlenecked by human expert data?
Around this claim
Evidence · 2
AI progress is less bottlenecked by expert human data than by algorithmic and infrastructure advances, so scaling up human expert data labeling wouldn't change progress much.Ryan Greenblatt · Dwarkesh Podcast · conf 99%AI R&D is a uniquely verifiable and containerizable domain, so once AIs match top human experts it can kick off a self-improving feedback loop yielding roughly four to five years of AI progress per single year.Ryan Greenblatt · Dwarkesh Podcast · conf 75%