As AI models scale, they exhibit discontinuous emerging capabilities — abilities like calculation that suddenly appear — making it inherently unpredictable what new skills a model will gain.
Dianne references the original scaling law papers to explain that model capabilities do not improve smoothly — they jump discontinuously — requiring evaluation systems to detect what the model can suddenly do. ✦ AI generated
Dianne Penn · Lenny's Podcast · 2026-07-26 · original ↗
starts at this moment · 18:08
“So what I'm hearing here is you almost don't know what will be possible with every model release. And so the important things to focus on is being adaptable as things emerge.”
There's some really interesting graphs in the original scaling law papers. I think folks are very familiar with the scaling loss in the lens of as you add in more compute and data what's called loss aka the loss from next token prediction goes down. And so it's a very smooth linear curve of like the models get more intelligent as you scale them up. What's actually also interesting in that paper is there are these very different emerging capability graphs. And so for example as you add in more data and you train the models with more compute you essentially see these actually discontinuous emerging capabilities jump. So the models go from 1+1 being a thing that it can't calculate to a thing that it can reliably calculate. And so these emerging capabilities, like some nature of predictability is not necessarily everyone knows the exact moment — you need the evals to be able to assess that — has actually always been a part of how this technology works and also what makes things like safety harder because unless you have the eval, unless you have the systems to test, these jumps might actually happen and you don't know.
verbatim transcript · starts at 18:08
18:08aka the loss from next token prediction uh goes down. And so it's a very smooth linear curve of like the models get more intelligent as you scale them up. What's actually also interesting uh in that paper is there are these like very uh different emerging capability graphs. And so for example uh as you add in more data and you train the models with more compute you essentially see these
18:34actually discontinuous emerging capabilities jump. So the models go from 1 + one being a thing that it can't calculate to a thing that it can reliably calculate. And so these emerging capabilities, this like some nature of like predictability is is is not necessarily everyone knows the exact moment like you need the ebells to be able to assess that has actually always been a part of uh how this technology
19:03works and also what makes like things like safety harder because unless you have the eval unless you have the systems to test um these jumps might actually happen and you don't know M that's so interesting that you may have developed this like AI brain that uh can do something you're not even aware of and so part of the job is just uncovering wow we just got really good
19:25at this thing what can we do with that >> I think there's like product overhang and user overhang like to to maybe put it in our um PM language even on today's models and I think there's like a lot that uh we could be exploring on like our current opuses and definitely with like Fable for example temple and that that discovery is actually another part of what's been in the early days of
19:52anthropics DNA and I think is also continuing to be a big part of how we operate in product in labs and and across research. This makes me think about something Gary Tan's been talking about uh president of YC. I don't know what his title is. uh he's he had this interesting point that if you're willing to spend $100,000 a year right now in tokens, you are living the