Cursor and Anthropic possess more tokens of proprietary coding data than exist on the entire public internet, and using that data to train a model produced a genuinely strong result.
Gavin Baker explains that Cursor's private coding dataset exceeds what's publicly available online, and feeding it into training (via RL and fine-tuning) produced a model that briefly topped the coding Pareto frontier. ✦ AI generated
Gavin Baker · BG2 Pod · 2026-06-11 · original ↗
starts at this moment · 5:07
“What are the key levers that we ought to be thinking about that you're thinking about over the course of the next few years?”
But my understanding is that Cursor and Anthropic have more tokens of proprietary coding data than anyone else. And they have more tokens of proprietary coding data than exist on the public internet. And so they fed Cursor fed um used ChemK 0.25, used their own private data, did some RL, some supervised fine-tuning and they got a really good model.
verbatim transcript · starts at 5:07
5:07was Pareto dominant or, you know, at the lowest level of intelligence with very little training. This just reflects, and I know you know Cursor well. I think you know Cursor [ __ ] a lot better than I do. A vast amount better than I do. [laughter] But my understanding is that Cursor and Anthropic have more tokens of proprietary coding data than anyone else. And they have more tokens of
5:30proprietary coding data than exist on the public internet. And so they fed Cursor fed um used ChemK 0.25, used their own private data, did some RL, some supervised fine-tuning and they got a really good model. And then they spent 3 weeks in the Colossus 2 cluster and they got a model that 12 days ago was Pareto dominant with Composer 2.5. That's on their own benchmark. Um Cursor bench, so maybe take it with a
5:58grain of salt. But I think this just suggests that the Cursor data is very valuable for coding and when it is trained, you know, to Chinchilla optimal or beyond Chinchilla optimal with reinforcement learning, you know, I think it suggests that XAI and SpaceX AI has a shot of being a real player in coding. >> I mean, I think one of the interesting things is, you know, we
6:21you know, the way he answered the question, right? We didn't talk about launch. Right? We didn't talk about Starlink or communications. Those up until really 6 months ago were the business. >> Yeah. >> Right? And, you know, and then we merged in x.ai and we merged in Cursor and then we announced these deals where it was very clear he was kind of building AWS right under our nose, you know, in in in
6:43in terms of this. But what I want to do is go to go to Fox. Give us the breakdown. Three big lines of business, right? We've got the the the communication Starlink launch business, we've got the, you know, AI compute business and then I want to come back to x.ai that you were just clicking on. But if we just go to the core business, what do we have to assume goes right in the
7:03core business both with launch and with Starlink in order to achieve the numbers that are out there? >> Yeah, sure. So, look, I think the thing that's foundational to everything is the launch business. >> Right. >> Right? This is the kind of crown jewel of SpaceX. Um it's something that no one else really has, notably reusability. >> Right. >> And soon rapid reusability. Right? This is, I think, what you need to believe in