Based on independent analysis, Anthropic's Sonnet model likely has around 1.3-1.5 trillion total parameters with 100+ billion active, while Opus is likely 1.5-1.8 trillion total with 150-180 billion active parameters.

9:35stuff like that >> the one I saw was it was that they came up with a bunch of questions and they could infer based on the general knowledge that one as well yeah but that that was a little bit sketchy was >> I've seen a more empirical one I'll send it to you because it went it that that blog post alone played a large part in like our decisions architecturally we

9:53took for the sovereign model one of the things that was very clear from that is that the likelihood is and like again no one really knows outside of the outside of anthropic that something like sonnet is in the I believe like 1 1.3 to 1.5 trillion total params um and has probably 100 100 plus billion active right and then an opus is probably in the 1.5 to 1.8 eight range and probably

10:21has 150 to 180 billion active depending on the DT type we're talking about whether it's FP8 or FP4 whatever. >> What about Fable? >> That it wasn't up for long enough for for for me to try to because I basically what I wanted to do is give Fable that blog post and then point it at an end point and be like right do the analysis on yourself and tell me how big you are.

10:39Never never got that far though because I don't think it was up for long enough. >> It was it's a ridiculous uplift though isn't it? It's I saw I'm sure you saw on X like numbers like 10 trill being knocked around. I don't know if that's true or not. >> I have no idea. I think it's obviously bigger than the other ones and obviously has way more active parameters. Um but I

10:59I I I couldn't speculate. I genuinely don't know. But I yeah I think that the net of that of that article was that you know Opus was uh in the region of 1.5 to 1.8 with around 150 billion active. Obviously, there's a lot of algorithmic and data work that goes into it. But I think if you don't at least match that architecture, then you're you're already going to struggle um to to sort of reach

11:24that ceiling. And I think an example of this um and it's way more nuanced than than this fairly basic argument I'm going to make, but if you look at like a Deep Seek V4 Pro, right, 1.6 trillion total, can't remember the exact number, but it's going to be in the region of 30 to 50 billion active. Yeah. >> Right. Um and and my view is that the reason for these architectural

11:46decisions is largely for inference of the model like sure great that you have those topline 1.6 trillion parameters but like if no one can run it cuz they need two nodes of B300s just to be able to like fit it into memory and actually you know run it at decent TPS then like how many people can actually take advantage of that. I think that is one of the reasons that whether it be like