ContextArticle
Marginal costs are back in a big way for AI, both in the short-term implications of state-of-the-art free/cheap models and in the long-term structure of the industry.
Thompson frames the debate over Kimi K3 as evidence that old cost-structure principles (once thought irrelevant to zero-marginal-cost software) are returning to the center of AI industry dynamics. ✦ AI generated
Ben Thompson · Stratechery · 2026-07-20 · original ↗
That was never more apparent than this past weekend, when arguments raged on X about the implications of Kimi K3, another open weights model out of China, approaching the state-of-the-art in terms of capabilities. The long and short of it is this: marginal costs are back in a big way, both in terms of short-term implications of state-of-the-art free models, and in terms of the long-term structure of the industry.
Read full article ↗excerpt · fair-use quotation
Around this claim
Evidence · 3
Open weight models are not truly free to use — the 'free' only refers to R&D, a fixed sunk cost, while COGS from running inference is real, revenue-correlated, and applies just as much to Kimi as to any other model.Ben Thompson · Stratechery · conf 75%Tokens are not a commodity, since different models need different amounts of tokens to reach a correct answer; what is actually fungible is the intelligence (the correct answer) that tokens produce, not the tokens themselves.Ben Thompson · Stratechery · conf 75%Tech firms are increasingly competing on making AI intelligence cheaper rather than solely bigger, smarter, or faster.Alex Kantrowitz · Big Technology · conf 70%