MechanismArticle

The new schema design in LLM de-duplicates conversation messages using hashes of individual message parts.

The content-addressable log scheme uses hashes of individual message parts to avoid storing duplicate conversation data as requests grow longer with client-tracked state. ✦ AI generated

Author · Simon Willison's Weblog · 2026-07-30 · original ↗

Share card ↓Export .md Export .txt

Here the conversation state is tracked by the client, so each of these requests gets longer and longer. The new schema design in LLM is designed to de-duplicate these using hashes of the individual message parts.

Read full article ↗excerpt · fair-use quotation

✳ LLM

Around this claim

Mechanism · 1

Content-addressable logs in LLM 0.32rc1 are designed to support OpenAI Chat Completion style requests where each incoming message extends the previous conversation.Author · Simon Willison's Weblog · conf 60%