Mechanism◆Article
Today's LLMs increase entropy rather than compressing and organizing knowledge in long-form nonfiction, so they will remain dependent on human guidance.
The author argues that organizing knowledge is a form of compression necessary for insight, but current models make long-form nonfiction more disorganized. This prevents their outputs from being endlessly layered into increasingly reliable knowledge without human guides. ✦ AI generated
the author · Interconnects · 2026-08-12 · original ↗
Organizing knowledge is a compression. This compression is needed to make insight. Today’s LLMs increase entropy in long-form non-fiction writing, and I don’t see how that can be stacked on top of itself endlessly. They’ll be reliant on humans acting as sort of guides.
Read full article ↗excerpt · fair-use quotation
- ·Organizing knowledge is a form of compression.
- ·Compression is necessary for producing insight.
- ·Today’s LLMs make long-form nonfiction more disorganized.
- ·Disorganized outputs cannot be endlessly layered into reliable knowledge.
- ·LLMs will remain reliant on humans as guides.
Around this claim
Mechanism · 2
LLMs are extremely sophisticated pattern-matching autocomplete systems trained only on text, not systems with true understanding or a replication of human brain intelligence, making 'alien intelligence' a more accurate label than 'artificial intelligence'.CJ · Syntax · conf 90%LLMs are the most sophisticated pattern-matching autocomplete systems ever built, lacking true understanding, and are better described as 'alien intelligence' than artificial intelligence because they predict tokens from language statistics rather than replicating how human brains actually think.CJ · Syntax · conf 90%
Counterpoint · 2
Using LLMs to build personal knowledge bases is the single most useful productivity improvement I tried this year.Casey Newton · Platformer · conf 80%The LLM wiki automates my old blips system—each morning it generates new pages for concepts in the news and updates a home page highlighting current stories, which directly generates podcast segments and story ideas.Casey Newton · Platformer · conf 70%
This moment responds to
supports → LLMs are good at checking or producing individual components and making small edits, but they compound errors when asked to organize and connect those components into an entire technical chapter.the author · Interconnectssupports → AI can provide substantial value in nonfiction writing when an expert supervises it closely, but it should mainly handle repetitive, verifiable, or editorial tasks rather than the parts that convey a work's story and intellectual soul.the author · Interconnectssupports → The best textbooks will remain heavily crafted by humans for at least two to five years because AI currently saves only 10–20% of the effort and excels at transforming existing knowledge rather than creating its core insight.the author · Interconnectssupports → Models have improved rapidly in coding, mathematics, search, and research, but writing well has barely advanced because it is a difficult, relatively orthogonal skill with inadequate specialized training data.the author · Interconnects