Bundling every version of a document into a single blob and applying a good compression algorithm should wipe out most of the redundant text.
The core insight: rather than compress cleverly per-column, take the full text of every prior version as a JSON array of strings and compress the whole thing with zlib or zstd.
transcript
The author (as spoken to GPT-Live): compression would work really well, right? If you Bundle all of those different um Every every version of this document all the way back to the start if you were to apply a good compression algorithm to them that should basically wipe out huge amounts of the redundant text.
gives example · 1