“It turns out, kind of? It's not exactly coherent text, but it clearly knows something about the text. Much more than I expected gzip to know.”

nathan.rs blog · Researcher demonstrates gzip as functional language model using compression

“A continuation that gzip 'expected', because it echoes text already in its window, compresses to almost nothing.”

nathan.rs blog · Researcher demonstrates gzip as functional language model using compression