Compression Is Intelligence
Why a concept called epiplexity may explain where intelligence really comes from. Intelligence, at its core, is a compression problem. Humans cannot track every falling apple, so we invent gravity. We cannot memorize every chess position, so we develop strategy. We cannot remember every sentence we’ve ever read, so we acquire grammar. In each case, intelligence emerges from the same constraint: we cannot brute-force the world. When computation is limited, discovering structure becomes essential. A recent paper from researchers at Carnegie Mellon and NYU introduces a concept that captures this idea precisely. They call it epiplexity — the portion of information that a computationally bounded learner can actually extract. The idea helps explain several puzzles about modern AI, from AlphaZero’s superhuman chess ability to the surprising effectiveness of reasoning-based models. More importantly, it reframes a deeper question: Where does intelligence actually come from? The Static vs. Euclid Problem Consider a simple thought experiment. You have two things in front of you. One is a terabyte of television static — pure noise, every pixel random. The other is a copy of Euclid’s Elements, the geometry text that shaped two thousand years of mathematics. ...