Blog
Thinking About Thinking as Compression: When Information Theory Meets Metacognition
Entropy, Surprise, and the Noisy Theater of Self-Reflection Start with a blunt claim: information is not “data” in the spreadsheet sense. It’s reduction of uncertainty—measured, since Shannon, in bits of entropy. Every belief you hold is a guess about the world’s probability distribution. Each time the world pushes back, your Read more