Blog
February 2026
Information Theory
We start from Claude Shannon's foundational work and build to some ideas in modern machine learning, and explore entropy, mutual information, and their unexpected connections.