KANITHAKALAM The Joy of Math

Information Theory

Entropy, uncertainty, and the limits of what can be said.

Foundations of Information Theory Entropy, conditional entropy and mutual information, from first principles