Information Theory Basics

The basics of information theory: information, entropy, KL divergence, mutual information.

Princeton 302, Lecture 20

[aelialaelia]

So well done! And the graphic design of 3B1B helps a lot to maintain continuity with Grant's content so that even new viewers aren't disoriented by different visuals.

[rish]

Thanks! Very good intro to information theory