Introduction to Entropy: Toward Disorder and Most Likely Outcomes

A little introduction to entropy. We start with the idea of entropy being synonymous with "disorder" and the second law of thermodynamics, which says that for an irreversible process in a closed system, the entropy, or "disorder," must increase. It is possible for processes to create regions of order (obviously), but there will be disorder created elsewhere. We will then introduce a more formal definition of entropy that involves the number of microstates (specific arrangements of individual bits) that produce a particular macrostate (observable property of the entire collection of bits).