Lemma 7.3. Assuming that:

$X$ a discrete random variable (and write $p_{x}$ for $ℙ (X = x)$ )

Then there exists

x

such that

p_{x} \geq 2^{- H [X]}