Lemma 4.2 (Shearer, expectation version). Assuming that:

  • X=(X1,…,Xn) a random variable

  • A⊂[n] a randomly chosen subset of [n], according to some probability distribution (don’t need any independence conditions!)

  • for each i∈[n], ℙ[i∈A]≥μ

Then
H[X]≤μ−1𝔼AH[XA].