Lemma 4.1 (Shearer). Assuming that:

  • X=(X1,…,Xn) a random variable

  • A a family of subsets of [n] such that every i∈[n] belongs to at least r of the sets A∈A

Then
H[X1,…,Xn]≤1r∑A∈AH[XA].