Corollary 1.13. Assuming that:

  • X1,…,Xn are random variables

Then
H[X1,…,Xn]≤H[X1]+⋯+H[Xn].