Proposition 1.11 (Subadditivity). Assuming that:

  • X and Y be random variables

Then H[X,Y]H[X]+H[Y].