Proposition 1.14 (Submodularity). Assuming that:

  • X,Y,Z are random variables

Then
H[X|Y,Z]H[X|Z].