Lemma 1.16.
Assuming that:
X
,
Y
,
Z
random variables
Z
=
f
(
X
)
=
g
(
Y
)
Then
H
[
X
,
Y
]
+
H
[
Z
]
≤
H
[
X
]
+
H
[
Y
]
.