Theorem 1.8
(Khinchin)
.
Assuming that:
H
satisfies the Khinchin axioms
X
takes values in a finite set
A
Then
H
[
X
]
=
∑
a
∈
A
p
a
log
(
1
p
a
)
.