Information entropy
Information and its relationship to entropy can be modeled by:R = H(x) - Hy(x)"The conditional entropy Hy(x) will, for convenience, be called the equivocation. It measures the average ambiguity of the received signal."