The conditional entropy,
is the number of bits which would have to be transmitted to identify  from  equally likely possibilities, less the relative entropy of the product distribution  from the true joint distribution  — i.e. less the expected number of bits saved which would have had to be sent if the value of  were coded according to the uniform distribution  rather than the conditional distribution  of  given .