title: What does it mean by the phrase "a machine learning algorithm learn a probability distribution"? What exactly is happening here
body: <p>Generative and discriminative models seem to learn conditional P(x|y) and joint P(x,y) probability distributions. But at the fundamental level I fail to convince myself what it means by the probability distribution is learnt. </p>