Propagation of uncertainty is a desirable property when using Upper Confidence Bounds (UCB; Auer, 2002) for exploration, since UCB methods rely only on the first two moments of PQˆπ .
propagation of uncertainty is not sufficient for effective exploration under posterior sampling.