 If both models are trained on the same data, the small model will be worse at generalisation because of its inferior expressive power.However, some information of how a model generalise is encoded in the pseudo-probabilities assigned to its output