In a rigid body, the centre of mass is always in the same place. In a loose collection the center of mass may be in space, as it is in the Solar System. Also, as planets' orbits change slightly, so will the position of the barycenter.