The distortion occurs because the normal rules of specular reflection don't apply to reflective gratings operated far from the non-dispersive reflection angle.
The distortion arises because the standard rules of mirror-like reflection do not apply to gratings that reflect light far from the angle at which non-dispersive reflection occurs.