REF: avoid sanitize_to_nanoseconds
Most of the usages are unnecessary bc we go through the DTA/TDA constructors.  After this there is only one left, and that will be removed by #48670
Thanks @jbrockmendel 