CLN: avoid upcasting in tests where unnecessary (PDEP-6 precursor)
another precursor to PDEP6, similar to https://github.com/pandas-dev/pandas/pull/52957

turns out there were even more of these which could be factored upon further inspection
Thanks @MarcoGorelli 