TST: add tzaware case to indices fixture
Much easier alternative to #31236.
does this have any user facing behavior changes?  > does this have any user facing behavior changes?

No, this is purely fleshing out the tests thanks!