TST: Parameterize & make tests more performant
> do you know how much time this saves?

Locally in total for this PR probably a second or so. Another benefit for the tests that reduce the data size is to also to reduce the peak memory pressure of a test.