Backport PR #29010 on branch 0.25.x (Setuptools CI fixup)
Backport PR #29010: Setuptools CI fixup
Looks like the 3.8 build is failing when trying to build numpy @jbrockmendel merge? Yeah, I think so... The 3.8 build isn't using conda and so is unaffected by this change.

And hopefully NumPy wheels are out soon and we can just install that for the 3.8 build.