CI: Run python dev with numpy python 3.10 wheels
- [ ] closes #xxxx
- [ ] tests added / passed
- [ ] Ensure all linting tests pass, see [here](https://pandas.pydata.org/pandas-docs/dev/development/contributing.html#code-standards) for how to run them
- [ ] whatsnew entry

Just testing the numpy wheels in preparation for making our own.

Also shaves like 4 min which is like 10% of time from the build. Verified that it runs from this commit https://github.com/numpy/numpy/commit/334428c4d10b778fd74fc3919f3dc9a3b1959875, which seems right. nice! @lithomas1  @meeseeksdev backport 1.3.x Something went wrong ... Please have  a look at my logs.