CI: Ensure no-use-pep517 with no-build-isolation with new pip version
xref https://github.com/scipy/oldest-supported-numpy/issues/53

We may even be able to replace no-build-isolation with no-use-pep517 https://github.com/scikit-learn/scikit-learn/pull/23339 but that could be a followup.
can you merge master (i merged the 32-bit build one first) Thanks @mroeschke  @meeseeksdev backport 1.4.x