Fix failure to convert string "uint64" to NaN
Including regression test

- [x] closes #32394
- [x] tests added / passed
- [x] passes `black pandas`
- [x] passes `git diff upstream/master -u -- "*.py" | flake8 --diff`
- [x] whatsnew entry

Great thanks @roberthdevries - keep the PRs coming! @WillAyd this has a number of issues in testing

pls revert

the OP is not tested at all  right just need another PR; @roberthdevries can u push a test for to_numeric

@WillAyd remember to set the version in the PR and issue before merging @jreback I will add another PR with a test for to_numeric referencing the original issue