Fix problem about loongarch install by pip
- [x] closes #xxxx (Replace xxxx with the Github issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


From numpy [v1.22.0](https://github.com/numpy/numpy/releases/tag/v1.22.0) support loongarch
Should I merge to 1.4.x branch ? > Should I merge to 1.4.x branch ?

Targetting master is fine. meeksmachine will backport if required This pull request is stale because it has been open for thirty days with no activity. Please [update](https://pandas.pydata.org/pandas-docs/stable/development/contributing.html#updating-your-pull-request) and respond to this comment if you're still interested in working on this. Thanks for the pull request, but it appears to be stale. If interested in continuing, please merge in the main branch, address the review and we can reopen.