CI/TST: numpy 1.22.3 release fixes
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).

Looks like this is xpassing now

```
___________________ test_alignment_deprecation_many_inputs ____________________
[gw0] win32 -- Python 3.9.10 C:\Miniconda\envs\pandas-dev\python.exe
[XPASS(strict)] ufunc 'my_ufunc' did not contain a loop with signature matching types
```

LGTM pending green @meeseeksdev backport 1.4.x Something went wrong ... Please have a look at my logs.