BUG/REF: Use lru_cache instead of NUMBA_FUNC_CACHE
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added an entry in the latest `doc/source/whatsnew/v1.5.0.rst` file if fixing a bug or adding a new feature.


> assume this has neutral perf impact

Yup, additionally this actually reduces some unnecessary jitting when e.g. going from `rolling.mean` to `expanding.mean` so that might be a slight performance bump in those odd cases