CI: Align MacOS dependencies with other builds
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature

xref https://github.com/pandas-dev/pandas/issues/29685

MacOS/Windows/Linux will use the same dependency file after this change 

are the CI failures here real? > are the CI failures here real?

The MacOS ones, yes (pyarrow is tricky apparently). I have no idea why the GHA Linux ones are failing though since the changes are totally unrelated.   @meeseeksdev backport 1.4.x Something went wrong ... Please have a look at my logs.