TST: simplify pyarrow tests, make mode work with temporal dtypes
- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

If I am understanding https://github.com/apache/arrow/pull/33685, then in pyarrow 11 we won't have to do the the int64 workaround? > If I am understanding https://github.com/apache/arrow/pull/33685, then in pyarrow 11 we won't have to do the the int64 workaround?

I don't know if that will affect mode directly. updated to use .cast instead of .astype Thanks @jbrockmendel 