Backport PR #45581 on branch 1.4.x (CI: Fix actions-310 testing 3.9 instead of 3.10)
Backport PR #45581
@jreback there was failures here that we are not seeing on master. currently investigating locally. could revert this or maybe follow-up with removing the xfails. It maybe only that the only change needed is to ci/deps/actions-310.yaml the xfails were removed from master https://github.com/pandas-dev/pandas/pull/45651#issuecomment-1022868410

will see if #45651 is suitable for backporting https://github.com/pandas-dev/pandas/pull/45651#issuecomment-1024446836