Backport PR #31215 on branch 1.0.x (Follow-up: XLSB Support)
Backport PR #31215: Follow-up: XLSB Support
dev failures should be fixed by https://github.com/pandas-dev/pandas/pull/31209. The merge commit should pass.