REGR: do not try to infer the excel type from a workbook object
- [ ] closes #39528
- [ ] tests added / passed
- [ ] Ensure all linting tests pass, see [here](https://pandas.pydata.org/pandas-docs/dev/development/contributing.html#code-standards) for how to run them
- [ ] whatsnew entry

@rhshadrach you beat me by half an hour :) and your PR #39586 seems to be more thorough. Ah, which was really thanks to your discussion in the issue.