TST: Don't ignore tolerance for integer series
- [ ] closes #56646 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

cc @lithomas1 
Thanks, can you also update the docstrings?

(e.g. https://github.com/pandas-dev/pandas/pull/56724/files#diff-9157afe37d6dba4c96d24fce3cf8290e3810b4662f77abf4a71719bbee795a25R845) done Looks like 2 more places need to be updated.

https://github.com/pandas-dev/pandas/blob/8b287cfe887a9952eea96c39527e6647be95581b/pandas/_testing/asserters.py#L718-L719

https://github.com/pandas-dev/pandas/blob/8b287cfe887a9952eea96c39527e6647be95581b/pandas/_testing/asserters.py#L1124-L1125 Oh sorry, I think I got everything now