BUG: replace with value also being replaced
- [x] closes #46306
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added an entry in `doc/source/whatsnew/v1.4.2.rst`

@jreback - greenish @meeseeksdev backport 1.4.x Something went wrong ... Please have a look at my logs.