BUG: parse_dates=False while passing date_parser tries to use date parser
- [x] closes #44366 
- [x] tests added / passed
- [x] Ensure all linting tests pass, see [here](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit) for how to run them
- [x] whatsnew entry

I have updated the code in the `pandas/io/parsers/readers.py` since if we pased `parse_dates=False`, it would still change it to True.
thx @loicdiridollou 