#50990 Increase to_dict('list') performance
- [x] closes #50990 
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/v2.1.0.rst` file if fixing a bug or adding a new feature.

`25.8±2ms       1.61±0.4ms     0.06  frame_methods.ToDict.time_to_dict_datetimelike('list')`
Thanks @taytzehao 