and though he no longer encouraged them , when he looked back at the man he 'd been before his injury , he recalled how he sure had n't pushed those women away when he 'd been with madison in the past .