Is there no direct logical correlation between 'He said to me, You have to go, he said to me.' and 'After saying that I can stay, he then told me to leave.', indicating neutrality?
He said to me, You have to go, he said to me.###After saying that I can stay, he then told me to leave.