I have nothing against you personally--but I can't let you stop us.
It's not anything I have against you personally, I just can't let you stop us.
I have a personal issue with you and I want this to stop.