As someone who's been in a psychologically abusive relationship (which eventually turned physical): Think about leaving this person. If your first thought is "they're going to be really angry at me and try to take it out on me," that's probably a sign they're psychologically abusing you.