You sound rather nice.  He's taking advantage of your reluctance to be rude to him.  "You seem to have a hearing problem.  I asked you to stop contacting me."  Dating sometimes requires a woman to assert herself.  Please let a family member know about this so he or she can back you up if necessary.