You should not stop talking to your friend because you are now seeing the girl that was your friend's girlfriend.
your friend is extremely upset with you because you started seeing her before they broke up.