This fits in with the idea that he's sharing her with another but is unable to leave her because he always falls for her when she returns.
This scenario reflects the concept of being bound by an attraction that prevents him from leaving despite sharing her with another person.