Picks and Pans reviewers Chuck Arnold and Ralph Novak wrote, while reviewing the "One Heart" album: "Two of the strongest cuts are actually recycled from last year's A New Day Has Come: "Have You Ever Been in Love" and a ballad version of "Sorry for Love." Christopher Smith from TalkAboutPopMusic described the song as a "guitar-laced piece of theatre that Celine wrestles with, with passion from the halfway mark, welcoming back ‘that voice’ for a new century, before ending with her usual tenderness and seduction."