I Don't Know How to Love Him to Love Him" album included an initial arrangement of Reddy's signature song, "I Am Woman" which via a 1972 re-recording with a new arrangement would prove to be the vehicle to consolidate Reddy's stardom, reaching No. 1 on the "Billboard" Hot 100 dated 9 December 1972. The earliest single version of "I Don't Know How to Love Him" was that cut by Karen Wyman an artist on the roster of MCA/Decca Records the label of release for the original "Jesus Christ Superstar" album: Wyman's single, produced by Ken Greengrass and Peter Matz, was released in November 1970 in the US
How Will I Know numbers tend to suffer from a particularly dated sound compared to her ballads, but this song still works remarkably well because of its lush melody throughout the verse, bridge and chorus." "[t]his track helps Houston prove that she knows how to interpret, with great skill, tunes that display solid craftsmanship," he added. While reviewing the "Deluxe Anniversary Edition" of the album, Mikael Wood of "Entertainment Weekly" commented on the a cappella version of the song noting, "a cappella mix of 'How Will I Know' [that] displays the singer's precision long before the advent of Auto-Tune." While reviewing "The Ultimate Collection",