Rankin was raised in New York and was introduced to music by his mother, who sang at home and for friends. The area of Washington Heights, Manhattan was becoming heavily Latino during his youth, and exposure to street music may have played a part. He began recording at age 17 (1957), eventually working as a songwriter contracted to Columbia Records. Rankin's earliest composition, "My Carousel" was written for Carmen McRae, followed by "A Happy Guy" for teen idol Rick Nelson. He had already developed a serious amphetamine problem by that time.