Growing up in Thousand Oaks, California, Scarbury was continually encouraged in his ambition to sing by his mother. At the age of 14, after being spotted by songwriter Jimmy Webb's father, he was signed to a recording contract, and seemed to be destined for stardom. Scarbury's first single, "She Never Smiles Anymore," flopped, and he was soon without a record label. 