Krieger was born in Los Angeles, California to a Jewish family. His father, an engineer, was a fan of classical music, while his mother enjoyed "Frank Sinatra and stuff like that". "Peter and the Wolf" was the first record that captivated him. When he broke it, he started listening to other records. The radio introduced him to the likes of Fats Domino, Elvis Presley, and the Platters. At the age of 10, he tried the trumpet but found it was not for him. He began playing the blues on his parents' piano with much more success than the trumpet. At 13, he enjoyed playing a friend's guitar.