Young is commonly said to have been born in Chicago on August 8, 1900, but according to Census data and his birth certificate, his birth year is 1899. His grave marker shows his birth year as 1901. He was born into a very musical Jewish family, his father being a tenor with Joseph Sheehan's touring opera company. After his mother died, his father abandoned the family. The young Victor, who had begun playing violin at the age of six, and was sent to Poland when he was ten to stay with his grandfather and study at Warsaw Imperial Conservatory (his teacher was Polish composer Roman Statkowski), achieving the Diploma of Merit. He studied the piano with Isidor Philipp of the Paris Conservatory. While still a teenager he embarked on a career as a concert violinist with the Warsaw Philharmonic under Juliusz Wertheim, assistant conductor in 1915–16.