Book was born in Bath, but at the age of four moved to India when his father, an officer in the Somerset Light Infantry, was posted. During World War II, Book's father served in Burma, and Book lived with his mother and brothers in army quarters in a number of places in British India, including Mumbai and Multan. In September 1945, the Book family returned to England. Tony started secondary school in Bath, and gained his first experience in competitive football when he was selected to play for both Bath boys and Somerset boys.