Dornan was born in New York City to a Roman Catholic family. He studied at Loyola Marymount University in Los Angeles. In 1952, he joined the United States Air Force as a fighter pilot. In 1955, he married Sallie Hansen. They have five children.