Panetta was born on June 28, 1938 in Monterey, California to an Itallian-American family. He studied at Santa Clara University. He served in the army from 1964 until 1966. He had won an Army Commendation Medal for his services in the force. Panetta is married to Sylvia Panetta.