Argov was born in Jerusalem in 1929. His family had lived in Jerusalem for seven generations. As a teenager, he joined the Palmach, the elite force of the Haganah. During the 1947-1948 Civil War in Mandatory Palestine, he was wounded in the Battle of Safed. When Israel was established and the 1948 Arab-Israeli War began, Argov joined the Israel Defense Forces (IDF).