Pipes was born to a Jewish family in Cieszyn, Poland, which fled the country as refugees after it was invaded by Nazi Germany. Settling in the United States in 1940, he became a naturalized citizen in 1943 while serving in the United States Army Air Corps.