Isaacson was born on May 20, 1952 in New Orleans, Louisiana. His father Irwin was an engineer. His mother Betsy was a Realtor. Isaacson grew up in New Orleans. He graduated from Harvard University in 1974. Isaacson attended Pembroke College, Oxford as a Rhodes Scholar.