Hoff went to Williams College and Connecticut College and graduated cum laude in 1948. Hoff married Joan Brower in 1948. He later attended Cornell Law School, graduating in 1951. The Hoffs moved to Burlington, Vermont in 1951.