Hoff attended Williams College, where he studied English, but postponed graduation for two years in order to serve in World War II. He saw combat action during World War II aboard the submarine, USS "Sea Dog", which took part in combat patrols throughout the Pacific Ocean theater. He attained the rank of Seaman First Class with the rating of quartermaster (the Navy's term for a navigator), and was discharged in 1946. He met his wife, Joan Brower, during his naval service and they were married in 1948. He later attended Cornell Law School, graduating in 1951.