Hoff was born in Turners Falls, Massachusetts. His father worked in the insurance industry and at the Massachusetts General Court. Philip was a star high school football player at Turners Falls High School. 