Murphy was born in Bremen, Georgia, where his father was a telegraph operator for the railroad. Murphy graduated from Bremen High School in 1941 and enrolled in North Georgia College in Dahlonega, Georgia. During World War II Murphy served in the Navy in the South Pacific. After leaving the Navy Murphy attended the University of Georgia Law School, graduating in 1949. That same year he was elected to the Bremen Board of Education. He was elected to the Georgia House of Representatives in 1960, serving in both positions simultaneously until 1965 when he left the Board of Education.