He graduated from that institution in June 1909 and was married shortly thereafter to his sweetheart from his Hope College days, Anna Huizenga. Upon his graduation, Muste was appointed pastor of the Ft. Washington Collegiate Church in the Washington Heights neighborhood of Manhattan, New York City. During his spare time, he availed himself of his parish's proximity to the theologically-liberal Union Theological Seminary to take additional courses there. He ultimately received a Bachelor of Divinity there and graduating from Union "magna cum laude."