From 1958 to 1960 Phillips read English Literature and Anglo Saxon at St Catherine's College, Oxford. He attended life drawing classes at the Ruskin School of Drawing and Fine Art, acted in plays, and designed and illustrated the "Isis" magazine. Upon graduation he taught Art, Music and English at Aristotle Road School, Brixton, London. He also attended evening classes in life drawing (under Frank Auerbach), and sculpture at Camberwell College of Arts, where he became a full-time student in 1961. When he graduated in 1964 his work was selected for that year's "Young Contemporaries" Exhibition in London and in the following year, the AIA Galleries in London exhibited his first one-man show. While studying at Camberwell Phillips married Jill, and their daughter Ruth was born in 1964. Their second child was a son, Leo.