In 1680 Sir Robert Sawyer presented the living of Highclere to the Rev. Isaac Milles (1638–1720), the elder, who remained there till his death. White Oak was the parsonage where Milles took pupils, including the many children of Thomas Herbert, 8th Earl of Pembroke, by marriage the new proprietor of Highclere. The Rev. Isaac Milles (fl. 1701–1727), the younger, carried on his father's school at Highclere. The daughter of Milles, the younger, Elizabeth married Reverend Richard Pococke, LL.B. (1660–1710) and had the Rt. Rev. Richard Pococke (1704–1765), who having been educated by his grandfather Milles, at his school at Highclere rectory, went on to become domestic chaplain to Philip Stanhope, 4th Earl of Chesterfield, and then Bishop of Ossory and Meath, and a renowned travel writer and orientalist.