In 1636, he was in school in Maidstone, Kent. His family joined Winthrop in America in 1638, settling in Salem, Massachusetts. Downing attended Harvard College and was one of nine students in the first graduating class of 1642. He was hired by Harvard as the college's first tutor. In 1645 he sailed for the West Indies on a ship that also carried slaves, as a preacher and instructor of the seamen, and arrived in England some time afterwards, becoming chaplain to Colonel John Okey's regiment (who had originally sponsored Downing's education in America).