He fell out of favour with the Queen in the early 1580s and was exiled from court after impregnating one of her maids of honour, Anne Vavasour, which instigated violent street brawls between Oxford’s retainers and Anne’s uncles. He was reconciled to the Queen in May 1583 at Theobalds, but all opportunities for advancement had been lost. In 1586, the Queen granted Oxford a £1,000 annuity to relieve his financial distress, caused by his extravagance and selling off his income-producing lands for ready money. After the death of his first wife, Anne Cecil, Oxford married Elizabeth Trentham, one of the Queen's maids of honour, with whom he had an heir, Henry de Vere. Oxford died in 1604, having spent the entirety of his inherited estates.