After the death of his second wife, Neville's father married thirdly, about May 1578, Elizabeth Bacon (c. 1541 – 3 May 1621), widow of Sir Robert Doyley (died between 21 and 29 July 1577) of Chislehampton, Oxfordshire, and Greenlands in Hambleden, Buckinghamshire. Elizabeth Bacon was the eldest daughter of Queen Elizabeth's Lord Keeper of the Great Seal, Sir Nicholas Bacon (1510–1579), by his first wife, Jane Ferneley (died 1552), the daughter of William Ferneley of Suffolk. After Neville's death, his widow, Elizabeth, married, before the end of September 1595, Sir William Peryam (died 9 October 1604). She made her last will on 12 November 1618, and died on 3 May 1621. There is a monument to her in the church of St Mary's, Henley-on-Thames.