Ann and Joseph were married on 15 November 1851 in Horsley Congregational Church, though Joseph was only twenty-one years old, and they had twelve years' happy married life – consisting of six months in Horsley, a year or two in London, five years in Banbury, and five in Manchester – until Ann died in 1863. However, when Horsley Congregational Church was rebuilt, Dr. Parker presented a beautiful stained glass window, bearing the following inscription: "In ever loving memory of Ann Nesbitt, for twelve years the devoted wife of Joseph Parker, Minister of the City Temple, London, this window is reverently and gratefully erected by the man whose life she did so much to mould". The pulpit of grained oak was given at the same time and was inscribed: "In grateful memory of William Nesbitt of Horsley Hills, to whom the Church herein assembling is deeply indebted for long-continued and invaluable service, this pulpit is affectionately erected by his son-in-law Joseph Parker." Both the stained glass window and the pulpit can still be viewed at Horsley Congregational Church. The site is now managed by The Hearth Centre (Horsley) Ltd locally known as The Hearth – see www.thehearth.co.uk . Regular church services are still held in the church.