Cowper was born in Berkhamsted, Hertfordshire, where his father John Cowper was rector of the Church of St Peter. His father's sister was the poet Judith Madan. His mother was Ann née Donne. He and his brother John were the only two of seven children to live past infancy. Ann died giving birth to John on 7 November 1737. His mother’s death at such an early age troubled William deeply and was the subject of his poem, "On the Receipt of My Mother's Picture", written more than fifty years later. He grew close to her family in his early years. He was particularly close with her brother Robert and his wife Harriot. They instilled in young William a love of reading and gave him some of his first books – John Bunyan’s "Pilgrim’s Progress" and John Gay’s "Fables."