Talbot's only son Theodore died in 1876 following a hunting accident. Hence the dedication to St. Theodore of an Anglo-Catholic parish in the east of Port Talbot. It was therefore his daughter Emily Charlotte Talbot (1840–1918) who inherited her father's fortune and became just as notable in the development of ports and railways. Another daughter, Olive Talbot, founded an Anglican theological college in Aberdare which subsequently moved to Cardiff Road, Llandaff; it was called St. Michael's College. Lt.-Col. Sir John Mansel Miller was his great-grandson.