He married Mary Johnson (1729–1820) on 11 May 1752 in Batheaston; Johnson was described by Ozias Humphry, who lodged with the couple for two years from 1762 until 1764, as having musical talents almost on a par with her husband. According to Michael Kelly, when young, Mrs Linley was "reckoned beautiful". The couple had 12 children over an 18-year period from 1753 until 1771, but only eight lived beyond infancy or childhood. Seven went on to musical or theatrical careers: Elizabeth Ann Linley (1754–1792), his eldest daughter, wife of Richard Brinsley Sheridan; his eldest son Thomas Linley the younger (1756–1778), composer and noted violinist; Mary Linley (1758–87), who gave up her career as a singer after she married playwright Richard Tickell in 1780; Samuel Linley (1760–1778), second son, singer and oboe player; Maria Linley (1763–84), singer; Ozias Thurston Linley (1765–1831), minor canon at Norwich and organist at Dulwich; and William Linley, (1771–1835), composer of glees, songs and writer. Another child, Jane Nash (1768–1806), sang in an amateur capacity until her marriage. Music historian Charles Burney visited when the children were young and listened to them singing and playing instruments; he described the family as "a Nest of Nightingales".