The Lady Olivia character in the 1806 novel "Leonora" by Maria Edgeworth was rumoured to have been based on Lady Asgill, portraying her as a "coquette". Lady Asgill herself maintained a two-decades long secret correspondence with Thomas Graham, 1st Baron Lynedoch. The two had agreed to destroy each other's correspondence, but some letters survived as Lynedoch did not destroy them all. A graphite drawing of Lady Asgill's setter dog was created at the Lynedoch Estate in Scotland by Charles Loraine Smith.