In the retired list, he was promoted to rear-admiral on 2 May 1855, vice-admiral on 15 January 1862, and admiral on 12 September 1865. In Sir Henry Taylor's play, "Edwin the Fair" (1842), the character Earl Athulf was based on Elliot. Taylor also mentioned Elliot in his poem, "Heroism in the Shade" (1845). Elliot was made a Knight Commander of the Most Honourable Order of the Bath in 1856. He died in retirement at Withycombe Raleigh, Exmouth, Devon, England, on 9 September 1875. He is buried in the churchyard of St John in the Wilderness, Exmouth. The weathered headstone inscription to his grave reads in worn lead lettering: "To the memory of / Adm Sir Charles Elliot KCB / Born 15th August 1801 / Died 9th September 1875 / The souls of the righteous are in the hands of God". This is the only known memorial to him anywhere in the world.