The island was charted in 1800 and named after the ship "Cartier". Its charted position was somewhat inaccurate until corrected in 1878 during a hydrographic survey by Lieutenant William Tooker in the "Airlie". On 5 January 1888 the "Ann Millicent" was wrecked on the island during a voyage from the Gulf of Carpentaria to Adelaide, South Australia. In 1909 it was annexed by the United Kingdom, but on 23 July 1931 both Ashmore Reef and Cartier Island was transferred to Australia.