Pickersgill died in 1857 and was buried in the Loudon Park Cemetery in southwest Baltimore, where her daughter erected a monument for her, and where some civic-minded organizations later erected a bronze plaque. The house where Pickersgill lived for 50 years, at the northwest corner of Albemarle and East Pratt Streets in downtown Baltimore, became known as the Star-Spangled Banner Flag House in 1927. The house was saved through the efforts of many preservation-minded citizens who were motivated by the Centennial Celebrations of 1914.