A handful of European settlers farmed the area in the 17th, 18th, and early 19th century, when Fairmount was still outside Philadelphia's city limits. Prominent city families established countryseats there as well, including Bush Hill, White Hall, and Lemon Hill, the last of which still stands overlooking the Schuylkill River. Fairmount was originally in Penn Township, which was subsequently divided, putting the future neighborhood in the newly created Spring Garden District until 1854 when it was incorporated into the City of Philadelphia.