Irvington is part of the Irvington Union Free School District, which also includes East Irvington, an unincorporated area of the Town of Greenburgh, and the Pennybridge section of Tarrytown, Irvington's northern neighbor. The schools are Dows Lane School (K-3), Main Street School (4&5), Irvington Middle School (6–8), and Irvington High School (9–12). The Middle School and High School are sited together on a combined campus on Heritage Hill Road off of North Broadway, on the site where the Stern castle, "Greystone", once stood. Stern purchased the property from Augustus C. Richards in the late nineteenth century.