The Heights was part of the colony of Pavonia, New Netherland, the superintendent of which was the American patriarch of the Van Vorst family. A Van Vorst House built in 1742 by the family (now on Palisade Avenue) is considered to be the oldest building in Hudson County. Summit Avenue, slightly to the west follows an Hackensack Indian trail that became the main road from the villages of Communipaw and Bergen and eventually connected to the Paterson and Hackensack Plank Roads.