During this period, lower Port Jefferson's main section of commerce was located on what is now East Main Street. Most of the current Main Street, located on what was initially a swamp, did not become as commercially viable until the 20th century. The section of town at the intersection of the two streets, then known as Hotel Square, became an active center of Port Jefferson's early tourism industry in the mid-19th century. Visitors in town for business, or traveling through by rail or ship, were able to select from a variety of lively hotels and restaurants. This included the John Roe house, which was repurposed and expanded into the Townsend House hotel. The village's first post office was added to this intersection in 1855.