The Incorporated Village of Port Jefferson is in the town of Brookhaven in Suffolk County, New York. It is on the North Shore of Long Island. As of the United States 2000 census, the 7,837 people lived there. The small town is home to several unique restaurants and shops, and has a growing tourism industry.