The U.S. Federal Census of 1860 designated Port Ludlow as one of the three enumeration districts in Jefferson County, Washington Territory. The census tally portrays the make-up of a young logging and sawmill community: Of the 124 people counted, 117 (94%) were adults between the ages of 20 and 50, and the remaining 7 were children. Of the adult population 112 (96%) were men and only 5 women, of which 3 were residing with husbands. 53 (47%) of the men were listed as lumbermen and 14 (13%) as sawyers. Of the total population, 94 (76%) were born in the United States, and of those all were born in the eastern half of the nation but two — a two-year-old born in California and a one-year-old born in Washington Territory. Of the 30 (24%) who were foreign-born, 8 were born in England, 8 in Ireland, 6 in Canada, 4 in Germany, 2 in Norway, and one each in Australia and Denmark. The indigenous peoples were not counted in the 1860 census.