The first depot was built of wood around 1850 by the Hudson River Railroad to handle freight shipments into and out of what was then a busy industrial Hudson River city.) Around 1890 the present brick depot was built by the New York Central Railroad; at that time its platform had extensions to the north and south along the tracks. There are some reports of fires in the 1880s and again in 1898; and blistering of the interior paint at roof level gives evidence that there was one.