Town designed his New Haven home on Hillhouse Avenue in the Greek Revival style; here he kept what was then an extraordinary architectural library — an inspiration to many, including Davis and another noted New Haven architect, Henry Austin. His impressive library contained more than 11,000 volumes of architecture books and prints and was far larger than any other personal collection anywhere at the time, including that of Sir John Soane in London. The library was amassed at a time when only a handful of significant architecture books had been published in America.