The Carnegie Library was one of the early Carnegie libraries funded in Indiana by Andrew Carnegie, to the tune of $15,000. The Neo-Classical architecture was done by Arthur Loomis, a nationally respected architect in the firm of Clarke & Loomis Architecture, with the cornerstone being set on September 19, 1903. Loomis was a native of Jeffersonville. The building once held classes for Indiana University Southeast. The Carnegie Library is the central focus point in Warder Park and now contains the Remnant Trust of Rare Books and Documents.