Folly
Eccentric structures may resemble follies, but the mere presence of eccentricity is not proof that a building is a folly. Many mansions and castles are quite eccentric, but being purpose-built to be used as residences, they are not properly follies.