The centrepiece of this small town is Tanilba House, on Caswell Crescent, which is listed on the New South Wales State Heritage Register along with The Temple of the Stork nearby. It is one of Australia's oldest buildings and the oldest in Port Stephens. In 1831 Lieut William Caswell, Royal Navy, received a land grant of , along with an assignment of convicts who cleared the land and built Tanilba House from locally quarried quartz porphry stone and lime mortar made on the property from oyster shells. A small gaol was also built on the southern side of the house. Ten acres (4 hectares) on the eastern side of the hill was used as a vineyard soon after the house was built. An olive tree planted in the vineyard survives to this day and is heritage listed. A bunya pine, the wisteria covered pergola and two Port Jackson figs are also specifically listed.