In the late 1950s two families of musicians who played with the Atlantic Symphony Orchestra moved to Duncan's Cove. One of those families embarked upon a decades-long construction project of unconventionally shaped timber-framed dwellings, and even had a small private airstrip. By the late 1960s, fishing from the cove had dwindled and the community become known as an artists colony, with many symphony players, visual artists and theatrical actors residing there. The landmark gunnery director tower stood derelict for many years, until finally passing into private hands in the 1990s. The building is virtually unrecognizable today, having been radically converted into a luxury residence.