 A carved stone sacrament house, removed from the original mediaeval church prior to its demolition, was later installed within one of the walls of St Rufus Church, and now serves as a memorial to James Duncan, a church elder who died in 1970.It bears the initials "IO" in its upper corners, a reference to James or John Ogilvy who lived at the nearby Milton Tower.St Rufus Church is mainly rubble-built, with sandstone ashlar detailing, and a slate roof.