The Town Council held a competition for a design for the eastern church, St Andrew's, which was won by Captain Andrew Frazer of the Royal Engineers and Robert Kay. The church was founded in 1781 and opened in 1784. The church is notable for its elliptical plan which was the first in Britain. The site on the north side of George Street was already developed when the Town Council bought it back to establish the Church, and this shallow space suited the elliptical design. There are similarities to William Adam's design for Hamilton Old Parish Church and to James Gibbs' original idea for St Martin-in-the-Fields in London, both of which were circular sanctuaries fronted with porticoes. The architectural style reflects the contemporary 18th-century fashion for classical Roman forms. These include the temple-front portico with ceiling rosettes based on examples found in Syria by Robert Wood and illustrated in his "Ruins of Palmyra" of 1753. The magnificent interior-ceiling design, in the style of Robert Adam, also incorporates many features found in Roman and Pompeian interior design, as well as Scottish thistles. The pulpit stands on the north wall, with a panelled gallery with original box pews round the other sides of the ellipse. The pulpit was lowered and the sounding board removed during a 1953 refurbishment, with sections of 19th century box pews removed during 2012 refurbishments.