The parish church of Rhymney is a Grade II listed building that was constructed in the neo-classical style. It was built by architect Philip Hardwick from London on commission for Andrew Buchan who was the manager of the local Rhymney brewery between 1838–1858. The building was listed in 1990 and was noted for being one of the most 'interesting' examples of neoclassical architecture in South Wales. Buchan himself is buried in the church vaults and is commemorated with a plaque in the nave of the parish. The parish is occasionally visited by enthusiasts of Hardwick's work who are interested in neo-classical buildings of this type.