Sker House was constructed about 900 years ago as the grange of Neath Abbey. There would have been a farm with outbuildings and barns, accommodation for the Cistercian monks who worked there and a chapel. Not much of the medieval house remains but one of the buildings may be preserved as part of the nearby large barn, Ty yr Ychen, which is also medieval. In 1543, after the dissolution of the monasteries, the property was purchased by Richard Williams, and soon afterwards repurchased by Christopher Turberville.