The new Hay Gaol in Church Street was built during 1879-80 by the local building firm of Witcombe Brothers. The perimeter consists of a five-metre-high () wall of locally produced red bricks, with a large central entrance gate (in front of a small barred entrance court). Two guard towers were placed at diagonally opposite corners of the perimeter wall.  The main cell-block contained 12 cells (including two for female prisoners). The cells (apart from two of a larger size) measured 9 feet 9 inches by 10 feet 2 inches, each with cement floors and a galvanised roof. The compound also contained a solitary confinement cell, mess-hall, kitchen, meeting-room and officer's residence.