The first prison, the Ararat County Gaol, was built in 1861, and was used a prison until 1887. During that time, three prisoners were hanged, and their graves can still be seen. In 1887, the prison was set up as a prison for criminals who were insane, and renamed J Ward. One prisoner was kept locked up in J Ward for more than 60 years. J Ward was closed in 1991, and is now a museum.