During World War II, the gaol was used as a military prison for Australian soldiers. After the war it became a storage building for the Victoria Police. Some of the buildings were pulled down to allow for the building of the Royal Melbourne Institute of Technology, now Victoria University. In 1972 the buildings were taken over by the National Trust as a museum.