ardsmuir had been a prison for only fifteen years ; following its renovation by jacobite prison-labor , it had been converted into a small permanent garrison , and the prison population dispersed-mostly transported to the american colonies .