Colchester
The Roman town of Camulodunum, officially known as Colonia Victricensis, reached its peak in the Second and Third centuries AD.  It may have reached a population of 30,000 in those centuries, but when the Romans withdrew from Britannia in 410 AD it probably had fewer than 5,000 inhabitants.