Prescott first went to school when he was seven. The family moved to Boston, Massachusetts, in 1808. Prescott went to Harvard University in 1811, at the age of 15. He was good at Latin and Greek, but found mathematics difficult. He graduated from Harvard in 1814.