He was born in Dunham, Lower Canada in 1834, the son of William Baker, and studied at Bishop's College.
Baker was elected to the House of Commons in an 1870 by-election after Brown Chamberlin resigned his seat.