It was Charles who build the other three palaces in locations more peripheral to the city center.
The sentence implies that Charles was responsible for building multiple palaces, and these were not located in the immediate vicinity of the city center.