the stately stone and brick homes and businesses in that area belonged to families who had been wealthy for generations , passing their rank and authority down from father to son through the passing centuries .