but they left him alone , with few exceptions-owing , i believe , more to the respect afforded by the great , nearly inexhaustible wealth accumulated by his ancestors than to any esteem for his philosophical pursuits .