he had not thought that his father had so many enemies , as well as friends , in the city , but realized that they had only dared move against him when his principal ally , lorenzo , had been absent .