His restoration as Earl of Kildare aroused the hostility of many, both Old English and New English, and successive Lord Deputies, and throughout his career he was frequently accused of treason, and was imprisoned in Dublin Castle and later in the Tower of London. He owed his survival mainly to the personal regard of Queen Elizabeth, who twice dismissed the charges of treason against him. He conformed to the Protestant religion in the beginning of the reign of Queen Elizabeth. In his last years although technically a free man he was forbidden to leave London, save that he was permitted to take his seat in the Parliament of Ireland which met in Dublin during April–May 1585.