When fifteen Thurles went to live with his paternal grandfather (then released from prison) at Drury Lane. His grandfather, the 11th Earl of Ormond, was now an old man and did not interfere much with his Protestant religious education. This was very important for Thurles's future life, as it meant that, unlike almost all his relatives in the Butler dynasty, he was a Protestant. This strained his relationship with the rest of his family and dependants, as they suffered from land confiscations and legal discrimination on account of their religion, while he did not.