After many years of being Prime Minister, he began to have disagreements with young king George III. The king started to think that the Prime Minister was using him as a puppet. The king convinced Rockingham to become the new Prime Minister and Grenville never held an office again.