In 1998, Bishop Ronald Ferris of the Diocese of Algoma removed Baxter from his parish and revoked his license to perform Anglican weddings because of his use of Elvis in Anglican services, saying it was "in poor taste". In 2002, the church revoked his invitation to be the keynote preacher at a Masonic service in a Toronto Anglican church. Baxter has said he found this particularly difficult, as he has been a Freemason for more than 25 years and was Worshipful Master of his lodge in 1980. Baxter attended the service anyway.