Apart from his political career, Lord Ebury was an active campaigner for Protestantism in the Church of England and was the founder and President of the society for the "revision of the prayer-book". He was also involved in the movement led by Anthony Ashley Cooper, 7th Earl of Shaftesbury, for the improvement of factory working hours. In later life he came to oppose William Ewart Gladstone on the issue of Irish Home Rule. In September 1893, at the age of 92, Lord Ebury voted against the Second Home Rule Bill, by far the oldest peer to vote in the matter.