Spencer, along with the successive Chief Secretaries for Ireland, Chichester Fortescue and Spencer's own cousin, Lord Hartington, supported coercive legislation to deal with the increase in agrarian crime, but at the same time supported a policy of releasing Fenian prisoners when possible. Spencer also had to deal during his tenure with Gladstone's Irish Universities Bill. In spite of Spencer's efforts to secure the support of the Catholic hierarchy for the bill, they opposed it, and it went down to defeat in the commons in March 1873. The government lingered on for a further year, until the election defeat of February 1874, when Spencer found himself out of office. When Gladstone returned to power for his second government in 1880, Spencer joined the Cabinet as Lord President of the Council, having responsibility for education policy, and was partially responsible for several major educational reforms of the period. The increasingly tense situation in Ireland, however, commanded an increasing portion of Spencer's time. In May 1882, Gladstone's decision to release the Irish Nationalist leader Charles Stewart Parnell from prison led to the resignation of the hardline Chief Secretary for Ireland, W. E. Forster. As a result, Spencer, while retaining his seat in the cabinet and position as Lord President, was again appointed Lord Lieutenant to take charge of the government's Irish policy.