Colton might have been premier again in June 1881, but stood aside in favour of Bray. On 16 June 1884 he became premier and chief secretary in his second ministry, which in the following twelve months passed some very useful legislation, including a public health act, an agricultural crown land act, a pastoral land act, a vermin destruction act and a land and income tax act. The ministry was defeated on 16 June 1885. Seldom had a ministry done so much in so short a time, but Colton was prostrated by overwork and was compelled to live in retirement for some months. On his return to parliament he attempted to lead the opposition, but an attack of paralysis finished his political career and he resigned from parliament in January 1887.