Although they did not participate in Peel's short-lived 1835 ministry, over the next several years they gradually merged into Peel's Conservative Party, with several members of the "Derby Dilly" taking prominent positions in Peel's second ministry. Joining the Conservatives, Stanley again served as Colonial Secretary in Peel's second government in 1841. In 1844 he was summoned to the House of Lords as Lord Stanley of Bickerstaffe in his father's Barony of Stanley by Writ of Acceleration. He broke with the Prime Minister again in 1845, this time over the repeal of the Corn Laws, and managed to bring the majority of the Conservative Party with him (including, among others, the young Benjamin Disraeli). He thereafter led the protectionist faction of the Conservative Party. In the House of Lords, on 23 November 1847, he accused the Irish Catholic clergy of using the confessional to encourage lawlessness and crime. This was disputed in a series of letters by the coadjutor Bishop of Derry, Edward Maginn. In 1851 he succeeded his father as Earl of Derby.