Bulwer was created a baronet, of Knebworth House in the County of Hertford, in the Baronetage of the United Kingdom, in 1838. In 1841, he left Parliament and spent much of his time in travel. He did not return to politics until 1852, when having differed from Lord John Russell over the Corn Laws, he stood for Hertfordshire as a Conservative. Bulwer-Lytton held that seat until 1866, when he was raised to the peerage as Baron Lytton of Knebworth in the County of Hertford. In 1858 he entered Lord Derby's government as Secretary of State for the Colonies, thus serving alongside his old friend Disraeli. He was comparatively inactive in the House of Lords.