After his failed Senatorial re-election bid, Johnson returned to the House, representing Kentucky's Fifth District from 1829 to 1833, and Thirteenth District from 1833 to 1837. During the Twenty-first and Twenty-second Congresses, he again served as chairman of the Committee on Post Office and Post Roads. In this capacity, he was again asked to address the question of Sunday mail delivery. He drew up a second report, largely similar in content to the first, arguing against legislation preventing mail delivery on Sunday. The report, commonly called "Col. Johnson's second Sunday mail report", was delivered to Congress in March 1830.