Rowland served as a member of the Georgia House of Representatives from 1976 through 1982. He was first elected to the United States House of Representatives in 1982 when he defeated Billy Lee Evans, who had accepted illegal campaign contributions. Rowland served six terms in Congress, from January 3, 1983, to January 3, 1995, and did not seek renomination in 1994.