Rhomberg spent most of the 1982 season in Class AAA, and he was called up to the major leagues with the Indians in September of that year. In his major league debut on September 8, which Rhomberg said was the first birthday of his son Kevin Jr, Rhomberg hit a home run. Several players shared the second base duties that year for the Indians; Rhomberg appeared in 16 games, mostly as a left fielder or pinch runner. Before the 1983 season, the Indians sent Rhomberg back to the Class AAA Charleston Charlies. He was called back up to the Indians in September 1983. He finished his major league career with the 1984 Indians, playing in 13 games. Over his 41-game major league career, Rhomberg had 18 hits in 47 at bats for a .383 batting average. He retired after spending the 1985 season in Class AAA with the Phoenix Giants.