Burns began the 1884 season playing for the Wilmington Quicksteps. He left the team on August 21, 1884, after they joined the Union Association. On the same day, Burns joined the Baltimore Orioles. At the age of 18, he was the youngest player on the Orioles. Burns played in only 35 games that season but had six home runs. He hit more home runs than any other player on the team that season. In 1885, he batted .231 with five home runs and 37 RBIs. Burns pitched to a 7–4 win–loss record. His low batting average, however, led him to be demoted to the Newark Domestics for the 1886 season. Burns helped the Domestics win the Eastern League pennant. By 1887, he returned to playing in the majors for the Orioles. He became the Orioles' team captain. Burns lost the role when he threw a baseball at a pitcher on another team. He was later fined $25.