Burns was nicknamed "Oyster" because he sold oysters in the off-season. He was described as a "loudmouth" with "an irritating voice and personality". Burns led the Bridegrooms to an American Association championship in 1889 and a National League pennant in 1890. He retired from baseball in 1901. He died on November 11, 1928, in Brooklyn, New York.