Harvey was easily recognizable due to his thick white hair, which had already gone completely gray when he was in his 30s, leading to the early nickname of "Silver." In late 1971, he grew a handlebar mustache, at a time when no major league field personnel had worn facial hair since the 1940s; he kept it trimmed to the edges of his mouth, and he wore it during the 1972 season, when Oakland A's players began to grow mustaches that season in order to earn bonuses from owner Charlie O. Finley. In the latter part of his career, Harvey was the voice of MLB's "You Make the Call" segments.