Towards the end of his first season with the Cardinals, Smith infamously attacked the Phillie Phanatic. Despite his speed, Smith was known for occasionally tripping and falling whilst running. He attributed this to being "pigeon-toed" as a child. During a series between the Cardinals and the Phillies in September 1982, the Phillie Phanatic began mimicking Smith at close range before the game, doing belly-whops on the turf. Tired of the mocking, Smith tackled the Phanatic, reportedly injuring the mascots ankles. Despite this, Smith was still allowed to play, so when he took his position in left field, Phillies fans started throwing beer bottles at him. Rather than seeking shelter, Smith turned around, threw up his arms, and taunted them, daring them to hit him, which none did.