At the 1964 Summer Olympics, in Tokyo, Hayes had his finest hour as a sprinter. First, he won the 100m and in doing so tied the then world record in the 100 m with a time of 10.06 seconds, even though he was running in lane 1 which had, the day before, been used for the 20 km racewalk and this badly chewed up the cinder track. He also was running in borrowed spikes because one of his shoes had been kicked under the bed when he was playing with some friends and he didn't realize until he got there. This was followed by a second gold medal in the 4×100 meter relay, which also produced a new World Record (39.06 seconds).