On March 13, 1952 Olson fought Robinson again, this time for the world middleweight title. Robinson, who had lost and regained the title against Randy Turpin in his previous two fights, was looking for an easy fight. However, Olson had improved significantly from their first encounter. Through ten rounds the fight was neck-and-neck, and only a dominant finish by Robinson over the last five rounds won him the decision. The "Los Angeles Times" wrote that Robinson won the first six rounds easily, slowly stacking up points, but that Olson reduced the points margin in the seventh through tenth. Robinson won the fifteenth convincingly with hard rights and lefts. This would be the only time that Olson lasted the duration against Robinson.