After 21 games with the White Sox, he was sent to Triple-A affiliate San Diego Padres of the Pacific Coast League after hitting .241 with no home runs and 9 RBIs. Doby fractured an ankle while sliding into third base after hitting a triple during a road game the Padres played against Sacramento, and was sent to a local hospital in Sacramento before going to Johns Hopkins Hospital for further evaluation. Doby worked out with the White Sox before the 1960 season but, due to nagging injuries, did not earn a roster spot. In late April he joined the Toronto Maple Leafs of the International League on a trial basis but was released by the team on May 6 after X-rays showed bone deterioration in his affected ankle.