Yarborough started 1963 without a full-time ride, but soon signed on to drive the No. 19 Ford for Herman Beam. His best finish was fifth twice, at Myrtle Beach and Savannah Speedway, respectively. He began the next season driving for Beam, but soon left and finished the year with Holman Moody, finishing sixth at North Wilkesboro Speedway, winding up nineteenth in points. The next season, he drove for various owners before picking up his first career win at Valdosta Speedway driving the #06 Ford for Kenny Myler, rising to tenth in the final standings.