The Padres fell to third in 1985, and Williams was let go as manager just before 1986 spring training. His record with the Padres was 337–311 over four seasons. As of 2011, he was the only manager in the team's history without a losing season. His difficulties with the Padres stemmed from a power struggle with team president Ballard Smith and general manager Jack McKeon. Williams was a hire of team owner (and McDonald's restaurant magnate) Ray Kroc, whose health was failing. McKeon and Smith (who also happened to be Kroc's son-in-law) were posturing to buy the team and viewed Williams as a threat to their plans. With his San Diego tenure at an end, it appeared that Williams' managerial career was finished.