The relationship turned sour in 1982 when a contract dispute between player and club led to Golac going out on loan to AFC Bournemouth in November 1982 and Manchester City in March 1983, before his contract with Southampton was terminated. After a brief spell back in Yugoslavia with minor level club FK Belasica he returned to Southampton in March 1984, helping the Saints finish as runners-up to Liverpool in the Football League. The following season, he lost his place to Mark Dennis and after another period on loan, this time at Portsmouth, Golac retired in 1986, having played 197 games for Southampton, scoring four goals.