During the first two Tests of 1983–84 against Pakistan at Perth, he took only one wicket and looked set to be dropped from the Test team as well. Fate intervened when Carl Rackemann, the man of the match from the second Test, was injured. This allowed Lillee to play the rest of the Test series and he finished with 20 wickets at 31.65. Along with Greg Chappell he announced his retirement during the final Test at Sydney, and took eight wickets, including a wicket with his last delivery in the match.