 Olivier started his career in Pretoria, making his debut for Northern Transvaal in 1990.He played 137 matches for the Northern Transvaal or the Blue Bulls and scored 75 tries, including a record seven tries in a Currie Cup match for Northern Transvaal against South Western Districts during the 1996 season.In 2001, Olivier joined the Pumas and played two seasons for the union.