Growing up, Dunlop was very good at most sports. This included rugby and boxing. He became the first Victorian player in the national rugby union team, the Wallabies. He was the only Victorian in the Australian Rugby League Hall of Fame. He later became a very successful boxer.