Nourse played cricket and football in his early years. His father refused to teach him how to play cricket, insisting that Dudley teach himself like he had. Aged 18, Nourse decided to concentrate on cricket, initially playing for Umbilo Cricket Club in Durban. He played domestic first-class cricket for the Natal cricket team from 1931 to 1952, and played 34 Test matches for South Africa, in a long international career of 16 years, from 1935 to 1951. He scored a century in his second match for Natal, when his father was playing for the opposing team, Western Province.