Dudley was the son of William Ward, 1st Earl of Dudley, and succeeded to the earldom at the age of 17. He inherited a substantial fortune and the palatial family seat at Witley Court. Dudley sat with the Conservative Party in the House of Lords, and was Parliamentary Secretary to the Board of Trade from 1895 to 1902. He was appointed Lord Lieutenant of Ireland when Arthur Balfour came to power, and was regarded as a competent administrator. His time in Dublin led to his inclusion as a character in James Joyce's "Ulysses".