Upon signing for the club, manager Bill Dodgin Sr. arranged for surgery to remove the cartilage from his troublesome knee. His first goal for Brentford secured an unusual feat for Dudley as his first three goals during the 1953–54 season were scored for different sides in three different divisions of the Football League, having scored in the First Division for Cardiff, the Second Division for Brentford and the Third Division for Southampton. He scored 32 goals in 72 league matches for Brentford before retiring in 1957.