He was a Member of Parliament for Colne Valley from 1963 to 1966 and for Sheffield Attercliffe from 1970 to 1992. He was a Minister of the Navy in the 1970s, and President of the NATO Assembly in the 1980s. Duffy was a critic of Prime Minister Margaret Thatcher.