In retirement, Boardman was active in the House of Lords almost until his death. He found more time to enjoy his life in Welford, Northamptonshire. A skilled horseman, he had ridden in earlier days in military steeplechases. He hunted with the Pytchley until he was well into his seventies, retiring only when his faithful mount Bramble became too old to continue. Boardman lived in Northamptonshire all his life, becoming Deputy Lieutenant of the county in 1977, and High Sheriff of Northamptonshire in 1979. He was awarded honorary doctorates by Nottingham and City universities. Among his many charitable works, Boardman was chairman of the national appeal for the Prince's Youth Business Trust.