Outside his parliamentary duties, Hastings continued to ride, hunting regularly with the Fitzwilliam and other hunts. In 1982 he was elected chairman of the British Field Sports Society in succession to Sir Marcus Kimball. After retiring from Parliament, he became a partner and manager of the Milton Park Stud, a member of the council of the Thoroughbred Breeders' Association, and joint master of the Fitzwilliam Hunt. He had maintained his lifelong love of racing and each evening before dinner, a glass of champagne in hand, he would watch the races of the day, prerecorded by his butler.