He stood down from the House of Commons in 1960 and was raised to the peerage as Viscount Amory, of Tiverton in the County of Devon, on 1 September of that year. From 1965 to 1970, he was Governor (Company Chairman) of the Hudson's Bay Company, North America's oldest company (established by English royal charter in 1670). Viscount Amory was sworn of the Privy Council in 1953, appointed GCMG in 1961 and KG in 1968. He also received the degree of Hon. LLD (Exon) in 1959, before serving as Chancellor of Exeter University from 1972 to 1981.