In the 1954 House election, Hunter faced a tough re-election against political newcomer Democrat Bernice F. Sisk. Sisk defeated Hunter in the election with a 53.8%-46.2% majority. After losing his re-election bid, he became the general counsel with Housing and Home Finance Agency in Washington, D.C., the following year. He served that position until July 1957 when he resigned in order to continue his law practice in Fresno. Three years later, he was again a delegate to the 1960 Republican National Convention in Chicago, Illinois. For the next ten years, he collaborated on the development and operation of the Rossmoor Leisure World Communities in California. From 1966 to 1969, Hunter served as chairman of California's state commission of housing and community development.