In 1964 Ramsey, a staunch ally of Zeno and E. Y. Ponder—the leaders of a political machine based in Madison County, lost his bid for reelection to his seat in the North Carolina House of Representatives to a Republican, F. Crafton Ramsey.
In 1964, Ramsey, a supporter of Zeno and E.Y. Ponder, who controlled a political machine in Madison County, was defeated by a Republican, F. Crafton Ramsey, for his seat in the North Carolina House of Representatives.