Graves lost his first campaign for governor in 1922, but four years later, with the secret endorsement of the Ku Klux Klan, he was elected to his first term as governor. Almost certainly Graves was the Exalted Cyclops (chapter president) of the Montgomery chapter of the Klan, but both Graves and U.S. Supreme Court Justice Hugo Black, another Alabama Klan member, were more opportunists than ideologues, politicians who used the temporary strength of the Klan to further their careers. After receiving solid gold "passports" from the Klan, Graves and Black were collectively known in some Alabama circles as "The Gold Dust Twins."