In 1882, Sheppard was placed on the Democratic statewide ticket for the post of Lieutenant Governor and easily won election and reelection in 1884. When Hugh Smith Thompson resigned on July 10, 1886, to be Assistant Secretary of the Treasury, Sheppard succeeded to the governorship.
In 1882, Sheppard was elected Lieutenant Governor on the Democratic ticket and won re-election in 1884. When Hugh Smith Thompson resigned as governor in 1886, Sheppard succeeded him.