Makarfi began his career at the Nigeria Universal Bank, where he rose to the rank of Assistant General Manager. He was appointed as Commissioner of Finance and Economic. Makarfi was elected as the executive governor of Kaduna State in 1999 and also won a second four-year term in 2003. He was elected as a Senator representing Kaduna North Senatorial District. In 2016, Makarfi was appointed PDP national Chairman at a Convention held in Port Harcourt and later resigned after 2019 primary election. 