Liston learned to box in the Missouri State Penitentiary while serving time for armed robbery. Later, he was re-incarcerated for assaulting a police officer. For much of his career, his contract was majority owned by Frankie Carbo, a one-time mob hit man and senior member of the Lucchese crime family, who ran boxing interests for the Mafia. The mob was deeply engaged in boxing at every level at the time, and Liston was never able to escape being labeled as the personification of everything that was unseemly and criminal in the sport, despite the fact that his criminality had been in the past. He distrusted boxing writers, and they paid him back, often depicting him as little more than an ignorant thug and a bully. He was typically described in thinly veiled racist terms—a "gorilla" and "hands like big bananas". Author James Baldwin understood Liston perhaps better than anyone in the press and sympathized with him and liked him, unlike boxing writers. He said, "Liston was the big Negro in every white man's hallway." He was a man who, according to Ali biographer David Remnick, "had never gotten a break and was never going to give one".