In this situation, Johnson's impeachment looms as the operative  a case of men who despised and battled their president--perhaps with good reason--but whose zeal in pursuing flimsy impeachment charges turned the judgment of history against them.
Johnson probably should have been impeached but the charges against him were poorly drawn up.
Johnson was impeached based on the charges put on him.