Without the force of government behind them, Pol Pot would have been fairly harmless and Hitler, a third-rate artist.
Governments enable and support the rise of authoritarians.
Hitler and Pol Pot over-powered their governments through force of will.