Close but no cigar.  Capitalism is one way society organizes economic activity, no different in intent then Communism, hunter-gatherer or Socialism (which is basically society forcing Capitalists to recognize a social responsibility).  Any method is only as good as the people who institute and control it.  Corporations are formed to accomplish economic goals which require more resources than an individual can provide.  In our early history they were single purpose entities not meant to be permanent ie. Erie Canal.  Today they are self-perpetuating bureaucracies (understand?)  purposed to "maximize shareholder satisfaction".  They attract managers/owners motivated by an unhealthy greed who're convinced the pursuit of profit absolves them of societal restrictions on behavior and feel society exists to serve them  They're useful when controlled, deadly when not.
Corporate oligarchy:
https://en.wikipedia.org/wiki/Corporatocracy
Don't like taxes?  The borders are open, take advantage :).