He chose 12 men as apostles and gave one of them primacy, and literally said that he would be the rock that he would build his church. Those men then selected successors, and really how can you argue this? No early church document, and not even the bible supports your claim. 

What you are writing is what protestants adhere to.