Some of his Republican colleagues dislike him for selfish reasons--they envy his popularity and resent his outsider stances.
Some colleagues don't like him because he is popular.
He is the least liked Republican with voters.