Ugly is going a bit far. He was plain, an average guy, overweight,  in an environment full of very attractive, fit men, although there are plenty of ugly men who have wit and charm and are attractive to women. It seems he didn't have that, either, he was a nasty bully to everyone. No doubt that was a factor.