Because while the dandy stands for beauty and elegance, he also stands for the restraint and self-discipline required to appear refined at all times.
The dandy must look to be refined.
Rogues and outlaws are the best dandies.