in his early adulthood , he became quite handsome to look at , a quality that attracted no small amount of attention from those idle rich women whom have little more to do than whisper and giggle about secrets and scandals .