As most things do now days, it gets blown out of proportion.  I know of some one who complain because the guy who was delivering the inner office mail was passing out candy to all the 'cute' women and not giving candy to the other women (fill in the blank).  This IS a true story.  In other words, 'Damned if you do and Damned if you don't', it's a no win world.  Sexual harassment simply breaks down to this, "It's what he/she defines it as."