when our relationship was off , people were either thinking that they were right in their assumption that a romance between an older man and a younger woman could not work , or that they were very sorry to see us separated , because we both seemed so sad .