i 'd never had much success with men , as far as i remembered , and the memory of what others had done to me was always uppermost in my mind when my heart felt even the tiniest tug in tristan 's direction .