the knowledge that she had sided with him instead of lord rafe would have hung between them forever , and ultimately it would have harmed their friendship more than the words that had been spoken at this time .