by the time the dessert and coffee were served jackson had turned the conversation to other matters and the tension in the room had substantially diminished , but most of the guests started leaving soon afterward and jackson made no great effort to detain them .