colfax noted his employer 's deep preoccupation with the letter and his darkening expression and immediately worried that the letter 's contents might somehow cause the earl to alter his plans for the evening .