clayton nodded a curt dismissal to the footman who had been serving him his lunch and waited until the servant had closed the door behind him , before shifting his impassive gaze to his unwelcome visitor .