besides , you were the one who realized that if you and mrs. fitzwilliam went to the luncheon at blanchard house , it would draw away your watcher and perhaps leave lister 's town house with fewer guards . ''