he also felt a certain irritation with annie mac-after all , she was employed to watch the children-but fairness made him admit that he ought to have made sure she 'd come back to watch mandy before he left .