he spoke with simple matter-of-factness , but i had n't missed the sideways looks directed at us by the passing seamen , and had already realized just why jamie was passing time in idle conversation by the rail with me .