The first time he asked, they each misheard him, but then told him they hadn't, except for the laundresses, who told him they crossed the river.
Initially, when he asked them, they all misunderstood him, but afterwards, they claimed they hadn't, with the exception of the laundresses, who admitted to having crossed the river.