they listened for a time , but as the day grew warm their patience and interest waned and gradually the crowd dispersed about their long neglected chores until only four boys remained with the man on the green .