the taliban still ruled this part of afghanistan right on the pakistan border , but they all had to be careful ; careful not to gather too many together in one place ; careful not to make too call too much attention to themselves even though they were to all be on the same side .