"I never saw one white person working those fields."

Cause and effect.  No need to even HIRE white people when employers could take advantage of those who were willing to work for lower pay because they were illegals.  Also saved employers from paying taxes and benefits when hiring illegals.   See how that works?