In the 1960s there was legal segregation; there were laws against Blacks and whites marrying that could result in imprisonment for the Black person, and widespread policies within the dominant society that allowed southern governments and businesses from hiring Black people. Even though slavery  had ended, allegedly in 1865, one hundred years later African Americans were still a permanent underclass.  I was a teenager during those times; it wasn't that long ago. That's why affirmative action programs were needed. People in the south especially, but not limited to them, had instituted lower level laws and practices that permanently kept Black people on the other side of the tracks. Greater equality didn't occur because Americans were rethinking their society wanting to live up to their ideals. It came from social upheaval and riots and marches and protests and Black people lifting themselves up despite extreme resistance.    That's why affirmative action happened.