It's because they were all free Americans in New York. It was the South and the plantation owners that wouldn't let go of the Slaves. This what lead to the Civil War, and it was the African American input to the vote. Republicans would say this is false and a lie, but it is, they that tell lies.