When they return to Philadelphia, the declaration is read and then subsequently debated and amended for days. Jefferson agrees to most alterations to the document, much to Adams' growing consternation. The debate reaches a head when the Southern delegates, led by Edward Rutledge, walk out of Congress when a clause opposing slavery is not removed. Adams remains adamant that the clause remain, but Franklin appeals to him to allow the passage to be removed so that they can first achieve the vote on independence and the formation of a nation, deferring the slavery fight to a later time. Adams leaves the final decision to Jefferson, who reluctantly concedes. After removing that clause, 11 of 13 colonies are now in favor. New York abstains "courteously" once again.