When Babcock returned to the White House with a draft a treaty, Fish and Secretary of Interior Jacob D. Cox were alarmed, since Babcock had no official standing. Fish told Cox "Babcock is back...I pledge you my word he had no more diplomatic authority than any other casual visitor to the island." At the next cabinet meeting Babcock was there in person and Grant told his silenced cabinet that Babcock was back and that he (Grant) approved of the treaty. Cox spoke up and said, "But Mr. President, has it been settled, then, that we "want" to annex Santo Domingo ?" Grant was embarrassed and began puffing on his cigar, while the other cabinet members said nothing, Cox's question remained unanswered. Fish threatened to resign over the matter, but Grant convinced him to stay on the administration, telling Fish he would not go around him again and he needed Fish's guidance and support. Fish agreed to remain on the cabinet, although he hoped Grant would drop the Santo Domingo annexation treaty.