Cain went about his new duties, generally supporting the recommendations brought to the board by Attorney General Herbert Brownell Jr.. Cain soon became aware of numerous cases in which the government's internal security program, while legal, often violated the civil liberties of the accused and sometimes denied them due process under the law. He began to speak out against what he believed to be the excesses of the program in a series of speeches to national civil liberties groups, to the point that White House Chief of Staff Sherman Adams and members of the Justice Department considered him disloyal. The Eisenhower Administration, under pressure from the right wing of their party, saw their internal security program as a means of eliminating security risks from government; Cain saw the program as often trampling on the civil rights of the accused. The confrontation came to a head in a contentious meeting between Cain and the President in the White House on June 7, 1955. Cain determined that he would not to be re-appointed to the position and resigned on June 17, 1955.