In New York, Breuer took the initiative to start a congregation with the numerous German refugees in Washington Heights, which would closely follow the morale and customs of its "spiritual ancestor" in Frankfurt. The congregation came to be called Khal Adath Yeshurun (KAJ), but is colloquially called "Breuer's" after its founder. In addition, he founded Yeshiva Rabbi Samson Raphael Hirsch, a yeshiva elementary school and high school named after his illustrious grandfather. It was the first such school in the area that used the vernacular. He also founded a teachers' seminary for women that would be renamed the Rika Breuer Teachers' Seminary after his wife's death. All institutions purported to follow the teachings and ideology of Breuer's grandfather Hirsch. In 1958, the community invited Frankfurt-born Shimon Schwab, then of Baltimore, to assist with rabbinical duties.