Shortly after moving to New York City, he became director of the "Arbeter Ordn Shuln", and helped set up a nationwide network of these schools, reaching a peak number of 140. Best described as supplemental schools, they aimed at promoting Yiddish identity, as well as inculcating the concepts of class consciousness and social justice. Goldberg saw two function of the (school); "to revolutionize Yiddish education and to separate religion from education for the first time in Jewish history; and on the other hand to ensure that progressive secularism is carried forward from generation to generation." For decades beginning in the 1920s, including two as director, he was associated with Camp Kinderland, known as a "red diaper baby" camp.