Right after the Nazis' Machtergreifung Carlebach was arrested. He attributed the arrest to Goebbels, who resented Carlebach for revealing his Jewish connections. Carlebach was released from custody because no judicial warrant existed but was forced to go into hiding. He found people who provided him with a hideout and forged papers. In order to move about in the streets of Berlin, Carlebach dyed his hair and dressed in an SA uniform. In this way, he monitored from within how Nazism tightened its power in Germany and wrote daily articles for "Haynt" in Warsaw under the pseudonym "Levi Gotthelf (לוי גאָטהעלף)".