In 1933, Wolters returned to Berlin, where he briefly worked as an assistant in Speer's office before returning to the "Reichsbahn", this time getting paid for his work. Speer had forged a close relationship with Hitler, and in late 1936, Speer informed Wolters that the dictator would soon appoint Speer as "Generalbauinspektor" (GBI) or General Building Inspector for the Reich Capital, and suggested that Wolters resign his post with the railway and come work for him again. Wolters did so, beginning work at the GBI office in January 1937 as a Head of Department in the Planning Bureau. Wolters was one of a number of young, well-paid assistants of Speer at the GBI, who were collectively nicknamed "Speer's Kindergarten". Most of the Kindergarteners were not Nazi Party members, since Speer found that Party duties interfered with working time, and the Kindergarten was expected to work long hours. Speer had Hitler's permission to hire non-Nazis, so the GBI became something of a political sanctuary.