Wolters was tireless in his efforts on behalf of Speer and his family to such an extent that his son, Fritz, later expressed feelings of neglect. For Speer's fiftieth birthday in March 1955, Wolters gathered letters from many of Speer's friends and wartime associates, and saw to it that they made their way inside the walls of Spandau in time for Speer's birthday. Wolters gave Speer's son Albert a summer job in his Düsseldorf office and a place to stay—in fact, Wolters hosted all six of the Speer children at one time or another. By prior arrangement, he and Speer tried to get in touch with each other by telepathy one New Year's Eve—but both men fell asleep before midnight struck.