Brown decided to return to Stalag III-D as soon as possible; not only were the conditions better, he was suspicious of what the Germans were planning. After a carefully orchestrated row with the senior British NCOs at Blechhammer he persuaded the Commandant, Rittmeister Prinz Von Hohenlohe, to transfer him back to Stalag III-D. He arrived on 12 June 1943 where he was selected by Major Heimpel of the Gestapo to be senior British NCO of Special Detachment 517 based at Genshagen, in the Teltow-Fläming district of Berlin.