Born in Breslau, Wiese volunteered for military service in the "Reichswehr" of the Third Reich in 1934. Initially serving in the "Heer" (Army), he transferred to the Luftwaffe (Air Force) in 1936. Following flight training, he was posted to "Jagdgeschwader" 52 (JG 52—52nd Fighter Wing) in June 1941 just prior to Operation Barbarossa, the invasion of the Soviet Union. He claimed his first aerial victory on 23 September 1941. On 26 June 1942, Wiese was appointed "Staffelkapitän" (squadron leader) of the 2. "Staffel" (2nd squadron) of JG 52 and received the Knight's Cross of the Iron Cross on 5 January 1943 following his 53rd aerial victory. On 11 May 1943, Wiese was tasked with the leadership of I. "Gruppe" (1st group) of JG 52 and was officially appointed its "Gruppenkommandeur" (group commander) on 13 November 1943. Following his 133rd aerial victory, he received the Knight's Cross of the Iron Cross with Oak Leaves on 2 March 1944.