In 1995–96, he became an assistant coach to VfB Stuttgart head coach Rolf Fringer. As Fringer had the opportunity to become coach of the Switzerland national team, Löw was promoted caretaker manager on 14 August 1996. He eventually became the permanent manager and was at the club until 21 May 1998. His first match as head coach was a 4–0 win against Schalke 04 on 17 August 1996. They finished the 1996–97 Bundesliga season in fourth place. The 1997–98 season started with a 3–0 against Karlsruher SC on 22 July 1997 in the semi–final of the DFB-Ligapokal. They went on to lose in the final against Bayern Munich on 26 July 1997. In the Bundesliga, Stuttgart finished in fourth place.