 In the 2004–05 season, Clermont finished 18th, only one point above relegation, and despite the club reaching the quarter-finals in both Coupe de la Ligue and Coupe de France, Perbet's contribution was limited, only finding the net five times in 32 matches, rarely being a starter.In August 2005, after appearing two times for Clermont during the season, Perbet joined Championnat National side AS Moulins.He found a goalscoring touch during his one-season spell at the Auvergne side, scoring 23 goals in only 31 appearances, and finishing the season as a topscorer alongside Jawad El Hajri of US Boulogne.