In January 2013 Rimkus joined the Latvian First League club FB Gulbene. With 20 goals in 23 matches during the 2013 season Rimkus became his club's second best top scorer. Despite Rimkus scoring a goal in the promotion/relegation play-offs, his team lost to FS METTA/Latvijas Universitāte 5–2 on aggregate and failed to secure a place in the Latvian Higher League for the 2014 season. Prior to the 2014 Latvian First League season Rimlus moved to AFA Olaine. Aged 40, he scored four goals in the first three league appearances for the club, but then left the team turning to playing indoor football.