In 1998, he was signed by Skonto Riga. After a really successful season the player was given away to FK Valmiera, where he played for 2 years, showing great performance. In 2001 FK Ventspils signed Rimkus for free and had him playing there until 2004. Scoring 70 goals in 100 matches, he attracted attention from many Russian clubs and was signed by FC Rostov in 2005. Staying goalless in 9 games he was soon released and taken back by FK Ventspils. In the next 5 seasons, as a player of FK Ventspils, Rimkus scored 66 league goals in 109 matches. In 2009, he left the club after rumors about betting on his own team results, but nothing was proved in the end, and later it turned out to be a serious conflict with the board of the club.