In 2003, the Barons moved to the USL Premier Development League, and after finishing in fourth place in their inaugural season, they made history in their second season in the PDL. In 2004, they became the fifth team in league history to go through the regular season with an unbeaten record (14–0–4). They won the Northeast Division title that year, but their season came to the end in the playoffs. In the conference championship game at McPherson Stadium in Greensboro, North Carolina, they lost to the Carolina Dynamo 3–2 on a goal in the 90th minute.