In 1930, Brown became a professional with the New York Giants, scoring 13 goals in 26 appearances. Soon after, he was called up to the U.S. national team for the 1930 World Cup. On his return from Uruguay, he rejoined his team that was renamed the New York Soccer Club, where he scored 6 goals in 25 appearances. He then moved to the Brooklyn Wanderers for the 1931 spring season with his old teammate, Razzo Carroll, where James scored 10 goals in 31 appearances. Brown moved to the Newark Americans in the fall 1931 season, but by this time the ASL was collapsing, and he played 13 games and scored 7 goals. Because of the decline in U.S. soccer, he decided to return to the UK in August 1932.