Based on his success in the U.S. both professionally and with the national team, several teams from both England and Scotland expressed an interest in signing Brown. In August 1932, as the Caledonia Cruise liner neared the dock, representatives from these teams awaited him. However, Scott Duncan, manager of Manchester United, took a tugboat out to the liner and signed Brown on board. Brown played from 1932 to 1934 with United, scoring 17 goals in 40 games, the second highest on the team. Notably, he scored directly from a corner kick in his first game against Grimsby Town within 90 seconds. While Brown scored regularly with United, he alienated the team management with his outspoken support for a players' union. On May 6, 1934, before United transferred Brown to Second Division Brentford for £300, he scored the only goal in the Manchester (Senior) Cup final match against cross-town rival, Manchester City, at Old Trafford, 1–0. Unfortunately, as with Manchester, his union sentiments quickly soured his relationship with the Brentford's team ownership. He made only one appearance for the first team, but scored 53 goals in 74 games for the reserves and won the 1934–35 London Challenge Cup.