With the Browns, Speedie quickly became an important part of an offensive attack that featured quarterback Otto Graham, fullback Marion Motley and fellow receiver Dante Lavelli. He was enthusiastic, energetic and fast, posing a challenge for defenders assigned to cover him. He had an unusual running style because of his bout with Perthes Disease, which Lavelli said "gave him an odd gait in which he could fake plays without even trying". Speedie caught the first touchdown in the AAFC's existence in the Browns' opening game against the Miami Seahawks, a 44–0 win. The Browns ended the regular season with a 12–2 record, winning the AAFC West division and earning a spot in the league championship. During the week before the championship game against the New York Yankees, Speedie and two teammates, Lou Rymkus and team captain Jim Daniell were arrested after an argument with Cleveland police. Daniell was driving a car with Rymkus and Speedie as passengers as they waited for Speedie's wife to return on a flight from Utah. A police car was blocking Daniell's way, and he honked the horn, leading to the confrontation and arrests. Brown kicked Daniell off of the team, but Speedie and Rymkus were not punished by the team; they were, however, held in custody for several hours and charged with creating a disturbance.