Ewbank got his first professional head coaching job in early 1954 for the NFL's Baltimore Colts, a franchise that had started play the previous year. While it was a step up for Ewbank, Brown encouraged him not to take the job and told him he would not be successful. After Ewbank took the job, Brown accused him of passing information about the Browns' draft targets to the Colts. Brown had insisted that he stay with the Browns through the 1954 draft, and NFL commissioner Bert Bell agreed. During the draft, Ewbank allegedly sent the names of players Brown liked to the Colts through Baltimore sportswriter John Steadman, including end Raymond Berry, who went on to have a long and successful career.