Gorman joined the Baltimore Orioles' Major League front office in as assistant farm system director, working under Harry Dalton. He was promoted to director of player development in 1966, when the Orioles won their first World Series championship. In , Gorman became the first farm system director in the history of the Kansas City Royals, where he eventually also assumed control of the team's scouting department. For his efforts, he was promoted to vice president in and assistant general manager in .