He helped Billy Walker's side to win promotion out of the Second Division in 1956–57, and showed the Vale what they had let go when he returned to Vale Park on 2 February to mastermind a 7–1 win. Forest finished tenth in the top-flight in 1957–58, and Baily left the City Ground having scored 14 goals in 68 league games for the club. He returned to the Second Division in December 1958 after signing with Alec Stock's Leyton Orient, playing 29 league games for Orient in 1958–59 and 1959–60, scoring three goals.