By this time, top English clubs were beginning to notice and in November 1960, Manchester City paid £17,000 for him (the deal also involved defender John McTavish moving in the opposite direction). Baker spent only the remainder of the 1960–61 season and the beginning of 1961–62 with City, before they sold his contract to Hibernian for £18,000 in November 1961. Over the next two years, Baker scored 43 goals in 84 games for Hibs before moving to Ipswich Town in December 1963. Ipswich paid £25,000 for him, and the player more than returned this investment by scoring 66 goals in 151 games. Ipswich then transferred Baker to Coventry City in November 1967. Over the next two seasons, he scored only six times in thirty games with Coventry. In October 1969, Coventry loaned Baker to Brentford where he scored two goals in eight games; he was released by Coventry at the end of the season.