Rankine began his career with the Doncaster Rovers youth system, before playing for Armthorpe Welfare and Barrow in non-League football. He moved to League Two club Scunthorpe United in 2004 but after only scoring one goal for them signed for Alfreton Town. He signed for Conference National club Rushden & Diamonds in 2006, where he played for three seasons, before signing for divisional rivals York City in 2009. He played for them in the 2010 Conference Premier play-off Final before signing for Aldershot Town in 2011. He spent two seasons at Aldershot and during that time had loan spells with Grimsby Town and York. After a season with Hereford United he signed for Gateshead in 2014.