James Shand was born in East Wemyss in Fife, Scotland, son of a farm ploughman turned coal miner and one of nine children. The family soon moved to the burgh of Auchtermuchty. The town now boasts a larger than life-sized sculpture of Shand. His father was a skilled melodeon player. Jimmy started with the mouth organ and soon played the fiddle. At the age of 14 he had to leave school and go down the mines. He played at social events and competitions. His enthusiasm for motor-bikes turned into an advantage when he played for events all round Fife. In 1926, he did benefit gigs for striking miners and was consequently prevented from returning to colliery work. One day Shand and a friend were admiring the instruments in the window of a music shop in Dundee. His friend said: "It wouldn't cost you to try one," so Shand walked in and strapped on an accordion. The owner, Charles Forbes, heard Shand play and immediately offered him a job as travelling salesman and debt-collector. He soon acquired a van and drove all over the north of Scotland. He switched to the British chromatic button accordion, an instrument he stuck with for the rest of his life.