Joseph Watt was born in 1887 in the Scottish fishing village of Gardenstown on the Moray Firth, into the large family of Joseph Sr. and Helen Watt. His father was a fisherman of many years service and his mother was also employed in the fish industry. At age ten his father was lost at sea in an accident, and the family moved to Fraserburgh in Aberdeenshire where his mother remarried. He learned the fishing trade from an early age and served aboard the "White Daisy" before purchasing a stake in the drifter "Annie".