Kwong was born in Calgary, Alberta. He was the son of Chinese immigrants from Taishan, Guangdong. He was the first Canadian professional gridiron football player of Chinese heritage. Kwong died in Calgary on September 3, 2016, at the age of 86.