Fraser, the youngest of four boys, was born in Indianapolis, Indiana, the son of Canadians Carol Mary (née Genereux; 1937–2016) and Peter Fraser. His mother was a sales counselor, and his father was a former journalist who worked as a Canadian foreign service officer for the Government Office of Tourism. His maternal uncle, George Genereux, was the only Canadian to win a gold medal in the 1952 Summer Olympics, at the Olympic Trap. He has three older brothers: Kevin, Regan, and Sean. He has Irish, Scottish, German, Czech, and French-Canadian ancestry. He holds dual American and Canadian citizenship.