Larson was born in Los Angeles, California. He grew up in Pasadena, California. He was of Swedish and Russian ancestry. He was gay and his partner of 35 years, director and screenwriter James Bridges, died in 1993.