Whalen was a son of Richard Whalen of Rochester, one of the oldest tobacconists in the United States.
Whalen was the offspring of Richard Whalen, a prominent tobacconist from Rochester, which is renowned for its long history of tobacco sales.