Rogers had an apartment in New York City and a summer home on Nantucket Island in Massachusetts. Rogers was red–green color blind. He had a healthy lifestyle as he swam every morning and neither smoked nor drank. He was a vegetarian because he believed eating meat was wrong, saying "I don't want to eat anything that has a mother". Despite popular rumors, he never served in the military as a Navy SEAL during the Vietnam War and never had tattoos.