This study used the American Time Use Survey (ATUS) to examine socialization, relaxation, and leisure activities throughout the day as related to social determinants of health (SDOH). The study population was adults aged 25 years and older who participated in the ATUS in 2014–2016, the most recent years for collecting SDOH. Descriptive analyses provide characteristics of the study population. Graphical analyses display socialization by SDOH across the hours of the day based on adjusted regression models. Quasi-binomial models analyzed the association between the numbers of minutes of various activities and SDOH. Associations between SDOH and sleeplessness (yes or no) were explored using logistic regression. For much of the day, being female, having less education, living in poverty, and having food insecurity were associated with more time socializing and relaxing. The major activities under socializing and relaxation are watching television and movies. Having a college degree was strongly associated with increased minutes of sports activity, whereas living in poverty and food insecurity were associated with fewer minutes. Less education, living in poverty, and having food insecurity were associated with sleeplessness. A possible mechanism of the effects of SODH on health is by its altering of the patterns of daily life.