This study set out to evaluate the association between job demands at baseline and physical performance over a six-year period across three cohorts of older Dutch workers examined 10 years apart. Data were drawn from three cohorts (1992–1999, 2002–2009 and 2012–2019) of the Longitudinal Aging Study Amsterdam. Individuals aged 55–65 years from each cohort who worked for pay were included (n = 274, n = 416, n = 618, respectively). Physical performance was measured using gait speed and chair stand performance. A population-based job exposure matrix was used to indicate levels of exposure probability of physical (use of force and repetitive movements) and psychosocial (cognitive demands and time pressure) job demands. We found that psychosocial job demands increased and physical demands decreased across the three cohorts. No between cohort differences were found for how job demands affected changes in physical performance over follow-up. For men, faster decline in gait speed was observed when comparing higher and lower use of force at baseline (β −0.012, 95% CI −0.021, −0.004). Greater use of force and repetitive movements were associated with faster decline in chair stand performance (β −0.012, 95% CI −0.020, −0.004 and β −0.009, 95% CI −0.017, −0.001, respectively). In women, no association of job demands on change in physical performance was observed. The study concluded that higher physical job demands were associated with stronger decline in physical performance across six years for men in all cohorts, while no associations were found among women.Supplementary InformationThe online version contains supplementary material available at 10.1007/s10433-023-00768-9.