Clemons later formed a relationship with his father, Willie, during his college years. Even then, the relationship between him and his father was more like a nephew to an uncle, being limited to visits during his family vacations down in Florida and regular phone calls. Willie was also invited to the 2003 CFL Eastern Division semi-final game his son was coaching in Toronto vs. the B.C. Lions, marking the first time his father had actually seen him in any capacity with the Argonauts. Shortly afterwards, his father died.