at the ceremonies , roosevelt wore a ring containing a lock of abraham lincoln 's hair loaned to him for the occasion by secretary of state john hay who had served as lincoln 's white house secretary .