hundreds of people spent part of thanksgiving day remembering president kennedy with a visit to the downtown building where investigators say lee harvey oswald fired the shots that killed him 27 years ago .