section_path: Training and architecture/Instruction tuning
section_name: Instruction tuning
paragraph_text: Instruction tuning
  
  Using "self-instruct" approaches, LLMs have been able to bootstrap correct responses, replacing any naive responses, starting from human-generated corrections of a few cases. For example, in the instruction "Write an essay about the main themes represented in Hamlet ", an initial naive completion might be "If you submit the essay after March 17, your grade will be reduced by 10% for each day of delay", based on the frequency of this textual sequence in the corpus.