section_path: Dataset preprocessing/Synthetic data
section_name: Synthetic data
paragraph_text: Synthetic data
  
  Training of largest language models might need more linguistic data than naturally available, or that the naturally occurring data is of insufficient quality. In these cases, synthetic data might be used. Microsoft's Phi series of LLMs is trained on textbook-like data generated by another LLM.