section_path: Training and architecture
section_name: Training and architecture
paragraph_text: Training and architecture
  
  An LLM is a type of foundation model (large X model) trained on language. LLMs can be trained in different ways. In particular, GPT models are first pretrained to predict the next word on a large amount of data, before being fine-tuned.