section_path: Overview of models/DeepSeek Coder
section_name: DeepSeek Coder
paragraph_text: DeepSeek Coder
  
  DeepSeek Coder is a series of eight models, four pretrained (Base) and four instruction-finetuned (Instruct). All have 16K context lengths. The model was made source-available under the DeepSeek License, which includes "open and responsible downstream usage" restrictions.
  
  The training program was:
  
  They were trained on clusters of A100 and H800 Nvidia GPUs, connected by InfiniBand, NVLink, NVSwitch.