|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- timdettmers/openassistant-guanaco |
|
--- |
|
|
|
This model is a test using Intel Gaudi Habana 2 chips using DDP training. Trained over 8xGaudi-2 Chips using DDP and Deepspeed using the openassistant dataset. |
|
|
|
# Prompt Format |
|
|
|
This model uses ChatML as the prompt format. |
|
|
|
``` |
|
<|im_start|>system |
|
You are a helpful assistant for Python which outputs in Markdown format.<|im_end|> |
|
<|im_start|>user |
|
Write a function to calculate the Fibonacci sequence<|im_end|> |
|
<|im_start|>assistant |
|
|
|
``` |
|
|