|
--- |
|
license: apache-2.0 |
|
language: |
|
- ko |
|
--- |
|
|
|
# Model Card for SOLAR-10.7B |
|
|
|
## Base Model |
|
- [upstage/SOLAR-10.7B-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-v1.0) |
|
|
|
## Hardware and Software |
|
|
|
* **Hardware**: We utilized an A100x4 * 1 for training our model |
|
* **Training Factors**: We fine-tuned this model using a combination of the [DeepSpeed library](https://github.com/microsoft/DeepSpeed) and the [HuggingFace TRL Trainer](https://huggingface.co/docs/trl/trainer) / [HuggingFace Accelerate](https://huggingface.co/docs/accelerate/index) |
|
|
