|
|
--- |
|
|
base_model: meta-llama/Llama-3.2-3B-Instruct |
|
|
datasets: |
|
|
- tatsu-lab/alpaca |
|
|
language: en |
|
|
tags: |
|
|
- torchtune |
|
|
--- |
|
|
|
|
|
# my_cool_model |
|
|
|
|
|
This model is a finetuned version of [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) on the [tatsu-lab/alpaca](https://huggingface.co/tatsu-lab/alpaca) dataset. |
|
|
|
|
|
# Model description |
|
|
|
|
|
More information needed |
|
|
|
|
|
# Training and evaluation results |
|
|
|
|
|
More information needed |
|
|
|
|
|
# Training procedure |
|
|
|
|
|
This model was trained using the [torchtune](https://github.com/pytorch/torchtune) library using the following command: |
|
|
|
|
|
```bash |
|
|
ppo_full_finetune_single_device.py --config \ |
|
|
./target/7B_full_ppo_low_memory_single_device.yaml device=cuda metric_logger._component_=torchtune.utils.metric_logging.WandBLogger metric_logger.project=torchtune_ppo forward_batch_size=2 batch_size=64 ppo_batch_size=32 gradient_accumulation_steps=16 compile=True optimizer._component_=bitsandbytes.optim.PagedAdamW optimizer.lr=3e-4 |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
# Framework versions |
|
|
|
|
|
- torchtune |
|
|
- torchao 0.5.0 |
|
|
- datasets 2.20.0 |
|
|
- sentencepiece 0.2.0 |
|
|
|
|
|
|
