trollek commited on
Commit
bfc1605
·
verified ·
1 Parent(s): f23c530

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ base_model: h2oai/h2o-danube2-1.8b-base
13
 
14
  # h2o-danube2 with ChatML template
15
 
16
- This is a [BAdam](https://arxiv.org/abs/2404.02827 "BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models") and [LoRA+](https://arxiv.org/abs/2402.12354 "LoRA+: Efficient Low Rank Adaptation of Large Models") fine-tuned danube2 base model. It uses the ChatML template and was trained on the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset from [GlaiveAI](https://huggingface.co/glaiveai) that has been converted to [ShareGPT](https://huggingface.co/datasets/hiyouga/glaive-function-calling-v2-sharegpt) by [hiyouga](https://huggingface.co/hiyouga) of [LLama-Factory](https://github.com/hiyouga/LLaMA-Factory) fame.
17
 
18
  ## Template
19
 
 
13
 
14
  # h2o-danube2 with ChatML template
15
 
16
+ This is a [BAdam](https://arxiv.org/abs/2404.02827 "BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models") fine-tuned danube2 base model. It uses the ChatML template and was trained on the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset from [GlaiveAI](https://huggingface.co/glaiveai) that has been converted to [ShareGPT](https://huggingface.co/datasets/hiyouga/glaive-function-calling-v2-sharegpt) by [hiyouga](https://huggingface.co/hiyouga) of [LLama-Factory](https://github.com/hiyouga/LLaMA-Factory) fame.
17
 
18
  ## Template
19