Hugging Face's logo

mlfoundations-dev
/
OH_DCFT_V3_wo_evol_instruct_140k

Text Generation
Transformers
Safetensors
llama
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Model card Files Community
sedrickkeh commited on
Commit
7598eae
·
verified ·
1 Parent(s): 26c85d0

Model save

Browse files
Files changed (7) hide show
  1. README.md +7 -8
  2. generation_config.json +1 -1
  3. model-00001-of-00004.safetensors +1 -1
  4. model-00002-of-00004.safetensors +1 -1
  5. model-00003-of-00004.safetensors +1 -1
  6. model-00004-of-00004.safetensors +1 -1
  7. training_args.bin +1 -1
README.md CHANGED
@@ -1,10 +1,9 @@
1
  ---
2
  library_name: transformers
3
- license: llama3
4
- base_model: meta-llama/Meta-Llama-3-8B
5
  tags:
6
  - llama-factory
7
- - full
8
  - generated_from_trainer
9
  model-index:
10
  - name: OH_DCFT_V3_wo_evol_instruct_140k
@@ -16,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # OH_DCFT_V3_wo_evol_instruct_140k
18
 
19
- This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) on the mlfoundations-dev/OH_DCFT_V3_wo_evol_instruct_140k dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6165
22
 
23
  ## Model description
24
 
@@ -56,9 +55,9 @@ The following hyperparameters were used during training:
56
 
57
  | Training Loss | Epoch | Step | Validation Loss |
58
  |:-------------:|:-----:|:----:|:---------------:|
59
- | 0.6296 | 1.0 | 377 | 0.6238 |
60
- | 0.5875 | 2.0 | 754 | 0.6138 |
61
- | 0.5391 | 3.0 | 1131 | 0.6165 |
62
 
63
 
64
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
+ license: llama3.1
4
+ base_model: meta-llama/Llama-3.1-8B
5
  tags:
6
  - llama-factory
 
7
  - generated_from_trainer
8
  model-index:
9
  - name: OH_DCFT_V3_wo_evol_instruct_140k
 
15
 
16
  # OH_DCFT_V3_wo_evol_instruct_140k
17
 
18
+ This model is a fine-tuned version of [meta-llama/Llama-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.6134
21
 
22
  ## Model description
23
 
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|
58
+ | 0.6282 | 1.0 | 377 | 0.6224 |
59
+ | 0.5895 | 2.0 | 754 | 0.6123 |
60
+ | 0.5447 | 3.0 | 1131 | 0.6134 |
61
 
62
 
63
  ### Framework versions
generation_config.json CHANGED
@@ -1,8 +1,8 @@
1
  {
 
2
  "bos_token_id": 128000,
3
  "do_sample": true,
4
  "eos_token_id": 128001,
5
- "max_length": 4096,
6
  "temperature": 0.6,
7
  "top_p": 0.9,
8
  "transformers_version": "4.45.2"
 
1
  {
2
+ "_from_model_config": true,
3
  "bos_token_id": 128000,
4
  "do_sample": true,
5
  "eos_token_id": 128001,
 
6
  "temperature": 0.6,
7
  "top_p": 0.9,
8
  "transformers_version": "4.45.2"
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:48a2d2a18efdecac649fb6bd9e4acd89b8ff63f5fc0621b524a1f01a66fdcc73
3
  size 4976698672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cdae4c106c1ef65f4d7879b7935303e436a6d8ce76a03e872315b85a1ef5d3e
3
  size 4976698672
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f43f31e053f32a46688edc6adcba7890720de592525cc39c541c6b9bf7d64399
3
  size 4999802720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8c4b21808de70a27239f0c622d0913db1842210b9b0341ac1f560c0e7dcd6f5
3
  size 4999802720
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ba25f55739603b375d57b58d534398bbac0083473b19c9769a6ec33722ad50f
3
  size 4915916176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a2578aeeb27765c95ef835b27589a4d61e43ee54863b818117492e2b949c533
3
  size 4915916176
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d90507300d7d54013cd3c549ee039ef093f4abd78cb090f2e71414d6d600e4da
3
  size 1168138808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfb244f99ab8bd2dce4643bd2a739cca4388e7bfbff5bd4cf003f24db83b8c53
3
  size 1168138808
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:be8fef694a942deece6c491b559fbf2feaf3332df8148585029c61d2d9f05a20
3
  size 7160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fbbad8d0c920f4b06d7fa44f9d6126abbb460e2f2abef70f16de3133ffec84b
3
  size 7160